2024-09-18T12:31:14.131 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:31:14.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:31:14.251 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384 branch: wip-guits-main-2024-09-17-1213 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@redhat.com first_in_suite: false job_id: '7911384' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.1 ' name: gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-17-1213 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-17-1213 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e owner: scheduled_gabrioux@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8982 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-17-1213 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDbJvDsG1yd3Zlv2aImUS//rVIIE4m5XzOBuvgHvmYfMFJqohk/TeHide9JhPirdI4YBArIdaJhNWQCYMsirpc= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjfWSGAnenhbMYD8xkN0ZIRk8dEyzpaoKHbAuZNmYVufuWULf8A2GHcgIK1KSHsYSvA+zm8WNEgJqWbpW9uPZo= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.1 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.1 roleless: true - print: '**** done end installing v18.2.1 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/gabrioux/src/git.ceph.com_ceph-c_wip-guits-main-2024-09-17-1213/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_12:14:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-18T12:31:14.252 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa; will attempt to use it 2024-09-18T12:31:14.252 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks 2024-09-18T12:31:14.252 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:31:14.254 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:31:14.275 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e' 2024-09-18T12:31:14.275 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:31:14.275 INFO:teuthology.packaging:ref: None 2024-09-18T12:31:14.275 INFO:teuthology.packaging:tag: None 2024-09-18T12:31:14.275 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-17-1213 2024-09-18T12:31:14.275 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:31:14.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-17-1213 2024-09-18T12:31:14.421 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4983.ge7fb7b56 2024-09-18T12:31:14.423 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:31:14.430 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:31:14.430 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:31:14.437 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:31:14.456 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:31:14.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:31:14.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:26:16.208233', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDbJvDsG1yd3Zlv2aImUS//rVIIE4m5XzOBuvgHvmYfMFJqohk/TeHide9JhPirdI4YBArIdaJhNWQCYMsirpc='} 2024-09-18T12:31:14.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:26:16.209374', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjfWSGAnenhbMYD8xkN0ZIRk8dEyzpaoKHbAuZNmYVufuWULf8A2GHcgIK1KSHsYSvA+zm8WNEgJqWbpW9uPZo='} 2024-09-18T12:31:14.501 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:31:14.507 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-18T12:31:14.507 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-18T12:31:14.507 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:31:14.555 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8fc45bbf40>, signals=[15]) 2024-09-18T12:31:14.555 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:31:14.561 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:31:14.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:31:14.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:31:14.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-09-18T12:31:14.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:31:14.711 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:31:14.717 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-18T12:31:14.734 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-18T12:31:14.735 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-18T12:31:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-18T12:31:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-18T12:31:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:31:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:31:14.793 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-18T12:31:14.813 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-09-18T12:31:14.832 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-09-18T12:31:14.832 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-09-18T12:31:14.890 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:31:14.891 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:31:14.892 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:31:14.892 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:31:14.892 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-09-18T12:31:14.912 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:31:14.920 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:31:14.925 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:31:14.926 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:31:14.928 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:31:14.948 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:31:14.954 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:31:14.954 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:31:14.984 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:31:15.076 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:31:15.129 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:31:15.144 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:31:15.144 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:31:15.144 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:31:15.145 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:31:15.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:31:15.161 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T12:31:15.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:31:15.162 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-18T12:31:15.218 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:31:15.219 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-18T12:31:15.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-18T12:31:15.220 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:31:15.220 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-503.el9.x86_64 2024-09-18T12:31:15.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-09-18T12:31:17.509 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-18T12:31:17.765 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-18T12:31:20.677 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-18T12:31:22.174 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-18T12:31:24.868 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-18T12:31:26.825 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-18T12:31:27.160 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-18T12:31:28.284 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-18T12:31:28.791 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T12:31:29.454 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-18T12:31:34.180 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-18T12:31:35.344 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 3.3 kB/s | 1.7 kB 00:00 2024-09-18T12:31:36.078 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:31:36.078 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:31:36.187 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:31:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-09-18T12:31:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:31:36.195 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 79 M 2024-09-18T12:31:36.195 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 126 M 2024-09-18T12:31:36.195 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:31:36.331 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 309 kB/s | 36 kB 00:00 2024-09-18T12:31:37.251 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:31:37.251 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:31:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:31:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:31:37.353 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:31:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-18T12:31:37.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:31:37.355 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-18T12:31:37.355 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-18T12:31:37.355 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:31:37.720 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 323 kB/s | 36 kB 00:00 2024-09-18T12:31:39.415 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-18T12:31:40.504 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:02 2024-09-18T12:31:42.379 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.2 MB/s | 35 MB 00:04 2024-09-18T12:31:42.597 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 35 MB 00:06 2024-09-18T12:31:43.504 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.9 MB/s | 29 MB 00:05 2024-09-18T12:31:43.504 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:31:43.504 INFO:teuthology.orchestra.run.smithi081.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-18T12:31:44.187 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:31:44.256 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.6 MB/s | 29 MB 00:07 2024-09-18T12:31:44.256 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:31:44.256 INFO:teuthology.orchestra.run.smithi136.stdout:Total 9.8 MB/s | 79 MB 00:08 2024-09-18T12:31:44.563 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:31:44.563 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:31:44.940 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:31:45.303 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:31:45.303 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:31:45.545 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:31:45.545 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:31:46.275 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:31:46.275 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:31:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:31:48.649 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:31:48.683 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:31:49.312 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:31:49.388 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:31:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:31:51.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:31:52.149 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:31:52.280 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:31:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:31:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:31:57.102 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:31:57.146 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:01.726 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:01.965 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.242 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.287 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.332 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:32:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:32:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:32:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:32:41.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:41.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:32:41.473 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:32:41.473 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.474 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.474 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.474 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.474 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:32:41.474 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:32:41.475 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:32:41.476 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:32:41.839 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:32:41.849 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:32:41.918 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.919 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.919 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.919 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:32:41.919 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:32:41.919 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-18T12:32:41.919 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:32:41.920 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:32:41.935 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.936 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.936 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.936 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:32:41.937 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:32:41.937 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-18T12:32:41.937 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:32:41.937 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:32:41.977 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.978 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-09-18T12:32:41.995 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:32:41.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:32:41.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 82.el9 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8274670 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:32:42.020 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:32:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:32:42.022 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:32:42.022 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:32:42.022 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:32:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:32:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:32:42.030 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:32:42.030 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:32:42.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:32:42.702 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-09-18T12:32:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-18T12:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:32:44.050 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:32:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-18T12:32:44.075 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T12:32:44.083 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-09-18T12:32:44.086 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-09-18T12:32:44.091 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.A2BPv3fY1z 2024-09-18T12:32:44.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A2BPv3fY1z 2024-09-18T12:32:44.102 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.Y76fpk81Zn 2024-09-18T12:32:44.102 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Y76fpk81Zn 2024-09-18T12:32:44.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.A2BPv3fY1z 2024-09-18T12:32:44.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.Y76fpk81Zn 2024-09-18T12:32:44.294 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.A2BPv3fY1z is 6KB 2024-09-18T12:32:44.314 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.Y76fpk81Zn is 6KB 2024-09-18T12:32:44.342 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.A2BPv3fY1z 2024-09-18T12:32:44.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:32:44.363 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.Y76fpk81Zn 2024-09-18T12:32:44.377 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:32:44.422 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:32:44.422 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:32:44.422 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:32:44.422 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:32:44.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:32:44.439 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:32:44.440 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:32:44.440 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:32:44.440 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:32:44.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:32:44.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-18T12:32:44.600 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-09-18T12:33:14.621 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-18T12:33:14.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T12:33:14.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:33:14.626 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-18T12:33:14.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-18T12:33:14.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:34:14.686 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:34:14.687 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:34:23.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T12:34:23.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:34:23.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-18T12:34:23.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:34:24.113 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T12:34:24.267 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-18T12:34:24.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-18T12:34:24.603 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:34:24.603 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-18T12:34:24.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T12:34:24.612 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:34:24.612 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T12:34:24.617 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:34:24.617 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:34:24.617 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:34:24.618 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:34:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:34:24.627 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:34:24.627 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:34:24.627 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:34:25.618 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-18T12:34:25.619 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:34:25.627 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-18T12:34:25.628 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:34:25.711 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-09-18T12:34:25.712 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-18T12:34:25.736 DEBUG:teuthology.parallel:result is None 2024-09-18T12:34:25.742 DEBUG:teuthology.parallel:result is None 2024-09-18T12:34:25.743 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:34:25.750 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:34:25.751 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:34:25.753 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:34:25.768 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:34:25.774 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:34:25.783 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:34:25.784 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:34:25.806 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:34:25.834 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:34:25.840 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:34:25.840 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:34:25.860 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:34:25.914 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:34:25.924 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:34:25.987 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:34:25.997 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:34:25.998 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:34:26.005 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:34:26.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:34:26.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:34:26.032 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:34:26.041 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:34:26.041 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:34:26.069 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:34:26.084 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:34:26.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:34:26.206 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:34:26.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:34:26.323 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:34:26.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:34:26.385 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:34:26.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:34:26.478 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:34:26.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:34:26.594 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:34:26.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:34:26.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-18T12:34:26.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-09-18T12:34:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:34:26.979 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:34:27.042 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:34:27.049 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:34:27.049 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:34:27.117 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:34:27.126 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-18T12:34:27.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-18T12:34:27.178 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-18T12:34:27.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-09-18T12:34:27.306 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-09-18T12:34:27.309 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:34:27.309 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-18T12:34:27.333 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-18T12:34:27.333 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-09-18T12:34:27.363 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-09-18T12:34:27.364 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-09-18T12:34:27.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:34:27.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:34:27.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:34:27.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:34:27.438 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:34:27.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:34:27.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:34:27.546 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:34:27.555 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T12:34:27.558 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T12:34:27.663 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:34:27.674 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:34:27.675 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:38:18.468 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-09-18T12:38:18.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T12:38:18.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:38:18.547 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T12:38:18.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T12:38:18.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-18T12:38:18.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:38:18.699 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-18T12:38:18.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-18T12:38:18.776 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:38:18.786 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:38:18.787 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:38:18.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:38:18.790 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:38:18.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:38:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:38:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:38:18.846 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:38:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-18T12:38:18.861 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:38:18.868 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-18T12:38:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:38:18.886 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-09-18T12:38:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:38:18.897 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-09-18T12:38:18.911 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:38:18.925 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:38:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:38:18.960 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:38:18.960 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-18T12:38:18.961 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.961 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.961 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.961 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.982 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:38:18.985 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:38:18.986 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-18T12:38:18.986 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.986 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.986 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.986 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:38:18.987 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:38:18.996 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:38:18.996 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'}} 2024-09-18T12:38:18.996 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.1', 'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:38:18.996 INFO:teuthology.task.install:Using flavor: default 2024-09-18T12:38:19.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:38:19.004 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:38:19.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-09-18T12:38:19.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:38:19.004 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:19.004 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:38:19.004 INFO:teuthology.packaging:branch: None 2024-09-18T12:38:19.005 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:19.136 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.1^{} -> 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-18T12:38:19.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-18T12:38:19.139 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-09-18T12:38:19.140 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:38:19.140 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:19.140 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:38:19.140 INFO:teuthology.packaging:branch: None 2024-09-18T12:38:19.140 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:19.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-18T12:38:19.286 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-09-18T12:38:19.287 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-09-18T12:38:19.290 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-09-18T12:38:19.290 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-09-18T12:38:19.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:38:19.332 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:38:19.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:38:19.340 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:38:19.340 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:38:19.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:38:19.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:38:19.358 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:38:19.358 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:19.358 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:38:19.358 INFO:teuthology.packaging:branch: None 2024-09-18T12:38:19.359 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:19.359 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:38:19.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:38:19.367 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:38:19.367 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:19.367 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:38:19.367 INFO:teuthology.packaging:branch: None 2024-09-18T12:38:19.367 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:19.367 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:38:19.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:38:19.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:38:19.499 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:38:19.507 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:38:19.563 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-18T12:38:19.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-18T12:38:19.572 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-09-18T12:38:19.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-09-18T12:38:19.792 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-18T12:38:19.800 INFO:teuthology.orchestra.run.smithi136.stdout:45 files removed 2024-09-18T12:38:19.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw 2024-09-18T12:38:19.827 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw 2024-09-18T12:38:20.252 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 545 kB/s | 76 kB 00:00 2024-09-18T12:38:20.254 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 492 kB/s | 76 kB 00:00 2024-09-18T12:38:20.420 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 77 kB/s | 9.4 kB 00:00 2024-09-18T12:38:20.429 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 72 kB/s | 9.4 kB 00:00 2024-09-18T12:38:20.579 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 18 kB/s | 2.2 kB 00:00 2024-09-18T12:38:20.597 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 16 kB/s | 2.2 kB 00:00 2024-09-18T12:38:21.171 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-18T12:38:23.205 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-18T12:38:25.382 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-18T12:38:30.037 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-18T12:38:31.499 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-18T12:38:33.025 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-18T12:38:34.212 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-18T12:38:34.246 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-18T12:38:35.880 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-18T12:38:37.026 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-18T12:38:39.635 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-18T12:38:41.868 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-18T12:38:41.882 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-09-18T12:38:41.883 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-09-18T12:38:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout:Install 28 Packages 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2024-09-18T12:38:41.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:38:41.886 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 53 M 2024-09-18T12:38:41.886 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:38:42.423 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-18T12:38:42.462 INFO:teuthology.orchestra.run.smithi081.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-09-18T12:38:42.803 INFO:teuthology.orchestra.run.smithi081.stdout:(2/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 14 MB/s | 7.7 MB 00:00 2024-09-18T12:38:42.828 INFO:teuthology.orchestra.run.smithi081.stdout:(3/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 65 kB/s | 24 kB 00:00 2024-09-18T12:38:42.862 INFO:teuthology.orchestra.run.smithi081.stdout:(4/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 11 MB/s | 658 kB 00:00 2024-09-18T12:38:43.229 INFO:teuthology.orchestra.run.smithi081.stdout:(5/30): ceph-common-18.2.1-0.el9.x86_64.rpm 19 MB/s | 18 MB 00:00 2024-09-18T12:38:43.271 INFO:teuthology.orchestra.run.smithi081.stdout:(6/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 1.0 MB/s | 474 kB 00:00 2024-09-18T12:38:43.296 INFO:teuthology.orchestra.run.smithi081.stdout:(7/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 672 kB/s | 45 kB 00:00 2024-09-18T12:38:43.330 INFO:teuthology.orchestra.run.smithi081.stdout:(8/30): python3-ceph-common-18.2.1-0.el9.x86_64 2.1 MB/s | 124 kB 00:00 2024-09-18T12:38:43.356 INFO:teuthology.orchestra.run.smithi081.stdout:(9/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-18T12:38:43.381 INFO:teuthology.orchestra.run.smithi081.stdout:(10/30): python3-rados-18.2.1-0.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-09-18T12:38:43.456 INFO:teuthology.orchestra.run.smithi081.stdout:(11/30): librgw2-18.2.1-0.el9.x86_64.rpm 7.5 MB/s | 4.5 MB 00:00 2024-09-18T12:38:43.481 INFO:teuthology.orchestra.run.smithi081.stdout:(12/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 989 kB/s | 99 kB 00:00 2024-09-18T12:38:43.507 INFO:teuthology.orchestra.run.smithi081.stdout:(13/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 297 kB 00:00 2024-09-18T12:38:43.607 INFO:teuthology.orchestra.run.smithi081.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-18T12:38:43.632 INFO:teuthology.orchestra.run.smithi081.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 608 kB/s | 107 kB 00:00 2024-09-18T12:38:43.657 INFO:teuthology.orchestra.run.smithi081.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 912 kB/s | 160 kB 00:00 2024-09-18T12:38:43.725 INFO:teuthology.orchestra.run.smithi081.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-18T12:38:43.750 INFO:teuthology.orchestra.run.smithi081.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 460 kB/s | 42 kB 00:00 2024-09-18T12:38:43.783 INFO:teuthology.orchestra.run.smithi081.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-18T12:38:43.834 INFO:teuthology.orchestra.run.smithi081.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-18T12:38:43.859 INFO:teuthology.orchestra.run.smithi081.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-18T12:38:43.884 INFO:teuthology.orchestra.run.smithi081.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-18T12:38:43.909 INFO:teuthology.orchestra.run.smithi081.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-18T12:38:43.935 INFO:teuthology.orchestra.run.smithi081.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:38:43.968 INFO:teuthology.orchestra.run.smithi081.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-18T12:38:44.002 INFO:teuthology.orchestra.run.smithi081.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-18T12:38:44.127 INFO:teuthology.orchestra.run.smithi081.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 26 MB/s | 3.3 MB 00:00 2024-09-18T12:38:44.169 INFO:teuthology.orchestra.run.smithi081.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-18T12:38:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:(29/30): librbd1-18.2.1-0.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-09-18T12:38:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-18T12:38:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:Total 21 MB/s | 53 MB 00:02 2024-09-18T12:38:44.451 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:38:44.487 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:38:44.487 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:38:44.676 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:38:44.682 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:38:44.682 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-18T12:38:44.683 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:38:44.684 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:38:44.685 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout:Install 28 Packages 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 2 Packages 2024-09-18T12:38:44.686 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:38:44.687 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 53 M 2024-09-18T12:38:44.687 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:38:44.975 INFO:teuthology.orchestra.run.smithi136.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 41 MB/s | 5.2 MB 00:00 2024-09-18T12:38:45.000 INFO:teuthology.orchestra.run.smithi136.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 969 kB/s | 24 kB 00:00 2024-09-18T12:38:45.033 INFO:teuthology.orchestra.run.smithi136.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-09-18T12:38:45.069 INFO:teuthology.orchestra.run.smithi136.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-18T12:38:45.101 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:38:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:38:45.176 INFO:teuthology.orchestra.run.smithi136.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 24 MB/s | 7.7 MB 00:00 2024-09-18T12:38:45.201 INFO:teuthology.orchestra.run.smithi136.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-18T12:38:45.226 INFO:teuthology.orchestra.run.smithi136.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.9 MB/s | 124 kB 00:00 2024-09-18T12:38:45.252 INFO:teuthology.orchestra.run.smithi136.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2024-09-18T12:38:45.277 INFO:teuthology.orchestra.run.smithi136.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-18T12:38:45.302 INFO:teuthology.orchestra.run.smithi136.stdout:(10/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 12 MB/s | 297 kB 00:00 2024-09-18T12:38:45.327 INFO:teuthology.orchestra.run.smithi136.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-18T12:38:45.386 INFO:teuthology.orchestra.run.smithi136.stdout:(12/30): librgw2-18.2.1-0.el9.x86_64.rpm 14 MB/s | 4.5 MB 00:00 2024-09-18T12:38:45.603 INFO:teuthology.orchestra.run.smithi136.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 24 MB/s | 18 MB 00:00 2024-09-18T12:38:45.645 INFO:teuthology.orchestra.run.smithi136.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-18T12:38:45.670 INFO:teuthology.orchestra.run.smithi136.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 563 kB/s | 160 kB 00:00 2024-09-18T12:38:45.712 INFO:teuthology.orchestra.run.smithi136.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-18T12:38:45.738 INFO:teuthology.orchestra.run.smithi136.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-18T12:38:45.763 INFO:teuthology.orchestra.run.smithi136.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-18T12:38:45.788 INFO:teuthology.orchestra.run.smithi136.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 559 kB/s | 42 kB 00:00 2024-09-18T12:38:45.838 INFO:teuthology.orchestra.run.smithi136.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-18T12:38:45.864 INFO:teuthology.orchestra.run.smithi136.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-18T12:38:45.889 INFO:teuthology.orchestra.run.smithi136.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-18T12:38:45.914 INFO:teuthology.orchestra.run.smithi136.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-18T12:38:45.940 INFO:teuthology.orchestra.run.smithi136.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:38:45.990 INFO:teuthology.orchestra.run.smithi136.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-09-18T12:38:46.023 INFO:teuthology.orchestra.run.smithi136.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-18T12:38:46.099 INFO:teuthology.orchestra.run.smithi136.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-09-18T12:38:46.166 INFO:teuthology.orchestra.run.smithi136.stdout:(28/30): librbd1-18.2.1-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-09-18T12:38:46.241 INFO:teuthology.orchestra.run.smithi136.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-18T12:38:46.366 INFO:teuthology.orchestra.run.smithi136.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-18T12:38:46.370 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:46.370 INFO:teuthology.orchestra.run.smithi136.stdout:Total 31 MB/s | 53 MB 00:01 2024-09-18T12:38:46.438 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:38:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:38:46.473 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:38:46.473 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:38:46.563 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-18T12:38:46.592 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-18T12:38:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-18T12:38:46.975 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-18T12:38:47.082 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:38:47.117 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:38:47.117 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:38:47.174 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:38:47.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-09-18T12:38:47.283 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:38:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:38:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-18T12:38:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-09-18T12:38:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-18T12:38:47.527 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:38:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:38:47.708 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-18T12:38:47.743 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-18T12:38:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-18T12:38:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-18T12:38:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-18T12:38:47.888 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-18T12:38:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-18T12:38:48.236 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-18T12:38:48.275 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-18T12:38:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-18T12:38:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-09-18T12:38:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-18T12:38:48.485 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:38:48.575 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-18T12:38:48.613 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-18T12:38:48.662 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-18T12:38:48.841 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-18T12:38:48.877 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-18T12:38:48.948 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-18T12:38:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-09-18T12:38:49.032 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-18T12:38:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-09-18T12:38:49.096 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:38:49.196 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:38:49.276 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-09-18T12:38:49.297 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:38:49.359 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:38:49.388 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-18T12:38:49.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-09-18T12:38:49.498 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-18T12:38:49.524 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:38:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:38:49.696 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-18T12:38:49.732 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-18T12:38:49.781 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-18T12:38:49.813 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-18T12:38:49.840 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-18T12:38:49.877 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-18T12:38:49.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-18T12:38:50.208 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-18T12:38:50.247 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-18T12:38:50.338 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-18T12:38:50.369 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-09-18T12:38:50.405 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-18T12:38:50.805 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-18T12:38:50.833 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-18T12:38:50.905 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-18T12:38:50.981 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-09-18T12:38:51.010 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-09-18T12:38:51.159 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:51.210 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:51.756 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:51.796 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-18T12:38:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-18T12:38:51.901 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:38:51.902 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:38:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:38:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:38:53.105 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:53.157 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:53.712 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-18T12:38:53.752 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-18T12:38:53.855 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-18T12:38:53.855 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:38:53.855 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:38:53.855 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:38:53.887 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:39:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:39:01.896 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-18T12:39:01.896 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-18T12:39:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:02.666 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:39:02.692 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:02.694 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-18T12:39:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-18T12:39:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-18T12:39:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-18T12:39:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-18T12:39:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-09-18T12:39:04.051 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:39:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:04.786 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:04.807 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:39:04.833 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:04.835 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-18T12:39:04.927 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-18T12:39:04.927 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:05.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-test 2024-09-18T12:39:05.732 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:26 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:05.861 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:05.861 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:05.861 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:39:05.861 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:05.861 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-18T12:39:05.862 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:05.863 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 40 M 2024-09-18T12:39:05.863 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 166 M 2024-09-18T12:39:05.863 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:06.042 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-09-18T12:39:06.065 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-18T12:39:06.066 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-18T12:39:06.067 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-09-18T12:39:06.084 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-18T12:39:06.109 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 733 kB/s | 165 kB 00:00 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:39:06.969 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:39:06.970 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:06.971 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:39:06.972 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:39:06.972 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:06.972 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:07.184 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): ceph-test-18.2.1-0.el9.x86_64.rpm 30 MB/s | 40 MB 00:01 2024-09-18T12:39:07.187 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:07.187 INFO:teuthology.orchestra.run.smithi081.stdout:Total 30 MB/s | 40 MB 00:01 2024-09-18T12:39:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:07.234 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:07.234 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:07.299 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-test 2024-09-18T12:39:07.578 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:07.579 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:07.884 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:25 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:08.023 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:08.024 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:08.025 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-09-18T12:39:08.025 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:08.025 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 40 M 2024-09-18T12:39:08.025 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 166 M 2024-09-18T12:39:08.025 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:08.109 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 2.5 MB/s | 165 kB 00:00 2024-09-18T12:39:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:39:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:39:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-18T12:39:08.260 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 424 kB/s | 64 kB 00:00 2024-09-18T12:39:08.285 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-18T12:39:08.677 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): ceph-test-18.2.1-0.el9.x86_64.rpm 63 MB/s | 40 MB 00:00 2024-09-18T12:39:08.679 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:08.679 INFO:teuthology.orchestra.run.smithi136.stdout:Total 61 MB/s | 40 MB 00:00 2024-09-18T12:39:08.707 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:08.727 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:08.727 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:09.060 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:09.061 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:09.561 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:09.642 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:39:09.694 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:39:09.720 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-18T12:39:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-18T12:39:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-18T12:39:13.441 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-18T12:39:13.528 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-18T12:39:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-18T12:39:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-09-18T12:39:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-09-18T12:39:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:39:14.388 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:14.389 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:14.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph 2024-09-18T12:39:15.282 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:15.418 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-09-18T12:39:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-09-18T12:39:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-09-18T12:39:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-18T12:39:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:39:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:39:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:39:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:39:15.424 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout:Install 33 Packages 2024-09-18T12:39:15.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:15.426 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 30 M 2024-09-18T12:39:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 110 M 2024-09-18T12:39:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:15.575 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-18T12:39:15.575 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-09-18T12:39:15.575 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-09-18T12:39:15.576 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:39:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 75 kB/s | 6.4 kB 00:00 2024-09-18T12:39:15.778 INFO:teuthology.orchestra.run.smithi081.stdout:(2/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 16 MB/s | 2.1 MB 00:00 2024-09-18T12:39:15.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:39:15.882 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:15.883 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:15.883 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:15.883 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:39:15.883 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:15.883 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:15.929 INFO:teuthology.orchestra.run.smithi081.stdout:(3/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-18T12:39:15.962 INFO:teuthology.orchestra.run.smithi081.stdout:(4/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-18T12:39:15.996 INFO:teuthology.orchestra.run.smithi081.stdout:(5/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 3.5 MB/s | 242 kB 00:00 2024-09-18T12:39:16.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph 2024-09-18T12:39:16.363 INFO:teuthology.orchestra.run.smithi081.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 30 MB/s | 18 MB 00:00 2024-09-18T12:39:16.688 INFO:teuthology.orchestra.run.smithi081.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 349 kB/s | 253 kB 00:00 2024-09-18T12:39:16.767 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:16.813 INFO:teuthology.orchestra.run.smithi081.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-18T12:39:16.839 INFO:teuthology.orchestra.run.smithi081.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 224 kB/s | 106 kB 00:00 2024-09-18T12:39:16.903 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:16.905 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:16.905 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:39:16.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:39:16.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:39:16.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout:Install 33 Packages 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:16.909 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 30 M 2024-09-18T12:39:16.910 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 110 M 2024-09-18T12:39:16.910 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:16.939 INFO:teuthology.orchestra.run.smithi081.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 995 kB/s | 125 kB 00:00 2024-09-18T12:39:17.023 INFO:teuthology.orchestra.run.smithi081.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-18T12:39:17.048 INFO:teuthology.orchestra.run.smithi081.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-09-18T12:39:17.098 INFO:teuthology.orchestra.run.smithi081.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-18T12:39:17.140 INFO:teuthology.orchestra.run.smithi081.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 556 kB/s | 51 kB 00:00 2024-09-18T12:39:17.165 INFO:teuthology.orchestra.run.smithi081.stdout:(15/33): python3-markupsafe-1.1.1-12.el9.x86_64 244 kB/s | 35 kB 00:00 2024-09-18T12:39:17.190 INFO:teuthology.orchestra.run.smithi081.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-18T12:39:17.244 INFO:teuthology.orchestra.run.smithi081.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 419 kB/s | 43 kB 00:00 2024-09-18T12:39:17.269 INFO:teuthology.orchestra.run.smithi081.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 466 kB/s | 11 kB 00:00 2024-09-18T12:39:17.303 INFO:teuthology.orchestra.run.smithi081.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-18T12:39:17.328 INFO:teuthology.orchestra.run.smithi081.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 302 kB/s | 18 kB 00:00 2024-09-18T12:39:17.353 INFO:teuthology.orchestra.run.smithi081.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-18T12:39:17.379 INFO:teuthology.orchestra.run.smithi081.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-18T12:39:17.405 INFO:teuthology.orchestra.run.smithi081.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:39:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-18T12:39:17.455 INFO:teuthology.orchestra.run.smithi081.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T12:39:17.480 INFO:teuthology.orchestra.run.smithi081.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-18T12:39:17.514 INFO:teuthology.orchestra.run.smithi081.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-09-18T12:39:17.528 INFO:teuthology.orchestra.run.smithi136.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 107 kB/s | 6.4 kB 00:00 2024-09-18T12:39:17.539 INFO:teuthology.orchestra.run.smithi081.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-18T12:39:17.564 INFO:teuthology.orchestra.run.smithi081.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-18T12:39:17.579 INFO:teuthology.orchestra.run.smithi136.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-18T12:39:17.590 INFO:teuthology.orchestra.run.smithi081.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-18T12:39:17.615 INFO:teuthology.orchestra.run.smithi081.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-18T12:39:17.630 INFO:teuthology.orchestra.run.smithi136.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2024-09-18T12:39:17.640 INFO:teuthology.orchestra.run.smithi081.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-18T12:39:17.654 INFO:teuthology.orchestra.run.smithi136.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 9.5 MB/s | 242 kB 00:00 2024-09-18T12:39:17.674 INFO:teuthology.orchestra.run.smithi081.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-18T12:39:17.678 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:17.679 INFO:teuthology.orchestra.run.smithi081.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-18T12:39:17.738 INFO:teuthology.orchestra.run.smithi136.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-18T12:39:17.801 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:17.839 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:17.839 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:17.980 INFO:teuthology.orchestra.run.smithi136.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 44 MB/s | 18 MB 00:00 2024-09-18T12:39:18.122 INFO:teuthology.orchestra.run.smithi136.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 542 kB/s | 253 kB 00:00 2024-09-18T12:39:18.147 INFO:teuthology.orchestra.run.smithi136.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 639 kB/s | 106 kB 00:00 2024-09-18T12:39:18.172 INFO:teuthology.orchestra.run.smithi136.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-18T12:39:18.239 INFO:teuthology.orchestra.run.smithi136.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-18T12:39:18.265 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:18.265 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:18.265 INFO:teuthology.orchestra.run.smithi136.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.0 MB/s | 125 kB 00:00 2024-09-18T12:39:18.290 INFO:teuthology.orchestra.run.smithi136.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-18T12:39:18.357 INFO:teuthology.orchestra.run.smithi136.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-18T12:39:18.382 INFO:teuthology.orchestra.run.smithi136.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-18T12:39:18.407 INFO:teuthology.orchestra.run.smithi136.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-18T12:39:18.433 INFO:teuthology.orchestra.run.smithi136.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-18T12:39:18.483 INFO:teuthology.orchestra.run.smithi136.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-18T12:39:18.508 INFO:teuthology.orchestra.run.smithi136.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-18T12:39:18.533 INFO:teuthology.orchestra.run.smithi136.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-18T12:39:18.559 INFO:teuthology.orchestra.run.smithi136.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-18T12:39:18.584 INFO:teuthology.orchestra.run.smithi136.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-18T12:39:18.610 INFO:teuthology.orchestra.run.smithi136.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 384 kB/s | 19 kB 00:00 2024-09-18T12:39:18.635 INFO:teuthology.orchestra.run.smithi136.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 387 kB/s | 20 kB 00:00 2024-09-18T12:39:18.660 INFO:teuthology.orchestra.run.smithi136.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-18T12:39:18.685 INFO:teuthology.orchestra.run.smithi136.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T12:39:18.711 INFO:teuthology.orchestra.run.smithi136.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-18T12:39:18.736 INFO:teuthology.orchestra.run.smithi136.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-18T12:39:18.753 INFO:teuthology.orchestra.run.smithi136.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-18T12:39:18.770 INFO:teuthology.orchestra.run.smithi136.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2024-09-18T12:39:18.795 INFO:teuthology.orchestra.run.smithi136.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-18T12:39:18.821 INFO:teuthology.orchestra.run.smithi136.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-18T12:39:18.849 INFO:teuthology.orchestra.run.smithi136.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.3 MB/s | 427 kB 00:00 2024-09-18T12:39:19.025 INFO:teuthology.orchestra.run.smithi136.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 87 kB/s | 20 kB 00:00 2024-09-18T12:39:19.029 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:19.029 INFO:teuthology.orchestra.run.smithi136.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-18T12:39:19.152 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:19.192 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:19.192 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:19.603 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:19.603 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-18T12:39:19.642 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-18T12:39:19.675 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-18T12:39:19.767 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-18T12:39:19.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-18T12:39:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-18T12:39:19.947 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-18T12:39:19.977 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-18T12:39:20.011 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-18T12:39:20.053 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-18T12:39:20.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-18T12:39:20.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-18T12:39:20.171 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-18T12:39:20.214 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-18T12:39:20.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-18T12:39:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-18T12:39:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-18T12:39:20.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-18T12:39:20.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-18T12:39:20.668 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-18T12:39:20.723 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-18T12:39:20.899 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:20.912 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-18T12:39:20.965 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-18T12:39:20.969 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-18T12:39:21.001 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-18T12:39:21.034 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-18T12:39:21.044 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-18T12:39:21.126 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-18T12:39:21.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-18T12:39:21.182 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-18T12:39:21.213 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-18T12:39:21.254 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-18T12:39:21.289 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-18T12:39:21.297 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-18T12:39:21.319 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-18T12:39:21.345 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-18T12:39:21.378 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-18T12:39:21.419 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-18T12:39:21.454 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-18T12:39:21.468 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-09-18T12:39:21.488 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-18T12:39:21.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:39:21.519 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:21.532 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-18T12:39:21.617 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-18T12:39:21.757 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-18T12:39:21.835 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-18T12:39:21.888 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-18T12:39:21.926 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-18T12:39:21.975 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-18T12:39:22.031 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-18T12:39:22.217 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-18T12:39:22.273 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-18T12:39:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-18T12:39:22.438 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-18T12:39:22.475 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-18T12:39:22.602 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-18T12:39:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-09-18T12:39:22.789 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:39:22.815 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:39:23.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:23.554 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-18T12:39:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-18T12:39:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:39:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:39:23.579 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:39:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:23.788 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-18T12:39:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-18T12:39:23.812 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:23.813 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:39:23.813 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:39:23.813 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:39:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-18T12:39:24.382 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-18T12:39:24.411 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-18T12:39:24.412 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:24.412 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:39:24.412 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:39:24.412 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:39:24.412 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:24.858 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-18T12:39:24.881 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-18T12:39:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:39:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:39:24.882 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:39:24.882 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:25.091 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-18T12:39:25.115 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-18T12:39:25.115 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:25.115 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:39:25.115 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:39:25.115 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:39:25.116 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:25.179 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-18T12:39:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-18T12:39:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-18T12:39:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-18T12:39:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-18T12:39:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-18T12:39:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:26.647 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:39:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:39:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:26.651 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:26.957 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-18T12:39:26.958 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-18T12:39:26.959 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-18T12:39:26.960 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-18T12:39:26.961 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-18T12:39:26.961 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-18T12:39:26.961 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-18T12:39:26.961 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-18T12:39:27.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-base 2024-09-18T12:39:27.606 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:27.694 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:39:27.736 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:27.737 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:39:27.737 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:27.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install cephadm 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:27.859 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:39:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:39:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:39:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:39:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:27.862 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:28.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-base 2024-09-18T12:39:28.384 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:39:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 221 k 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 213 k 2024-09-18T12:39:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm-18.2.1-0.el9.noarch.rpm 2.7 MB/s | 221 kB 00:00 2024-09-18T12:39:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:Total 2.7 MB/s | 221 kB 00:00 2024-09-18T12:39:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:28.602 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:28.602 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:28.605 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:28.605 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:28.776 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:28.865 INFO:teuthology.orchestra.run.smithi136.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:39:28.906 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:28.907 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:39:28.907 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:28.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install cephadm 2024-09-18T12:39:29.134 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:29.216 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:29.551 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:29.683 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:29.683 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:29.683 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:39:29.683 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:29.683 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:39:29.684 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 221 k 2024-09-18T12:39:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 213 k 2024-09-18T12:39:29.685 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:29.740 INFO:teuthology.orchestra.run.smithi136.stdout:cephadm-18.2.1-0.el9.noarch.rpm 3.9 MB/s | 221 kB 00:00 2024-09-18T12:39:29.741 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:29.741 INFO:teuthology.orchestra.run.smithi136.stdout:Total 3.8 MB/s | 221 kB 00:00 2024-09-18T12:39:29.741 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:29.746 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:29.746 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:29.749 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:29.750 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:29.822 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:29.849 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:30.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:39:30.295 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:30.369 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:30.677 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:30.712 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:30.813 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:39:30.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:30.815 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 142 k 2024-09-18T12:39:30.815 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 395 k 2024-09-18T12:39:30.815 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:30.902 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 1.6 MB/s | 142 kB 00:00 2024-09-18T12:39:30.902 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:30.903 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.6 MB/s | 142 kB 00:00 2024-09-18T12:39:30.903 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:30.913 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:30.913 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:30.950 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:30.967 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:30.968 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:31.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:39:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:31.203 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:31.204 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:39:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:31.773 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:31.907 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repo Size 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:31.908 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:31.909 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:39:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:31.909 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 142 k 2024-09-18T12:39:31.909 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 395 k 2024-09-18T12:39:31.909 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:31.947 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 3.6 MB/s | 142 kB 00:00 2024-09-18T12:39:31.948 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:31.948 INFO:teuthology.orchestra.run.smithi136.stdout:Total 3.5 MB/s | 142 kB 00:00 2024-09-18T12:39:31.948 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:31.955 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:31.955 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:32.011 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:32.012 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:32.159 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:32.223 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:32.247 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:32.248 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:39:32.248 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:39:32.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:32.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr 2024-09-18T12:39:32.968 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:33.058 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:39:33.103 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:33.104 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:39:33.104 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:33.157 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:33.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:39:33.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr 2024-09-18T12:39:33.739 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:33.868 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-09-18T12:39:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:Install 7 Packages 2024-09-18T12:39:33.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:33.871 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 2.1 M 2024-09-18T12:39:33.871 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 8.5 M 2024-09-18T12:39:33.871 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:33.970 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 284 kB/s | 23 kB 00:00 2024-09-18T12:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 118 kB/s | 15 kB 00:00 2024-09-18T12:39:34.065 INFO:teuthology.orchestra.run.smithi136.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 154 kB/s | 9.0 kB 00:00 2024-09-18T12:39:34.108 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:34.109 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:39:34.109 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:34.123 INFO:teuthology.orchestra.run.smithi081.stdout:(4/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 9.2 MB/s | 1.8 MB 00:00 2024-09-18T12:39:34.148 INFO:teuthology.orchestra.run.smithi081.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 447 kB/s | 31 kB 00:00 2024-09-18T12:39:34.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:39:34.185 INFO:teuthology.orchestra.run.smithi081.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 325 kB/s | 41 kB 00:00 2024-09-18T12:39:34.232 INFO:teuthology.orchestra.run.smithi081.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-09-18T12:39:34.236 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:34.236 INFO:teuthology.orchestra.run.smithi081.stdout:Total 5.6 MB/s | 2.1 MB 00:00 2024-09-18T12:39:34.236 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:34.244 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:34.244 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:34.325 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:34.326 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:34.631 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T12:39:34.734 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T12:39:34.773 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T12:39:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T12:39:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-09-18T12:39:34.905 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-09-18T12:39:34.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout:Install 7 Packages 2024-09-18T12:39:34.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:34.908 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 2.1 M 2024-09-18T12:39:34.908 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 8.5 M 2024-09-18T12:39:34.908 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:35.027 INFO:teuthology.orchestra.run.smithi136.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 397 kB/s | 23 kB 00:00 2024-09-18T12:39:35.052 INFO:teuthology.orchestra.run.smithi136.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 175 kB/s | 15 kB 00:00 2024-09-18T12:39:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-09-18T12:39:35.111 INFO:teuthology.orchestra.run.smithi136.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 12 MB/s | 1.8 MB 00:00 2024-09-18T12:39:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-18T12:39:35.153 INFO:teuthology.orchestra.run.smithi136.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 72 kB/s | 9.0 kB 00:00 2024-09-18T12:39:35.186 INFO:teuthology.orchestra.run.smithi136.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 305 kB/s | 41 kB 00:00 2024-09-18T12:39:35.220 INFO:teuthology.orchestra.run.smithi136.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 287 kB/s | 31 kB 00:00 2024-09-18T12:39:35.245 INFO:teuthology.orchestra.run.smithi136.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-18T12:39:35.249 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:35.249 INFO:teuthology.orchestra.run.smithi136.stdout:Total 6.0 MB/s | 2.1 MB 00:00 2024-09-18T12:39:35.249 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:35.257 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:35.257 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:35.324 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:35.325 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:35.616 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:35.671 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T12:39:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T12:39:35.706 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T12:39:35.751 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T12:39:35.784 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T12:39:35.812 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-09-18T12:39:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T12:39:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T12:39:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:39:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:39:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:35.965 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:36.050 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-09-18T12:39:36.082 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-18T12:39:36.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:39:36.591 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T12:39:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T12:39:36.769 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:36.866 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:39:36.867 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:36.868 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:36.901 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:36.902 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:39:36.902 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:39:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:36.904 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:36.905 INFO:teuthology.orchestra.run.smithi081.stdout:Install 12 Packages 2024-09-18T12:39:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:36.905 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 38 M 2024-09-18T12:39:36.906 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 212 M 2024-09-18T12:39:36.906 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:37.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:39:37.464 INFO:teuthology.orchestra.run.smithi081.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-18T12:39:37.581 INFO:teuthology.orchestra.run.smithi081.stdout:(2/12): ceph-mgr-diskprediction-local-18.2.1-0. 24 MB/s | 7.4 MB 00:00 2024-09-18T12:39:37.648 INFO:teuthology.orchestra.run.smithi081.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-18T12:39:37.688 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:37.765 INFO:teuthology.orchestra.run.smithi081.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-18T12:39:37.821 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:37.822 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:37.822 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:39:37.822 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:37.822 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:39:37.823 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout:Install 12 Packages 2024-09-18T12:39:37.824 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:37.825 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 38 M 2024-09-18T12:39:37.825 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 212 M 2024-09-18T12:39:37.825 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:37.849 INFO:teuthology.orchestra.run.smithi081.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 462 kB/s | 38 kB 00:00 2024-09-18T12:39:37.874 INFO:teuthology.orchestra.run.smithi081.stdout:(6/12): flexiblas-3.0.4-8.el9.x86_64.rpm 80 kB/s | 33 kB 00:00 2024-09-18T12:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.6 MB/s | 3.0 MB 00:00 2024-09-18T12:39:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 917 kB/s | 245 kB 00:00 2024-09-18T12:39:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-18T12:39:38.402 INFO:teuthology.orchestra.run.smithi136.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 54 MB/s | 7.4 MB 00:00 2024-09-18T12:39:38.478 INFO:teuthology.orchestra.run.smithi136.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-18T12:39:38.492 INFO:teuthology.orchestra.run.smithi081.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-18T12:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.3 MB/s | 4.9 MB 00:00 2024-09-18T12:39:38.995 INFO:teuthology.orchestra.run.smithi136.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.8 MB/s | 3.0 MB 00:00 2024-09-18T12:39:39.037 INFO:teuthology.orchestra.run.smithi136.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 439 kB/s | 18 kB 00:00 2024-09-18T12:39:39.070 INFO:teuthology.orchestra.run.smithi136.stdout:(5/12): libquadmath-11.5.0-2.el9.x86_64.rpm 237 kB/s | 191 kB 00:00 2024-09-18T12:39:39.096 INFO:teuthology.orchestra.run.smithi136.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 656 kB/s | 38 kB 00:00 2024-09-18T12:39:39.137 INFO:teuthology.orchestra.run.smithi136.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-18T12:39:39.246 INFO:teuthology.orchestra.run.smithi136.stdout:(8/12): libgfortran-11.5.0-2.el9.x86_64.rpm 816 kB/s | 801 kB 00:00 2024-09-18T12:39:39.321 INFO:teuthology.orchestra.run.smithi136.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-18T12:39:39.572 INFO:teuthology.orchestra.run.smithi136.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 771 kB/s | 250 kB 00:00 2024-09-18T12:39:39.797 INFO:teuthology.orchestra.run.smithi136.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-18T12:39:39.864 INFO:teuthology.orchestra.run.smithi136.stdout:(12/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.2 MB/s | 4.9 MB 00:00 2024-09-18T12:39:39.865 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:39.865 INFO:teuthology.orchestra.run.smithi136.stdout:Total 19 MB/s | 38 MB 00:02 2024-09-18T12:39:40.167 INFO:teuthology.orchestra.run.smithi081.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.6 MB/s | 16 MB 00:01 2024-09-18T12:39:40.168 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:40.169 INFO:teuthology.orchestra.run.smithi081.stdout:Total 12 MB/s | 38 MB 00:03 2024-09-18T12:39:40.218 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:40.245 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:40.245 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:40.523 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:40.548 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:40.548 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:40.749 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:40.749 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:41.048 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:41.048 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:41.507 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:41.586 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:39:41.628 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:39:41.729 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:39:41.763 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:39:41.806 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:41.886 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:39:41.949 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:39:41.957 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:39:41.978 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:39:42.055 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:39:42.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:39:42.332 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:39:42.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:39:42.699 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:39:42.817 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:39:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:39:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:39:44.059 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:39:44.421 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:39:45.085 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:39:45.121 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-18T12:39:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:39:45.499 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-18T12:39:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:39:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:39:48.191 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:39:48.192 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:39:48.193 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:39:48.193 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:39:48.193 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:39:48.193 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:48.193 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-18T12:39:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-09-18T12:39:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:39:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:39:48.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:39:48.656 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:39:48.657 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:39:48.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:39:48.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:39:48.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:39:48.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:48.658 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:49.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:39:49.151 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:07 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:49.283 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:49.284 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:39:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout:Install 13 Packages 2024-09-18T12:39:49.286 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:49.287 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 2.2 M 2024-09-18T12:39:49.287 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 26 M 2024-09-18T12:39:49.287 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:49.563 INFO:teuthology.orchestra.run.smithi136.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 564 kB/s | 50 kB 00:00 2024-09-18T12:39:49.588 INFO:teuthology.orchestra.run.smithi136.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 225 kB/s | 26 kB 00:00 2024-09-18T12:39:49.614 INFO:teuthology.orchestra.run.smithi136.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 137 kB/s | 19 kB 00:00 2024-09-18T12:39:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:10 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:49.681 INFO:teuthology.orchestra.run.smithi136.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-18T12:39:49.731 INFO:teuthology.orchestra.run.smithi136.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-18T12:39:49.756 INFO:teuthology.orchestra.run.smithi136.stdout:(6/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-18T12:39:49.774 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-09-18T12:39:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:39:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:49.777 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:49.777 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:49.777 INFO:teuthology.orchestra.run.smithi081.stdout:Install 13 Packages 2024-09-18T12:39:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:49.777 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 2.2 M 2024-09-18T12:39:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 26 M 2024-09-18T12:39:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:49.798 INFO:teuthology.orchestra.run.smithi136.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-18T12:39:49.823 INFO:teuthology.orchestra.run.smithi136.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-18T12:39:49.849 INFO:teuthology.orchestra.run.smithi136.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-18T12:39:49.874 INFO:teuthology.orchestra.run.smithi136.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-18T12:39:49.907 INFO:teuthology.orchestra.run.smithi136.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-18T12:39:49.933 INFO:teuthology.orchestra.run.smithi136.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-18T12:39:49.966 INFO:teuthology.orchestra.run.smithi136.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.5 MB/s | 1.0 MB 00:00 2024-09-18T12:39:49.969 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:49.969 INFO:teuthology.orchestra.run.smithi136.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-18T12:39:50.016 INFO:teuthology.orchestra.run.smithi081.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 1.1 MB/s | 50 kB 00:00 2024-09-18T12:39:50.032 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:50.047 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:50.048 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:50.083 INFO:teuthology.orchestra.run.smithi081.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 175 kB/s | 19 kB 00:00 2024-09-18T12:39:50.109 INFO:teuthology.orchestra.run.smithi081.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 189 kB/s | 26 kB 00:00 2024-09-18T12:39:50.138 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:50.138 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:50.175 INFO:teuthology.orchestra.run.smithi081.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-18T12:39:50.201 INFO:teuthology.orchestra.run.smithi081.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-18T12:39:50.226 INFO:teuthology.orchestra.run.smithi081.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-18T12:39:50.268 INFO:teuthology.orchestra.run.smithi081.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-09-18T12:39:50.293 INFO:teuthology.orchestra.run.smithi081.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 350 kB/s | 32 kB 00:00 2024-09-18T12:39:50.327 INFO:teuthology.orchestra.run.smithi081.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-18T12:39:50.386 INFO:teuthology.orchestra.run.smithi081.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-18T12:39:50.411 INFO:teuthology.orchestra.run.smithi081.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 721 kB/s | 59 kB 00:00 2024-09-18T12:39:50.453 INFO:teuthology.orchestra.run.smithi081.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 6.7 MB/s | 1.0 MB 00:00 2024-09-18T12:39:50.478 INFO:teuthology.orchestra.run.smithi081.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 972 kB/s | 90 kB 00:00 2024-09-18T12:39:50.481 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:50.481 INFO:teuthology.orchestra.run.smithi081.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-18T12:39:50.543 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:50.558 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:50.558 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:50.646 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:50.648 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:50.664 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:50.822 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:39:50.884 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:39:50.939 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:39:50.977 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:39:51.010 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:39:51.111 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:39:51.155 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:51.221 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:39:51.270 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:39:51.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:39:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:39:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:39:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:39:51.530 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:39:51.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:39:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:39:51.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:39:51.978 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:39:52.034 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:39:52.068 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:39:52.115 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:39:52.138 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-18T12:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:39:52.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:39:52.644 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:39:52.666 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-18T12:39:52.917 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-18T12:39:52.917 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:39:52.918 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:39:53.255 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:39:53.255 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:53.255 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:39:53.256 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:39:53.257 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:39:53.257 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:53.257 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-18T12:39:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:39:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:39:53.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:39:53.800 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:39:53.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:53.800 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:39:53.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:39:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:39:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:53.802 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:54.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:39:54.075 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:39:54.216 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:39:54.217 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:54.217 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-18T12:39:54.217 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:54.217 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:39:54.220 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:39:54.221 INFO:teuthology.orchestra.run.smithi136.stdout:Install 6 Packages 2024-09-18T12:39:54.221 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:54.221 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 7.0 M 2024-09-18T12:39:54.221 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 33 M 2024-09-18T12:39:54.222 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:39:54.645 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:15 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:39:54.737 INFO:teuthology.orchestra.run.smithi136.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2024-09-18T12:39:54.778 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:39:54.778 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:39:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Install 6 Packages 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 7.0 M 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 33 M 2024-09-18T12:39:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi136.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-18T12:39:54.820 INFO:teuthology.orchestra.run.smithi136.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-18T12:39:54.837 INFO:teuthology.orchestra.run.smithi136.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 4.4 MB/s | 74 kB 00:00 2024-09-18T12:39:54.871 INFO:teuthology.orchestra.run.smithi136.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-18T12:39:54.906 INFO:teuthology.orchestra.run.smithi081.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-09-18T12:39:54.998 INFO:teuthology.orchestra.run.smithi081.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.8 MB/s | 548 kB 00:00 2024-09-18T12:39:55.024 INFO:teuthology.orchestra.run.smithi081.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-18T12:39:55.057 INFO:teuthology.orchestra.run.smithi081.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-18T12:39:55.149 INFO:teuthology.orchestra.run.smithi081.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 849 kB/s | 248 kB 00:00 2024-09-18T12:39:56.904 INFO:teuthology.orchestra.run.smithi136.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-18T12:39:56.906 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:56.906 INFO:teuthology.orchestra.run.smithi136.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-09-18T12:39:56.977 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:39:56.989 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:39:56.989 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:39:57.087 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:39:57.088 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:39:57.291 INFO:teuthology.orchestra.run.smithi081.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-18T12:39:57.293 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:57.293 INFO:teuthology.orchestra.run.smithi081.stdout:Total 2.8 MB/s | 7.0 MB 00:02 2024-09-18T12:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:39:57.398 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:39:57.477 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:39:57.478 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:39:57.604 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:39:57.647 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:39:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:39:57.964 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:39:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:39:58.168 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:39:58.259 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:39:58.319 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:39:58.343 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-18T12:39:58.538 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:39:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:39:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:39:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-18T12:39:59.135 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-18T12:39:59.135 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-09-18T12:39:59.135 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:39:59.135 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:39:59.135 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:39:59.136 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:39:59.418 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:39:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:39:59.420 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:39:59.420 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:39:59.420 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:39:59.478 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-18T12:39:59.478 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-09-18T12:39:59.479 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:39:59.479 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:39:59.479 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:39:59.479 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:39:59.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-fuse 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:39:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:39:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:39:59.746 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:39:59.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-fuse 2024-09-18T12:40:00.240 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:18 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:00.373 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:00.373 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout:Install 2 Packages 2024-09-18T12:40:00.374 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:00.375 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 919 k 2024-09-18T12:40:00.375 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 2.7 M 2024-09-18T12:40:00.375 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:00.473 INFO:teuthology.orchestra.run.smithi136.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-18T12:40:00.498 INFO:teuthology.orchestra.run.smithi136.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 779 kB/s | 80 kB 00:00 2024-09-18T12:40:00.499 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:00.499 INFO:teuthology.orchestra.run.smithi136.stdout:Total 7.2 MB/s | 919 kB 00:00 2024-09-18T12:40:00.512 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:00.532 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:00.532 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:00.579 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:00.612 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:00.612 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-09-18T12:40:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout:Install 2 Packages 2024-09-18T12:40:00.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:00.714 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 919 k 2024-09-18T12:40:00.714 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 2.7 M 2024-09-18T12:40:00.714 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:00.799 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:00.901 INFO:teuthology.orchestra.run.smithi081.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-18T12:40:00.929 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:40:00.998 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-18T12:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 209 kB/s | 80 kB 00:00 2024-09-18T12:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.7 MB/s | 919 kB 00:00 2024-09-18T12:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:01.340 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:01.341 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:01.523 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:40:01.690 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-18T12:40:01.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-09-18T12:40:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-18T12:40:01.949 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:40:01.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:01.950 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:01.950 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:40:01.950 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:01.950 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:02.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librados-devel 2024-09-18T12:40:02.441 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-18T12:40:02.441 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:02.747 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:02.842 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:02.979 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:02.980 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 127 k 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 456 k 2024-09-18T12:40:02.981 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:03.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados-devel 2024-09-18T12:40:03.045 INFO:teuthology.orchestra.run.smithi136.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 127 kB 00:00 2024-09-18T12:40:03.046 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:03.046 INFO:teuthology.orchestra.run.smithi136.stdout:Total 1.9 MB/s | 127 kB 00:00 2024-09-18T12:40:03.046 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:03.051 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:03.051 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:03.114 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:03.114 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:03.270 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:03.632 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:03.767 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:03.767 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:40:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:03.769 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 127 k 2024-09-18T12:40:03.769 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 456 k 2024-09-18T12:40:03.769 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:03.815 INFO:teuthology.orchestra.run.smithi081.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 2.7 MB/s | 127 kB 00:00 2024-09-18T12:40:03.816 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:03.816 INFO:teuthology.orchestra.run.smithi081.stdout:Total 2.6 MB/s | 127 kB 00:00 2024-09-18T12:40:03.816 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:03.817 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:03.822 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:03.822 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:03.887 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:03.888 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:04.043 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:04.074 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:04.129 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:04.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install libcephfs2 2024-09-18T12:40:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:04.831 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:04.831 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:04.943 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:05.034 INFO:teuthology.orchestra.run.smithi136.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:05.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs2 2024-09-18T12:40:05.081 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:05.082 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:05.082 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:05.151 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install libcephfs-devel 2024-09-18T12:40:05.660 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:05.734 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:23 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:05.752 INFO:teuthology.orchestra.run.smithi081.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:05.799 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:05.799 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:05.799 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:05.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs-devel 2024-09-18T12:40:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:05.867 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:05.868 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 31 k 2024-09-18T12:40:05.869 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 139 k 2024-09-18T12:40:05.869 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:05.941 INFO:teuthology.orchestra.run.smithi136.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 427 kB/s | 31 kB 00:00 2024-09-18T12:40:05.942 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:05.942 INFO:teuthology.orchestra.run.smithi136.stdout:Total 420 kB/s | 31 kB 00:00 2024-09-18T12:40:05.942 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:05.945 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:05.945 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:05.958 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:05.958 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:06.036 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:06.443 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:06.524 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:06.574 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:40:06.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:06.576 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 31 k 2024-09-18T12:40:06.576 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 139 k 2024-09-18T12:40:06.576 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:06.627 INFO:teuthology.orchestra.run.smithi081.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 596 kB/s | 31 kB 00:00 2024-09-18T12:40:06.629 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:06.629 INFO:teuthology.orchestra.run.smithi081.stdout:Total 582 kB/s | 31 kB 00:00 2024-09-18T12:40:06.629 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:06.632 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:06.632 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:06.650 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:06.650 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:06.739 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:06.752 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:06.849 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:06.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librados2 2024-09-18T12:40:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:07.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:07.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:07.460 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:07.460 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:07.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:07.460 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:07.538 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:07.628 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:07.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados2 2024-09-18T12:40:07.671 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:07.672 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:07.672 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:07.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librbd1 2024-09-18T12:40:08.227 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:08.315 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:08.318 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:08.357 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:08.358 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:08.358 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:08.407 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:08.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librbd1 2024-09-18T12:40:08.449 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:08.450 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:08.451 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:08.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rados 2024-09-18T12:40:09.001 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:09.089 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:09.108 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:09.196 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:09.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rados 2024-09-18T12:40:09.240 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:09.241 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:09.241 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:09.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rgw 2024-09-18T12:40:09.776 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:09.864 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:09.909 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:09.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rgw 2024-09-18T12:40:09.999 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:10.041 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:10.042 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:10.042 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:10.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-cephfs 2024-09-18T12:40:10.551 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:10.639 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:10.681 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:10.682 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:10.682 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:10.697 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:10.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-cephfs 2024-09-18T12:40:10.787 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:10.830 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:10.830 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:10.831 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:10.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rbd 2024-09-18T12:40:11.335 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:11.424 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:11.466 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:11.467 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:11.467 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:11.479 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:11.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rbd 2024-09-18T12:40:11.569 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:11.612 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:11.613 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-18T12:40:11.613 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:11.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-fuse 2024-09-18T12:40:12.112 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:12.201 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-18T12:40:12.243 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:12.244 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T12:40:12.244 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:12.257 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:12.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-fuse 2024-09-18T12:40:12.390 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:12.392 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:40:12.392 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:12.392 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 86 k 2024-09-18T12:40:12.392 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 226 k 2024-09-18T12:40:12.392 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:12.477 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-09-18T12:40:12.478 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:12.478 INFO:teuthology.orchestra.run.smithi136.stdout:Total 993 kB/s | 86 kB 00:00 2024-09-18T12:40:12.478 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:12.485 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:12.485 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:12.548 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:12.548 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:12.689 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:12.799 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:12.901 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:13.033 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:40:13.034 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:13.035 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 86 k 2024-09-18T12:40:13.035 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 226 k 2024-09-18T12:40:13.035 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:13.081 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.8 MB/s | 86 kB 00:00 2024-09-18T12:40:13.082 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:13.082 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.8 MB/s | 86 kB 00:00 2024-09-18T12:40:13.082 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:13.089 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:13.089 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:13.151 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:13.151 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:13.176 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:13.292 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:13.394 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:13.427 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:13.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-mirror 2024-09-18T12:40:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:14.006 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:14.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-mirror 2024-09-18T12:40:14.289 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:14.427 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:14.428 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 3.0 M 2024-09-18T12:40:14.429 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 12 M 2024-09-18T12:40:14.429 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:14.556 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 23 MB/s | 3.0 MB 00:00 2024-09-18T12:40:14.557 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:14.557 INFO:teuthology.orchestra.run.smithi136.stdout:Total 23 MB/s | 3.0 MB 00:00 2024-09-18T12:40:14.558 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:14.566 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:14.566 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:14.645 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:14.645 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:14.925 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:14.925 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 3.0 M 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 12 M 2024-09-18T12:40:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:15.019 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 32 MB/s | 3.0 MB 00:00 2024-09-18T12:40:15.019 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:15.020 INFO:teuthology.orchestra.run.smithi081.stdout:Total 32 MB/s | 3.0 MB 00:00 2024-09-18T12:40:15.020 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:15.029 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:15.029 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:15.062 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:15.108 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:15.108 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:15.140 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:15.140 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:40:15.140 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:40:15.140 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:40:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:15.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:40:15.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:16.163 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:16.164 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:16.164 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:16.164 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:16.164 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:16.164 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:16.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-nbd 2024-09-18T12:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:16.744 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:16.744 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:17.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-nbd 2024-09-18T12:40:17.014 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:38:42 PM UTC. 2024-09-18T12:40:17.148 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-18T12:40:17.148 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:17.148 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 171 k 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 494 k 2024-09-18T12:40:17.149 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-18T12:40:17.219 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.4 MB/s | 171 kB 00:00 2024-09-18T12:40:17.220 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:17.220 INFO:teuthology.orchestra.run.smithi136.stdout:Total 2.3 MB/s | 171 kB 00:00 2024-09-18T12:40:17.220 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-18T12:40:17.227 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-18T12:40:17.228 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-18T12:40:17.290 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-18T12:40:17.290 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-18T12:40:17.452 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-18T12:40:17.549 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:17.598 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:38:39 PM UTC. 2024-09-18T12:40:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T12:40:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 171 k 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 494 k 2024-09-18T12:40:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T12:40:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 3.1 MB/s | 171 kB 00:00 2024-09-18T12:40:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:Total 3.0 MB/s | 171 kB 00:00 2024-09-18T12:40:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T12:40:17.799 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T12:40:17.799 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T12:40:17.861 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T12:40:17.862 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T12:40:17.984 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T12:40:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:18.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:18.222 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:18.222 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-18T12:40:18.222 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:18.222 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:40:18.222 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-18T12:40:18.467 DEBUG:teuthology.parallel:result is None 2024-09-18T12:40:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:18.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-18T12:40:18.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:18.784 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T12:40:18.784 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-09-18T12:40:18.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:18.785 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T12:40:19.056 DEBUG:teuthology.parallel:result is None 2024-09-18T12:40:19.057 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:40:19.057 INFO:teuthology.packaging:ref: None 2024-09-18T12:40:19.057 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:40:19.057 INFO:teuthology.packaging:branch: None 2024-09-18T12:40:19.057 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:40:19.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-18T12:40:19.208 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:40:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.1-0.el9 2024-09-18T12:40:19.231 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-09-18T12:40:19.232 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-09-18T12:40:19.233 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-18T12:40:19.234 INFO:teuthology.packaging:ref: None 2024-09-18T12:40:19.234 INFO:teuthology.packaging:tag: v18.2.1 2024-09-18T12:40:19.234 INFO:teuthology.packaging:branch: None 2024-09-18T12:40:19.234 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:40:19.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-18T12:40:19.375 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:40:19.399 INFO:teuthology.orchestra.run.smithi136.stdout:18.2.1-0.el9 2024-09-18T12:40:19.399 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-09-18T12:40:19.399 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-09-18T12:40:19.402 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:40:19.402 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:40:19.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:40:19.429 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:40:19.430 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:40:19.468 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:40:19.468 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:40:19.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:40:19.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:40:19.561 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:40:19.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:40:19.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:40:19.656 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:40:19.656 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:40:19.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:40:19.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:40:19.747 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:40:19.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:40:19.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:40:19.839 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:40:19.840 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:40:19.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:40:19.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:40:19.930 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:40:19.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:40:19.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:40:20.021 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:40:20.033 INFO:teuthology.task.print:**** done install task... 2024-09-18T12:40:20.033 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-18T12:40:20.133 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.io/ceph/ceph:v18.2.1', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:40:20.133 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.1 2024-09-18T12:40:20.133 INFO:tasks.cephadm:Cluster fsid is 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:20.133 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-18T12:40:20.133 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-18T12:40:20.134 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi081': '172.21.15.81', 'mon.smithi136': '172.21.15.136'} 2024-09-18T12:40:20.134 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-18T12:40:20.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-18T12:40:20.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-09-18T12:40:20.184 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-18T12:40:20.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:40:20.340 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83115/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4983-ge7fb7b56', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4983.ge7fb7b56'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-17 17:21:57.325397', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-17-1213', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-18T12:40:20.625 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-18T12:40:20.628 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:40:20.628 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:40:20.628 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.142 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 18 12:40 /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.143 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.639 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 18 12:40 /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.640 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.659 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:40:21.692 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.1 on all hosts... 2024-09-18T12:40:21.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-09-18T12:40:21.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-09-18T12:40:23.282 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-18T12:40:23.340 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-18T12:40:37.610 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T12:40:37.611 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:40:38.103 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-09-18T12:40:38.104 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-18T12:40:38.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-18T12:40:38.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-09-18T12:40:38.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-18T12:40:38.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-09-18T12:40:38.246 INFO:tasks.cephadm:Writing seed config... 2024-09-18T12:40:38.247 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-18T12:40:38.247 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-18T12:40:38.247 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-18T12:40:38.247 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-18T12:40:38.248 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-18T12:40:38.249 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-18T12:40:38.250 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:40:38.250 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-18T12:40:38.272 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2a553466-75bb-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-18T12:40:38.273 DEBUG:teuthology.orchestra.run.smithi081:mon.smithi081> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service 2024-09-18T12:40:38.315 INFO:tasks.cephadm:Bootstrapping... 2024-09-18T12:40:38.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 -v bootstrap --fsid 2a553466-75bb-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:40:38.467 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:38.467 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.1', '-v', 'bootstrap', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-09-18T12:40:38.491 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:40:38.492 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-18T12:40:38.492 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-09-18T12:40:38.524 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:40:38.525 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-09-18T12:40:38.525 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-09-18T12:40:38.532 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:40:38.533 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:40:38.539 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:40:38.539 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:40:38.545 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-18T12:40:38.552 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-18T12:40:38.552 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:40:38.552 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-09-18T12:40:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:40:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-18T12:40:38.584 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-09-18T12:40:38.584 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-09-18T12:40:38.590 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:40:38.590 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:40:38.596 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:40:38.596 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:40:38.603 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-18T12:40:38.609 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-18T12:40:38.609 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140179573011792 on /run/cephadm/2a553466-75bb-11ef-bceb-c7b262605968.lock 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140179573011792 acquired on /run/cephadm/2a553466-75bb-11ef-bceb-c7b262605968.lock 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-09-18T12:40:38.610 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-09-18T12:40:38.611 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-18T12:40:38.613 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-09-18T12:40:38.614 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-09-18T12:40:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-18T12:40:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-18T12:40:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-18T12:40:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:40:38.620 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-18T12:40:38.620 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-18T12:40:38.620 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-18T12:40:38.620 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-18T12:40:38.621 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.1... 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:a733d3c618b71f19c168ebecd1953429dce2c1631835ca182e9551c36dce5989 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-09-18T12:40:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-09-18T12:40:41.247 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-18T12:40:50.681 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-09-18T12:40:50.681 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-09-18T12:40:50.681 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-09-18T12:40:51.695 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-09-18T12:40:51.695 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-09-18T12:40:52.617 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBUyupmCO6zABAAv89KSF0oKFSzSvGtHJ2Dxg== 2024-09-18T12:40:53.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBUyupmDTLCNxAAy1LfxPG9mAB4g0NybNA1VA== 2024-09-18T12:40:54.530 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBVyupmm0ayNxAASeugLLYippH5HSZJWaspPg== 2024-09-18T12:40:54.530 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for smithi081 [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:55.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:40:55.562 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:40:55.562 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-09-18T12:40:56.889 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.smithi081 on 2024-09-18T12:40:57.110 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-18T12:40:57.247 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-18T12:40:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target. 2024-09-18T12:40:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target. 2024-09-18T12:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081 2024-09-18T12:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service: Unit ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service not loaded. 2024-09-18T12:40:57.819 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target.wants/ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service → /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968@.service. 2024-09-18T12:40:58.313 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:58 smithi081 podman[27262]: 2024-09-18 12:40:58.268836022 +0000 UTC m=+0.330721418 container start 115a0de413ec9d5f2c9b0cf65eac603e5ea239f34a0ca9f53e93378271efdab4 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_CLEAN=True) 2024-09-18T12:40:58.313 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:58 smithi081 ceph-mon[27280]: mkfs 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:58.363 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:40:58.363 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-18T12:40:58.370 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:40:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:40:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-18T12:40:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:40:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-09-18T12:40:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-09-18T12:40:58.605 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:58 smithi081 ceph-mon[27280]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-09-18T12:40:58.605 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:58 smithi081 bash[27262]: 115a0de413ec9d5f2c9b0cf65eac603e5ea239f34a0ca9f53e93378271efdab4 2024-09-18T12:40:58.605 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:58 smithi081 systemd[1]: Started Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: monmap e1: 1 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: fsmap 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: mgrmap e1: no daemons active 2024-09-18T12:40:59.482 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:40:59 smithi081 ceph-mon[27280]: from='client.? 172.21.15.81:0/1583104202' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-18T12:40:59.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi081 (age 0.594471s) 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-18T12:40:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-18T12:40:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-18T12:40:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-09-18T12:40:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-09-18T12:40:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-09-18T12:41:00.571 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:00 smithi081 ceph-mon[27280]: from='client.? 172.21.15.81:0/2162453267' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:41:00.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:00 smithi081 ceph-mon[27280]: from='client.? 172.21.15.81:0/2162453267' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-18T12:41:00.575 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:41:00.576 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:41:00.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:41:00.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:41:00.578 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-09-18T12:41:01.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:01 smithi081 ceph-mon[27280]: from='client.? 172.21.15.81:0/2870825762' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:01.832 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-09-18T12:41:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:01 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:41:02.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[27276]: 2024-09-18T12:41:02.154+0000 7f6cd2406700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:41:02.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[27276]: 2024-09-18T12:41:02.154+0000 7f6cd2406700 -1 mon.smithi081@0(leader) e1 *** Got Signal Terminated *** 2024-09-18T12:41:02.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 podman[27525]: 2024-09-18 12:41:02.340330807 +0000 UTC m=+0.344191192 container died 115a0de413ec9d5f2c9b0cf65eac603e5ea239f34a0ca9f53e93378271efdab4 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD) 2024-09-18T12:41:02.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 podman[27525]: 2024-09-18 12:41:02.705975937 +0000 UTC m=+0.709836322 container cleanup 115a0de413ec9d5f2c9b0cf65eac603e5ea239f34a0ca9f53e93378271efdab4 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-09-18T12:41:02.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 bash[27525]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081 2024-09-18T12:41:03.283 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:02 smithi081 podman[27539]: 2024-09-18 12:41:02.948688352 +0000 UTC m=+0.604932490 container remove 115a0de413ec9d5f2c9b0cf65eac603e5ea239f34a0ca9f53e93378271efdab4 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD) 2024-09-18T12:41:03.283 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service: Deactivated successfully. 2024-09-18T12:41:03.283 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 systemd[1]: Stopped Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:41:03.283 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 systemd[1]: Starting Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:41:03.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 podman[27627]: 2024-09-18 12:41:03.185915672 +0000 UTC m=+0.016113711 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph:v18.2.1 2024-09-18T12:41:03.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 podman[27627]: 2024-09-18 12:41:03.324361751 +0000 UTC m=+0.154559816 container create 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-09-18T12:41:03.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 podman[27627]: 2024-09-18 12:41:03.585079473 +0000 UTC m=+0.415277506 container init 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True) 2024-09-18T12:41:03.673 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 podman[27627]: 2024-09-18 12:41:03.588079069 +0000 UTC m=+0.418277101 container start 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.29.1) 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: pidfile_write: ignore empty --pid-file 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: load: jerasure load: lrc 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:41:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Git sha 0 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Compile date 2023-12-11 22:07:34 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: DB SUMMARY 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: DB Session ID: SIDQVBNNJ12DV3LOZWZS 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi081/store.db dir, Total Num: 1, files: 000008.sst 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi081/store.db: 000009.log size: 90980 ; 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:41:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.env: 0x55795dd09720 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.info_log: 0x55795f3f72e0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.statistics: (nil) 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.use_fsync: 0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:41:03.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:41:03.860 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:41:03.861 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:41:03.861 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:41:03.861 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:41:03.861 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.db_log_dir: 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.wal_dir: 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:41:03.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.write_buffer_manager: 0x55795e686320 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:41:03.863 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.unordered_write: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.row_cache: None 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.wal_filter: None 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.wal_compression: 0 2024-09-18T12:41:03.864 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:41:03.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:41:03.866 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_open_files: -1 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Compression algorithms supported: 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kZSTD supported: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:41:03.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000010 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.merge_operator: 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_filter: None 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:41:03.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55795f3f73e0) 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_type: 0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_index_type: 0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_shortening: 1 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: checksum: 4 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: no_block_cache: 0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache: 0x55795e7091f0 2024-09-18T12:41:03.869 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_options: 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: capacity : 536870912 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_shard_bits : 4 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: strict_capacity_limit : 0 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_compressed: (nil) 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: persistent_cache: (nil) 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size: 4096 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size_deviation: 10 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_restart_interval: 16 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_block_restart_interval: 1 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_block_size: 4096 2024-09-18T12:41:03.870 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: partition_filters: 0 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: use_delta_encoding: 1 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: filter_policy: bloomfilter 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: whole_key_filtering: 1 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: verify_compression: 0 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: format_version: 5 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_index_compression: 1 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_align: 0 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_auto_readahead_size: 262144 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: prepopulate_block_cache: 0 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:41:03.871 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression: NoCompression 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.num_levels: 7 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:41:03.872 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:41:03.873 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:41:03.874 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:41:03.875 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:41:03.876 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.table_properties_collectors: 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:41:03.877 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:41:03.879 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:41:03.879 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.ttl: 2592000 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:41:03.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 86123a14-373b-48b6-8ac1-b54956fa44c4 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663263617119, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663263618080, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 86989, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 85070, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11738, "raw_average_key_size": 48, "raw_value_size": 78540, "raw_average_value_size": 325, "num_data_blocks": 11, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726663263, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "86123a14-373b-48b6-8ac1-b54956fa44c4", "db_session_id": "SIDQVBNNJ12DV3LOZWZS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:41:03.881 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663263618161, "job": 1, "event": "recovery_finished"} 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi081/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55795e7a6000 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: DB pointer 0x55795e792000 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** DB Stats ** 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:41:03.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L0 2/0 86.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Sum 2/0 86.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:41:03.883 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative compaction: 0.00 GB write, 28.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval compaction: 0.00 GB write, 28.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache BinnedLRUCache@0x55795e7091f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-18T12:41:03.884 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: starting mon.smithi081 rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi081 fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???) e1 preinit fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).mds e1 new map 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).mds e1 print_map 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: e1 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: legacy client fscid: -1 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: No filesystems configured 2024-09-18T12:41:03.885 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 bash[27627]: 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 systemd[1]: Started Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: monmap e1: 1 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: fsmap 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:41:03.886 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:03 smithi081 ceph-mon[27646]: mgrmap e1: no daemons active 2024-09-18T12:41:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-18T12:41:04.749 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:41:04.750 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-09-18T12:41:04.750 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-18T12:41:04.750 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-18T12:41:04.751 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-18T12:41:04.999 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2a553466-75bb-11ef-bceb-c7b262605968@mgr.smithi081.pfnvgp 2024-09-18T12:41:04.999 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2a553466-75bb-11ef-bceb-c7b262605968@mgr.smithi081.pfnvgp.service: Unit ceph-2a553466-75bb-11ef-bceb-c7b262605968@mgr.smithi081.pfnvgp.service not loaded. 2024-09-18T12:41:05.142 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968.target.wants/ceph-2a553466-75bb-11ef-bceb-c7b262605968@mgr.smithi081.pfnvgp.service → /etc/systemd/system/ceph-2a553466-75bb-11ef-bceb-c7b262605968@.service. 2024-09-18T12:41:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:05 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/709367309' entity='client.admin' 2024-09-18T12:41:05.685 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:41:05.686 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-18T12:41:05.693 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:41:05.693 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:41:05.693 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-18T12:41:05.693 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:41:05.701 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:41:05.701 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-09-18T12:41:05.709 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-09-18T12:41:07.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:07 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3256418635' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:41:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "2a553466-75bb-11ef-bceb-c7b262605968", 2024-09-18T12:41:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:41:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:40:58.311066+0000", 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-09-18T12:41:10.655 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:10 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3672744083' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "2a553466-75bb-11ef-bceb-c7b262605968", 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:41:10.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:41:10.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:41:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T12:41:10.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:40:58.311066+0000", 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:10.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:41:10.975 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:10.975 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-09-18T12:41:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:41:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: mgrmap e2: smithi081.pfnvgp(active, starting, since 0.00284679s) 2024-09-18T12:41:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:41:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:41:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:12.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:12 smithi081 ceph-mon[27646]: from='mgr.14100 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "2a553466-75bb-11ef-bceb-c7b262605968", 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:41:14.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-18T12:41:14.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:41:14.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:41:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:41:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:41:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:40:58.311066+0000", 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:41:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:41:14.290 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:14.290 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-09-18T12:41:14.393 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:14 smithi081 ceph-mon[27646]: mgrmap e3: smithi081.pfnvgp(active, since 1.00665s) 2024-09-18T12:41:14.393 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:14 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/797042964' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:41:15.438 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:41:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:41:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:41:15.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:41:15.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:41:15.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:15.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:41:15.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:41:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:41:15.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:41:15.442 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-09-18T12:41:15.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:15 smithi081 ceph-mon[27646]: mgrmap e4: smithi081.pfnvgp(active, since 2s) 2024-09-18T12:41:15.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4045861800' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:41:16.882 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:16 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1111906616' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-18T12:41:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:17 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1111906616' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-18T12:41:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:17 smithi081 ceph-mon[27646]: mgrmap e5: smithi081.pfnvgp(active, since 4s) 2024-09-18T12:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "smithi081.pfnvgp", 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-18T12:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-09-18T12:41:18.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:18 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/535415704' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:41:23.516 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: osdmap e2: 0 total, 0 up, 0 in 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: mgrmap e6: smithi081.pfnvgp(active, starting, since 0.00387424s) 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:23.517 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:23.518 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:23.518 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:23.518 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:23.518 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:41:23.518 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:23 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:41:24.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:24 smithi081 ceph-mon[27646]: Found migration_current of "None". Setting to last migration. 2024-09-18T12:41:24.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:24 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:24.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:24 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:24.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:24 smithi081 ceph-mon[27646]: mgrmap e7: smithi081.pfnvgp(active, since 1.0057s) 2024-09-18T12:41:24.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:24 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:24.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:24.850 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-18T12:41:24.850 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:41:24.850 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:24.850 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-09-18T12:41:24.850 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:24] ENGINE Bus STARTING 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:24] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:24] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:24] ENGINE Bus STARTED 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:25.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:25 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:26.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:26 smithi081 ceph-mon[27646]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:26.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:26 smithi081 ceph-mon[27646]: mgrmap e8: smithi081.pfnvgp(active, since 2s) 2024-09-18T12:41:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-18T12:41:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-09-18T12:41:28.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:27 smithi081 ceph-mon[27646]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:29.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:29 smithi081 ceph-mon[27646]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:29.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:29 smithi081 ceph-mon[27646]: Generating ssh key... 2024-09-18T12:41:29.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:29 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:29.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:29 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:30.059 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBROZBupVSJAKtW4m7xKo7BqHCmMrcHEvA4NH5cfEUz1LKJWLgFICz/2DN6LWOoWuXro+pnRQF8UFI0K07c+cLUcI95q6857u0+ith3AvhHgWdeSuqECZc1wJguEBf0eYE3Ug/PwYjEU1KcSf8lF8/o+hi5nVSgGfy/6Q6Dx8DPrMjJueE6MIIycB8NOLjQVbNdX6uQvBaWoxFo/urLeqk2cHNcRw6cZ/+suNg1PyEpvQqJ+gNZcOreJSMgQe1tsePHda7EQeBaCjSJAfgV6Tpe2kmze3oryecYQb4ej0SopYb/D8o1spqWOlXJcu4H6IoW+WUPH3IUxcGgiMNaIG5OKmBPcpm1I9mxtB50G4hKS9YgaRjfGNPLv9E7UajgV7Oh1kJoPRZ4Wsm5id6WJUQrevWIEZekUeYrmbpzZfLbmJXAwwduys61kE9HzpZOsLpPNF31bKKOJRvSqF/Rfv9XGiuWEMlqwxJRagwJAH/Cl4Uz20buZYVGn//VxRo1gU= ceph-2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:30.059 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-18T12:41:30.059 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-09-18T12:41:30.065 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-09-18T12:41:30.306 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:30 smithi081 ceph-mon[27646]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:31 smithi081 ceph-mon[27646]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:31 smithi081 ceph-mon[27646]: Deploying cephadm binary to smithi081 2024-09-18T12:41:33.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-09-18T12:41:33.735 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying mon service with default placement... 2024-09-18T12:41:34.335 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:34 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:34.336 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:34 smithi081 ceph-mon[27646]: Added host smithi081 2024-09-18T12:41:34.336 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:34 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:35.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-18T12:41:35.044 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying mgr service with default placement... 2024-09-18T12:41:35.645 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:35 smithi081 ceph-mon[27646]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:35.645 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:35 smithi081 ceph-mon[27646]: Saving service mon spec with placement count:5 2024-09-18T12:41:35.645 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:35 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:36.994 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:36 smithi081 ceph-mon[27646]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:36.994 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:36 smithi081 ceph-mon[27646]: Saving service mgr spec with placement count:2 2024-09-18T12:41:36.994 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:36 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:36.994 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:36 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:36.994 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:36 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:36.996 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-18T12:41:36.996 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying crash service with default placement... 2024-09-18T12:41:38.821 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:38 smithi081 ceph-mon[27646]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:38.821 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:38 smithi081 ceph-mon[27646]: Saving service crash spec with placement * 2024-09-18T12:41:38.821 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:38 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:38.821 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:38 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:38.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-18T12:41:38.823 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying ceph-exporter service with default placement... 2024-09-18T12:41:40.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-18T12:41:40.130 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying prometheus service with default placement... 2024-09-18T12:41:40.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:40 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:40.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:40 smithi081 ceph-mon[27646]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:40.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:40 smithi081 ceph-mon[27646]: Saving service ceph-exporter spec with placement * 2024-09-18T12:41:40.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:40 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:42.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:41 smithi081 ceph-mon[27646]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:41 smithi081 ceph-mon[27646]: Saving service prometheus spec with placement count:1 2024-09-18T12:41:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:41 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:42.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-18T12:41:42.252 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying grafana service with default placement... 2024-09-18T12:41:43.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-18T12:41:43.424 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying node-exporter service with default placement... 2024-09-18T12:41:44.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:43 smithi081 ceph-mon[27646]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:44.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:43 smithi081 ceph-mon[27646]: Saving service grafana spec with placement count:1 2024-09-18T12:41:44.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:43 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:44.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:43 smithi081 ceph-mon[27646]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:44.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-18T12:41:44.606 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying alertmanager service with default placement... 2024-09-18T12:41:45.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:45 smithi081 ceph-mon[27646]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:45 smithi081 ceph-mon[27646]: Saving service node-exporter spec with placement * 2024-09-18T12:41:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:45 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:45.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-18T12:41:46.425 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:46 smithi081 ceph-mon[27646]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:46.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:46 smithi081 ceph-mon[27646]: Saving service alertmanager spec with placement count:1 2024-09-18T12:41:46.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:46 smithi081 ceph-mon[27646]: from='mgr.14118 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:46.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:46 smithi081 ceph-mon[27646]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:47.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:47 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4117444677' entity='client.admin' 2024-09-18T12:41:48.200 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-09-18T12:41:48.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:48 smithi081 ceph-mon[27646]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:48 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1054742963' entity='client.admin' 2024-09-18T12:41:49.898 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:49 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3320127322' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-18T12:41:50.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:50 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3320127322' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-18T12:41:50.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:50 smithi081 ceph-mon[27646]: mgrmap e9: smithi081.pfnvgp(active, since 26s) 2024-09-18T12:41:51.581 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:51.581 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-18T12:41:51.581 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:41:51.581 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "smithi081.pfnvgp", 2024-09-18T12:41:51.581 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:41:51.582 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:51.582 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-18T12:41:51.582 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-09-18T12:41:51.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:51 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4154054759' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: osdmap e3: 0 total, 0 up, 0 in 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: mgrmap e10: smithi081.pfnvgp(active, starting, since 0.00362995s) 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:41:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:41:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:41:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:41:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:56 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:41:58.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:41:58.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-18T12:41:58.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:41:58.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:41:58.234 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-09-18T12:41:58.234 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-09-18T12:41:58.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:57] ENGINE Bus STARTING 2024-09-18T12:41:58.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:57] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:41:58.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:57] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:41:58.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: [18/Sep/2024:12:41:57] ENGINE Bus STARTED 2024-09-18T12:41:58.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T12:41:58.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: mgrmap e11: smithi081.pfnvgp(active, since 1.00506s) 2024-09-18T12:41:58.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:58 smithi081 ceph-mon[27646]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T12:41:59.720 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:59 smithi081 ceph-mon[27646]: mgrmap e12: smithi081.pfnvgp(active, since 2s) 2024-09-18T12:41:59.720 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:59 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:59.721 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:59 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:59.721 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:41:59 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:41:59.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-09-18T12:42:00.729 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:00 smithi081 ceph-mon[27646]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:00.730 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:00 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:01.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$NPf0F666ovgZtxivv01HzOIiIYruWmvJGfrK1iV52c6ZbsszU/B0C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726663320, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-18T12:42:01.212 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-09-18T12:42:01.797 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:01 smithi081 ceph-mon[27646]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:01.798 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:01 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:02.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:02 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4292012651' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-18T12:42:02.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-09-18T12:42:02.875 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:42:02.875 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-18T12:42:02.882 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:42:02.882 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-18T12:42:02.882 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-18T12:42:02.882 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-18T12:42:02.884 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-09-18T12:42:02.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:02.884 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-09-18T12:42:02.884 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-09-18T12:42:02.884 INFO:teuthology.orchestra.run.smithi081.stdout: Password: zbixb222yq 2024-09-18T12:42:02.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:02.885 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config directory 2024-09-18T12:42:02.885 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling autotune for osd_memory_target 2024-09-18T12:42:03.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:03 smithi081 ceph-mon[27646]: mgrmap e13: smithi081.pfnvgp(active, since 6s) 2024-09-18T12:42:05.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-18T12:42:05.898 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-18T12:42:05.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.898 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:05.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:05.899 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-09-18T12:42:05.933 INFO:tasks.cephadm:Fetching config... 2024-09-18T12:42:05.933 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:42:05.934 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-18T12:42:05.951 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-18T12:42:05.951 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:42:05.951 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-18T12:42:06.006 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-18T12:42:06.006 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:42:06.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/keyring of=/dev/stdout 2024-09-18T12:42:06.071 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-18T12:42:06.071 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:42:06.071 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-18T12:42:06.128 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-18T12:42:06.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBROZBupVSJAKtW4m7xKo7BqHCmMrcHEvA4NH5cfEUz1LKJWLgFICz/2DN6LWOoWuXro+pnRQF8UFI0K07c+cLUcI95q6857u0+ith3AvhHgWdeSuqECZc1wJguEBf0eYE3Ug/PwYjEU1KcSf8lF8/o+hi5nVSgGfy/6Q6Dx8DPrMjJueE6MIIycB8NOLjQVbNdX6uQvBaWoxFo/urLeqk2cHNcRw6cZ/+suNg1PyEpvQqJ+gNZcOreJSMgQe1tsePHda7EQeBaCjSJAfgV6Tpe2kmze3oryecYQb4ej0SopYb/D8o1spqWOlXJcu4H6IoW+WUPH3IUxcGgiMNaIG5OKmBPcpm1I9mxtB50G4hKS9YgaRjfGNPLv9E7UajgV7Oh1kJoPRZ4Wsm5id6WJUQrevWIEZekUeYrmbpzZfLbmJXAwwduys61kE9HzpZOsLpPNF31bKKOJRvSqF/Rfv9XGiuWEMlqwxJRagwJAH/Cl4Uz20buZYVGn//VxRo1gU= ceph-2a553466-75bb-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:42:06.202 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBROZBupVSJAKtW4m7xKo7BqHCmMrcHEvA4NH5cfEUz1LKJWLgFICz/2DN6LWOoWuXro+pnRQF8UFI0K07c+cLUcI95q6857u0+ith3AvhHgWdeSuqECZc1wJguEBf0eYE3Ug/PwYjEU1KcSf8lF8/o+hi5nVSgGfy/6Q6Dx8DPrMjJueE6MIIycB8NOLjQVbNdX6uQvBaWoxFo/urLeqk2cHNcRw6cZ/+suNg1PyEpvQqJ+gNZcOreJSMgQe1tsePHda7EQeBaCjSJAfgV6Tpe2kmze3oryecYQb4ej0SopYb/D8o1spqWOlXJcu4H6IoW+WUPH3IUxcGgiMNaIG5OKmBPcpm1I9mxtB50G4hKS9YgaRjfGNPLv9E7UajgV7Oh1kJoPRZ4Wsm5id6WJUQrevWIEZekUeYrmbpzZfLbmJXAwwduys61kE9HzpZOsLpPNF31bKKOJRvSqF/Rfv9XGiuWEMlqwxJRagwJAH/Cl4Uz20buZYVGn//VxRo1gU= ceph-2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:06.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBROZBupVSJAKtW4m7xKo7BqHCmMrcHEvA4NH5cfEUz1LKJWLgFICz/2DN6LWOoWuXro+pnRQF8UFI0K07c+cLUcI95q6857u0+ith3AvhHgWdeSuqECZc1wJguEBf0eYE3Ug/PwYjEU1KcSf8lF8/o+hi5nVSgGfy/6Q6Dx8DPrMjJueE6MIIycB8NOLjQVbNdX6uQvBaWoxFo/urLeqk2cHNcRw6cZ/+suNg1PyEpvQqJ+gNZcOreJSMgQe1tsePHda7EQeBaCjSJAfgV6Tpe2kmze3oryecYQb4ej0SopYb/D8o1spqWOlXJcu4H6IoW+WUPH3IUxcGgiMNaIG5OKmBPcpm1I9mxtB50G4hKS9YgaRjfGNPLv9E7UajgV7Oh1kJoPRZ4Wsm5id6WJUQrevWIEZekUeYrmbpzZfLbmJXAwwduys61kE9HzpZOsLpPNF31bKKOJRvSqF/Rfv9XGiuWEMlqwxJRagwJAH/Cl4Uz20buZYVGn//VxRo1gU= ceph-2a553466-75bb-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:42:06.341 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBROZBupVSJAKtW4m7xKo7BqHCmMrcHEvA4NH5cfEUz1LKJWLgFICz/2DN6LWOoWuXro+pnRQF8UFI0K07c+cLUcI95q6857u0+ith3AvhHgWdeSuqECZc1wJguEBf0eYE3Ug/PwYjEU1KcSf8lF8/o+hi5nVSgGfy/6Q6Dx8DPrMjJueE6MIIycB8NOLjQVbNdX6uQvBaWoxFo/urLeqk2cHNcRw6cZ/+suNg1PyEpvQqJ+gNZcOreJSMgQe1tsePHda7EQeBaCjSJAfgV6Tpe2kmze3oryecYQb4ej0SopYb/D8o1spqWOlXJcu4H6IoW+WUPH3IUxcGgiMNaIG5OKmBPcpm1I9mxtB50G4hKS9YgaRjfGNPLv9E7UajgV7Oh1kJoPRZ4Wsm5id6WJUQrevWIEZekUeYrmbpzZfLbmJXAwwduys61kE9HzpZOsLpPNF31bKKOJRvSqF/Rfv9XGiuWEMlqwxJRagwJAH/Cl4Uz20buZYVGn//VxRo1gU= ceph-2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:06.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-18T12:42:06.449 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:06 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3050898102' entity='client.admin' 2024-09-18T12:42:06.553 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:42:09.717 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-18T12:42:09.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-18T12:42:10.299 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:10 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2137255068' entity='client.admin' 2024-09-18T12:42:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:42:11.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:11.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:11.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:42:11.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:11.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:42:11.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:42:11.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:11.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:11 smithi081 ceph-mon[27646]: Deploying daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:42:13.943 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-09-18T12:42:13.943 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:42:13.943 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-09-18T12:42:13.963 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:42:13.963 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:14.020 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-09-18T12:42:14.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch host add smithi136 2024-09-18T12:42:14.225 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:14.389 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:14.390 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:42:14.390 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:42:14.390 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:14 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:15.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:15 smithi081 ceph-mon[27646]: Deploying daemon crash.smithi081 on smithi081 2024-09-18T12:42:17.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:17 smithi081 ceph-mon[27646]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:17.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:17 smithi081 ceph-mon[27646]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:17.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:17 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:18.601 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-09-18T12:42:18.688 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:18 smithi081 ceph-mon[27646]: Deploying cephadm binary to smithi136 2024-09-18T12:42:18.688 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:18 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:18.688 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:18 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:18.689 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:18 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:18.689 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:18 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:19.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-18T12:42:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:42:19.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:19 smithi081 ceph-mon[27646]: Deploying daemon node-exporter.smithi081 on smithi081 2024-09-18T12:42:19.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:19 smithi081 ceph-mon[27646]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:19.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:19 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:19.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:19 smithi081 ceph-mon[27646]: Added host smithi136 2024-09-18T12:42:21.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:21 smithi081 ceph-mon[27646]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:21.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:21 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-09-18T12:42:23.092 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-18T12:42:23.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-18T12:42:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:23.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:23 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:24.738 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:24 smithi081 ceph-mon[27646]: Deploying daemon alertmanager.smithi081 on smithi081 2024-09-18T12:42:25.661 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-18T12:42:26.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:25 smithi081 ceph-mon[27646]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:26.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:25 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1661796193' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T12:42:26.977 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:26 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1661796193' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T12:42:26.977 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:26 smithi081 ceph-mon[27646]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T12:42:26.977 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:26 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:26.996 INFO:tasks.cephadm:Adding mon.smithi081 on smithi081 2024-09-18T12:42:26.996 INFO:tasks.cephadm:Adding mon.smithi136 on smithi136 2024-09-18T12:42:26.996 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136' 2024-09-18T12:42:27.194 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:27.238 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:28.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:27 smithi081 ceph-mon[27646]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:28.949 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mon update... 2024-09-18T12:42:29.523 DEBUG:teuthology.orchestra.run.smithi136:mon.smithi136> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi136.service 2024-09-18T12:42:29.526 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:29.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:29.770 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:29.815 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:29.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:29 smithi081 ceph-mon[27646]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:29.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:29 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:31.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:30 smithi081 ceph-mon[27646]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:31.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:30 smithi081 ceph-mon[27646]: Saving service mon spec with placement smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136;count:2 2024-09-18T12:42:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:31.454 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:31.455 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:31.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:31 smithi081 ceph-mon[27646]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:31.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:31 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3247026111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:33.002 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:33.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:33.198 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:33.244 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-18T12:42:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:33.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:33 smithi081 ceph-mon[27646]: Deploying daemon grafana.smithi081 on smithi081 2024-09-18T12:42:34.982 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:34.982 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:34.984 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:35.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:35 smithi081 ceph-mon[27646]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:35.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:35 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1441306721' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:36.564 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:36.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:36.753 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:36.798 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:37.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:37 smithi081 ceph-mon[27646]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:37.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:37 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:38.500 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:38.500 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:38.502 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:39.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:39 smithi081 ceph-mon[27646]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:39 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3285026789' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:40.228 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:40.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:40.424 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:40.479 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:41.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:41 smithi081 ceph-mon[27646]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:42.164 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:42.164 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:42.166 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:42.815 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3219340202' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:43.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:43.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:43.738 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:43 smithi081 ceph-mon[27646]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:43.908 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:43.952 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:45.620 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:45.620 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:45.622 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:45 smithi081 ceph-mon[27646]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:45 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1588649817' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.017 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.018 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.018 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:46 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:47.189 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:47.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:47.386 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:47.430 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:48.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:47 smithi081 ceph-mon[27646]: Deploying daemon prometheus.smithi081 on smithi081 2024-09-18T12:42:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:47 smithi081 ceph-mon[27646]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:49.019 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:49.019 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:49.021 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:50.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:49 smithi081 ceph-mon[27646]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:49 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/2317274454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:50.611 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:50.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:50.810 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:50.854 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:52.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:51 smithi081 ceph-mon[27646]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:52.524 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:52.525 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:52.527 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:53.008 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:52 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1186068685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:53.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:53 smithi081 ceph-mon[27646]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:54.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:54.055 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:54.251 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:54.295 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:55.812 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:55.812 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:55.815 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:42:55.934 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:55 smithi081 ceph-mon[27646]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:56 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1117318041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:57.392 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:57.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:57.588 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:57.632 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:42:57.997 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:57 smithi081 ceph-mon[27646]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:57.997 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:57 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:57.997 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:57 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:57.997 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:57 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:42:57.998 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:57 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T12:42:59.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:58 smithi081 ceph-mon[27646]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T12:42:59.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:58 smithi081 ceph-mon[27646]: mgrmap e14: smithi081.pfnvgp(active, since 61s) 2024-09-18T12:42:59.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:42:59.405 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:59.408 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:42:59 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/578590688' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:00.986 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:00.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:01.185 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:01.229 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:02.837 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:02.837 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:02.839 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:03.058 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:02 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/791734356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:04.389 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:04.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:04.589 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:04.634 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: mgrmap e15: smithi081.pfnvgp(active, starting, since 0.00318668s) 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:43:04.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:43:04.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: [18/Sep/2024:12:43:04] ENGINE Bus STARTING 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: [18/Sep/2024:12:43:05] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: [18/Sep/2024:12:43:05] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: [18/Sep/2024:12:43:05] ENGINE Bus STARTED 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: mgrmap e16: smithi081.pfnvgp(active, since 1.00557s) 2024-09-18T12:43:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:06.427 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:06.427 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:06.429 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:07.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:07 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3138019393' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:07.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:07 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:08.069 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:08.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:08.535 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:08.586 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:08.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:08 smithi081 ceph-mon[27646]: mgrmap e17: smithi081.pfnvgp(active, since 2s) 2024-09-18T12:43:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:11.045 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:11.045 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:11.047 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:11.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:11.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:43:11.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:11.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:11.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:10 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1323661934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:11 smithi081 ceph-mon[27646]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:43:12.651 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:12.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:12.889 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:15.145 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:15.146 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: Deploying daemon crash.smithi136 on smithi136 2024-09-18T12:43:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:16 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3665949853' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:16.741 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:16.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:16.933 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:18.856 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:18.857 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/540485419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:20.556 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:20.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:20.748 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:21.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:20 smithi081 ceph-mon[27646]: Deploying daemon node-exporter.smithi136 on smithi136 2024-09-18T12:43:22.976 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:22.976 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:22.978 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:23.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:23 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/4189660346' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:25.121 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:25.121 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:25.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T12:43:25.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:25.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:25.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:25 smithi081 ceph-mon[27646]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:43:26.385 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:27.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:27 smithi081 ceph-mon[27646]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:28.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:28.243 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:28.245 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/1642578382' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:30.023 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:30.024 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:30.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:29 smithi081 ceph-mon[27646]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:30.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:29 smithi081 ceph-mon[27646]: Deploying daemon mon.smithi136 on smithi136 2024-09-18T12:43:30.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:29 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:31.240 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:43:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:31 smithi081 ceph-mon[27646]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.203 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:33.203 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:40:54.860777Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:43:33.203 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 podman[35330]: 2024-09-18 12:43:33.108029878 +0000 UTC m=+0.116449481 container create 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T12:43:33.205 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-18T12:43:33.469 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 podman[35330]: 2024-09-18 12:43:33.336233488 +0000 UTC m=+0.344653095 container init 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, CEPH_POINT_RELEASE=-18.2.1, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux ) 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 podman[35330]: 2024-09-18 12:43:33.339793104 +0000 UTC m=+0.348212708 container start 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1) 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pidfile_write: ignore empty --pid-file 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: load: jerasure load: lrc 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Git sha 0 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Compile date 2023-12-11 22:07:34 2024-09-18T12:43:33.470 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: DB SUMMARY 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: DB Session ID: GKD2ME7XB4URHYC4OKIR 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi136/store.db dir, Total Num: 0, files: 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi136/store.db: 000004.log size: 511 ; 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:43:33.471 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.env: 0x55e26ef96720 2024-09-18T12:43:33.472 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:43:33.472 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.info_log: 0x55e2716db2e0 2024-09-18T12:43:33.472 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:43:33.472 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.statistics: (nil) 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.use_fsync: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.db_log_dir: 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.wal_dir: 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:43:33.474 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.write_buffer_manager: 0x55e27094c140 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.unordered_write: 0 2024-09-18T12:43:33.475 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.row_cache: None 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.wal_filter: None 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.wal_compression: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:43:33.476 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:43:33.477 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_open_files: -1 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:43:33.478 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Compression algorithms supported: 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kZSTD supported: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:43:33.479 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi136/store.db/MANIFEST-000005 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.merge_operator: 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_filter: None 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e2716db3e0) 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:43:33.480 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_type: 0 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: data_block_index_type: 0 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_shortening: 1 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: checksum: 4 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: no_block_cache: 0 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache: 0x55e2709ed350 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_options: 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: capacity : 536870912 2024-09-18T12:43:33.481 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: num_shard_bits : 4 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: strict_capacity_limit : 0 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_compressed: (nil) 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: persistent_cache: (nil) 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_size: 4096 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_size_deviation: 10 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_restart_interval: 16 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_block_restart_interval: 1 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: metadata_block_size: 4096 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: partition_filters: 0 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: use_delta_encoding: 1 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: filter_policy: bloomfilter 2024-09-18T12:43:33.482 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: whole_key_filtering: 1 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: verify_compression: 0 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: format_version: 5 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: enable_index_compression: 1 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_align: 0 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: max_auto_readahead_size: 262144 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: prepopulate_block_cache: 0 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression: NoCompression 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:43:33.483 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.num_levels: 7 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:43:33.484 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:43:33.485 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:43:33.486 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:43:33.486 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:43:33.486 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:43:33.486 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:43:33.487 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:43:33.487 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:43:33.487 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:43:33.487 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:43:33.488 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.table_properties_collectors: 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:43:33.489 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.ttl: 2592000 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:43:33.490 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi136/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e4245e8d-0dde-4f27-98ac-e6b6f7811bf2 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663413370422, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663413370858, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726663413, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e4245e8d-0dde-4f27-98ac-e6b6f7811bf2", "db_session_id": "GKD2ME7XB4URHYC4OKIR", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663413370948, "job": 1, "event": "recovery_finished"} 2024-09-18T12:43:33.491 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi136/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e270a8a000 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: DB pointer 0x55e270a76000 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** DB Stats ** 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** Compaction Stats [default] ** 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** Compaction Stats [default] ** 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.493 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Block cache BinnedLRUCache@0x55e2709ed350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.494 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136 does not exist in monmap, will attempt to join an existing cluster 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: using public_addr v2:172.21.15.136:0/0 -> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: starting mon.smithi136 rank -1 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi136 fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(???) e0 preinit fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).mds e1 new map 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).mds e1 print_map 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: e1 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: legacy client fscid: -1 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: No filesystems configured 2024-09-18T12:43:33.495 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon node-exporter.smithi081 on smithi081 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Added host smithi136 2024-09-18T12:43:33.496 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.497 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon alertmanager.smithi081 on smithi081 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1661796193' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1661796193' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Saving service mon spec with placement smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136;count:2 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3247026111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.498 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.499 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon grafana.smithi081 on smithi081 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1441306721' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3285026789' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3219340202' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.500 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1588649817' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon prometheus.smithi081 on smithi081 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.501 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/2317274454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1186068685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1117318041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14162 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mgrmap e14: smithi081.pfnvgp(active, since 61s) 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/578590688' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/791734356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mgrmap e15: smithi081.pfnvgp(active, starting, since 0.00318668s) 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: [18/Sep/2024:12:43:04] ENGINE Bus STARTING 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: [18/Sep/2024:12:43:05] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: [18/Sep/2024:12:43:05] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: [18/Sep/2024:12:43:05] ENGINE Bus STARTED 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mgrmap e16: smithi081.pfnvgp(active, since 1.00557s) 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3138019393' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mgrmap e17: smithi081.pfnvgp(active, since 2s) 2024-09-18T12:43:33.504 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:43:33.505 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1323661934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:33.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon crash.smithi136 on smithi136 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3665949853' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/540485419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon node-exporter.smithi136 on smithi136 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/4189660346' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T12:43:33.508 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/1642578382' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: Deploying daemon mon.smithi136 on smithi136 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:33.509 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:33.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 ceph-mon[35363]: mon.smithi136@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-18T12:43:33.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 bash[35330]: 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 2024-09-18T12:43:33.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:33 smithi136 systemd[1]: Started Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:43:35.181 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:35.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:43:35.377 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: mon.smithi081 calling monitor election 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: mon.smithi136 calling monitor election 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: monmap e2: 2 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],smithi136=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: fsmap 2024-09-18T12:43:38.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: mgrmap e17: smithi081.pfnvgp(active, since 33s) 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: overall HEALTH_OK 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: mon.smithi081 calling monitor election 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: mon.smithi136 calling monitor election 2024-09-18T12:43:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: monmap e2: 2 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],smithi136=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: fsmap 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: mgrmap e17: smithi081.pfnvgp(active, since 33s) 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: overall HEALTH_OK 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/2575456109' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:43:38.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:38.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:39.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:39 smithi136 ceph-mon[35363]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:39.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:39 smithi136 ceph-mon[35363]: mgrmap e18: smithi081.pfnvgp(active, since 34s), standbys: smithi136.vdkrdt 2024-09-18T12:43:39.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:39 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:43:39.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:39 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:39.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:39 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:39 smithi081 ceph-mon[27646]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:39 smithi081 ceph-mon[27646]: mgrmap e18: smithi081.pfnvgp(active, since 34s), standbys: smithi136.vdkrdt 2024-09-18T12:43:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:39 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:43:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:39 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:39.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:39 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:43:40.160 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:43:40.160 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:43:33.397025Z","created":"2024-09-18T12:40:54.860777Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi136","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-18T12:43:40.162 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 2 2024-09-18T12:43:40.720 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:40.720 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:40 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/3274759619' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:40 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/3274759619' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:43:40.991 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-18T12:43:40.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-18T12:43:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:41.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:41 smithi081 ceph-mon[27646]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:41 smithi136 ceph-mon[35363]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:42.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:43:42.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:43:42.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:42.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:42.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Reconfiguring mon.smithi081 (unknown last config time)... 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:42.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:42 smithi081 ceph-mon[27646]: Reconfiguring daemon mon.smithi081 on smithi081 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Reconfiguring mon.smithi081 (unknown last config time)... 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:43.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:42 smithi136 ceph-mon[35363]: Reconfiguring daemon mon.smithi081 on smithi081 2024-09-18T12:43:43.145 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:43.145 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-18T12:43:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-09-18T12:43:43.855 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:43 smithi081 ceph-mon[27646]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:43.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:43 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2446038835' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:43.857 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-18T12:43:43.858 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:43:43.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:43:43.885 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:43:43.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:43.950 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:43:43.950 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:43:43.977 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:43 smithi136 ceph-mon[35363]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:43.977 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:43 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2446038835' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:43.983 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:43:43.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:44.051 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-18T12:43:44.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-18T12:43:44.054 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-18T12:43:44.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-18T12:43:44.096 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-18T12:43:44.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-18T12:43:44.139 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-18T12:43:44.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-18T12:43:44.183 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-18T12:43:44.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-18T12:43:44.226 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-18T12:43:44.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-18T12:43:44.269 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-18T12:43:44.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-18T12:43:44.312 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-18T12:43:44.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-18T12:43:44.356 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-18T12:43:44.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-18T12:43:44.401 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-18T12:43:44.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-18T12:43:44.445 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-18T12:43:44.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-18T12:43:44.488 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-18T12:43:44.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-18T12:43:44.534 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-18T12:43:44.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-18T12:43:44.577 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-18T12:43:44.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-18T12:43:44.621 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-18T12:43:44.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-18T12:43:44.663 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-18T12:43:44.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-18T12:43:44.706 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-18T12:43:44.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-18T12:43:44.750 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-18T12:43:44.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-18T12:43:44.793 DEBUG:tasks.cephadm:set 18 configs 2024-09-18T12:43:44.793 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-18T12:43:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:45.922 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.922 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.922 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.923 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.942 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.943 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.946 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:45.954 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:47.022 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:46 smithi081 ceph-mon[27646]: Reconfiguring mgr.smithi081.pfnvgp (unknown last config time)... 2024-09-18T12:43:47.022 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:46 smithi081 ceph-mon[27646]: Reconfiguring daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:43:47.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:46 smithi136 ceph-mon[35363]: Reconfiguring mgr.smithi081.pfnvgp (unknown last config time)... 2024-09-18T12:43:47.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:46 smithi136 ceph-mon[35363]: Reconfiguring daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:43:47.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:47 smithi081 ceph-mon[27646]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:48.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:47 smithi136 ceph-mon[35363]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:50.001 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:49 smithi081 ceph-mon[27646]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:50.001 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:50.007 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:49 smithi136 ceph-mon[35363]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:50.008 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:52.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:51 smithi136 ceph-mon[35363]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:52.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:51 smithi081 ceph-mon[27646]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:43:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:52 smithi081 ceph-mon[27646]: Reconfiguring ceph-exporter.smithi081 (monmap changed)... 2024-09-18T12:43:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:52 smithi081 ceph-mon[27646]: Reconfiguring daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:43:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:52 smithi136 ceph-mon[35363]: Reconfiguring ceph-exporter.smithi081 (monmap changed)... 2024-09-18T12:43:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:52 smithi136 ceph-mon[35363]: Reconfiguring daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:43:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:53.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:53 smithi081 ceph-mon[27646]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:53 smithi136 ceph-mon[35363]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:43:55.965 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:55 smithi081 ceph-mon[27646]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:56.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:55 smithi136 ceph-mon[35363]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:57.180 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:56 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/985237333' entity='client.admin' 2024-09-18T12:43:57.180 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:56 smithi081 ceph-mon[27646]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:57.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:56 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/985237333' entity='client.admin' 2024-09-18T12:43:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:56 smithi136 ceph-mon[35363]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:59.793 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:43:59 smithi081 ceph-mon[27646]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:00.021 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:43:59 smithi136 ceph-mon[35363]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:01.682 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:01 smithi081 ceph-mon[27646]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:01.682 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:01 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3874028315' entity='client.admin' 2024-09-18T12:44:01.682 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:01 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/638442101' entity='client.admin' 2024-09-18T12:44:01.683 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:01 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1468331043' entity='client.admin' 2024-09-18T12:44:01.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:01 smithi136 ceph-mon[35363]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:01.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:01 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3874028315' entity='client.admin' 2024-09-18T12:44:01.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:01 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/638442101' entity='client.admin' 2024-09-18T12:44:01.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:01 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1468331043' entity='client.admin' 2024-09-18T12:44:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.204+0000 7f491ffff700 1 -- 172.21.15.81:0/1114545506 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f492808a060 con 0x7f49380ffba0 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f492006c460 msgr2=0x7f492006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 --2- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f492006c460 0x7f492006e920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f492c00b5c0 tx=0x7f492c005960 comp rx=0 tx=0).stop 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49380ffba0 msgr2=0x7f4938195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 --2- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49380ffba0 0x7f4938195870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f492800d900 tx=0x7f492800dcc0 comp rx=0 tx=0).stop 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 shutdown_connections 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 --2- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f492006c460 0x7f492006e920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 --2- 172.21.15.81:0/1114545506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49380ffba0 0x7f4938195870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 --2- 172.21.15.81:0/1114545506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4938100da0 0x7f4938195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.206+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 >> 172.21.15.81:0/1114545506 conn(0x7f49380fb120 msgr2=0x7f4938068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.207+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 shutdown_connections 2024-09-18T12:44:02.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:02.207+0000 7f493d231700 1 -- 172.21.15.81:0/1114545506 wait complete. 2024-09-18T12:44:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:03 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1114545506' entity='client.admin' 2024-09-18T12:44:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:03 smithi081 ceph-mon[27646]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:03.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:03 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1114545506' entity='client.admin' 2024-09-18T12:44:03.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:03 smithi136 ceph-mon[35363]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:44:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 -- 172.21.15.81:0/628194567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0100ca0 msgr2=0x7f20f01010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 --2- 172.21.15.81:0/628194567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0100ca0 0x7f20f01010c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009910 tx=0x7f20e0009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 -- 172.21.15.81:0/628194567 shutdown_connections 2024-09-18T12:44:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 --2- 172.21.15.81:0/628194567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0101ea0 0x7f20f0102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 --2- 172.21.15.81:0/628194567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0100ca0 0x7f20f01010c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 -- 172.21.15.81:0/628194567 >> 172.21.15.81:0/628194567 conn(0x7f20f00fc260 msgr2=0x7f20f00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 -- 172.21.15.81:0/628194567 shutdown_connections 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.593+0000 7f20f50c8700 1 -- 172.21.15.81:0/628194567 wait complete. 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 Processor -- start 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 -- start start 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0100ca0 0x7f20f0195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f01964f0 con 0x7f20f0101ea0 2024-09-18T12:44:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20f50c8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0196630 con 0x7f20f0100ca0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45148/0 (socket says 172.21.15.81:45148) 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 -- 172.21.15.81:0/4005324496 learned_addr learned my addr 172.21.15.81:0/4005324496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20eed9d700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0100ca0 0x7f20f0195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 -- 172.21.15.81:0/4005324496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0100ca0 msgr2=0x7f20f0195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0100ca0 0x7f20f0195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 -- 172.21.15.81:0/4005324496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00095f0 con 0x7f20f0101ea0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20e7fff700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20d800d900 tx=0x7f20d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d8004a00 con 0x7f20f0101ea0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.594+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f20d8005020 con 0x7f20f0101ea0 2024-09-18T12:44:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.595+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f019b0e0 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.595+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d8009a70 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.595+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f019b630 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.596+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0108b90 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.596+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f20d8009ce0 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.596+0000 7f20ecd99700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 0x7f20dc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.596+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f20d808a470 con 0x7f20f0101ea0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.596+0000 7f20eed9d700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 0x7f20dc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.597+0000 7f20eed9d700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 0x7f20dc06e920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006010 tx=0x7f20e000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.601+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f20d80598f0 con 0x7f20f0101ea0 2024-09-18T12:44:04.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.803+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f20f0108d20 con 0x7f20f0101ea0 2024-09-18T12:44:04.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.807+0000 7f20ecd99700 1 -- 172.21.15.81:0/4005324496 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f20d8017020 con 0x7f20f0101ea0 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 msgr2=0x7f20dc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 0x7f20dc06e920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006010 tx=0x7f20e000b540 comp rx=0 tx=0).stop 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 msgr2=0x7f20f0195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20d800d900 tx=0x7f20d800dc10 comp rx=0 tx=0).stop 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 shutdown_connections 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20f0100ca0 0x7f20f0195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f20dc06c460 0x7f20dc06e920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 --2- 172.21.15.81:0/4005324496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f0101ea0 0x7f20f0195ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.809+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 >> 172.21.15.81:0/4005324496 conn(0x7f20f00fc260 msgr2=0x7f20f01050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.810+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 shutdown_connections 2024-09-18T12:44:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:04.810+0000 7f20f50c8700 1 -- 172.21.15.81:0/4005324496 wait complete. 2024-09-18T12:44:05.027 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:44:06.044 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:06.044 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4005324496' entity='client.admin' 2024-09-18T12:44:06.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:06.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:06.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:06.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 -- 172.21.15.81:0/740437656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 msgr2=0x7fc71c0fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 --2- 172.21.15.81:0/740437656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c0fffd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc710009910 tx=0x7fc710009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 -- 172.21.15.81:0/740437656 shutdown_connections 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 --2- 172.21.15.81:0/740437656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 --2- 172.21.15.81:0/740437656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c0fffd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 -- 172.21.15.81:0/740437656 >> 172.21.15.81:0/740437656 conn(0x7fc71c0fb150 msgr2=0x7fc71c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 -- 172.21.15.81:0/740437656 shutdown_connections 2024-09-18T12:44:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.056+0000 7fc722c38700 1 -- 172.21.15.81:0/740437656 wait complete. 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 Processor -- start 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 -- start start 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c198650 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.057+0000 7fc722c38700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c198790 con 0x7fc71c100db0 2024-09-18T12:44:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34974/0 (socket says 172.21.15.81:34974) 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 -- 172.21.15.81:0/3300871345 learned_addr learned my addr 172.21.15.81:0/3300871345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc71bfff700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 -- 172.21.15.81:0/3300871345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 msgr2=0x7fc71c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 -- 172.21.15.81:0/3300871345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100095f0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc71bfff700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc7209d4700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc7100055f0 tx=0x7fc7100056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71001d070 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc71000f460 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc710021640 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c19d1f0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.058+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c19d6b0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.059+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c04f2e0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.060+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fc710003ae0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.060+0000 7fc719ffb700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 0x7fc70c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.060+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fc71008b9f0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.060+0000 7fc71bfff700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 0x7fc70c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.061+0000 7fc71bfff700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 0x7fc70c06e930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc708005fd0 tx=0x7fc708005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/4005324496' entity='client.admin' 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.065+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc71005adf0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.258+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7fc71c19da80 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.262+0000 7fc719ffb700 1 -- 172.21.15.81:0/3300871345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) v1 ==== 108+0+0 (secure 0 0 0) 0x7fc71007a0b0 con 0x7fc71c0ffbb0 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 msgr2=0x7fc70c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 0x7fc70c06e930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc708005fd0 tx=0x7fc708005e30 comp rx=0 tx=0).stop 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 msgr2=0x7fc71c197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc7100055f0 tx=0x7fc7100056d0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 shutdown_connections 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.264+0000 7fc722c38700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc70c06c470 0x7fc70c06e930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.265+0000 7fc722c38700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0ffbb0 0x7fc71c197b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.265+0000 7fc722c38700 1 --2- 172.21.15.81:0/3300871345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc71c100db0 0x7fc71c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.265+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 >> 172.21.15.81:0/3300871345 conn(0x7fc71c0fb150 msgr2=0x7fc71c068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.265+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 shutdown_connections 2024-09-18T12:44:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:06.265+0000 7fc722c38700 1 -- 172.21.15.81:0/3300871345 wait complete. 2024-09-18T12:44:07.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:06 smithi136 ceph-mon[35363]: Reconfiguring crash.smithi081 (monmap changed)... 2024-09-18T12:44:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:06 smithi136 ceph-mon[35363]: Reconfiguring daemon crash.smithi081 on smithi081 2024-09-18T12:44:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:06 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3300871345' entity='client.admin' 2024-09-18T12:44:07.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:06 smithi081 ceph-mon[27646]: Reconfiguring crash.smithi081 (monmap changed)... 2024-09-18T12:44:07.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:06 smithi081 ceph-mon[27646]: Reconfiguring daemon crash.smithi081 on smithi081 2024-09-18T12:44:07.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:06 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3300871345' entity='client.admin' 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 -- 172.21.15.81:0/2754660868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 msgr2=0x7f86300fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 --2- 172.21.15.81:0/2754660868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f86300fffc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8620009910 tx=0x7f8620009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 -- 172.21.15.81:0/2754660868 shutdown_connections 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 --2- 172.21.15.81:0/2754660868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 0x7f8630101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 --2- 172.21.15.81:0/2754660868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f86300fffc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 -- 172.21.15.81:0/2754660868 >> 172.21.15.81:0/2754660868 conn(0x7f86300fb120 msgr2=0x7f86300fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:07.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 -- 172.21.15.81:0/2754660868 shutdown_connections 2024-09-18T12:44:07.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.348+0000 7f86355f6700 1 -- 172.21.15.81:0/2754660868 wait complete. 2024-09-18T12:44:07.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 Processor -- start 2024-09-18T12:44:07.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 -- start start 2024-09-18T12:44:07.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:07.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 0x7f8630194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630195490 con 0x7f86300ffba0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.349+0000 7f86355f6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301955d0 con 0x7f8630100da0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34992/0 (socket says 172.21.15.81:34992) 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 -- 172.21.15.81:0/2940141480 learned_addr learned my addr 172.21.15.81:0/2940141480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862e7fc700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 0x7f8630194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 -- 172.21.15.81:0/2940141480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 msgr2=0x7f8630194e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 0x7f8630194e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 -- 172.21.15.81:0/2940141480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200095f0 con 0x7f86300ffba0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f862effd700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8620005f50 tx=0x7f86200055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862001d070 con 0x7f86300ffba0 2024-09-18T12:44:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f862000f460 con 0x7f86300ffba0 2024-09-18T12:44:07.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8620003ea0 con 0x7f86300ffba0 2024-09-18T12:44:07.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863019a020 con 0x7f86300ffba0 2024-09-18T12:44:07.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.350+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863019a510 con 0x7f86300ffba0 2024-09-18T12:44:07.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.351+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863018e8e0 con 0x7f86300ffba0 2024-09-18T12:44:07.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.352+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f8620003a60 con 0x7f86300ffba0 2024-09-18T12:44:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.352+0000 7f8617fff700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 0x7f861806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.352+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f862008b8e0 con 0x7f86300ffba0 2024-09-18T12:44:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.352+0000 7f862e7fc700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 0x7f861806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.352+0000 7f862e7fc700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 0x7f861806e930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8624009a10 tx=0x7f8624009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.356+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f862005ace0 con 0x7f86300ffba0 2024-09-18T12:44:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.551+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f86300619a0 con 0x7f86300ffba0 2024-09-18T12:44:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.555+0000 7f8617fff700 1 -- 172.21.15.81:0/2940141480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7f862008b150 con 0x7f86300ffba0 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 msgr2=0x7f861806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 0x7f861806e930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8624009a10 tx=0x7f8624009190 comp rx=0 tx=0).stop 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 msgr2=0x7f8630194930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8620005f50 tx=0x7f86200055f0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 shutdown_connections 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f861806c470 0x7f861806e930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86300ffba0 0x7f8630194930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 --2- 172.21.15.81:0/2940141480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8630100da0 0x7f8630194e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:07.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 >> 172.21.15.81:0/2940141480 conn(0x7f86300fb120 msgr2=0x7f86300fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:07.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 shutdown_connections 2024-09-18T12:44:07.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:07.558+0000 7f86355f6700 1 -- 172.21.15.81:0/2940141480 wait complete. 2024-09-18T12:44:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:07 smithi136 ceph-mon[35363]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:07 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2940141480' entity='client.admin' 2024-09-18T12:44:08.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:07 smithi081 ceph-mon[27646]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:08.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:07 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2940141480' entity='client.admin' 2024-09-18T12:44:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 -- 172.21.15.81:0/2636355283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 msgr2=0x7efd080ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 --2- 172.21.15.81:0/2636355283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd080ff380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009910 tx=0x7efcf8009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 -- 172.21.15.81:0/2636355283 shutdown_connections 2024-09-18T12:44:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 --2- 172.21.15.81:0/2636355283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 0x7efd081023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 --2- 172.21.15.81:0/2636355283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd080ff380 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 -- 172.21.15.81:0/2636355283 >> 172.21.15.81:0/2636355283 conn(0x7efd080fa8c0 msgr2=0x7efd080fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 -- 172.21.15.81:0/2636355283 shutdown_connections 2024-09-18T12:44:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 -- 172.21.15.81:0/2636355283 wait complete. 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.375+0000 7efd0de7e700 1 Processor -- start 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd0de7e700 1 -- start start 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd0de7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd0de7e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 0x7efd08195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd0de7e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081964a0 con 0x7efd080fef60 2024-09-18T12:44:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd0de7e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081965e0 con 0x7efd08101f40 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35014/0 (socket says 172.21.15.81:35014) 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 -- 172.21.15.81:0/3169127062 learned_addr learned my addr 172.21.15.81:0/3169127062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd06ffd700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 0x7efd08195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 -- 172.21.15.81:0/3169127062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 msgr2=0x7efd08195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 0x7efd08195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 -- 172.21.15.81:0/3169127062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80095f0 con 0x7efd080fef60 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.376+0000 7efd077fe700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcf80055b0 tx=0x7efcf80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.377+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf801d070 con 0x7efd080fef60 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.377+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7efcf800f460 con 0x7efd080fef60 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.377+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0819b030 con 0x7efd080fef60 2024-09-18T12:44:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.377+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf8003ea0 con 0x7efd080fef60 2024-09-18T12:44:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.377+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0819b520 con 0x7efd080fef60 2024-09-18T12:44:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.378+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08108b90 con 0x7efd080fef60 2024-09-18T12:44:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.378+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7efcf802b440 con 0x7efd080fef60 2024-09-18T12:44:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.378+0000 7efd04ff9700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 0x7efcf006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.379+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7efcf808b7e0 con 0x7efd080fef60 2024-09-18T12:44:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.379+0000 7efd06ffd700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 0x7efcf006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.379+0000 7efd06ffd700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 0x7efcf006e920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005950 tx=0x7efcfc00b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:09.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.383+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efcf805ad80 con 0x7efd080fef60 2024-09-18T12:44:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.580+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7efd08108d20 con 0x7efd080fef60 2024-09-18T12:44:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.584+0000 7efd04ff9700 1 -- 172.21.15.81:0/3169127062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7efcf808b050 con 0x7efd080fef60 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 msgr2=0x7efcf006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 0x7efcf006e920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005950 tx=0x7efcfc00b410 comp rx=0 tx=0).stop 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 msgr2=0x7efd08195940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcf80055b0 tx=0x7efcf80055e0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 shutdown_connections 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efcf006c460 0x7efcf006e920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd080fef60 0x7efd08195940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 --2- 172.21.15.81:0/3169127062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08101f40 0x7efd08195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.586+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 >> 172.21.15.81:0/3169127062 conn(0x7efd080fa8c0 msgr2=0x7efd08105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.587+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 shutdown_connections 2024-09-18T12:44:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:09.587+0000 7efd0de7e700 1 -- 172.21.15.81:0/3169127062 wait complete. 2024-09-18T12:44:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:09 smithi136 ceph-mon[35363]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:09 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3169127062' entity='client.admin' 2024-09-18T12:44:10.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:09 smithi081 ceph-mon[27646]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:10.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:09 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3169127062' entity='client.admin' 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 -- 172.21.15.81:0/166727402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 msgr2=0x7f0fac103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/166727402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac103b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009910 tx=0x7f0f9c009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 -- 172.21.15.81:0/166727402 shutdown_connections 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/166727402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 0x7f0fac106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/166727402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac103b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 -- 172.21.15.81:0/166727402 >> 172.21.15.81:0/166727402 conn(0x7f0fac0fb150 msgr2=0x7f0fac0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 -- 172.21.15.81:0/166727402 shutdown_connections 2024-09-18T12:44:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.266+0000 7f0fb08d0700 1 -- 172.21.15.81:0/166727402 wait complete. 2024-09-18T12:44:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 Processor -- start 2024-09-18T12:44:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 -- start start 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 0x7f0fac0ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0ffc50 con 0x7f0fac101760 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.267+0000 7f0fb08d0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0ffd90 con 0x7f0fac104090 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35030/0 (socket says 172.21.15.81:35030) 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 -- 172.21.15.81:0/1135856111 learned_addr learned my addr 172.21.15.81:0/1135856111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0fa9d9b700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 0x7f0fac0ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 -- 172.21.15.81:0/1135856111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 msgr2=0x7f0fac0ff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 0x7f0fac0ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 -- 172.21.15.81:0/1135856111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0095f0 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0faa59c700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c006010 tx=0x7f0f9c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c01d070 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f0f9c00f460 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac100010 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c003ea0 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.268+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac100500 con 0x7f0fac101760 2024-09-18T12:44:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.269+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac18fa10 con 0x7f0fac101760 2024-09-18T12:44:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.270+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f0f9c003a60 con 0x7f0fac101760 2024-09-18T12:44:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.270+0000 7f0f9b7fe700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 0x7f0f9406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.270+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0f9c08b9c0 con 0x7f0fac101760 2024-09-18T12:44:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.270+0000 7f0fa9d9b700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 0x7f0f9406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.270+0000 7f0fa9d9b700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 0x7f0f9406e920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0006fd0 tx=0x7f0fa0008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.275+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0f9c05adc0 con 0x7f0fac101760 2024-09-18T12:44:11.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.469+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7f0fac02cfc0 con 0x7f0fac101760 2024-09-18T12:44:11.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.473+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(24 keys) v1 ==== 1008+0+0 (secure 0 0 0) 0x7f0f9c07a0b0 con 0x7f0fac101760 2024-09-18T12:44:11.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.473+0000 7f0f9b7fe700 1 -- 172.21.15.81:0/1135856111 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v20)=0 v20) v1 ==== 114+0+0 (secure 0 0 0) 0x7f0f9c08b230 con 0x7f0fac101760 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 msgr2=0x7f0f9406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 0x7f0f9406e920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0006fd0 tx=0x7f0fa0008040 comp rx=0 tx=0).stop 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 msgr2=0x7f0fac1010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c006010 tx=0x7f0f9c0056a0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 shutdown_connections 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f9406c460 0x7f0f9406e920 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fac101760 0x7f0fac1010c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 --2- 172.21.15.81:0/1135856111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac104090 0x7f0fac0ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 >> 172.21.15.81:0/1135856111 conn(0x7f0fac0fb150 msgr2=0x7f0fac0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 shutdown_connections 2024-09-18T12:44:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:11.475+0000 7f0fb08d0700 1 -- 172.21.15.81:0/1135856111 wait complete. 2024-09-18T12:44:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:11 smithi081 ceph-mon[27646]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:11 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1135856111' entity='client.admin' 2024-09-18T12:44:12.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:11 smithi136 ceph-mon[35363]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:11 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1135856111' entity='client.admin' 2024-09-18T12:44:14.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:13 smithi081 ceph-mon[27646]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:14.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:13 smithi136 ceph-mon[35363]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 -- 172.21.15.81:0/847398930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 msgr2=0x7f48c00731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 --2- 172.21.15.81:0/847398930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c00731a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009910 tx=0x7f48bc009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 -- 172.21.15.81:0/847398930 shutdown_connections 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 --2- 172.21.15.81:0/847398930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 0x7f48c0073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 --2- 172.21.15.81:0/847398930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c00731a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 -- 172.21.15.81:0/847398930 >> 172.21.15.81:0/847398930 conn(0x7f48c00fc260 msgr2=0x7f48c00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 -- 172.21.15.81:0/847398930 shutdown_connections 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.540+0000 7f48c7cff700 1 -- 172.21.15.81:0/847398930 wait complete. 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 Processor -- start 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 -- start start 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 0x7f48c0197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0198790 con 0x7f48c0074d40 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c7cff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d1a0 con 0x7f48c0073770 2024-09-18T12:44:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c529a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c529a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52264/0 (socket says 172.21.15.81:52264) 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c529a700 1 -- 172.21.15.81:0/995115682 learned_addr learned my addr 172.21.15.81:0/995115682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.541+0000 7f48c5a9b700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 0x7f48c0197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c529a700 1 -- 172.21.15.81:0/995115682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 msgr2=0x7f48c0197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c529a700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 0x7f48c0197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c529a700 1 -- 172.21.15.81:0/995115682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0095f0 con 0x7f48c0074d40 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c529a700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48b000d8d0 tx=0x7f48b000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b00098a0 con 0x7f48c0074d40 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) v1 ==== 1008+0+0 (secure 0 0 0) 0x7f48b0009e50 con 0x7f48c0074d40 2024-09-18T12:44:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b000f3c0 con 0x7f48c0074d40 2024-09-18T12:44:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c019d3a0 con 0x7f48c0074d40 2024-09-18T12:44:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.542+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c019d800 con 0x7f48c0074d40 2024-09-18T12:44:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.543+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c0191c20 con 0x7f48c0074d40 2024-09-18T12:44:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.544+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f48b0009a00 con 0x7f48c0074d40 2024-09-18T12:44:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.544+0000 7f48b6ffd700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 0x7f48ac06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.545+0000 7f48c5a9b700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 0x7f48ac06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.545+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f48b008a460 con 0x7f48c0074d40 2024-09-18T12:44:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.546+0000 7f48c5a9b700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 0x7f48ac06e930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006010 tx=0x7f48bc00b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.551+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f48b0055e50 con 0x7f48c0074d40 2024-09-18T12:44:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.753+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f48c002d020 con 0x7f48c0074d40 2024-09-18T12:44:15.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.759+0000 7f48b6ffd700 1 -- 172.21.15.81:0/995115682 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v21)=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7f48b00200b0 con 0x7f48c0074d40 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.761+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 msgr2=0x7f48ac06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.761+0000 7f48c7cff700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 0x7f48ac06e930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006010 tx=0x7f48bc00b560 comp rx=0 tx=0).stop 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.761+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 msgr2=0x7f48c0198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.761+0000 7f48c7cff700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48b000d8d0 tx=0x7f48b000dbe0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 shutdown_connections 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0073770 0x7f48c0197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f48ac06c470 0x7f48ac06e930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 --2- 172.21.15.81:0/995115682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c0074d40 0x7f48c0198170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 >> 172.21.15.81:0/995115682 conn(0x7f48c00fc260 msgr2=0x7f48c00fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:15.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 shutdown_connections 2024-09-18T12:44:15.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:15.762+0000 7f48c7cff700 1 -- 172.21.15.81:0/995115682 wait complete. 2024-09-18T12:44:16.009 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:15 smithi081 ceph-mon[27646]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:16.009 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/995115682' entity='client.admin' 2024-09-18T12:44:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:15 smithi136 ceph-mon[35363]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:15 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/995115682' entity='client.admin' 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.246+0000 7f1343f6e700 1 -- 172.21.15.81:0/4252574206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 msgr2=0x7f133c104340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.246+0000 7f1343f6e700 1 --2- 172.21.15.81:0/4252574206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c104340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f132c009910 tx=0x7f132c009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- 172.21.15.81:0/4252574206 shutdown_connections 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 --2- 172.21.15.81:0/4252574206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c104340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 --2- 172.21.15.81:0/4252574206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 0x7f133c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- 172.21.15.81:0/4252574206 >> 172.21.15.81:0/4252574206 conn(0x7f133c0fb160 msgr2=0x7f133c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- 172.21.15.81:0/4252574206 shutdown_connections 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- 172.21.15.81:0/4252574206 wait complete. 2024-09-18T12:44:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 Processor -- start 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- start start 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 0x7f133c19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19ce80 con 0x7f133c101eb0 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.247+0000 7f1343f6e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19cfc0 con 0x7f133c0ff540 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52282/0 (socket says 172.21.15.81:52282) 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 -- 172.21.15.81:0/2132950454 learned_addr learned my addr 172.21.15.81:0/2132950454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341d0a700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 0x7f133c19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 -- 172.21.15.81:0/2132950454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 msgr2=0x7f133c19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 0x7f133c19c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 -- 172.21.15.81:0/2132950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0095f0 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1341509700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b5c0 tx=0x7f132c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132c01d070 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) v1 ==== 1008+0+0 (secure 0 0 0) 0x7f132c022470 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132c00f690 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c1a1a10 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.248+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1a1f00 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.249+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c196040 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.250+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f132c0225e0 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.250+0000 7f1332ffd700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 0x7f132806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.250+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f132c08bba0 con 0x7f133c101eb0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.250+0000 7f1341d0a700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 0x7f132806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.251+0000 7f1341d0a700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 0x7f132806e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1338005950 tx=0x7f1338005cf0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.255+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f132c05b0d0 con 0x7f133c101eb0 2024-09-18T12:44:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.448+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f133c068af0 con 0x7f133c101eb0 2024-09-18T12:44:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.452+0000 7f1332ffd700 1 -- 172.21.15.81:0/2132950454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7f132c08b410 con 0x7f133c101eb0 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.454+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 msgr2=0x7f132806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.454+0000 7f1343f6e700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 0x7f132806e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1338005950 tx=0x7f1338005cf0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.454+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 msgr2=0x7f133c19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.454+0000 7f1343f6e700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b5c0 tx=0x7f132c005710 comp rx=0 tx=0).stop 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 shutdown_connections 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133c0ff540 0x7f133c19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f132806c470 0x7f132806e930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 --2- 172.21.15.81:0/2132950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c101eb0 0x7f133c19c860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 >> 172.21.15.81:0/2132950454 conn(0x7f133c0fb160 msgr2=0x7f133c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 shutdown_connections 2024-09-18T12:44:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.455+0000 7f1343f6e700 1 -- 172.21.15.81:0/2132950454 wait complete. 2024-09-18T12:44:17.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- 172.21.15.81:0/934864086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c100cb0 msgr2=0x7fa76c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 --2- 172.21.15.81:0/934864086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c100cb0 0x7fa76c1010d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa768009910 tx=0x7fa768009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- 172.21.15.81:0/934864086 shutdown_connections 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 --2- 172.21.15.81:0/934864086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c101eb0 0x7fa76c102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 --2- 172.21.15.81:0/934864086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c100cb0 0x7fa76c1010d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- 172.21.15.81:0/934864086 >> 172.21.15.81:0/934864086 conn(0x7fa76c0fc230 msgr2=0x7fa76c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- 172.21.15.81:0/934864086 shutdown_connections 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- 172.21.15.81:0/934864086 wait complete. 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 Processor -- start 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- start start 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 0x7fa76c074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0736c0 con 0x7fa76c101eb0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.943+0000 7fa77345d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c073800 con 0x7fa76c100cb0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52304/0 (socket says 172.21.15.81:52304) 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 -- 172.21.15.81:0/3422300757 learned_addr learned my addr 172.21.15.81:0/3422300757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7711f9700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 0x7fa76c074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 -- 172.21.15.81:0/3422300757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 msgr2=0x7fa76c074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 0x7fa76c074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 -- 172.21.15.81:0/3422300757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680095f0 con 0x7fa76c101eb0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7711f9700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 0x7fa76c074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7709f8700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c8a0 tx=0x7fa75c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75c00cea0 con 0x7fa76c101eb0 2024-09-18T12:44:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) v1 ==== 1008+0+0 (secure 0 0 0) 0x7fa75c004830 con 0x7fa76c101eb0 2024-09-18T12:44:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c073ae0 con 0x7fa76c101eb0 2024-09-18T12:44:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75c005320 con 0x7fa76c101eb0 2024-09-18T12:44:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.944+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c19da80 con 0x7fa76c101eb0 2024-09-18T12:44:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.945+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c04f2e0 con 0x7fa76c101eb0 2024-09-18T12:44:17.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.946+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fa75c005590 con 0x7fa76c101eb0 2024-09-18T12:44:17.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.946+0000 7fa7627fc700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 0x7fa75806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:17.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.946+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fa75c08a230 con 0x7fa76c101eb0 2024-09-18T12:44:17.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.946+0000 7fa7711f9700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 0x7fa75806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:17.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.947+0000 7fa7711f9700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 0x7fa75806e920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa768005e00 tx=0x7fa768005fb0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:17.950+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa75c0596b0 con 0x7fa76c101eb0 2024-09-18T12:44:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:17 smithi081 ceph-mon[27646]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:17 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2132950454' entity='client.admin' 2024-09-18T12:44:18.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.145+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7fa76c19dc10 con 0x7fa76c101eb0 2024-09-18T12:44:18.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.149+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(25 keys) v1 ==== 1039+0+0 (secure 0 0 0) 0x7fa75c0596b0 con 0x7fa76c101eb0 2024-09-18T12:44:18.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.149+0000 7fa7627fc700 1 -- 172.21.15.81:0/3422300757 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v23)=0 v23) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa75c01d070 con 0x7fa76c101eb0 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 msgr2=0x7fa75806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 0x7fa75806e920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa768005e00 tx=0x7fa768005fb0 comp rx=0 tx=0).stop 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 msgr2=0x7fa76c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c8a0 tx=0x7fa75c00cc60 comp rx=0 tx=0).stop 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 shutdown_connections 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c100cb0 0x7fa76c074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa75806c460 0x7fa75806e920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 --2- 172.21.15.81:0/3422300757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa76c101eb0 0x7fa76c073180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 >> 172.21.15.81:0/3422300757 conn(0x7fa76c0fc230 msgr2=0x7fa76c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 shutdown_connections 2024-09-18T12:44:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:18.151+0000 7fa77345d700 1 -- 172.21.15.81:0/3422300757 wait complete. 2024-09-18T12:44:18.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:17 smithi136 ceph-mon[35363]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:17 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2132950454' entity='client.admin' 2024-09-18T12:44:19.407 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:19 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3422300757' entity='client.admin' 2024-09-18T12:44:19.407 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:19 smithi081 ceph-mon[27646]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:19.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:19 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3422300757' entity='client.admin' 2024-09-18T12:44:19.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:19 smithi136 ceph-mon[35363]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:20.411 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 -- 172.21.15.81:0/833695319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 msgr2=0x7fbee0102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 --2- 172.21.15.81:0/833695319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0102460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009910 tx=0x7fbec8009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 -- 172.21.15.81:0/833695319 shutdown_connections 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 --2- 172.21.15.81:0/833695319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0102460 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 --2- 172.21.15.81:0/833695319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee00ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 -- 172.21.15.81:0/833695319 >> 172.21.15.81:0/833695319 conn(0x7fbee00fa8c0 msgr2=0x7fbee00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 -- 172.21.15.81:0/833695319 shutdown_connections 2024-09-18T12:44:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.519+0000 7fbee65f8700 1 -- 172.21.15.81:0/833695319 wait complete. 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 Processor -- start 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 -- start start 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee0196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0196fb0 con 0x7fbee0102000 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbee65f8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01970f0 con 0x7fbee00fef80 2024-09-18T12:44:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52316/0 (socket says 172.21.15.81:52316) 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 -- 172.21.15.81:0/2233170150 learned_addr learned my addr 172.21.15.81:0/2233170150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbedffff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee0196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 -- 172.21.15.81:0/2233170150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 msgr2=0x7fbee0196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee0196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 -- 172.21.15.81:0/2233170150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80095f0 con 0x7fbee0102000 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbedffff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee0196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.520+0000 7fbed7fff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbec8006010 tx=0x7fbec8005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.521+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec801d070 con 0x7fbee0102000 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.521+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) v1 ==== 1039+0+0 (secure 0 0 0) 0x7fbec8022470 con 0x7fbee0102000 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.521+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee019bb40 con 0x7fbee0102000 2024-09-18T12:44:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.521+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec800f690 con 0x7fbee0102000 2024-09-18T12:44:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.521+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee019c030 con 0x7fbee0102000 2024-09-18T12:44:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.522+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0190430 con 0x7fbee0102000 2024-09-18T12:44:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.522+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fbec80225e0 con 0x7fbee0102000 2024-09-18T12:44:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.523+0000 7fbeddffb700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 0x7fbecc06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.523+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fbec808bc90 con 0x7fbee0102000 2024-09-18T12:44:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.523+0000 7fbedffff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 0x7fbecc06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.523+0000 7fbedffff700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 0x7fbecc06e930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbee00682c0 tx=0x7fbed0008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.527+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbec805b230 con 0x7fbee0102000 2024-09-18T12:44:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 -- 172.21.15.81:0/1867550498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31580ffc10 msgr2=0x7f3158100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 --2- 172.21.15.81:0/1867550498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31580ffc10 0x7f3158100030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3140009910 tx=0x7f3140009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 -- 172.21.15.81:0/1867550498 shutdown_connections 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 --2- 172.21.15.81:0/1867550498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3158100e10 0x7f3158101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 --2- 172.21.15.81:0/1867550498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31580ffc10 0x7f3158100030 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 -- 172.21.15.81:0/1867550498 >> 172.21.15.81:0/1867550498 conn(0x7f31580fb190 msgr2=0x7f31580fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 -- 172.21.15.81:0/1867550498 shutdown_connections 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 -- 172.21.15.81:0/1867550498 wait complete. 2024-09-18T12:44:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.677+0000 7f315de6d700 1 Processor -- start 2024-09-18T12:44:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f315de6d700 1 -- start start 2024-09-18T12:44:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f315de6d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31580ffc10 0x7f3158069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f315de6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f315de6d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315819b650 con 0x7f3158100e10 2024-09-18T12:44:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f315de6d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315819b790 con 0x7f31580ffc10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52328/0 (socket says 172.21.15.81:52328) 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 -- 172.21.15.81:0/3199683622 learned_addr learned my addr 172.21.15.81:0/3199683622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f31577fe700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31580ffc10 0x7f3158069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 -- 172.21.15.81:0/3199683622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31580ffc10 msgr2=0x7f3158069140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31580ffc10 0x7f3158069140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.678+0000 7f3156ffd700 1 -- 172.21.15.81:0/3199683622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400095f0 con 0x7f3158100e10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f3156ffd700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f314800c8a0 tx=0x7f314800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314800cea0 con 0x7f3158100e10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315819ba70 con 0x7f3158100e10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) v1 ==== 1039+0+0 (secure 0 0 0) 0x7f3148004830 con 0x7f3158100e10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315819bfc0 con 0x7f3158100e10 2024-09-18T12:44:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.679+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3148005490 con 0x7f3158100e10 2024-09-18T12:44:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.680+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3138005110 con 0x7f3158100e10 2024-09-18T12:44:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.681+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f31480049a0 con 0x7f3158100e10 2024-09-18T12:44:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.681+0000 7f3154ff9700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 0x7f314406e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.681+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f314808a210 con 0x7f3158100e10 2024-09-18T12:44:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.681+0000 7f31577fe700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 0x7f314406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.682+0000 7f31577fe700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 0x7f314406e930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3140000c00 tx=0x7f3140005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.690+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3148059690 con 0x7f3158100e10 2024-09-18T12:44:20.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.731+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fbee002cc70 con 0x7fbee0102000 2024-09-18T12:44:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.737+0000 7fbeddffb700 1 -- 172.21.15.81:0/2233170150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7fbec80270c0 con 0x7fbee0102000 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 msgr2=0x7fbecc06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 0x7fbecc06e930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbee00682c0 tx=0x7fbed0008040 comp rx=0 tx=0).stop 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 msgr2=0x7fbee0196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbec8006010 tx=0x7fbec8005710 comp rx=0 tx=0).stop 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 shutdown_connections 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbee00fef80 0x7fbee0196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbecc06c470 0x7fbecc06e930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 --2- 172.21.15.81:0/2233170150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee0102000 0x7fbee0196990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 >> 172.21.15.81:0/2233170150 conn(0x7fbee00fa8c0 msgr2=0x7fbee00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 shutdown_connections 2024-09-18T12:44:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.739+0000 7fbee65f8700 1 -- 172.21.15.81:0/2233170150 wait complete. 2024-09-18T12:44:20.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.889+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f3138005d60 con 0x7f3158100e10 2024-09-18T12:44:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.893+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3148059690 con 0x7f3158100e10 2024-09-18T12:44:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.894+0000 7f3154ff9700 1 -- 172.21.15.81:0/3199683622 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7f314801d070 con 0x7f3158100e10 2024-09-18T12:44:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 msgr2=0x7f314406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 0x7f314406e930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3140000c00 tx=0x7f3140005fd0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 msgr2=0x7f315819b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f314800c8a0 tx=0x7f314800cc60 comp rx=0 tx=0).stop 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 shutdown_connections 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31580ffc10 0x7f3158069140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f314406c470 0x7f314406e930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 --2- 172.21.15.81:0/3199683622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3158100e10 0x7f315819b030 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 >> 172.21.15.81:0/3199683622 conn(0x7f31580fb190 msgr2=0x7f3158104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 shutdown_connections 2024-09-18T12:44:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:20.896+0000 7f315de6d700 1 -- 172.21.15.81:0/3199683622 wait complete. 2024-09-18T12:44:21.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-18T12:44:21.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-18T12:44:21.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.680+0000 7ff3777d5700 1 -- 172.21.15.81:0/319314391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3700ff540 msgr2=0x7ff370101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.680+0000 7ff3777d5700 1 --2- 172.21.15.81:0/319314391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3700ff540 0x7ff370101970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009910 tx=0x7ff36c009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.680+0000 7ff3777d5700 1 -- 172.21.15.81:0/319314391 shutdown_connections 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 --2- 172.21.15.81:0/319314391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff370101eb0 0x7ff370104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 --2- 172.21.15.81:0/319314391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3700ff540 0x7ff370101970 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- 172.21.15.81:0/319314391 >> 172.21.15.81:0/319314391 conn(0x7ff3700fb160 msgr2=0x7ff3700fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- 172.21.15.81:0/319314391 shutdown_connections 2024-09-18T12:44:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- 172.21.15.81:0/319314391 wait complete. 2024-09-18T12:44:21.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 Processor -- start 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- start start 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 0x7ff37019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37019d860 con 0x7ff370101eb0 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff3777d5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3701a2270 con 0x7ff3700ff540 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.681+0000 7ff374d70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52352/0 (socket says 172.21.15.81:52352) 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 -- 172.21.15.81:0/56371133 learned_addr learned my addr 172.21.15.81:0/56371133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff375571700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 0x7ff37019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 -- 172.21.15.81:0/56371133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 msgr2=0x7ff37019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 0x7ff37019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 -- 172.21.15.81:0/56371133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0095f0 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff375571700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 0x7ff37019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff374d70700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c8a0 tx=0x7ff36000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff36000cea0 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff360004830 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3701a2470 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3600054f0 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.682+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3701a2990 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.683+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370196ae0 con 0x7ff370101eb0 2024-09-18T12:44:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.684+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7ff3600049a0 con 0x7ff370101eb0 2024-09-18T12:44:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.684+0000 7ff3667fc700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 0x7ff35c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.684+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff36008a220 con 0x7ff370101eb0 2024-09-18T12:44:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.684+0000 7ff375571700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 0x7ff35c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.684+0000 7ff375571700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 0x7ff35c06e920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff36c006010 tx=0x7ff36c00b580 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.689+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff360055c10 con 0x7ff370101eb0 2024-09-18T12:44:21.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.881+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7ff370068af0 con 0x7ff370101eb0 2024-09-18T12:44:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.885+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff360005750 con 0x7ff370101eb0 2024-09-18T12:44:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.885+0000 7ff3667fc700 1 -- 172.21.15.81:0/56371133 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff36001d070 con 0x7ff370101eb0 2024-09-18T12:44:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 msgr2=0x7ff35c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 0x7ff35c06e920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff36c006010 tx=0x7ff36c00b580 comp rx=0 tx=0).stop 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 msgr2=0x7ff37019d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c8a0 tx=0x7ff36000cc60 comp rx=0 tx=0).stop 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 shutdown_connections 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3700ff540 0x7ff37019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff35c06c460 0x7ff35c06e920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 --2- 172.21.15.81:0/56371133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff370101eb0 0x7ff37019d240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 >> 172.21.15.81:0/56371133 conn(0x7ff3700fb160 msgr2=0x7ff3700fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 shutdown_connections 2024-09-18T12:44:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:21.887+0000 7ff3777d5700 1 -- 172.21.15.81:0/56371133 wait complete. 2024-09-18T12:44:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:21 smithi136 ceph-mon[35363]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:21 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2233170150' entity='client.admin' 2024-09-18T12:44:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:21 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3199683622' entity='client.admin' 2024-09-18T12:44:22.098 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:21 smithi081 ceph-mon[27646]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:22.098 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:21 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2233170150' entity='client.admin' 2024-09-18T12:44:22.098 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:21 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3199683622' entity='client.admin' 2024-09-18T12:44:23.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:22 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/56371133' entity='client.admin' 2024-09-18T12:44:23.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:22 smithi081 ceph-mon[27646]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:22 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/56371133' entity='client.admin' 2024-09-18T12:44:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:22 smithi136 ceph-mon[35363]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- 172.21.15.81:0/3820825283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 msgr2=0x7fd39c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3820825283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c101220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd390009910 tx=0x7fd390009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- 172.21.15.81:0/3820825283 shutdown_connections 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3820825283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c101220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3820825283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 0x7fd39c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- 172.21.15.81:0/3820825283 >> 172.21.15.81:0/3820825283 conn(0x7fd39c0fb160 msgr2=0x7fd39c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- 172.21.15.81:0/3820825283 shutdown_connections 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- 172.21.15.81:0/3820825283 wait complete. 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 Processor -- start 2024-09-18T12:44:25.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.026+0000 7fd3a2347700 1 -- start start 2024-09-18T12:44:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3a2347700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 0x7fd39c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3a2347700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3a2347700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1973d0 con 0x7fd39c100dc0 2024-09-18T12:44:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3a2347700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c197510 con 0x7fd39c0ffbc0 2024-09-18T12:44:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52366/0 (socket says 172.21.15.81:52366) 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 -- 172.21.15.81:0/3651764736 learned_addr learned my addr 172.21.15.81:0/3651764736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39bfff700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 0x7fd39c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 -- 172.21.15.81:0/3651764736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 msgr2=0x7fd39c196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 0x7fd39c196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 -- 172.21.15.81:0/3651764736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900095f0 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd39b7fe700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd390006010 tx=0x7fd39000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39001d070 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd39000f460 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c19bf60 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.027+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd390021640 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.028+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c19c420 con 0x7fd39c100dc0 2024-09-18T12:44:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.028+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c068af0 con 0x7fd39c100dc0 2024-09-18T12:44:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.029+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fd39000fab0 con 0x7fd39c100dc0 2024-09-18T12:44:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.029+0000 7fd3997fa700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 0x7fd38406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.029+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fd39008ba30 con 0x7fd39c100dc0 2024-09-18T12:44:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.029+0000 7fd39bfff700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 0x7fd38406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.030+0000 7fd39bfff700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 0x7fd38406e920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006fd0 tx=0x7fd38c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:25.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.035+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd39005aeb0 con 0x7fd39c100dc0 2024-09-18T12:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.236+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fd39c19c700 con 0x7fd39c100dc0 2024-09-18T12:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.241+0000 7fd3997fa700 1 -- 172.21.15.81:0/3651764736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v27)=0 v27) v1 ==== 106+0+0 (secure 0 0 0) 0x7fd3900260b0 con 0x7fd39c100dc0 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 msgr2=0x7fd38406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 0x7fd38406e920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006fd0 tx=0x7fd38c008040 comp rx=0 tx=0).stop 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 msgr2=0x7fd39c196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd390006010 tx=0x7fd39000be20 comp rx=0 tx=0).stop 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 shutdown_connections 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39c0ffbc0 0x7fd39c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd38406c460 0x7fd38406e920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 --2- 172.21.15.81:0/3651764736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c100dc0 0x7fd39c196db0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 >> 172.21.15.81:0/3651764736 conn(0x7fd39c0fb160 msgr2=0x7fd39c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.243+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 shutdown_connections 2024-09-18T12:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:25.244+0000 7fd3a2347700 1 -- 172.21.15.81:0/3651764736 wait complete. 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:25 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3651764736' entity='client.admin' 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:25.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:25 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3651764736' entity='client.admin' 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.622+0000 7f8f30794700 1 -- 172.21.15.81:0/1397947254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f281022b0 msgr2=0x7f8f281026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.622+0000 7f8f30794700 1 --2- 172.21.15.81:0/1397947254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f281022b0 0x7f8f281026d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009910 tx=0x7f8f24009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- 172.21.15.81:0/1397947254 shutdown_connections 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 --2- 172.21.15.81:0/1397947254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f280fed30 0x7f8f280ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 --2- 172.21.15.81:0/1397947254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f281022b0 0x7f8f281026d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- 172.21.15.81:0/1397947254 >> 172.21.15.81:0/1397947254 conn(0x7f8f280fa8b0 msgr2=0x7f8f280fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- 172.21.15.81:0/1397947254 shutdown_connections 2024-09-18T12:44:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- 172.21.15.81:0/1397947254 wait complete. 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 Processor -- start 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- start start 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 0x7f8f28196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28196fe0 con 0x7f8f280fed30 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f30794700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28197120 con 0x7f8f281022b0 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f2e530700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f2e530700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48976/0 (socket says 172.21.15.81:48976) 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.623+0000 7f8f2e530700 1 -- 172.21.15.81:0/3777684254 learned_addr learned my addr 172.21.15.81:0/3777684254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2dd2f700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 0x7f8f28196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2e530700 1 -- 172.21.15.81:0/3777684254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 msgr2=0x7f8f28196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2e530700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 0x7f8f28196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2e530700 1 -- 172.21.15.81:0/3777684254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240095f0 con 0x7f8f280fed30 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2dd2f700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 0x7f8f28196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f2e530700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400bda0 tx=0x7f8f2400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2401d070 con 0x7f8f280fed30 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f24004c50 con 0x7f8f280fed30 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2819bb80 con 0x7f8f280fed30 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2400f690 con 0x7f8f280fed30 2024-09-18T12:44:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.624+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2819c040 con 0x7f8f280fed30 2024-09-18T12:44:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.625+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f28109830 con 0x7f8f280fed30 2024-09-18T12:44:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.626+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f8f24022a20 con 0x7f8f280fed30 2024-09-18T12:44:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.626+0000 7f8f1f7fe700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 0x7f8f1406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.626+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f8f2408bbc0 con 0x7f8f280fed30 2024-09-18T12:44:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.626+0000 7f8f2dd2f700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 0x7f8f1406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.626+0000 7f8f2dd2f700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 0x7f8f1406e920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f28068da0 tx=0x7f8f1800a680 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.631+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8f2405b210 con 0x7f8f280fed30 2024-09-18T12:44:27.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:27 smithi136 ceph-mon[35363]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.822+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f8f2819c650 con 0x7f8f280fed30 2024-09-18T12:44:27.824 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:27 smithi081 ceph-mon[27646]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.828+0000 7f8f1f7fe700 1 -- 172.21.15.81:0/3777684254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8f24027020 con 0x7f8f280fed30 2024-09-18T12:44:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 msgr2=0x7f8f1406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 0x7f8f1406e920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f28068da0 tx=0x7f8f1800a680 comp rx=0 tx=0).stop 2024-09-18T12:44:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 msgr2=0x7f8f28196510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400bda0 tx=0x7f8f2400be80 comp rx=0 tx=0).stop 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 shutdown_connections 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f1406c460 0x7f8f1406e920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280fed30 0x7f8f28196510 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 --2- 172.21.15.81:0/3777684254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f281022b0 0x7f8f28196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 >> 172.21.15.81:0/3777684254 conn(0x7f8f280fa8b0 msgr2=0x7f8f28105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 shutdown_connections 2024-09-18T12:44:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:27.831+0000 7f8f30794700 1 -- 172.21.15.81:0/3777684254 wait complete. 2024-09-18T12:44:28.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.065 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.065 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.693 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2a553466-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-18T12:44:28.694 INFO:tasks.cephadm:Deploying OSDs... 2024-09-18T12:44:28.695 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:44:28.695 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:44:28.712 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:44:28.712 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-18T12:44:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 12:42:56.045819768 +0000 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 12:38:00.343420145 +0000 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 12:38:00.343420145 +0000 2024-09-18T12:44:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 12:38:00.343420145 +0000 2024-09-18T12:44:28.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:44:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T12:44:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T12:44:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000246419 s, 2.1 MB/s 2024-09-18T12:44:28.835 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:44:28.891 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-18T12:44:28.946 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 12:42:56.046819749 +0000 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 12:38:00.679413901 +0000 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 12:38:00.679413901 +0000 2024-09-18T12:44:28.947 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 12:38:00.679413901 +0000 2024-09-18T12:44:28.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:44:28.998 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:28 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3777684254' entity='client.admin' 2024-09-18T12:44:29.010 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T12:44:29.010 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T12:44:29.010 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000184515 s, 2.8 MB/s 2024-09-18T12:44:29.011 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:44:29.067 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 12:42:56.046819749 +0000 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 12:38:01.003407881 +0000 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 12:38:01.003407881 +0000 2024-09-18T12:44:29.122 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 12:38:01.003407881 +0000 2024-09-18T12:44:29.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:44:29.188 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T12:44:29.188 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T12:44:29.188 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000223028 s, 2.3 MB/s 2024-09-18T12:44:29.189 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:44:29.246 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 12:42:56.046819749 +0000 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 12:38:01.325401898 +0000 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 12:38:01.325401898 +0000 2024-09-18T12:44:29.302 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 12:38:01.325401898 +0000 2024-09-18T12:44:29.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:44:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:28 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3777684254' entity='client.admin' 2024-09-18T12:44:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T12:44:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T12:44:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000212993 s, 2.4 MB/s 2024-09-18T12:44:29.367 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:44:29.423 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:44:29.423 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:44:29.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:44:29.444 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-09-18T12:44:29.502 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:44:29.502 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:29.502 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T12:44:29.502 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:29.503 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:29.503 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-18 12:43:31.557159384 +0000 2024-09-18T12:44:29.503 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-18 12:37:50.720436735 +0000 2024-09-18T12:44:29.503 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-18 12:37:50.720436735 +0000 2024-09-18T12:44:29.503 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-18 12:37:50.720436735 +0000 2024-09-18T12:44:29.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:44:29.571 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-18T12:44:29.571 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-18T12:44:29.571 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000236344 s, 2.2 MB/s 2024-09-18T12:44:29.573 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:44:29.631 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-09-18T12:44:29.689 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:44:29.689 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:29.689 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T12:44:29.689 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:29.690 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:29.690 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-18 12:43:31.557159384 +0000 2024-09-18T12:44:29.690 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-18 12:37:51.050429100 +0000 2024-09-18T12:44:29.690 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-18 12:37:51.050429100 +0000 2024-09-18T12:44:29.690 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-18 12:37:51.050429100 +0000 2024-09-18T12:44:29.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:44:29.755 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-18T12:44:29.756 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-18T12:44:29.756 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000269564 s, 1.9 MB/s 2024-09-18T12:44:29.757 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:44:29.817 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-18 12:43:31.558159361 +0000 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-18 12:37:51.383421395 +0000 2024-09-18T12:44:29.874 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-18 12:37:51.383421395 +0000 2024-09-18T12:44:29.875 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-18 12:37:51.383421395 +0000 2024-09-18T12:44:29.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:44:29.939 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-18T12:44:29.939 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-18T12:44:29.939 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000301601 s, 1.7 MB/s 2024-09-18T12:44:29.941 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:44:29.998 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-09-18T12:44:30.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:29 smithi081 ceph-mon[27646]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-18 12:43:31.558159361 +0000 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-18 12:37:51.696414154 +0000 2024-09-18T12:44:30.054 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-18 12:37:51.696414154 +0000 2024-09-18T12:44:30.055 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-18 12:37:51.696414154 +0000 2024-09-18T12:44:30.055 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:44:30.117 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:29 smithi136 ceph-mon[35363]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:30.119 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-18T12:44:30.120 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-18T12:44:30.120 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000188555 s, 2.7 MB/s 2024-09-18T12:44:30.121 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:44:30.177 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-18T12:44:30.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:44:30.888 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:44:31.009 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:30 smithi081 ceph-mon[27646]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:30 smithi136 ceph-mon[35363]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:33.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:33 smithi081 ceph-mon[27646]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:33.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:33 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:33.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:33 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:33.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:33 smithi081 ceph-mon[27646]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-09-18T12:44:33.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:33 smithi081 ceph-mon[27646]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-09-18T12:44:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:33 smithi136 ceph-mon[35363]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:33 smithi136 ceph-mon[35363]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-09-18T12:44:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:33 smithi136 ceph-mon[35363]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-09-18T12:44:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:44:34.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-18T12:44:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:44:35.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:35 smithi081 ceph-mon[27646]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:36.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:35 smithi136 ceph-mon[35363]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:38.019 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:37 smithi081 ceph-mon[27646]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:38.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:37 smithi136 ceph-mon[35363]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- 172.21.15.81:0/4252075755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4101eb0 msgr2=0x7fbfa4102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 --2- 172.21.15.81:0/4252075755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4101eb0 0x7fbfa4102310 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009910 tx=0x7fbf94009c20 comp rx=0 tx=0).stop 2024-09-18T12:44:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- 172.21.15.81:0/4252075755 shutdown_connections 2024-09-18T12:44:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 --2- 172.21.15.81:0/4252075755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4101eb0 0x7fbfa4102310 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 --2- 172.21.15.81:0/4252075755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- 172.21.15.81:0/4252075755 >> 172.21.15.81:0/4252075755 conn(0x7fbfa40fc230 msgr2=0x7fbfa40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- 172.21.15.81:0/4252075755 shutdown_connections 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- 172.21.15.81:0/4252075755 wait complete. 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 Processor -- start 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.268+0000 7fbfac65e700 1 -- start start 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4101eb0 0x7fbfa41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4197010 con 0x7fbfa4100cb0 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4197150 con 0x7fbfa4101eb0 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58276/0 (socket says 172.21.15.81:58276) 2024-09-18T12:44:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 -- 172.21.15.81:0/1261964914 learned_addr learned my addr 172.21.15.81:0/1261964914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:44:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfa9bf9700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4101eb0 0x7fbfa41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 -- 172.21.15.81:0/1261964914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4101eb0 msgr2=0x7fbfa41969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4101eb0 0x7fbfa41969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 -- 172.21.15.81:0/1261964914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940095f0 con 0x7fbfa4100cb0 2024-09-18T12:44:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfaa3fa700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000d900 tx=0x7fbfa000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa000b920 con 0x7fbfa4100cb0 2024-09-18T12:44:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa419bc00 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbfa0010460 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa000f590 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.269+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa419c150 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.270+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa4109810 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.271+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fbfa00105d0 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.271+0000 7fbf9b7fe700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 0x7fbf9006e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.272+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fbfa008a510 con 0x7fbfa4100cb0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.272+0000 7fbfa9bf9700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 0x7fbf9006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.272+0000 7fbfa9bf9700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 0x7fbf9006e930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf9400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.276+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbfa0059910 con 0x7fbfa4100cb0 2024-09-18T12:44:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:44:38.489+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfa4106800 con 0x7fbf9006c470 2024-09-18T12:44:39.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:39.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:39.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:40.024 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:39 smithi081 ceph-mon[27646]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:40.024 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:39 smithi081 ceph-mon[27646]: from='client.14324 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:40.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:39 smithi136 ceph-mon[35363]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:39 smithi136 ceph-mon[35363]: from='client.14324 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:41 smithi136 ceph-mon[35363]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:41 smithi081 ceph-mon[27646]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:43.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/382252199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aebf45a3-32ad-463f-8d90-0e28808cde70"}]: dispatch 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/382252199' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aebf45a3-32ad-463f-8d90-0e28808cde70"}]': finished 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:44:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/812650237' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/382252199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aebf45a3-32ad-463f-8d90-0e28808cde70"}]: dispatch 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/382252199' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aebf45a3-32ad-463f-8d90-0e28808cde70"}]': finished 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:44:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/812650237' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:44.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:43 smithi136 ceph-mon[35363]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:43 smithi081 ceph-mon[27646]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:45 smithi136 ceph-mon[35363]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:46.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:45 smithi081 ceph-mon[27646]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:47.979 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:47 smithi081 ceph-mon[27646]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:48.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:47 smithi136 ceph-mon[35363]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:49 smithi081 ceph-mon[27646]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:50.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:49 smithi136 ceph-mon[35363]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:50.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:51 smithi136 ceph-mon[35363]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:52.101 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:51 smithi081 ceph-mon[27646]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: Reconfiguring ceph-exporter.smithi136 (monmap changed)... 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: Reconfiguring daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:44:53.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:53 smithi136 ceph-mon[35363]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:53.550 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: Reconfiguring ceph-exporter.smithi136 (monmap changed)... 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: Reconfiguring daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:44:53.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:53 smithi081 ceph-mon[27646]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:54.525 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:44:54.525 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:54.525 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: Deploying daemon osd.0 on smithi081 2024-09-18T12:44:54.525 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:54.525 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:54.526 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: Reconfiguring crash.smithi136 (monmap changed)... 2024-09-18T12:44:54.526 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:54.526 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:54.526 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:54 smithi136 ceph-mon[35363]: Reconfiguring daemon crash.smithi136 on smithi136 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: Deploying daemon osd.0 on smithi081 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: Reconfiguring crash.smithi136 (monmap changed)... 2024-09-18T12:44:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:54.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:54.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:54 smithi081 ceph-mon[27646]: Reconfiguring daemon crash.smithi136 on smithi136 2024-09-18T12:44:55.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:55.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:55.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:44:55.342 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:44:55.342 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:44:55.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:56.414 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:56 smithi081 ceph-mon[27646]: Reconfiguring mgr.smithi136.vdkrdt (monmap changed)... 2024-09-18T12:44:56.414 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:56 smithi081 ceph-mon[27646]: Reconfiguring daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:44:56.521 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:56 smithi136 ceph-mon[35363]: Reconfiguring mgr.smithi136.vdkrdt (monmap changed)... 2024-09-18T12:44:56.521 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:56 smithi136 ceph-mon[35363]: Reconfiguring daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: Reconfiguring mon.smithi136 (monmap changed)... 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:44:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:44:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:57 smithi081 ceph-mon[27646]: Reconfiguring daemon mon.smithi136 on smithi136 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: Reconfiguring mon.smithi136 (monmap changed)... 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:44:57.919 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:57.920 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:57 smithi136 ceph-mon[35363]: Reconfiguring daemon mon.smithi136 on smithi136 2024-09-18T12:44:59.283 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:44:59.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:59.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:44:58 smithi081 ceph-mon[27646]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:44:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:59.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:44:58 smithi136 ceph-mon[35363]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.288 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:00.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:01.275 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:01 smithi081 ceph-mon[27646]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:01.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:01 smithi136 ceph-mon[35363]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.916+0000 7fbf9b7fe700 1 -- 172.21.15.81:0/1261964914 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbfa4106800 con 0x7fbf9006c470 2024-09-18T12:45:02.918 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 msgr2=0x7fbf9006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 0x7fbf9006e930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf9400b540 comp rx=0 tx=0).stop 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 msgr2=0x7fbfa41964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000d900 tx=0x7fbfa000dcc0 comp rx=0 tx=0).stop 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 shutdown_connections 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbf9006c470 0x7fbf9006e930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa4100cb0 0x7fbfa41964b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 --2- 172.21.15.81:0/1261964914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa4101eb0 0x7fbfa41969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 >> 172.21.15.81:0/1261964914 conn(0x7fbfa40fc230 msgr2=0x7fbfa41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 shutdown_connections 2024-09-18T12:45:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:02.918+0000 7fbfac65e700 1 -- 172.21.15.81:0/1261964914 wait complete. 2024-09-18T12:45:03.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:03 smithi136 ceph-mon[35363]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:03.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:03.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:03.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:03 smithi136 ceph-mon[35363]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:45:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:03 smithi081 ceph-mon[27646]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:03 smithi081 ceph-mon[27646]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:45:04.208 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.0.service 2024-09-18T12:45:04.211 INFO:tasks.cephadm:Deploying osd.1 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-18T12:45:04.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:45:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:05.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:05.157 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[49309]: 2024-09-18T12:45:04.900+0000 7eff1422a700 -1 osd.0 0 waiting for initial osdmap 2024-09-18T12:45:05.157 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:45:04 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[49309]: 2024-09-18T12:45:04.903+0000 7eff0c818700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:06.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: from='osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:06.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:06.973 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] boot 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:06.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:06 smithi081 ceph-mon[27646]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: osd.0 [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] boot 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:06 smithi136 ceph-mon[35363]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:07 smithi136 ceph-mon[35363]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:45:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:07 smithi081 ceph-mon[27646]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:45:08.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:45:08.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-18T12:45:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:45:09.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:09 smithi081 ceph-mon[27646]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:09 smithi136 ceph-mon[35363]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 -- 172.21.15.81:0/1276255473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c100dc0 msgr2=0x7fab3c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 --2- 172.21.15.81:0/1276255473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c100dc0 0x7fab3c101220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab30009910 tx=0x7fab30009c20 comp rx=0 tx=0).stop 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 -- 172.21.15.81:0/1276255473 shutdown_connections 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 --2- 172.21.15.81:0/1276255473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c100dc0 0x7fab3c101220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 --2- 172.21.15.81:0/1276255473 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 -- 172.21.15.81:0/1276255473 >> 172.21.15.81:0/1276255473 conn(0x7fab3c0fb160 msgr2=0x7fab3c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 -- 172.21.15.81:0/1276255473 shutdown_connections 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.727+0000 7fab4101d700 1 -- 172.21.15.81:0/1276255473 wait complete. 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 Processor -- start 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 -- start start 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c100dc0 0x7fab3c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1972a0 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab4101d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1973e0 con 0x7fab3c100dc0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50970/0 (socket says 172.21.15.81:50970) 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 -- 172.21.15.81:0/3414718641 learned_addr learned my addr 172.21.15.81:0/3414718641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3a59c700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c100dc0 0x7fab3c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 -- 172.21.15.81:0/3414718641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c100dc0 msgr2=0x7fab3c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c100dc0 0x7fab3c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.728+0000 7fab3ad9d700 1 -- 172.21.15.81:0/3414718641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300095f0 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab3ad9d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c910 tx=0x7fab2c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2c0041f0 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c19bea0 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab2c00ce60 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2c003d20 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.729+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c19c360 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.730+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c068af0 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.731+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fab2c00f450 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.731+0000 7fab23fff700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 0x7fab2406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.731+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7fab2c08a600 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.731+0000 7fab3a59c700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 0x7fab2406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.732+0000 7fab3a59c700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 0x7fab2406e970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab3000b5c0 tx=0x7fab300052a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.736+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fab2c059760 con 0x7fab3c0ffbc0 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:11.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:11.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:11.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.971 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:11.971 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:11.971 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:11.971 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:11.982+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fab3c069560 con 0x7fab2406c4b0 2024-09-18T12:45:12.988 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:12 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi081 2024-09-18T12:45:12.988 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:12 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi081 to 11840M 2024-09-18T12:45:12.988 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:12.988 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:12.988 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:12 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi081 2024-09-18T12:45:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:12 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi081 to 11840M 2024-09-18T12:45:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:13 smithi081 ceph-mon[27646]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:13 smithi081 ceph-mon[27646]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:13 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:13 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:14.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:13 smithi136 ceph-mon[35363]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:14.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:13 smithi136 ceph-mon[35363]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:14.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:13 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:14.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:13 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:16.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:16.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/402589765' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c489a23-0fbc-4071-ae2a-5c6654858702"}]: dispatch 2024-09-18T12:45:16.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/402589765' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c489a23-0fbc-4071-ae2a-5c6654858702"}]': finished 2024-09-18T12:45:16.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:45:16.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:16.047 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1095502506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/402589765' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c489a23-0fbc-4071-ae2a-5c6654858702"}]: dispatch 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/402589765' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c489a23-0fbc-4071-ae2a-5c6654858702"}]': finished 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:15 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1095502506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:20.059 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:19 smithi081 ceph-mon[27646]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:20.059 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:20.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:19 smithi136 ceph-mon[35363]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:20.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:21.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:21 smithi081 ceph-mon[27646]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:21 smithi136 ceph-mon[35363]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:22.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:45:22.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:45:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:23.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:23 smithi136 ceph-mon[35363]: Deploying daemon osd.1 on smithi081 2024-09-18T12:45:23.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:23 smithi136 ceph-mon[35363]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:23.915 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:23 smithi081 ceph-mon[27646]: Deploying daemon osd.1 on smithi081 2024-09-18T12:45:23.915 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:23 smithi081 ceph-mon[27646]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:26.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:25 smithi081 ceph-mon[27646]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:26.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:25 smithi136 ceph-mon[35363]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:27.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:27 smithi081 ceph-mon[27646]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:27.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:27.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:27.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:28.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:27 smithi136 ceph-mon[35363]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:28.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:28.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:28.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:29.996 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:29 smithi081 ceph-mon[27646]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:29.996 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:29 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:29.996 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:29 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:29 smithi136 ceph-mon[35363]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:29 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:29 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 1 on host 'smithi081' 2024-09-18T12:45:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.903+0000 7fab23fff700 1 -- 172.21.15.81:0/3414718641 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fab3c069560 con 0x7fab2406c4b0 2024-09-18T12:45:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 msgr2=0x7fab2406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 0x7fab2406e970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab3000b5c0 tx=0x7fab300052a0 comp rx=0 tx=0).stop 2024-09-18T12:45:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 msgr2=0x7fab3c1967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c910 tx=0x7fab2c00cc20 comp rx=0 tx=0).stop 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 shutdown_connections 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fab2406c4b0 0x7fab2406e970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab3c0ffbc0 0x7fab3c1967d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 --2- 172.21.15.81:0/3414718641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab3c100dc0 0x7fab3c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 >> 172.21.15.81:0/3414718641 conn(0x7fab3c0fb160 msgr2=0x7fab3c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 shutdown_connections 2024-09-18T12:45:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:30.906+0000 7fab4101d700 1 -- 172.21.15.81:0/3414718641 wait complete. 2024-09-18T12:45:31.538 DEBUG:teuthology.orchestra.run.smithi081:osd.1> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.1.service 2024-09-18T12:45:31.540 INFO:tasks.cephadm:Deploying osd.2 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-18T12:45:31.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:45:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:31 smithi081 ceph-mon[27646]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:31 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:31 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:31.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:31 smithi081 ceph-mon[27646]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:45:31.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:45:31 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:45:31.575+0000 7f8c79ad9640 -1 osd.1 0 log_to_monitors true 2024-09-18T12:45:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:31 smithi136 ceph-mon[35363]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:31 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:31 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:31 smithi136 ceph-mon[35363]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:45:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:45:33.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-mon[27646]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:45:33.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-mon[27646]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T12:45:33.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:33.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-mon[27646]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:45:33.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-mon[27646]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:33.016 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:45:32.877+0000 7f8c6e93c700 -1 osd.1 0 waiting for initial osdmap 2024-09-18T12:45:33.016 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:45:32 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:45:32.883+0000 7f8c69f30700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:45:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:32 smithi136 ceph-mon[35363]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:45:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:32 smithi136 ceph-mon[35363]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T12:45:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:32 smithi136 ceph-mon[35363]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:45:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:32 smithi136 ceph-mon[35363]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:34.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:33 smithi081 ceph-mon[27646]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:45:34.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:33 smithi081 ceph-mon[27646]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T12:45:34.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:33 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.125 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:33 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:33 smithi136 ceph-mon[35363]: from='osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:45:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:33 smithi136 ceph-mon[35363]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T12:45:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:33 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] boot 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T12:45:34.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:34.973 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:34.973 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: osd.1 [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] boot 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:45:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:35.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:45:35.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-18T12:45:36.189 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:35 smithi081 ceph-mon[27646]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T12:45:36.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:35 smithi136 ceph-mon[35363]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T12:45:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:45:38.032 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:37 smithi081 ceph-mon[27646]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:38.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:38.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:38.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:37 smithi136 ceph-mon[35363]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:38.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:38.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 -- 172.21.15.81:0/1322158732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 msgr2=0x7f1648102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 --2- 172.21.15.81:0/1322158732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648102310 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f163c009910 tx=0x7f163c009c20 comp rx=0 tx=0).stop 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 -- 172.21.15.81:0/1322158732 shutdown_connections 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 --2- 172.21.15.81:0/1322158732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648102310 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 --2- 172.21.15.81:0/1322158732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 0x7f16481010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 -- 172.21.15.81:0/1322158732 >> 172.21.15.81:0/1322158732 conn(0x7f16480fc230 msgr2=0x7f16480fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 -- 172.21.15.81:0/1322158732 shutdown_connections 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.253+0000 7f164d35a700 1 -- 172.21.15.81:0/1322158732 wait complete. 2024-09-18T12:45:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 Processor -- start 2024-09-18T12:45:38.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 -- start start 2024-09-18T12:45:38.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 0x7f1648196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481970b0 con 0x7f1648101eb0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f164d35a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481971f0 con 0x7f1648100cb0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f16467fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f16467fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58756/0 (socket says 172.21.15.81:58756) 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f16467fc700 1 -- 172.21.15.81:0/5330375 learned_addr learned my addr 172.21.15.81:0/5330375 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.254+0000 7f1646ffd700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 0x7f1648196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f16467fc700 1 -- 172.21.15.81:0/5330375 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 msgr2=0x7f1648196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f16467fc700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 0x7f1648196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f16467fc700 1 -- 172.21.15.81:0/5330375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0095f0 con 0x7f1648101eb0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f16467fc700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f163c006010 tx=0x7f163c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163c01d070 con 0x7f1648101eb0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164819bc40 con 0x7f1648101eb0 2024-09-18T12:45:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f163c00f460 con 0x7f1648101eb0 2024-09-18T12:45:38.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163c021640 con 0x7f1648101eb0 2024-09-18T12:45:38.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.255+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164819c130 con 0x7f1648101eb0 2024-09-18T12:45:38.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.256+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16481098b0 con 0x7f1648101eb0 2024-09-18T12:45:38.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.256+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f163c00fab0 con 0x7f1648101eb0 2024-09-18T12:45:38.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.257+0000 7f162ffff700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 0x7f163006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.257+0000 7f1646ffd700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 0x7f163006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.257+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f163c08bd70 con 0x7f1648101eb0 2024-09-18T12:45:38.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.257+0000 7f1646ffd700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 0x7f163006e920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1648101d10 tx=0x7f1638009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.261+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f163c05add0 con 0x7f1648101eb0 2024-09-18T12:45:38.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:45:38.470+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1648106800 con 0x7f163006c460 2024-09-18T12:45:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:40.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:39 smithi081 ceph-mon[27646]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:40.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:39 smithi081 ceph-mon[27646]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:40.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:39 smithi136 ceph-mon[35363]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:39 smithi136 ceph-mon[35363]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:41.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:41.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:42 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi081 2024-09-18T12:45:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:42 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi081 to 5920M 2024-09-18T12:45:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:42 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:43.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:42 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi081 2024-09-18T12:45:43.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:42 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi081 to 5920M 2024-09-18T12:45:43.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:42 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3136343069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "512e92ea-0506-4c3a-bfef-2c7c4d57c1ba"}]: dispatch 2024-09-18T12:45:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3136343069' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "512e92ea-0506-4c3a-bfef-2c7c4d57c1ba"}]': finished 2024-09-18T12:45:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:45:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:45:44.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:43 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/544565952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3136343069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "512e92ea-0506-4c3a-bfef-2c7c4d57c1ba"}]: dispatch 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3136343069' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "512e92ea-0506-4c3a-bfef-2c7c4d57c1ba"}]': finished 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:45:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:43 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/544565952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:45.158 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:44 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:45.158 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:44 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:45.158 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:44 smithi136 ceph-mon[35363]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:45.188 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:44 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:45.189 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:44 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:45.189 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:44 smithi081 ceph-mon[27646]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:47.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:47.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:47.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:47 smithi081 ceph-mon[27646]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:47 smithi136 ceph-mon[35363]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:50.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:49 smithi136 ceph-mon[35363]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:50.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:49 smithi081 ceph-mon[27646]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:50.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:50 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:45:50.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:50 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:51.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:50 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:45:51.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:50 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:51.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:51 smithi081 ceph-mon[27646]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:51.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:51 smithi081 ceph-mon[27646]: Deploying daemon osd.2 on smithi081 2024-09-18T12:45:52.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:51 smithi136 ceph-mon[35363]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:51 smithi136 ceph-mon[35363]: Deploying daemon osd.2 on smithi081 2024-09-18T12:45:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:53 smithi136 ceph-mon[35363]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:53 smithi081 ceph-mon[27646]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:55.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:55 smithi081 ceph-mon[27646]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:55 smithi136 ceph-mon[35363]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:57 smithi081 ceph-mon[27646]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:57.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:57.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:45:57.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:57.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:57 smithi136 ceph-mon[35363]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:45:59.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:45:59 smithi081 ceph-mon[27646]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:00.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:45:59 smithi136 ceph-mon[35363]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.375+0000 7f162ffff700 1 -- 172.21.15.81:0/5330375 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1648106800 con 0x7f163006c460 2024-09-18T12:46:00.377 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 2 on host 'smithi081' 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 msgr2=0x7f163006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 0x7f163006e920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1648101d10 tx=0x7f1638009190 comp rx=0 tx=0).stop 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 msgr2=0x7f1648196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f163c006010 tx=0x7f163c00bd70 comp rx=0 tx=0).stop 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 shutdown_connections 2024-09-18T12:46:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1648100cb0 0x7f1648196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f163006c460 0x7f163006e920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 --2- 172.21.15.81:0/5330375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1648101eb0 0x7f1648196a90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 >> 172.21.15.81:0/5330375 conn(0x7f16480fc230 msgr2=0x7f16481050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 shutdown_connections 2024-09-18T12:46:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:46:00.378+0000 7f164d35a700 1 -- 172.21.15.81:0/5330375 wait complete. 2024-09-18T12:46:01.030 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:00 smithi081 ceph-mon[27646]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:46:01.030 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:01.030 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:01.058 DEBUG:teuthology.orchestra.run.smithi081:osd.2> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.2.service 2024-09-18T12:46:01.060 INFO:tasks.cephadm:Deploying osd.3 on smithi136 with /dev/vg_nvme/lv_4... 2024-09-18T12:46:01.060 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:46:01.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:00 smithi136 ceph-mon[35363]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:46:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:02.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-mon[27646]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:02.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-mon[27646]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:46:02.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-mon[27646]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:46:02.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:02.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-mon[27646]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:46:02.027 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[63993]: 2024-09-18T12:46:01.719+0000 7fada7cb2700 -1 osd.2 0 waiting for initial osdmap 2024-09-18T12:46:02.027 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:01 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[63993]: 2024-09-18T12:46:01.725+0000 7fada02a0700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:46:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:01 smithi136 ceph-mon[35363]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:01 smithi136 ceph-mon[35363]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:46:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:01 smithi136 ceph-mon[35363]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:46:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:01 smithi136 ceph-mon[35363]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-18T12:46:03.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:02 smithi081 ceph-mon[27646]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:46:03.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:02 smithi081 ceph-mon[27646]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:46:03.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:02 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:03.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:02 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:02 smithi136 ceph-mon[35363]: from='osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-18T12:46:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:02 smithi136 ceph-mon[35363]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:46:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:02 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:02 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:03.841 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:46:03.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-09-18T12:46:04.062 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:04.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] boot 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:04.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:46:04.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:46:04.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:46:04.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: osd.2 [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] boot 2024-09-18T12:46:04.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:46:04.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:04.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:04.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:04.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:04.766 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:04 smithi136 ceph-mon[35363]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T12:46:04.766 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:04.766 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:46:04.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:04 smithi081 ceph-mon[27646]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T12:46:04.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:04.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:46:05.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 -- 172.21.15.136:0/1946590969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb700100520 msgr2=0x7fb700100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 --2- 172.21.15.136:0/1946590969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb700100520 0x7fb700100980 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009910 tx=0x7fb6f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 -- 172.21.15.136:0/1946590969 shutdown_connections 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 --2- 172.21.15.136:0/1946590969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb700100520 0x7fb700100980 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 --2- 172.21.15.136:0/1946590969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7000ff320 0x7fb7000ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 -- 172.21.15.136:0/1946590969 >> 172.21.15.136:0/1946590969 conn(0x7fb7000fa8c0 msgr2=0x7fb7000fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 -- 172.21.15.136:0/1946590969 shutdown_connections 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.667+0000 7fb705d1e700 1 -- 172.21.15.136:0/1946590969 wait complete. 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 Processor -- start 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 -- start start 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 0x7fb700195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700196480 con 0x7fb700100520 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.668+0000 7fb705d1e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001965f0 con 0x7fb7000ff320 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56408/0 (socket says 172.21.15.136:56408) 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 -- 172.21.15.136:0/3725266573 learned_addr learned my addr 172.21.15.136:0/3725266573 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6feffd700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 0x7fb700195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 -- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 msgr2=0x7fb700195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 0x7fb700195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 -- 172.21.15.136:0/3725266573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00095f0 con 0x7fb7000ff320 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6feffd700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 0x7fb700195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:05.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6ff7fe700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4007b50 tx=0x7fb6f4007f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f4011070 con 0x7fb7000ff320 2024-09-18T12:46:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb6f400c2e0 con 0x7fb7000ff320 2024-09-18T12:46:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7001946f0 con 0x7fb7000ff320 2024-09-18T12:46:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f400e800 con 0x7fb7000ff320 2024-09-18T12:46:05.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.669+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb700194c40 con 0x7fb7000ff320 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.670+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb700107e80 con 0x7fb7000ff320 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.671+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fb6f4003af0 con 0x7fb7000ff320 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.671+0000 7fb6fcff9700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 0x7fb6e806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.671+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3049+0+0 (secure 0 0 0) 0x7fb6f408c330 con 0x7fb7000ff320 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.672+0000 7fb6feffd700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 0x7fb6e806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.672+0000 7fb6feffd700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 0x7fb6e806e920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000c00 tx=0x7fb6f000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.676+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb6f40575e0 con 0x7fb7000ff320 2024-09-18T12:46:05.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:05.872+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb700104e70 con 0x7fb6e806c460 2024-09-18T12:46:06.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:05 smithi081 ceph-mon[27646]: pgmap v98: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:06.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:46:06.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:05 smithi081 ceph-mon[27646]: osdmap e21: 3 total, 3 up, 3 in 2024-09-18T12:46:06.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:46:06.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:05 smithi136 ceph-mon[35363]: pgmap v98: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:06.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:46:06.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:05 smithi136 ceph-mon[35363]: osdmap e21: 3 total, 3 up, 3 in 2024-09-18T12:46:06.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:46:06.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:46:06.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:06.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68112]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:06.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68112]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:06.689 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:46:06.690 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:06.690 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68118]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:06.690 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68118]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:06.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:06.831+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fb6f401cda0 con 0x7fb7000ff320 2024-09-18T12:46:06.971 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: osdmap e22: 3 total, 3 up, 3 in 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:06.972 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:06.973 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:06.973 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:06.973 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:06 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.105 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68153]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:46:07.105 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68153]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:07.105 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68153]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:07.105 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:06 smithi081 sudo[68153]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:07.105 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: osdmap e22: 3 total, 3 up, 3 in 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:07.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:07.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:06 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:07.357 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68222]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:46:07.357 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68222]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:07.357 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68222]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:07.357 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68222]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:07.630 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68306]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:46:07.630 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68306]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:07.630 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68306]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:07.630 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68306]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:07.890 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68319]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:46:07.890 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:07.890 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68319]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:07.890 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68319]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:08.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68334]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:46:08.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68334]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:08.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68334]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:08.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:07 smithi081 sudo[68334]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:08.452 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:08.452 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi081 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi081 to 3946M 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: osdmap e23: 3 total, 3 up, 3 in 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: mgrmap e19: smithi081.pfnvgp(active, since 3m), standbys: smithi136.vdkrdt 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39293]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:08.453 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39293]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:08.470 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 sudo[68438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:46:08.470 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 sudo[68438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:08.470 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 sudo[68438]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 sudo[68438]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi081 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi081 to 3946M 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: osdmap e23: 3 total, 3 up, 3 in 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: mgrmap e19: smithi081.pfnvgp(active, since 3m), standbys: smithi136.vdkrdt 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:08.471 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:08 smithi081 ceph-mon[27646]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:46:08.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:46:08.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:46:08.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39296]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-18T12:46:08.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:08 smithi136 sudo[39296]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: pgmap v103: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/2588750289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]: dispatch 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]: dispatch 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]': finished 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:09.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:09 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:46:09.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: pgmap v103: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/2588750289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]: dispatch 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]: dispatch 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce66d6e2-6d56-4470-84e9-90306ae535e7"}]': finished 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:09.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:09 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:10.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:10 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/938332921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:10 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/938332921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:11.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:11 smithi136 ceph-mon[35363]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:11.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:11.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:11 smithi081 ceph-mon[27646]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:12.562 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:12.562 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:12.562 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:13.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:13 smithi081 ceph-mon[27646]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:13.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:13 smithi136 ceph-mon[35363]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:15.794 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:15 smithi136 ceph-mon[35363]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:15 smithi081 ceph-mon[27646]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:16 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:46:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:16 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:16 smithi136 ceph-mon[35363]: Deploying daemon osd.3 on smithi136 2024-09-18T12:46:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:46:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:16 smithi081 ceph-mon[27646]: Deploying daemon osd.3 on smithi136 2024-09-18T12:46:18.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:17 smithi136 ceph-mon[35363]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:17 smithi081 ceph-mon[27646]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:20.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:19 smithi136 ceph-mon[35363]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:20.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:19 smithi081 ceph-mon[27646]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:22.000 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:21 smithi136 ceph-mon[35363]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:22.001 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:22.001 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:22.001 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:21 smithi081 ceph-mon[27646]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:23.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:23 smithi136 ceph-mon[35363]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:24.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:23 smithi081 ceph-mon[27646]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:24.342 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 3 on host 'smithi136' 2024-09-18T12:46:24.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.341+0000 7fb6fcff9700 1 -- 172.21.15.136:0/3725266573 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb700104e70 con 0x7fb6e806c460 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 msgr2=0x7fb6e806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 0x7fb6e806e920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000c00 tx=0x7fb6f000b540 comp rx=0 tx=0).stop 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 msgr2=0x7fb7001959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4007b50 tx=0x7fb6f4007f10 comp rx=0 tx=0).stop 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 shutdown_connections 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7000ff320 0x7fb7001959b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb6e806c460 0x7fb6e806e920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 --2- 172.21.15.136:0/3725266573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb700100520 0x7fb700195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.342+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 >> 172.21.15.136:0/3725266573 conn(0x7fb7000fa8c0 msgr2=0x7fb700103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:24.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.343+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 shutdown_connections 2024-09-18T12:46:24.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:24.343+0000 7fb705d1e700 1 -- 172.21.15.136:0/3725266573 wait complete. 2024-09-18T12:46:24.940 DEBUG:teuthology.orchestra.run.smithi136:osd.3> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.3.service 2024-09-18T12:46:24.942 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_3... 2024-09-18T12:46:24.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:46:25.315 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:25.556 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:25 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:25.556 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:25 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:25.556 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:25 smithi136 ceph-mon[35363]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:25.556 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:25 smithi136 ceph-mon[35363]: from='osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:46:25.556 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:25 smithi136 ceph-mon[35363]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:46:25.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:25.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:25.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:25 smithi081 ceph-mon[27646]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:25.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:25 smithi081 ceph-mon[27646]: from='osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:46:25.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:25 smithi081 ceph-mon[27646]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:46:26.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:46:26.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: osdmap e25: 4 total, 3 up, 4 in 2024-09-18T12:46:26.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:26.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:26.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:26.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:26.560 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:26.560 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[41355]: 2024-09-18T12:46:26.308+0000 7fa75d2a2700 -1 osd.3 0 waiting for initial osdmap 2024-09-18T12:46:26.560 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:46:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[41355]: 2024-09-18T12:46:26.315+0000 7fa757093700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: osdmap e25: 4 total, 3 up, 4 in 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:26.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:27 smithi136 ceph-mon[35363]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:46:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:27 smithi136 ceph-mon[35363]: osdmap e26: 4 total, 3 up, 4 in 2024-09-18T12:46:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:27 smithi136 ceph-mon[35363]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:27.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:27 smithi081 ceph-mon[27646]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:46:27.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:27 smithi081 ceph-mon[27646]: osdmap e26: 4 total, 3 up, 4 in 2024-09-18T12:46:27.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:27.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:27.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:27 smithi081 ceph-mon[27646]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] boot 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:46:28.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:28 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:28.623 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:46:28.623 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:46:28.623 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:28.624 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: osd.3 [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] boot 2024-09-18T12:46:28.624 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:46:28.624 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:28 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:46:28.626 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:46:28.645 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-09-18T12:46:29.377 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:29.528 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:29 smithi136 ceph-mon[35363]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:46:29.528 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:29 smithi136 ceph-mon[35363]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:29.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:29 smithi081 ceph-mon[27646]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:46:29.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:29 smithi081 ceph-mon[27646]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:30.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:30 smithi136 ceph-mon[35363]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:46:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:30 smithi081 ceph-mon[27646]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- 172.21.15.136:0/2772726573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 msgr2=0x7f8cf8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 --2- 172.21.15.136:0/2772726573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8101640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009910 tx=0x7f8cf4009c20 comp rx=0 tx=0).stop 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- 172.21.15.136:0/2772726573 shutdown_connections 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 --2- 172.21.15.136:0/2772726573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 0x7f8cf8100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 --2- 172.21.15.136:0/2772726573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8101640 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- 172.21.15.136:0/2772726573 >> 172.21.15.136:0/2772726573 conn(0x7f8cf80fa8c0 msgr2=0x7f8cf80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- 172.21.15.136:0/2772726573 shutdown_connections 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- 172.21.15.136:0/2772726573 wait complete. 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 Processor -- start 2024-09-18T12:46:31.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.350+0000 7f8cff68c700 1 -- start start 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 0x7f8cf81953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8195f20 con 0x7f8cf80ffdf0 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8196060 con 0x7f8cf8101220 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:42092/0 (socket says 172.21.15.136:42092) 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 -- 172.21.15.136:0/4234667698 learned_addr learned my addr 172.21.15.136:0/4234667698 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfd428700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 0x7f8cf81953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 -- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 msgr2=0x7f8cf81953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 0x7f8cf81953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 -- 172.21.15.136:0/4234667698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40095f0 con 0x7f8cf8101220 2024-09-18T12:46:31.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cfcc27700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009970 tx=0x7f8ce8009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ce8012070 con 0x7f8cf8101220 2024-09-18T12:46:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ce8007ae0 con 0x7f8cf8101220 2024-09-18T12:46:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf80fed40 con 0x7f8cf8101220 2024-09-18T12:46:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ce8017c20 con 0x7f8cf8101220 2024-09-18T12:46:31.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.351+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf80ff290 con 0x7f8cf8101220 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.352+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf81087c0 con 0x7f8cf8101220 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.353+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8ce8007c50 con 0x7f8cf8101220 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.353+0000 7f8cee7fc700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 0x7f8ce406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.353+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7f8ce808c5f0 con 0x7f8cf8101220 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.353+0000 7f8cfd428700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 0x7f8ce406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.354+0000 7f8cfd428700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 0x7f8ce406e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006010 tx=0x7f8cf400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:31.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.358+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8ce805b050 con 0x7f8cf8101220 2024-09-18T12:46:31.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:31.558+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf8105750 con 0x7f8ce406c4e0 2024-09-18T12:46:31.560 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:31 smithi136 ceph-mon[35363]: osdmap e30: 4 total, 4 up, 4 in 2024-09-18T12:46:31.560 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:31 smithi136 ceph-mon[35363]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:46:31.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:31 smithi081 ceph-mon[27646]: osdmap e30: 4 total, 4 up, 4 in 2024-09-18T12:46:31.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:31 smithi081 ceph-mon[27646]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:46:32.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: osdmap e31: 4 total, 4 up, 4 in 2024-09-18T12:46:32.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:32.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:32.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:32.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi136 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi136 to 14912M 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: osdmap e31: 4 total, 4 up, 4 in 2024-09-18T12:46:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi136 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi136 to 14912M 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:32.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:32 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:32.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:32.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:32.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:32.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:32 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:33.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:33 smithi136 ceph-mon[35363]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-18T12:46:33.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:33 smithi081 ceph-mon[27646]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/476630459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]: dispatch 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]: dispatch 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]': finished 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:35.032 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:35.033 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:34 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/2514286858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/476630459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]: dispatch 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]: dispatch 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9135dc3a-851b-45e3-8248-9572c6c54d07"}]': finished 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:34 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/2514286858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:36.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:35 smithi136 ceph-mon[35363]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-18T12:46:36.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:35 smithi081 ceph-mon[27646]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-18T12:46:38.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:37 smithi136 ceph-mon[35363]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:37 smithi081 ceph-mon[27646]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:40.006 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:39 smithi136 ceph-mon[35363]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:39 smithi081 ceph-mon[27646]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:41 smithi136 ceph-mon[35363]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:46:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:41 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:41 smithi081 ceph-mon[27646]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:46:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:41 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:43.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:42 smithi081 ceph-mon[27646]: Deploying daemon osd.4 on smithi136 2024-09-18T12:46:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:42 smithi136 ceph-mon[35363]: Deploying daemon osd.4 on smithi136 2024-09-18T12:46:44.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:43 smithi136 ceph-mon[35363]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:43 smithi081 ceph-mon[27646]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:46.062 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:45 smithi136 ceph-mon[35363]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:46.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:45 smithi081 ceph-mon[27646]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:47.060 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:47.060 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:47.060 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:48.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:47 smithi136 ceph-mon[35363]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:47 smithi081 ceph-mon[27646]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:50.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:49 smithi136 ceph-mon[35363]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:50.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:49 smithi081 ceph-mon[27646]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.272+0000 7f8cee7fc700 1 -- 172.21.15.136:0/4234667698 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8cf8105750 con 0x7f8ce406c4e0 2024-09-18T12:46:50.274 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 msgr2=0x7f8ce406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 0x7f8ce406e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006010 tx=0x7f8cf400b540 comp rx=0 tx=0).stop 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 msgr2=0x7f8cf8195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009970 tx=0x7f8ce8009c80 comp rx=0 tx=0).stop 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 shutdown_connections 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8ce406c4e0 0x7f8ce406e9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cf80ffdf0 0x7f8cf81953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 --2- 172.21.15.136:0/4234667698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101220 0x7f8cf8195900 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 >> 172.21.15.136:0/4234667698 conn(0x7f8cf80fa8c0 msgr2=0x7f8cf8104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:50.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 shutdown_connections 2024-09-18T12:46:50.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:50.275+0000 7f8cff68c700 1 -- 172.21.15.136:0/4234667698 wait complete. 2024-09-18T12:46:51.212 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.4.service 2024-09-18T12:46:51.214 INFO:tasks.cephadm:Deploying osd.5 on smithi136 with /dev/vg_nvme/lv_2... 2024-09-18T12:46:51.214 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:46:51.475 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:51 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:51 smithi136 ceph-mon[35363]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:51 smithi136 ceph-mon[35363]: from='osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:46:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:51 smithi136 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:46:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:51 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:51 smithi081 ceph-mon[27646]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:51 smithi081 ceph-mon[27646]: from='osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:46:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:51 smithi081 ceph-mon[27646]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: osdmap e33: 5 total, 4 up, 5 in 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:52.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:52.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[47759]: 2024-09-18T12:46:52.252+0000 7fd26d371700 -1 osd.4 0 waiting for initial osdmap 2024-09-18T12:46:52.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:46:52 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[47759]: 2024-09-18T12:46:52.259+0000 7fd267162700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: osdmap e33: 5 total, 4 up, 5 in 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:52 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:53 smithi081 ceph-mon[27646]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:46:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:53 smithi081 ceph-mon[27646]: osdmap e34: 5 total, 4 up, 5 in 2024-09-18T12:46:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:53 smithi081 ceph-mon[27646]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:53.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:53 smithi136 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:46:53.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:53 smithi136 ceph-mon[35363]: osdmap e34: 5 total, 4 up, 5 in 2024-09-18T12:46:53.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:53.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:53.510 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:53 smithi136 ceph-mon[35363]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-18T12:46:54.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:54 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:46:54.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:54 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:46:54.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:54 smithi136 ceph-mon[35363]: osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] boot 2024-09-18T12:46:54.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:54 smithi136 ceph-mon[35363]: osdmap e35: 5 total, 5 up, 5 in 2024-09-18T12:46:54.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:54 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:54 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:46:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:54 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:46:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:54 smithi081 ceph-mon[27646]: osd.4 [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] boot 2024-09-18T12:46:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:54 smithi081 ceph-mon[27646]: osdmap e35: 5 total, 5 up, 5 in 2024-09-18T12:46:54.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:54 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:46:54.849 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-18T12:46:54.867 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-09-18T12:46:55.402 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:46:55.523 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:55 smithi136 ceph-mon[35363]: osdmap e36: 5 total, 5 up, 5 in 2024-09-18T12:46:55.523 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:55 smithi136 ceph-mon[35363]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:46:55.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:55 smithi081 ceph-mon[27646]: osdmap e36: 5 total, 5 up, 5 in 2024-09-18T12:46:55.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:55 smithi081 ceph-mon[27646]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:46:57.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.531+0000 7f46c71b4700 1 -- 172.21.15.136:0/3367832017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c00ffe70 msgr2=0x7f46c01002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:57.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.531+0000 7f46c71b4700 1 --2- 172.21.15.136:0/3367832017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c00ffe70 0x7f46c01002d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009910 tx=0x7f46ac009c20 comp rx=0 tx=0).stop 2024-09-18T12:46:57.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- 172.21.15.136:0/3367832017 shutdown_connections 2024-09-18T12:46:57.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 --2- 172.21.15.136:0/3367832017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c00ffe70 0x7f46c01002d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 --2- 172.21.15.136:0/3367832017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c0101130 0x7f46c0101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- 172.21.15.136:0/3367832017 >> 172.21.15.136:0/3367832017 conn(0x7f46c00fa8c0 msgr2=0x7f46c00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- 172.21.15.136:0/3367832017 shutdown_connections 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- 172.21.15.136:0/3367832017 wait complete. 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 Processor -- start 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- start start 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c00ffe70 0x7f46c00ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c019b8a0 con 0x7f46c00ffe70 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46c71b4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c019b9e0 con 0x7f46c0101130 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.532+0000 7f46bffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:57.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48858/0 (socket says 172.21.15.136:48858) 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 -- 172.21.15.136:0/2131109263 learned_addr learned my addr 172.21.15.136:0/2131109263 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46c4f50700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c00ffe70 0x7f46c00ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 -- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c00ffe70 msgr2=0x7f46c00ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c00ffe70 0x7f46c00ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 -- 172.21.15.136:0/2131109263 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0095f0 con 0x7f46c0101130 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bffff700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00bda0 tx=0x7f46ac00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46ac01d070 con 0x7f46c0101130 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c019bc60 con 0x7f46c0101130 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c019c150 con 0x7f46c0101130 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f46ac004c50 con 0x7f46c0101130 2024-09-18T12:46:57.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.533+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46ac021640 con 0x7f46c0101130 2024-09-18T12:46:57.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.534+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c01087b0 con 0x7f46c0101130 2024-09-18T12:46:57.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.535+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f46ac00fa10 con 0x7f46c0101130 2024-09-18T12:46:57.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.535+0000 7f46bdffb700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 0x7f46b006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:57.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.535+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7f46ac08c5c0 con 0x7f46c0101130 2024-09-18T12:46:57.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.535+0000 7f46c4f50700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 0x7f46b006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:57.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.536+0000 7f46c4f50700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 0x7f46b006e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006fd0 tx=0x7f46b4008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:57.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.540+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f46ac05ae70 con 0x7f46c0101130 2024-09-18T12:46:57.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:46:57.736+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c01057d0 con 0x7f46b006c4e0 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi136 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi136 to 7456M 2024-09-18T12:46:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:57 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi136 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi136 to 7456M 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:57.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:57 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:46:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:58 smithi136 ceph-mon[35363]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:58 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:58.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:58 smithi081 ceph-mon[27646]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:58.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:58.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:58.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:58 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:59.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:46:59 smithi136 ceph-mon[35363]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:00.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:46:59 smithi081 ceph-mon[27646]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:00 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/596671735' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]: dispatch 2024-09-18T12:47:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:00 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]: dispatch 2024-09-18T12:47:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:00 smithi136 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]': finished 2024-09-18T12:47:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:00 smithi136 ceph-mon[35363]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:47:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:00 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:00 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/596671735' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]: dispatch 2024-09-18T12:47:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:00 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]: dispatch 2024-09-18T12:47:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:00 smithi081 ceph-mon[27646]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "784393cb-3ea2-4c15-8ee4-c93e80e0c5f5"}]': finished 2024-09-18T12:47:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:00 smithi081 ceph-mon[27646]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:47:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:00 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:01 smithi136 ceph-mon[35363]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:01 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/2358372232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:01 smithi081 ceph-mon[27646]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:01 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/2358372232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:04.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:03 smithi136 ceph-mon[35363]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:03 smithi081 ceph-mon[27646]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:04.851 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:05.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:05.973 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:05 smithi136 ceph-mon[35363]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:06.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:05 smithi081 ceph-mon[27646]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:07 smithi136 ceph-mon[35363]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:07 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:47:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:07 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:07 smithi081 ceph-mon[27646]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:07 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:47:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:07 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:08 smithi136 ceph-mon[35363]: Deploying daemon osd.5 on smithi136 2024-09-18T12:47:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:08 smithi081 ceph-mon[27646]: Deploying daemon osd.5 on smithi136 2024-09-18T12:47:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:09 smithi136 ceph-mon[35363]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:10.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:09 smithi081 ceph-mon[27646]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:11.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:11 smithi136 ceph-mon[35363]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:11 smithi081 ceph-mon[27646]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:13.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:13.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:13.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:12 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:12 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:13.750 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:13 smithi136 ceph-mon[35363]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:14.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:13 smithi081 ceph-mon[27646]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:15.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.898+0000 7f46bdffb700 1 -- 172.21.15.136:0/2131109263 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f46c01057d0 con 0x7f46b006c4e0 2024-09-18T12:47:15.902 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 5 on host 'smithi136' 2024-09-18T12:47:15.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 msgr2=0x7f46b006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:15.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 0x7f46b006e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006fd0 tx=0x7f46b4008040 comp rx=0 tx=0).stop 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 msgr2=0x7f46c019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00bda0 tx=0x7f46ac00be80 comp rx=0 tx=0).stop 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 shutdown_connections 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46b006c4e0 0x7f46b006e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c00ffe70 0x7f46c00ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:15.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 --2- 172.21.15.136:0/2131109263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46c0101130 0x7f46c019b2d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:15.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 >> 172.21.15.136:0/2131109263 conn(0x7f46c00fa8c0 msgr2=0x7f46c01040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:15.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 shutdown_connections 2024-09-18T12:47:15.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:15.901+0000 7f46c71b4700 1 -- 172.21.15.136:0/2131109263 wait complete. 2024-09-18T12:47:16.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:15 smithi136 ceph-mon[35363]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:15 smithi081 ceph-mon[27646]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:16.486 DEBUG:teuthology.orchestra.run.smithi136:osd.5> sudo journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.5.service 2024-09-18T12:47:16.488 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-18T12:47:16.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:47:16.700 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:16.814 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:47:16 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:47:16.634+0000 7f615e141640 -1 osd.5 0 log_to_monitors true 2024-09-18T12:47:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:16 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:16 smithi081 ceph-mon[27646]: from='osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:47:17.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:16 smithi081 ceph-mon[27646]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:47:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:16 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:16 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:16 smithi136 ceph-mon[35363]: from='osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:47:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:16 smithi136 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:47:18.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:47:17.866+0000 7f6152fa4700 -1 osd.5 0 waiting for initial osdmap 2024-09-18T12:47:18.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:47:17.874+0000 7f614dd97700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:47:18.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:18.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: osdmap e38: 6 total, 5 up, 6 in 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:18.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:17 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: osdmap e38: 6 total, 5 up, 6 in 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:17 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2522282126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc100da0 msgr2=0x7fc3bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2522282126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc100da0 0x7fc3bc101200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009910 tx=0x7fc3b0009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2522282126 shutdown_connections 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2522282126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc100da0 0x7fc3bc101200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2522282126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2522282126 >> 172.21.15.81:0/2522282126 conn(0x7fc3bc0fb120 msgr2=0x7fc3bc0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2522282126 shutdown_connections 2024-09-18T12:47:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.455+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2522282126 wait complete. 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 Processor -- start 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 -- start start 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc100da0 0x7fc3bc1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc197010 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc197150 con 0x7fc3bc100da0 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42040/0 (socket says 172.21.15.81:42040) 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 -- 172.21.15.81:0/2563593265 learned_addr learned my addr 172.21.15.81:0/2563593265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3b9d9b700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc100da0 0x7fc3bc1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 -- 172.21.15.81:0/2563593265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc100da0 msgr2=0x7fc3bc1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc100da0 0x7fc3bc1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 -- 172.21.15.81:0/2563593265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00095f0 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ba59c700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00e8f0 tx=0x7fc3ac00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac009790 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc19bc00 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3ac00c810 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.456+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac003d20 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.457+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc19c150 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.457+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc108700 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.458+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fc3ac0041f0 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.458+0000 7fc3ab7fe700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 0x7fc3a406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.459+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4186+0+0 (secure 0 0 0) 0x7fc3ac014070 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.459+0000 7fc3b9d9b700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 0x7fc3a406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.459+0000 7fc3b9d9b700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 0x7fc3a406e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009fd0 tx=0x7fc3b0005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.463+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc3ac059d90 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.653+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc3bc19c760 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.653+0000 7fc3ab7fe700 1 -- 172.21.15.81:0/2563593265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc3ac059920 con 0x7fc3bc0ffba0 2024-09-18T12:47:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 msgr2=0x7fc3a406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 0x7fc3a406e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009fd0 tx=0x7fc3b0005940 comp rx=0 tx=0).stop 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 msgr2=0x7fc3bc1964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00e8f0 tx=0x7fc3ac00ec00 comp rx=0 tx=0).stop 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 shutdown_connections 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fc3a406c4e0 0x7fc3a406e9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc0ffba0 0x7fc3bc1964b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 --2- 172.21.15.81:0/2563593265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3bc100da0 0x7fc3bc1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 >> 172.21.15.81:0/2563593265 conn(0x7fc3bc0fb120 msgr2=0x7fc3bc068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 shutdown_connections 2024-09-18T12:47:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:18.655+0000 7fc3c0a6d700 1 -- 172.21.15.81:0/2563593265 wait complete. 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: osdmap e39: 6 total, 5 up, 6 in 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:19.132 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:18 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2563593265' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: osdmap e39: 6 total, 5 up, 6 in 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:47:19.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:18 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2563593265' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:47:19.355 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1726663613,"num_in_osds":6,"osd_in_since":1726663620,"num_remapped_pgs":0} 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: purged_snaps scrub starts 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: purged_snaps scrub ok 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] boot 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:20.190 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: purged_snaps scrub starts 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: purged_snaps scrub ok 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: osd.5 [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] boot 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:47:20.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:20.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:47:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:21.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:47:21.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:21.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: Detected new or changed devices on smithi136 2024-09-18T12:47:21.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:21.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:20 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: Detected new or changed devices on smithi136 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:21.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:21.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:21.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:20 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:22.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi136 to 4970M 2024-09-18T12:47:22.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:22.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:22.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:22.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:22.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/2003673023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 msgr2=0x7f0d981010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/2003673023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981010d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009910 tx=0x7f0d8c009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/2003673023 shutdown_connections 2024-09-18T12:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/2003673023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/2003673023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981010d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/2003673023 >> 172.21.15.81:0/2003673023 conn(0x7f0d980fc230 msgr2=0x7f0d980fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/2003673023 shutdown_connections 2024-09-18T12:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/2003673023 wait complete. 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 Processor -- start 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- start start 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98196f90 con 0x7f0d98100cb0 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.246+0000 7f0d9ed7b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981970d0 con 0x7f0d98101eb0 2024-09-18T12:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42046/0 (socket says 172.21.15.81:42046) 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 -- 172.21.15.81:0/3974123064 learned_addr learned my addr 172.21.15.81:0/3974123064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d97fff700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 -- 172.21.15.81:0/3974123064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 msgr2=0x7f0d98196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 -- 172.21.15.81:0/3974123064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0095f0 con 0x7f0d98100cb0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d97fff700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9cb17700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00bda0 tx=0x7f0d8c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8c01d070 con 0x7f0d98100cb0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d8c004c50 con 0x7f0d98100cb0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9819bb30 con 0x7f0d98100cb0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8c00f690 con 0x7f0d98100cb0 2024-09-18T12:47:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.247+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9819bff0 con 0x7f0d98100cb0 2024-09-18T12:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.248+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98109810 con 0x7f0d98100cb0 2024-09-18T12:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.249+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0d8c022a20 con 0x7f0d98100cb0 2024-09-18T12:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.249+0000 7f0d95ffb700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 0x7f0d8806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.250+0000 7f0d97fff700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 0x7f0d8806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.250+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0d8c08ca00 con 0x7f0d98100cb0 2024-09-18T12:47:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.250+0000 7f0d97fff700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 0x7f0d8806e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005fd0 tx=0x7f0d84005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.254+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0d8c05b2a0 con 0x7f0d98100cb0 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi136 to 4970M 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:47:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.445+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f0d9819c680 con 0x7f0d98100cb0 2024-09-18T12:47:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.446+0000 7f0d95ffb700 1 -- 172.21.15.81:0/3974123064 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f0d8c027090 con 0x7f0d98100cb0 2024-09-18T12:47:22.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 msgr2=0x7f0d8806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 0x7f0d8806e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005fd0 tx=0x7f0d84005e30 comp rx=0 tx=0).stop 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 msgr2=0x7f0d981964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00bda0 tx=0x7f0d8c00be80 comp rx=0 tx=0).stop 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 shutdown_connections 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0d8806c4e0 0x7f0d8806e9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d98100cb0 0x7f0d981964c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 --2- 172.21.15.81:0/3974123064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d98101eb0 0x7f0d98196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 >> 172.21.15.81:0/3974123064 conn(0x7f0d980fc230 msgr2=0x7f0d981050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 shutdown_connections 2024-09-18T12:47:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:22.448+0000 7f0d9ed7b700 1 -- 172.21.15.81:0/3974123064 wait complete. 2024-09-18T12:47:23.015 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:22 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3974123064' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:47:23.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:22 smithi081 ceph-mon[27646]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:23.145 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1726663638,"num_in_osds":6,"osd_in_since":1726663620,"num_remapped_pgs":0} 2024-09-18T12:47:23.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:47:23.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:22 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3974123064' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:47:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:22 smithi136 ceph-mon[35363]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:24.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3415407351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 msgr2=0x7fb4f8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3415407351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f8100180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009910 tx=0x7fb4e8009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3415407351 shutdown_connections 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3415407351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4f8100750 0x7fb4f81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3415407351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f8100180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3415407351 >> 172.21.15.81:0/3415407351 conn(0x7fb4f80fb650 msgr2=0x7fb4f80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3415407351 shutdown_connections 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.967+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3415407351 wait complete. 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.968+0000 7fb4fdf27700 1 Processor -- start 2024-09-18T12:47:24.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.968+0000 7fb4fdf27700 1 -- start start 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.968+0000 7fb4fdf27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4fdf27700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4f8100750 0x7fb4f819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4fdf27700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f819c120 con 0x7fb4f80ffda0 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4fdf27700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f81955d0 con 0x7fb4f8100750 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42056/0 (socket says 172.21.15.81:42056) 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 -- 172.21.15.81:0/3988346685 learned_addr learned my addr 172.21.15.81:0/3988346685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 -- 172.21.15.81:0/3988346685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4f8100750 msgr2=0x7fb4f819ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4f8100750 0x7fb4f819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 -- 172.21.15.81:0/3988346685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80095f0 con 0x7fb4f80ffda0 2024-09-18T12:47:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4ef7fe700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8006010 tx=0x7fb4e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e801d070 con 0x7fb4f80ffda0 2024-09-18T12:47:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb4e800f460 con 0x7fb4f80ffda0 2024-09-18T12:47:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8195850 con 0x7fb4f80ffda0 2024-09-18T12:47:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e8021640 con 0x7fb4f80ffda0 2024-09-18T12:47:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.969+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f8195d40 con 0x7fb4f80ffda0 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.970+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f8108140 con 0x7fb4f80ffda0 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.971+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fb4e800faf0 con 0x7fb4f80ffda0 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.971+0000 7fb4f57fa700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 0x7fb4e406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.971+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb4e808c6f0 con 0x7fb4f80ffda0 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.971+0000 7fb4f77fe700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 0x7fb4e406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:24.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.972+0000 7fb4f77fe700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 0x7fb4e406e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8104a20 tx=0x7fb4e0005c80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:24.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:24.976+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb4e805ad40 con 0x7fb4f80ffda0 2024-09-18T12:47:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.163+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4f8107b20 con 0x7fb4f80ffda0 2024-09-18T12:47:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.164+0000 7fb4f57fa700 1 -- 172.21.15.81:0/3988346685 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11045 (secure 0 0 0) 0x7fb4e805a8d0 con 0x7fb4f80ffda0 2024-09-18T12:47:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:25.166 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:40:58.310618+0000","modified":"2024-09-18T12:47:19.871463+0000","last_up_change":"2024-09-18T12:47:18.861981+0000","last_in_change":"2024-09-18T12:47:00.284556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:46:04.761164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aebf45a3-32ad-463f-8d90-0e28808cde70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6803","nonce":287794116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6805","nonce":287794116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6809","nonce":287794116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6807","nonce":287794116}]},"public_addr":"172.21.15.81:6803/287794116","cluster_addr":"172.21.15.81:6805/287794116","heartbeat_back_addr":"172.21.15.81:6809/287794116","heartbeat_front_addr":"172.21.15.81:6807/287794116","state":["exists","up"]},{"osd":1,"uuid":"9c489a23-0fbc-4071-ae2a-5c6654858702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6811","nonce":2317981204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6813","nonce":2317981204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6817","nonce":2317981204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6815","nonce":2317981204}]},"public_addr":"172.21.15.81:6811/2317981204","cluster_addr":"172.21.15.81:6813/2317981204","heartbeat_back_addr":"172.21.15.81:6817/2317981204","heartbeat_front_addr":"172.21.15.81:6815/2317981204","state":["exists","up"]},{"osd":2,"uuid":"512e92ea-0506-4c3a-bfef-2c7c4d57c1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6819","nonce":2715223271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6821","nonce":2715223271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6825","nonce":2715223271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6823","nonce":2715223271}]},"public_addr":"172.21.15.81:6819/2715223271","cluster_addr":"172.21.15.81:6821/2715223271","heartbeat_back_addr":"172.21.15.81:6825/2715223271","heartbeat_front_addr":"172.21.15.81:6823/2715223271","state":["exists","up"]},{"osd":3,"uuid":"ce66d6e2-6d56-4470-84e9-90306ae535e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6801","nonce":2559147625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6803","nonce":2559147625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6807","nonce":2559147625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6805","nonce":2559147625}]},"public_addr":"172.21.15.136:6801/2559147625","cluster_addr":"172.21.15.136:6803/2559147625","heartbeat_back_addr":"172.21.15.136:6807/2559147625","heartbeat_front_addr":"172.21.15.136:6805/2559147625","state":["exists","up"]},{"osd":4,"uuid":"9135dc3a-851b-45e3-8248-9572c6c54d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6809","nonce":2946423358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6811","nonce":2946423358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6815","nonce":2946423358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6813","nonce":2946423358}]},"public_addr":"172.21.15.136:6809/2946423358","cluster_addr":"172.21.15.136:6811/2946423358","heartbeat_back_addr":"172.21.15.136:6815/2946423358","heartbeat_front_addr":"172.21.15.136:6813/2946423358","state":["exists","up"]},{"osd":5,"uuid":"784393cb-3ea2-4c15-8ee4-c93e80e0c5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6817","nonce":538593939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6819","nonce":538593939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6823","nonce":538593939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6821","nonce":538593939}]},"public_addr":"172.21.15.136:6817/538593939","cluster_addr":"172.21.15.136:6819/538593939","heartbeat_back_addr":"172.21.15.136:6823/538593939","heartbeat_front_addr":"172.21.15.136:6821/538593939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:04.124142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:32.591405+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:00.945663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:25.811391+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:51.584972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:17.622163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/891805519":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/1329491122":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/41128836":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/4202672354":"2024-09-19T12:41:56.434322+0000","172.21.15.81:0/875936782":"2024-09-19T12:41:56.434322+0000","172.21.15.81:6801/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:6800/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1687125345":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3714357492":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3403991039":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1872549892":"2024-09-19T12:41:56.434322+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 msgr2=0x7fb4e406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 0x7fb4e406e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8104a20 tx=0x7fb4e0005c80 comp rx=0 tx=0).stop 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 msgr2=0x7fb4f819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8006010 tx=0x7fb4e800be20 comp rx=0 tx=0).stop 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 shutdown_connections 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb4e406c4e0 0x7fb4e406e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f80ffda0 0x7fb4f819b550 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 --2- 172.21.15.81:0/3988346685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4f8100750 0x7fb4f819ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 >> 172.21.15.81:0/3988346685 conn(0x7fb4f80fb650 msgr2=0x7fb4f80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 shutdown_connections 2024-09-18T12:47:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:25.166+0000 7fb4fdf27700 1 -- 172.21.15.81:0/3988346685 wait complete. 2024-09-18T12:47:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:25 smithi136 ceph-mon[35363]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:25.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:25 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3988346685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:25.985 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:25 smithi081 ceph-mon[27646]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:25.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:25 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3988346685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:26.007 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T12:46:04.761164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-18T12:47:26.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-18T12:47:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:27.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 -- 172.21.15.81:0/727530225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f240ffc20 msgr2=0x7f0f24100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:27.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 --2- 172.21.15.81:0/727530225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f240ffc20 0x7f0f24100080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009910 tx=0x7f0f14009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:27.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 -- 172.21.15.81:0/727530225 shutdown_connections 2024-09-18T12:47:27.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 --2- 172.21.15.81:0/727530225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f240ffc20 0x7f0f24100080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:27.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 --2- 172.21.15.81:0/727530225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f24105bd0 0x7f0f24105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:27.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 -- 172.21.15.81:0/727530225 >> 172.21.15.81:0/727530225 conn(0x7f0f24075670 msgr2=0x7f0f24075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:27.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 -- 172.21.15.81:0/727530225 shutdown_connections 2024-09-18T12:47:27.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.840+0000 7f0f2b384700 1 -- 172.21.15.81:0/727530225 wait complete. 2024-09-18T12:47:27.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 Processor -- start 2024-09-18T12:47:27.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 -- start start 2024-09-18T12:47:27.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f240ffc20 0x7f0f24197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:27.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24198270 con 0x7f0f24105bd0 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2b384700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241983e0 con 0x7f0f240ffc20 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48326/0 (socket says 172.21.15.81:48326) 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 -- 172.21.15.81:0/3246344156 learned_addr learned my addr 172.21.15.81:0/3246344156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f29120700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f240ffc20 0x7f0f24197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 -- 172.21.15.81:0/3246344156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f240ffc20 msgr2=0x7f0f24197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f240ffc20 0x7f0f24197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 -- 172.21.15.81:0/3246344156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140095f0 con 0x7f0f24105bd0 2024-09-18T12:47:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.841+0000 7f0f2891f700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f14006010 tx=0x7f0f1400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.842+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1401d070 con 0x7f0f24105bd0 2024-09-18T12:47:27.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.842+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f241a0780 con 0x7f0f24105bd0 2024-09-18T12:47:27.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.842+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f1400f460 con 0x7f0f24105bd0 2024-09-18T12:47:27.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.842+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f14021640 con 0x7f0f24105bd0 2024-09-18T12:47:27.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.842+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f241a0bf0 con 0x7f0f24105bd0 2024-09-18T12:47:27.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.843+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f241080d0 con 0x7f0f24105bd0 2024-09-18T12:47:27.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.843+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0f1400faf0 con 0x7f0f24105bd0 2024-09-18T12:47:27.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.843+0000 7f0f1a7fc700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 0x7f0f1006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:27.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.844+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0f1408c740 con 0x7f0f24105bd0 2024-09-18T12:47:27.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.844+0000 7f0f29120700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 0x7f0f1006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:27.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.844+0000 7f0f29120700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 0x7f0f1006e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005fd0 tx=0x7f0f2000a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:27.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:27.848+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0f14057300 con 0x7f0f24105bd0 2024-09-18T12:47:28.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.034+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f24107ab0 con 0x7f0f24105bd0 2024-09-18T12:47:28.036 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:27 smithi081 ceph-mon[27646]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:28.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.035+0000 7f0f1a7fc700 1 -- 172.21.15.81:0/3246344156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f1405a920 con 0x7f0f24105bd0 2024-09-18T12:47:28.037 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-18T12:47:28.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 msgr2=0x7f0f1006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:28.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 0x7f0f1006e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005fd0 tx=0x7f0f2000a560 comp rx=0 tx=0).stop 2024-09-18T12:47:28.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 msgr2=0x7f0f24197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:28.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f14006010 tx=0x7f0f1400be20 comp rx=0 tx=0).stop 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 shutdown_connections 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f240ffc20 0x7f0f24197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f1006c4e0 0x7f0f1006e9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 --2- 172.21.15.81:0/3246344156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f24105bd0 0x7f0f24197c50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 >> 172.21.15.81:0/3246344156 conn(0x7f0f24075670 msgr2=0x7f0f240fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 shutdown_connections 2024-09-18T12:47:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:28.037+0000 7f0f2b384700 1 -- 172.21.15.81:0/3246344156 wait complete. 2024-09-18T12:47:28.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:27 smithi136 ceph-mon[35363]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:28.672 INFO:tasks.cephadm:Setting up client nodes... 2024-09-18T12:47:28.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:47:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:28 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3246344156' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:47:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:29.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:28 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3246344156' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:47:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:29 smithi136 ceph-mon[35363]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:30.099 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:29 smithi081 ceph-mon[27646]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:30.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 -- 172.21.15.81:0/992292309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 msgr2=0x7ff1841023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:30.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 --2- 172.21.15.81:0/992292309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff1841023a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff178009910 tx=0x7ff178009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:30.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 -- 172.21.15.81:0/992292309 shutdown_connections 2024-09-18T12:47:30.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 --2- 172.21.15.81:0/992292309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff1841023a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 --2- 172.21.15.81:0/992292309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff1840ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 -- 172.21.15.81:0/992292309 >> 172.21.15.81:0/992292309 conn(0x7ff1840fa8c0 msgr2=0x7ff1840fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 -- 172.21.15.81:0/992292309 shutdown_connections 2024-09-18T12:47:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.595+0000 7ff1891b0700 1 -- 172.21.15.81:0/992292309 wait complete. 2024-09-18T12:47:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 Processor -- start 2024-09-18T12:47:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 -- start start 2024-09-18T12:47:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff184196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1841970d0 con 0x7ff184101f40 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff1891b0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff184197210 con 0x7ff1840fef60 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.596+0000 7ff18259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48340/0 (socket says 172.21.15.81:48340) 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 -- 172.21.15.81:0/687122907 learned_addr learned my addr 172.21.15.81:0/687122907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff182d9d700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff184196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 -- 172.21.15.81:0/687122907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 msgr2=0x7ff184196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff184196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 -- 172.21.15.81:0/687122907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780095f0 con 0x7ff184101f40 2024-09-18T12:47:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff182d9d700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff184196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff18259c700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff178006010 tx=0x7ff17800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff17801d070 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18419bc60 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff17800f460 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff178021640 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.597+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18419c150 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.598+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1841098a0 con 0x7ff184101f40 2024-09-18T12:47:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.599+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff17800fab0 con 0x7ff184101f40 2024-09-18T12:47:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.599+0000 7ff16bfff700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 0x7ff16c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.599+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff17808c8e0 con 0x7ff184101f40 2024-09-18T12:47:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.599+0000 7ff182d9d700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 0x7ff16c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.599+0000 7ff182d9d700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 0x7ff16c06e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff184068c10 tx=0x7ff174008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:30.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.604+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff17805af30 con 0x7ff184101f40 2024-09-18T12:47:30.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.868+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff18419c800 con 0x7ff184101f40 2024-09-18T12:47:30.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.872+0000 7ff16bfff700 1 -- 172.21.15.81:0/687122907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff17805aac0 con 0x7ff184101f40 2024-09-18T12:47:30.874 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-18T12:47:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDiy+pm8sLdMxAA6aJqo1woF6bJQohyq0d76w== 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 msgr2=0x7ff16c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 0x7ff16c06e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff184068c10 tx=0x7ff174008040 comp rx=0 tx=0).stop 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 msgr2=0x7ff184196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff178006010 tx=0x7ff17800be20 comp rx=0 tx=0).stop 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 shutdown_connections 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1840fef60 0x7ff184196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff16c06c4e0 0x7ff16c06e9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 --2- 172.21.15.81:0/687122907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101f40 0x7ff184196ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.874+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 >> 172.21.15.81:0/687122907 conn(0x7ff1840fa8c0 msgr2=0x7ff184105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:30.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.875+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 shutdown_connections 2024-09-18T12:47:30.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:30.875+0000 7ff1891b0700 1 -- 172.21.15.81:0/687122907 wait complete. 2024-09-18T12:47:31.640 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:47:31.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-18T12:47:31.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:47:31.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:47:31.891 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi136/config 2024-09-18T12:47:32.004 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:31 smithi136 ceph-mon[35363]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:32.004 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:31 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/687122907' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:32.004 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:31 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/687122907' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:47:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:31 smithi081 ceph-mon[27646]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:31 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/687122907' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:31 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/687122907' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:47:33.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 -- 172.21.15.136:0/197489661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 msgr2=0x7f1d94101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:33.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/197489661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94101220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009910 tx=0x7f1d7c009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:33.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 -- 172.21.15.136:0/197489661 shutdown_connections 2024-09-18T12:47:33.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/197489661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94101220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/197489661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 0x7f1d940fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 -- 172.21.15.136:0/197489661 >> 172.21.15.136:0/197489661 conn(0x7f1d940fb160 msgr2=0x7f1d940fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 -- 172.21.15.136:0/197489661 shutdown_connections 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.504+0000 7f1d98aa0700 1 -- 172.21.15.136:0/197489661 wait complete. 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 Processor -- start 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 -- start start 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 0x7f1d941967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94197270 con 0x7f1d940ffbc0 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d98aa0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d941973b0 con 0x7f1d94100dc0 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55758/0 (socket says 172.21.15.136:55758) 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 -- 172.21.15.136:0/2522192848 learned_addr learned my addr 172.21.15.136:0/2522192848 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-18T12:47:33.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d9259c700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 0x7f1d941967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:33.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 -- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 msgr2=0x7f1d941967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:33.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 0x7f1d941967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 -- 172.21.15.136:0/2522192848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0095f0 con 0x7f1d94100dc0 2024-09-18T12:47:33.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.505+0000 7f1d8bfff700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00bd70 tx=0x7f1d7c00bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.506+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c01d070 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.506+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d7c005940 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.506+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9419be10 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.506+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c021430 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.506+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9419c2d0 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.507+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d94068af0 con 0x7f1d94100dc0 2024-09-18T12:47:33.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.507+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f1d7c00f860 con 0x7f1d94100dc0 2024-09-18T12:47:33.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.507+0000 7f1d8b7fe700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 0x7f1d8006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:33.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.508+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f1d7c08c7d0 con 0x7f1d94100dc0 2024-09-18T12:47:33.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.508+0000 7f1d9259c700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 0x7f1d8006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:33.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.508+0000 7f1d9259c700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 0x7f1d8006e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d94100c20 tx=0x7f1d8400a3b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:33.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.512+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1d7c05ae20 con 0x7f1d94100dc0 2024-09-18T12:47:33.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.781+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1d9419c560 con 0x7f1d94100dc0 2024-09-18T12:47:33.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.786+0000 7f1d8b7fe700 1 -- 172.21.15.136:0/2522192848 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1d7c05a9b0 con 0x7f1d94100dc0 2024-09-18T12:47:33.787 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-09-18T12:47:33.787 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDly+pmuYyqLhAAWDPvyKtwAzQC5QnoJSIHUg== 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 msgr2=0x7f1d8006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 0x7f1d8006e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d94100c20 tx=0x7f1d8400a3b0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 msgr2=0x7f1d94196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00bd70 tx=0x7f1d7c00bda0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 shutdown_connections 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1d8006c4e0 0x7f1d8006e9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d940ffbc0 0x7f1d941967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 --2- 172.21.15.136:0/2522192848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d94100dc0 0x7f1d94196ce0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:33.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 >> 172.21.15.136:0/2522192848 conn(0x7f1d940fb160 msgr2=0x7f1d94068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:33.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 shutdown_connections 2024-09-18T12:47:33.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:47:33.788+0000 7f1d98aa0700 1 -- 172.21.15.136:0/2522192848 wait complete. 2024-09-18T12:47:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:33 smithi136 ceph-mon[35363]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:34.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:33 smithi081 ceph-mon[27646]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:34.379 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:47:34.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-18T12:47:34.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T12:47:34.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-18T12:47:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:34.985 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:34 smithi081 ceph-mon[27646]: from='client.? 172.21.15.136:0/2522192848' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:34.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:34 smithi081 ceph-mon[27646]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:34.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:34 smithi081 ceph-mon[27646]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:47:34.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:34 smithi136 ceph-mon[35363]: from='client.? 172.21.15.136:0/2522192848' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:34 smithi136 ceph-mon[35363]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:47:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:34 smithi136 ceph-mon[35363]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:47:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:36.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:35 smithi081 ceph-mon[27646]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:36.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:35 smithi136 ceph-mon[35363]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/925020396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e0105350 msgr2=0x7ff0e0105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/925020396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e0105350 0x7ff0e0105730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009910 tx=0x7ff0d0009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/925020396 shutdown_connections 2024-09-18T12:47:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/925020396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e00ff340 0x7ff0e00ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/925020396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e0105350 0x7ff0e0105730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/925020396 >> 172.21.15.81:0/925020396 conn(0x7ff0e0074e30 msgr2=0x7ff0e0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/925020396 shutdown_connections 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.261+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/925020396 wait complete. 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 Processor -- start 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 -- start start 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 0x7ff0e0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01982f0 con 0x7ff0e00ff340 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e7ce0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0198430 con 0x7ff0e0105350 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e5a7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e5a7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50904/0 (socket says 172.21.15.81:50904) 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e5a7c700 1 -- 172.21.15.81:0/2195753482 learned_addr learned my addr 172.21.15.81:0/2195753482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.262+0000 7ff0e527b700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 0x7ff0e0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e5a7c700 1 -- 172.21.15.81:0/2195753482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 msgr2=0x7ff0e0197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e5a7c700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 0x7ff0e0197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e5a7c700 1 -- 172.21.15.81:0/2195753482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00095f0 con 0x7ff0e00ff340 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e527b700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 0x7ff0e0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e5a7c700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0006010 tx=0x7ff0d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0d001d070 con 0x7ff0e00ff340 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e01a0800 con 0x7ff0e00ff340 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0d000f460 con 0x7ff0e00ff340 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0d0021640 con 0x7ff0e00ff340 2024-09-18T12:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.263+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01a0c10 con 0x7ff0e00ff340 2024-09-18T12:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.264+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0107870 con 0x7ff0e00ff340 2024-09-18T12:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.264+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff0d000faf0 con 0x7ff0e00ff340 2024-09-18T12:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.265+0000 7ff0d6ffd700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 0x7ff0cc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.265+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff0d008c7d0 con 0x7ff0e00ff340 2024-09-18T12:47:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.265+0000 7ff0e527b700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 0x7ff0cc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.265+0000 7ff0e527b700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 0x7ff0cc06e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e010aa30 tx=0x7ff0dc008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.269+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff0d0057390 con 0x7ff0e00ff340 2024-09-18T12:47:36.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.461+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7ff0e004f2e0 con 0x7ff0e00ff340 2024-09-18T12:47:36.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.461+0000 7ff0d6ffd700 1 -- 172.21.15.81:0/2195753482 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v37) v1 ==== 86+0+187 (secure 0 0 0) 0x7ff0d005a9b0 con 0x7ff0e00ff340 2024-09-18T12:47:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 msgr2=0x7ff0cc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 0x7ff0cc06e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e010aa30 tx=0x7ff0dc008040 comp rx=0 tx=0).stop 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 msgr2=0x7ff0e0197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0006010 tx=0x7ff0d000be20 comp rx=0 tx=0).stop 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 shutdown_connections 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff0cc06c4e0 0x7ff0cc06e9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e00ff340 0x7ff0e0197790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 --2- 172.21.15.81:0/2195753482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0e0105350 0x7ff0e0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:36.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.463+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 >> 172.21.15.81:0/2195753482 conn(0x7ff0e0074e30 msgr2=0x7ff0e00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:36.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.464+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 shutdown_connections 2024-09-18T12:47:36.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:36.464+0000 7ff0e7ce0700 1 -- 172.21.15.81:0/2195753482 wait complete. 2024-09-18T12:47:37.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:36 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2195753482' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:47:37.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:36 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2195753482' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:47:37.111 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":37,"timestamp":"2024-09-18T12:47:20.864278+0000","name":"","changes":[{"name":"osd/host:smithi136/osd_memory_target","previous_value":"7818211532","new_value":"5212141021"}]}] 2024-09-18T12:47:37.111 INFO:tasks.ceph_manager:config epoch is 37 2024-09-18T12:47:37.111 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:47:37.111 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:47:37.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-18T12:47:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:38.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:37 smithi136 ceph-mon[35363]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:38.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:37 smithi081 ceph-mon[27646]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 -- 172.21.15.81:0/4012528134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 msgr2=0x7fcd34100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 --2- 172.21.15.81:0/4012528134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd34100080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009910 tx=0x7fcd24009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 -- 172.21.15.81:0/4012528134 shutdown_connections 2024-09-18T12:47:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 --2- 172.21.15.81:0/4012528134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd34100080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 --2- 172.21.15.81:0/4012528134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 0x7fcd34105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 -- 172.21.15.81:0/4012528134 >> 172.21.15.81:0/4012528134 conn(0x7fcd34075670 msgr2=0x7fcd34075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 -- 172.21.15.81:0/4012528134 shutdown_connections 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.874+0000 7fcd394a9700 1 -- 172.21.15.81:0/4012528134 wait complete. 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 Processor -- start 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 -- start start 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 0x7fcd3419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34195620 con 0x7fcd340ffc20 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd394a9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34195790 con 0x7fcd34105bd0 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50922/0 (socket says 172.21.15.81:50922) 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd32ffd700 1 -- 172.21.15.81:0/2568491194 learned_addr learned my addr 172.21.15.81:0/2568491194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.875+0000 7fcd327fc700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 0x7fcd3419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd32ffd700 1 -- 172.21.15.81:0/2568491194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 msgr2=0x7fcd3419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd32ffd700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 0x7fcd3419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd32ffd700 1 -- 172.21.15.81:0/2568491194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240095f0 con 0x7fcd340ffc20 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd32ffd700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d8d0 tx=0x7fcd2800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd280098a0 con 0x7fcd340ffc20 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd34195a70 con 0x7fcd340ffc20 2024-09-18T12:47:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd28010460 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2800f5f0 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.876+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd34195fc0 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.877+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd341080d0 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.877+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fcd28009a00 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.878+0000 7fcd1bfff700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 0x7fcd1c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.878+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fcd2808b330 con 0x7fcd340ffc20 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.878+0000 7fcd327fc700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 0x7fcd1c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.878+0000 7fcd327fc700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 0x7fcd1c06e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd34196ec0 tx=0x7fcd2401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:38.882+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcd28055ef0 con 0x7fcd340ffc20 2024-09-18T12:47:39.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.133+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcd34196be0 con 0x7fcd340ffc20 2024-09-18T12:47:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.136+0000 7fcd1bfff700 1 -- 172.21.15.81:0/2568491194 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+173010 (secure 0 0 0) 0x7fcd28059510 con 0x7fcd340ffc20 2024-09-18T12:47:39.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.139+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 msgr2=0x7fcd1c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.139+0000 7fcd394a9700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 0x7fcd1c06e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd34196ec0 tx=0x7fcd2401a040 comp rx=0 tx=0).stop 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.139+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 msgr2=0x7fcd3419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.139+0000 7fcd394a9700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d8d0 tx=0x7fcd2800dbe0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 shutdown_connections 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcd1c06c4e0 0x7fcd1c06e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd340ffc20 0x7fcd3419b630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 --2- 172.21.15.81:0/2568491194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd34105bd0 0x7fcd3419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 >> 172.21.15.81:0/2568491194 conn(0x7fcd34075670 msgr2=0x7fcd340fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:39.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 shutdown_connections 2024-09-18T12:47:39.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:39.140+0000 7fcd394a9700 1 -- 172.21.15.81:0/2568491194 wait complete. 2024-09-18T12:47:39.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"active_gid":14213,"active_name":"smithi081.pfnvgp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2},{"type":"v1","addr":"172.21.15.81:6801","nonce":2}]},"active_addr":"172.21.15.81:6801/2","active_change":"2024-09-18T12:43:04.422419+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14238,"name":"smithi136.vdkrdt","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/","prometheus":"http://172.21.15.81:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3335789619}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":940042369}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":353780439}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3488192554}]}]} 2024-09-18T12:47:39.786 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-18T12:47:39.786 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-18T12:47:39.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:47:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:39 smithi136 ceph-mon[35363]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:39 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2568491194' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:47:40.105 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:39 smithi081 ceph-mon[27646]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:40.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:39 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2568491194' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 -- 172.21.15.81:0/552798987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 msgr2=0x7f42d8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 --2- 172.21.15.81:0/552798987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d8100180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009910 tx=0x7f42cc009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 -- 172.21.15.81:0/552798987 shutdown_connections 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 --2- 172.21.15.81:0/552798987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d8100750 0x7f42d81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 --2- 172.21.15.81:0/552798987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d8100180 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.612+0000 7f42dee61700 1 -- 172.21.15.81:0/552798987 >> 172.21.15.81:0/552798987 conn(0x7f42d80fb650 msgr2=0x7f42d80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 -- 172.21.15.81:0/552798987 shutdown_connections 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 -- 172.21.15.81:0/552798987 wait complete. 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 Processor -- start 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 -- start start 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d8100750 0x7f42d8197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8198250 con 0x7f42d80ffda0 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dee61700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8198390 con 0x7f42d8100750 2024-09-18T12:47:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dcbfd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dcbfd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50938/0 (socket says 172.21.15.81:50938) 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.613+0000 7f42dcbfd700 1 -- 172.21.15.81:0/758771494 learned_addr learned my addr 172.21.15.81:0/758771494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dcbfd700 1 -- 172.21.15.81:0/758771494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d8100750 msgr2=0x7f42d8197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dcbfd700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d8100750 0x7f42d8197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dcbfd700 1 -- 172.21.15.81:0/758771494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0095f0 con 0x7f42d80ffda0 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dcbfd700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc01d070 con 0x7f42d80ffda0 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f42cc004f50 con 0x7f42d80ffda0 2024-09-18T12:47:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d81a0760 con 0x7f42d80ffda0 2024-09-18T12:47:41.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc021640 con 0x7f42d80ffda0 2024-09-18T12:47:41.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.614+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d81a0b70 con 0x7f42d80ffda0 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.615+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8108140 con 0x7f42d80ffda0 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.616+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f42cc00f460 con 0x7f42d80ffda0 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.616+0000 7f42d5ffb700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 0x7f42c806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.616+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f42cc08c6a0 con 0x7f42d80ffda0 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.616+0000 7f42d7fff700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 0x7f42c806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.617+0000 7f42d7fff700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 0x7f42c806e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005950 tx=0x7f42c40058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.621+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f42cc057260 con 0x7f42d80ffda0 2024-09-18T12:47:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.814+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42d8107b20 con 0x7f42d80ffda0 2024-09-18T12:47:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.815+0000 7f42d5ffb700 1 -- 172.21.15.81:0/758771494 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11045 (secure 0 0 0) 0x7f42cc00fe60 con 0x7f42d80ffda0 2024-09-18T12:47:41.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:41.817 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:40:58.310618+0000","modified":"2024-09-18T12:47:19.871463+0000","last_up_change":"2024-09-18T12:47:18.861981+0000","last_in_change":"2024-09-18T12:47:00.284556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:46:04.761164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aebf45a3-32ad-463f-8d90-0e28808cde70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6803","nonce":287794116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6805","nonce":287794116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6809","nonce":287794116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6807","nonce":287794116}]},"public_addr":"172.21.15.81:6803/287794116","cluster_addr":"172.21.15.81:6805/287794116","heartbeat_back_addr":"172.21.15.81:6809/287794116","heartbeat_front_addr":"172.21.15.81:6807/287794116","state":["exists","up"]},{"osd":1,"uuid":"9c489a23-0fbc-4071-ae2a-5c6654858702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6811","nonce":2317981204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6813","nonce":2317981204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6817","nonce":2317981204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6815","nonce":2317981204}]},"public_addr":"172.21.15.81:6811/2317981204","cluster_addr":"172.21.15.81:6813/2317981204","heartbeat_back_addr":"172.21.15.81:6817/2317981204","heartbeat_front_addr":"172.21.15.81:6815/2317981204","state":["exists","up"]},{"osd":2,"uuid":"512e92ea-0506-4c3a-bfef-2c7c4d57c1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6819","nonce":2715223271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6821","nonce":2715223271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6825","nonce":2715223271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6823","nonce":2715223271}]},"public_addr":"172.21.15.81:6819/2715223271","cluster_addr":"172.21.15.81:6821/2715223271","heartbeat_back_addr":"172.21.15.81:6825/2715223271","heartbeat_front_addr":"172.21.15.81:6823/2715223271","state":["exists","up"]},{"osd":3,"uuid":"ce66d6e2-6d56-4470-84e9-90306ae535e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6801","nonce":2559147625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6803","nonce":2559147625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6807","nonce":2559147625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6805","nonce":2559147625}]},"public_addr":"172.21.15.136:6801/2559147625","cluster_addr":"172.21.15.136:6803/2559147625","heartbeat_back_addr":"172.21.15.136:6807/2559147625","heartbeat_front_addr":"172.21.15.136:6805/2559147625","state":["exists","up"]},{"osd":4,"uuid":"9135dc3a-851b-45e3-8248-9572c6c54d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6809","nonce":2946423358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6811","nonce":2946423358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6815","nonce":2946423358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6813","nonce":2946423358}]},"public_addr":"172.21.15.136:6809/2946423358","cluster_addr":"172.21.15.136:6811/2946423358","heartbeat_back_addr":"172.21.15.136:6815/2946423358","heartbeat_front_addr":"172.21.15.136:6813/2946423358","state":["exists","up"]},{"osd":5,"uuid":"784393cb-3ea2-4c15-8ee4-c93e80e0c5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6817","nonce":538593939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6819","nonce":538593939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6823","nonce":538593939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6821","nonce":538593939}]},"public_addr":"172.21.15.136:6817/538593939","cluster_addr":"172.21.15.136:6819/538593939","heartbeat_back_addr":"172.21.15.136:6823/538593939","heartbeat_front_addr":"172.21.15.136:6821/538593939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:04.124142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:32.591405+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:00.945663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:25.811391+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:51.584972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:17.622163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/891805519":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/1329491122":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/41128836":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/4202672354":"2024-09-19T12:41:56.434322+0000","172.21.15.81:0/875936782":"2024-09-19T12:41:56.434322+0000","172.21.15.81:6801/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:6800/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1687125345":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3714357492":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3403991039":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1872549892":"2024-09-19T12:41:56.434322+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:47:41.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 msgr2=0x7f42c806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 0x7f42c806e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005950 tx=0x7f42c40058e0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 msgr2=0x7f42d81976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc00be20 comp rx=0 tx=0).stop 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 shutdown_connections 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f42c806c4e0 0x7f42c806e9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d80ffda0 0x7f42d81976f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 --2- 172.21.15.81:0/758771494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d8100750 0x7f42d8197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 >> 172.21.15.81:0/758771494 conn(0x7f42d80fb650 msgr2=0x7f42d80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 shutdown_connections 2024-09-18T12:47:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:41.817+0000 7f42dee61700 1 -- 172.21.15.81:0/758771494 wait complete. 2024-09-18T12:47:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:41 smithi136 ceph-mon[35363]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:41 smithi081 ceph-mon[27646]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:42.455 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-18T12:47:42.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:47:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:43.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/758771494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:43.103 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/758771494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:44.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:43 smithi136 ceph-mon[35363]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:43 smithi081 ceph-mon[27646]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 -- 172.21.15.81:0/1376744055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38068580 msgr2=0x7f1c380689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/1376744055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38068580 0x7f1c380689e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009910 tx=0x7f1c20009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 -- 172.21.15.81:0/1376744055 shutdown_connections 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/1376744055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38068580 0x7f1c380689e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/1376744055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38106cd0 0x7f1c381070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 -- 172.21.15.81:0/1376744055 >> 172.21.15.81:0/1376744055 conn(0x7f1c38075670 msgr2=0x7f1c38075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 -- 172.21.15.81:0/1376744055 shutdown_connections 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.377+0000 7f1c3cf03700 1 -- 172.21.15.81:0/1376744055 wait complete. 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 Processor -- start 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 -- start start 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38068580 0x7f1c3819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3819f480 con 0x7f1c38106cd0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3cf03700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c38198930 con 0x7f1c38068580 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50960/0 (socket says 172.21.15.81:50960) 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c35d9b700 1 -- 172.21.15.81:0/3082717853 learned_addr learned my addr 172.21.15.81:0/3082717853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.378+0000 7f1c3659c700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38068580 0x7f1c3819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c35d9b700 1 -- 172.21.15.81:0/3082717853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38068580 msgr2=0x7f1c3819e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c35d9b700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38068580 0x7f1c3819e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c35d9b700 1 -- 172.21.15.81:0/3082717853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200095f0 con 0x7f1c38106cd0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c35d9b700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006010 tx=0x7f1c2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2001d070 con 0x7f1c38106cd0 2024-09-18T12:47:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c2000f460 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c38198bb0 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c20021640 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.379+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c381990a0 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.380+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3804f2e0 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.380+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f1c2000faf0 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.381+0000 7f1c2f7fe700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 0x7f1c2406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.381+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f1c2008c7d0 con 0x7f1c38106cd0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.381+0000 7f1c3659c700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 0x7f1c2406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.381+0000 7f1c3659c700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 0x7f1c2406e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009f20 tx=0x7f1c300094f0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.385+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1c2005ae20 con 0x7f1c38106cd0 2024-09-18T12:47:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.576+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c381992c0 con 0x7f1c38106cd0 2024-09-18T12:47:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.576+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3082717853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11045 (secure 0 0 0) 0x7f1c2005a9b0 con 0x7f1c38106cd0 2024-09-18T12:47:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:47:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"2a553466-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:40:58.310618+0000","modified":"2024-09-18T12:47:19.871463+0000","last_up_change":"2024-09-18T12:47:18.861981+0000","last_in_change":"2024-09-18T12:47:00.284556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:46:04.761164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aebf45a3-32ad-463f-8d90-0e28808cde70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6803","nonce":287794116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6805","nonce":287794116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6809","nonce":287794116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":287794116},{"type":"v1","addr":"172.21.15.81:6807","nonce":287794116}]},"public_addr":"172.21.15.81:6803/287794116","cluster_addr":"172.21.15.81:6805/287794116","heartbeat_back_addr":"172.21.15.81:6809/287794116","heartbeat_front_addr":"172.21.15.81:6807/287794116","state":["exists","up"]},{"osd":1,"uuid":"9c489a23-0fbc-4071-ae2a-5c6654858702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6811","nonce":2317981204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6813","nonce":2317981204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6817","nonce":2317981204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2317981204},{"type":"v1","addr":"172.21.15.81:6815","nonce":2317981204}]},"public_addr":"172.21.15.81:6811/2317981204","cluster_addr":"172.21.15.81:6813/2317981204","heartbeat_back_addr":"172.21.15.81:6817/2317981204","heartbeat_front_addr":"172.21.15.81:6815/2317981204","state":["exists","up"]},{"osd":2,"uuid":"512e92ea-0506-4c3a-bfef-2c7c4d57c1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6819","nonce":2715223271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6821","nonce":2715223271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6825","nonce":2715223271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2715223271},{"type":"v1","addr":"172.21.15.81:6823","nonce":2715223271}]},"public_addr":"172.21.15.81:6819/2715223271","cluster_addr":"172.21.15.81:6821/2715223271","heartbeat_back_addr":"172.21.15.81:6825/2715223271","heartbeat_front_addr":"172.21.15.81:6823/2715223271","state":["exists","up"]},{"osd":3,"uuid":"ce66d6e2-6d56-4470-84e9-90306ae535e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6801","nonce":2559147625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6803","nonce":2559147625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6807","nonce":2559147625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2559147625},{"type":"v1","addr":"172.21.15.136:6805","nonce":2559147625}]},"public_addr":"172.21.15.136:6801/2559147625","cluster_addr":"172.21.15.136:6803/2559147625","heartbeat_back_addr":"172.21.15.136:6807/2559147625","heartbeat_front_addr":"172.21.15.136:6805/2559147625","state":["exists","up"]},{"osd":4,"uuid":"9135dc3a-851b-45e3-8248-9572c6c54d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6809","nonce":2946423358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6811","nonce":2946423358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6815","nonce":2946423358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":2946423358},{"type":"v1","addr":"172.21.15.136:6813","nonce":2946423358}]},"public_addr":"172.21.15.136:6809/2946423358","cluster_addr":"172.21.15.136:6811/2946423358","heartbeat_back_addr":"172.21.15.136:6815/2946423358","heartbeat_front_addr":"172.21.15.136:6813/2946423358","state":["exists","up"]},{"osd":5,"uuid":"784393cb-3ea2-4c15-8ee4-c93e80e0c5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6817","nonce":538593939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6819","nonce":538593939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6823","nonce":538593939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":538593939},{"type":"v1","addr":"172.21.15.136:6821","nonce":538593939}]},"public_addr":"172.21.15.136:6817/538593939","cluster_addr":"172.21.15.136:6819/538593939","heartbeat_back_addr":"172.21.15.136:6823/538593939","heartbeat_front_addr":"172.21.15.136:6821/538593939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:04.124142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:32.591405+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:00.945663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:25.811391+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:51.584972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:17.622163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/891805519":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/1329491122":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/41128836":"2024-09-19T12:43:04.422270+0000","172.21.15.81:0/4202672354":"2024-09-19T12:41:56.434322+0000","172.21.15.81:0/875936782":"2024-09-19T12:41:56.434322+0000","172.21.15.81:6801/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:6800/2":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1687125345":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3714357492":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/3403991039":"2024-09-19T12:41:23.234470+0000","172.21.15.81:0/1872549892":"2024-09-19T12:41:56.434322+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 msgr2=0x7f1c2406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 0x7f1c2406e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009f20 tx=0x7f1c300094f0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 msgr2=0x7f1c3819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006010 tx=0x7f1c2000be20 comp rx=0 tx=0).stop 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 shutdown_connections 2024-09-18T12:47:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c38068580 0x7f1c3819e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1c2406c4e0 0x7f1c2406e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 --2- 172.21.15.81:0/3082717853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38106cd0 0x7f1c3819edf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 >> 172.21.15.81:0/3082717853 conn(0x7f1c38075670 msgr2=0x7f1c380feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 shutdown_connections 2024-09-18T12:47:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:44.579+0000 7f1c3cf03700 1 -- 172.21.15.81:0/3082717853 wait complete. 2024-09-18T12:47:45.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:44 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3082717853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:45.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-18T12:47:45.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-18T12:47:45.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-18T12:47:45.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-18T12:47:45.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-18T12:47:45.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-18T12:47:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:44 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3082717853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:47:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:45.933 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:45 smithi081 ceph-mon[27646]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:46.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:45 smithi136 ceph-mon[35363]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:48.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:47 smithi136 ceph-mon[35363]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:47 smithi081 ceph-mon[27646]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:49 smithi081 ceph-mon[27646]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:49 smithi136 ceph-mon[35363]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- 172.21.15.81:0/3173384880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 msgr2=0x7f4190100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 --2- 172.21.15.81:0/3173384880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f4190100180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4184009910 tx=0x7f4184009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- 172.21.15.81:0/3173384880 shutdown_connections 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 --2- 172.21.15.81:0/3173384880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 0x7f41901047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 --2- 172.21.15.81:0/3173384880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f4190100180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- 172.21.15.81:0/3173384880 >> 172.21.15.81:0/3173384880 conn(0x7f41900fb650 msgr2=0x7f41900fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- 172.21.15.81:0/3173384880 shutdown_connections 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- 172.21.15.81:0/3173384880 wait complete. 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 Processor -- start 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.297+0000 7f4197148700 1 -- start start 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4197148700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4197148700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 0x7f4190197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4197148700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901981c0 con 0x7f41900ffda0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4197148700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4190198300 con 0x7f4190100750 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40708/0 (socket says 172.21.15.81:40708) 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 -- 172.21.15.81:0/2935968831 learned_addr learned my addr 172.21.15.81:0/2935968831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 -- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 msgr2=0x7f4190197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f418ffff700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 0x7f4190197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 0x7f4190197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840095f0 con 0x7f41900ffda0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4194ee4700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4184006010 tx=0x7f418400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418401d070 con 0x7f41900ffda0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f418400f460 con 0x7f41900ffda0 2024-09-18T12:47:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41901a0760 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.298+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4184021640 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.299+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41901a0b10 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.299+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f419010cfe0 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.300+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f418400fab0 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.300+0000 7f418dffb700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 0x7f418006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.300+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f418408cdb0 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.300+0000 7f418ffff700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 0x7f418006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f418dffb700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 0x7f41800744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4180074b50 con 0x7f4180072080 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f418408d210 con 0x7f41900ffda0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f418ffff700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 0x7f418006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41900696c0 tx=0x7f417c005d70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f41956e5700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 0x7f41800744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.301+0000 7f41956e5700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 0x7f41800744a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.302+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== osd.3 v2:172.21.15.136:6800/2559147625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4180074b50 con 0x7f4180072080 2024-09-18T12:47:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.317+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 --> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f419004f2e0 con 0x7f4180072080 2024-09-18T12:47:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f418dffb700 1 -- 172.21.15.81:0/2935968831 <== osd.3 v2:172.21.15.136:6800/2559147625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f419004f2e0 con 0x7f4180072080 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 msgr2=0x7f41800744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 0x7f41800744a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 msgr2=0x7f418006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 0x7f418006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41900696c0 tx=0x7f417c005d70 comp rx=0 tx=0).stop 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 msgr2=0x7f41901976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4184006010 tx=0x7f418400be20 comp rx=0 tx=0).stop 2024-09-18T12:47:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 shutdown_connections 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:6800/2559147625,v1:172.21.15.136:6801/2559147625] conn(0x7f4180072080 0x7f41800744a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f418006c4e0 0x7f418006e9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41900ffda0 0x7f41901976f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 --2- 172.21.15.81:0/2935968831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4190100750 0x7f4190197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 >> 172.21.15.81:0/2935968831 conn(0x7f41900fb650 msgr2=0x7f41900fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 shutdown_connections 2024-09-18T12:47:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.318+0000 7f4197148700 1 -- 172.21.15.81:0/2935968831 wait complete. 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 -- 172.21.15.81:0/186048474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c105bd0 msgr2=0x7fb20c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 --2- 172.21.15.81:0/186048474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c105bd0 0x7fb20c105fb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009910 tx=0x7fb1fc009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 -- 172.21.15.81:0/186048474 shutdown_connections 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 --2- 172.21.15.81:0/186048474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb20c0ffc20 0x7fb20c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 --2- 172.21.15.81:0/186048474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c105bd0 0x7fb20c105fb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 -- 172.21.15.81:0/186048474 >> 172.21.15.81:0/186048474 conn(0x7fb20c075670 msgr2=0x7fb20c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 -- 172.21.15.81:0/186048474 shutdown_connections 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.804+0000 7fb213563700 1 -- 172.21.15.81:0/186048474 wait complete. 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 Processor -- start 2024-09-18T12:47:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 -- start start 2024-09-18T12:47:51.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb20c105bd0 0x7fb20c197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1982f0 con 0x7fb20c0ffc20 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb213563700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c198460 con 0x7fb20c105bd0 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40736/0 (socket says 172.21.15.81:40736) 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 -- 172.21.15.81:0/1303592009 learned_addr learned my addr 172.21.15.81:0/1303592009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 -- 172.21.15.81:0/1303592009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb20c105bd0 msgr2=0x7fb20c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb20c105bd0 0x7fb20c197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0095f0 con 0x7fb20c0ffc20 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2112ff700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc006010 tx=0x7fb1fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1fc01d070 con 0x7fb20c0ffc20 2024-09-18T12:47:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.806+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c1a0740 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.805+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc004f50 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.806+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1fc021410 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.806+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c1a0bb0 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.806+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb20c10cfa0 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.807+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fb1fc00f460 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.807+0000 7fb2027fc700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 0x7fb1f806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.807+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb1fc08c620 con 0x7fb20c0ffc20 2024-09-18T12:47:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.807+0000 7fb210afe700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 0x7fb1f806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb2027fc700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 0x7fb1f80744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1f8074b50 con 0x7fb1f8072080 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1fc08ecf0 con 0x7fb20c0ffc20 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb211b00700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 0x7fb1f80744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb210afe700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 0x7fb1f806e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb208005fd0 tx=0x7fb208005f60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.808+0000 7fb211b00700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 0x7fb1f80744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.809+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== osd.0 v2:172.21.15.81:6802/287794116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb1f8074b50 con 0x7fb1f8072080 2024-09-18T12:47:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.824+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 --> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb20c04f2e0 con 0x7fb1f8072080 2024-09-18T12:47:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb2027fc700 1 -- 172.21.15.81:0/1303592009 <== osd.0 v2:172.21.15.81:6802/287794116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb20c04f2e0 con 0x7fb1f8072080 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 msgr2=0x7fb1f80744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 0x7fb1f80744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 msgr2=0x7fb1f806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 0x7fb1f806e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb208005fd0 tx=0x7fb208005f60 comp rx=0 tx=0).stop 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 msgr2=0x7fb20c1976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc006010 tx=0x7fb1fc00be20 comp rx=0 tx=0).stop 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 shutdown_connections 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6802/287794116,v1:172.21.15.81:6803/287794116] conn(0x7fb1f8072080 0x7fb1f80744a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb1f806c4e0 0x7fb1f806e9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb20c0ffc20 0x7fb20c1976d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 --2- 172.21.15.81:0/1303592009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb20c105bd0 0x7fb20c197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 >> 172.21.15.81:0/1303592009 conn(0x7fb20c075670 msgr2=0x7fb20c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 shutdown_connections 2024-09-18T12:47:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:51.825+0000 7fb213563700 1 -- 172.21.15.81:0/1303592009 wait complete. 2024-09-18T12:47:52.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 -- 172.21.15.81:0/306170835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc740ffc20 msgr2=0x7fbc74100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 --2- 172.21.15.81:0/306170835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc740ffc20 0x7fbc74100080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009910 tx=0x7fbc64009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 -- 172.21.15.81:0/306170835 shutdown_connections 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 --2- 172.21.15.81:0/306170835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc740ffc20 0x7fbc74100080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 --2- 172.21.15.81:0/306170835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc74105bd0 0x7fbc74105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 -- 172.21.15.81:0/306170835 >> 172.21.15.81:0/306170835 conn(0x7fbc74075670 msgr2=0x7fbc74075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 -- 172.21.15.81:0/306170835 shutdown_connections 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.001+0000 7fbc7c541700 1 -- 172.21.15.81:0/306170835 wait complete. 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 Processor -- start 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 -- start start 2024-09-18T12:47:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc740ffc20 0x7fbc74197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74198380 con 0x7fbc74105bd0 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7c541700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741984f0 con 0x7fbc740ffc20 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40756/0 (socket says 172.21.15.81:40756) 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 -- 172.21.15.81:0/2738666361 learned_addr learned my addr 172.21.15.81:0/2738666361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc7a2dd700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc740ffc20 0x7fbc74197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 -- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc740ffc20 msgr2=0x7fbc74197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc740ffc20 0x7fbc74197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.002+0000 7fbc79adc700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640095f0 con 0x7fbc74105bd0 2024-09-18T12:47:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc79adc700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc64006010 tx=0x7fbc6400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6401d070 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc6400f460 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc741a07d0 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc64021640 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.003+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc741a0c40 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.004+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc7410cfa0 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.005+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fbc6400faf0 con 0x7fbc74105bd0 2024-09-18T12:47:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.005+0000 7fbc6b7fe700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.005+0000 7fbc7a2dd700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.005+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fbc6408d300 con 0x7fbc74105bd0 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc6b7fe700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 0x7fbc600744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc60074b50 con 0x7fbc60072080 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc6408d760 con 0x7fbc74105bd0 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc7a2dd700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc70005fd0 tx=0x7fbc7000a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc7aade700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 0x7fbc600744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.006+0000 7fbc7aade700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 0x7fbc600744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.007+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== osd.4 v2:172.21.15.136:6808/2946423358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc60074b50 con 0x7fbc60072080 2024-09-18T12:47:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.023+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 --> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc7404f2e0 con 0x7fbc60072080 2024-09-18T12:47:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.023+0000 7fbc6b7fe700 1 -- 172.21.15.81:0/2738666361 <== osd.4 v2:172.21.15.136:6808/2946423358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbc7404f2e0 con 0x7fbc60072080 2024-09-18T12:47:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.023+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 msgr2=0x7fbc600744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 0x7fbc600744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 msgr2=0x7fbc6006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc70005fd0 tx=0x7fbc7000a560 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 msgr2=0x7fbc74197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc64006010 tx=0x7fbc6400be20 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 shutdown_connections 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc740ffc20 0x7fbc74197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.136:6808/2946423358,v1:172.21.15.136:6809/2946423358] conn(0x7fbc60072080 0x7fbc600744a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 --2- 172.21.15.81:0/2738666361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74105bd0 0x7fbc74197ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 >> 172.21.15.81:0/2738666361 conn(0x7fbc74075670 msgr2=0x7fbc740fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 shutdown_connections 2024-09-18T12:47:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:52.024+0000 7fbc7c541700 1 -- 172.21.15.81:0/2738666361 wait complete. 2024-09-18T12:47:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:51 smithi081 ceph-mon[27646]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:51 smithi136 ceph-mon[35363]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:52.734 INFO:teuthology.orchestra.run.smithi081.stdout:38654705700 2024-09-18T12:47:52.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-18T12:47:53.847 INFO:teuthology.orchestra.run.smithi081.stdout:115964117012 2024-09-18T12:47:53.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-18T12:47:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:53 smithi081 ceph-mon[27646]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:54.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:53 smithi136 ceph-mon[35363]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:54.582 INFO:teuthology.orchestra.run.smithi081.stdout:150323855373 2024-09-18T12:47:54.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-18T12:47:55.961 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:55 smithi081 ceph-mon[27646]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:55 smithi136 ceph-mon[35363]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:56.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.186+0000 7f9935918700 1 -- 172.21.15.81:0/476131692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930101850 msgr2=0x7f99301058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.186+0000 7f9935918700 1 --2- 172.21.15.81:0/476131692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930101850 0x7f99301058a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9924009910 tx=0x7f9924009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:56.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 -- 172.21.15.81:0/476131692 shutdown_connections 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 --2- 172.21.15.81:0/476131692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930101850 0x7f99301058a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 --2- 172.21.15.81:0/476131692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930100ea0 0x7f9930101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 -- 172.21.15.81:0/476131692 >> 172.21.15.81:0/476131692 conn(0x7f99300fc750 msgr2=0x7f99300feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 -- 172.21.15.81:0/476131692 shutdown_connections 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 -- 172.21.15.81:0/476131692 wait complete. 2024-09-18T12:47:56.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 Processor -- start 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.187+0000 7f9935918700 1 -- start start 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9935918700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9935918700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930101850 0x7f99300735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9935918700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930073b10 con 0x7f9930100ea0 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9935918700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930073c50 con 0x7f9930101850 2024-09-18T12:47:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60084/0 (socket says 172.21.15.81:60084) 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 -- 172.21.15.81:0/2417395203 learned_addr learned my addr 172.21.15.81:0/2417395203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992e7fc700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930101850 0x7f99300735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 -- 172.21.15.81:0/2417395203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930101850 msgr2=0x7f99300735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930101850 0x7f99300735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99240095f0 con 0x7f9930100ea0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f992effd700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f992000b4b0 tx=0x7f992000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9920011800 con 0x7f9930100ea0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9920011e10 con 0x7f9930100ea0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.188+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99301a2b40 con 0x7f9930100ea0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.189+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99301a2f50 con 0x7f9930100ea0 2024-09-18T12:47:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.189+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992000f2e0 con 0x7f9930100ea0 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.189+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f993010e140 con 0x7f9930100ea0 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f9920011960 con 0x7f9930100ea0 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 0x7f991806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f992008b070 con 0x7f9930100ea0 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f992e7fc700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 0x7f991806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 0x7f99180744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9918074b50 con 0x7f9918072080 2024-09-18T12:47:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f992008d740 con 0x7f9930100ea0 2024-09-18T12:47:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.191+0000 7f992f7fe700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 0x7f99180744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.192+0000 7f992e7fc700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 0x7f991806e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9930074880 tx=0x7f992401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.192+0000 7f992f7fe700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 0x7f99180744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.192+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== osd.2 v2:172.21.15.81:6818/2715223271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9918074b50 con 0x7f9918072080 2024-09-18T12:47:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.208+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 --> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f993004f2e0 con 0x7f9918072080 2024-09-18T12:47:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.209+0000 7f9934916700 1 -- 172.21.15.81:0/2417395203 <== osd.2 v2:172.21.15.81:6818/2715223271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f993004f2e0 con 0x7f9918072080 2024-09-18T12:47:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.209+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 msgr2=0x7f99180744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.209+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 0x7f99180744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 msgr2=0x7f991806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 0x7f991806e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9930074880 tx=0x7f992401a040 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 msgr2=0x7f9930073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f992000b4b0 tx=0x7f992000b870 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 shutdown_connections 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f991806c4e0 0x7f991806e9a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9930100ea0 0x7f9930073090 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.81:6818/2715223271,v1:172.21.15.81:6819/2715223271] conn(0x7f9918072080 0x7f99180744a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 --2- 172.21.15.81:0/2417395203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930101850 0x7f99300735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 >> 172.21.15.81:0/2417395203 conn(0x7f99300fc750 msgr2=0x7f99300fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 shutdown_connections 2024-09-18T12:47:56.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.210+0000 7f9935918700 1 -- 172.21.15.81:0/2417395203 wait complete. 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 -- 172.21.15.81:0/2431562318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb200ffda0 msgr2=0x7fdb20100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 --2- 172.21.15.81:0/2431562318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb200ffda0 0x7fdb20100180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009910 tx=0x7fdb10009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 -- 172.21.15.81:0/2431562318 shutdown_connections 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 --2- 172.21.15.81:0/2431562318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb20100750 0x7fdb201047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 --2- 172.21.15.81:0/2431562318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb200ffda0 0x7fdb20100180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 -- 172.21.15.81:0/2431562318 >> 172.21.15.81:0/2431562318 conn(0x7fdb200fb650 msgr2=0x7fdb200fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 -- 172.21.15.81:0/2431562318 shutdown_connections 2024-09-18T12:47:56.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.404+0000 7fdb2488c700 1 -- 172.21.15.81:0/2431562318 wait complete. 2024-09-18T12:47:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 Processor -- start 2024-09-18T12:47:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 -- start start 2024-09-18T12:47:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 0x7fdb201976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201982e0 con 0x7fdb20100750 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb2488c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20198420 con 0x7fdb200ffda0 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb1dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb1dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60096/0 (socket says 172.21.15.81:60096) 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.405+0000 7fdb1dd9b700 1 -- 172.21.15.81:0/339493116 learned_addr learned my addr 172.21.15.81:0/339493116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1e59c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 0x7fdb201976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1dd9b700 1 -- 172.21.15.81:0/339493116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 msgr2=0x7fdb201976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1dd9b700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 0x7fdb201976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1dd9b700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100095f0 con 0x7fdb20100750 2024-09-18T12:47:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1e59c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 0x7fdb201976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb1dd9b700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c8f0 tx=0x7fdb1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb14007a50 con 0x7fdb20100750 2024-09-18T12:47:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb14007bb0 con 0x7fdb20100750 2024-09-18T12:47:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb201a0730 con 0x7fdb20100750 2024-09-18T12:47:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb14018630 con 0x7fdb20100750 2024-09-18T12:47:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.406+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb201a0c50 con 0x7fdb20100750 2024-09-18T12:47:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.407+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb2010cfe0 con 0x7fdb20100750 2024-09-18T12:47:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fdb14007d20 con 0x7fdb20100750 2024-09-18T12:47:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 0x7fdb0806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fdb1408b410 con 0x7fdb20100750 2024-09-18T12:47:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb1e59c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 0x7fdb0806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 0x7fdb080744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb08074b50 con 0x7fdb08072080 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb1408dae0 con 0x7fdb20100750 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb1ed9d700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 0x7fdb080744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.408+0000 7fdb1e59c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 0x7fdb0806e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b5c0 tx=0x7fdb1001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.409+0000 7fdb1ed9d700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 0x7fdb080744a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:56.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.409+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== osd.1 v2:172.21.15.81:6810/2317981204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdb08074b50 con 0x7fdb08072080 2024-09-18T12:47:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.424+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 --> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb2004f2e0 con 0x7fdb08072080 2024-09-18T12:47:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb0f7fe700 1 -- 172.21.15.81:0/339493116 <== osd.1 v2:172.21.15.81:6810/2317981204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb2004f2e0 con 0x7fdb08072080 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 msgr2=0x7fdb080744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 0x7fdb080744a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 msgr2=0x7fdb0806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 0x7fdb0806e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b5c0 tx=0x7fdb1001a040 comp rx=0 tx=0).stop 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 msgr2=0x7fdb20197c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c8f0 tx=0x7fdb1400ccb0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 shutdown_connections 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6810/2317981204,v1:172.21.15.81:6811/2317981204] conn(0x7fdb08072080 0x7fdb080744a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb200ffda0 0x7fdb201976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fdb0806c4e0 0x7fdb0806e9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 --2- 172.21.15.81:0/339493116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb20100750 0x7fdb20197c00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 >> 172.21.15.81:0/339493116 conn(0x7fdb200fb650 msgr2=0x7fdb200fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 shutdown_connections 2024-09-18T12:47:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:56.425+0000 7fdb2488c700 1 -- 172.21.15.81:0/339493116 wait complete. 2024-09-18T12:47:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 -- 172.21.15.81:0/1348880844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40ff5a0 msgr2=0x7f82e40ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 --2- 172.21.15.81:0/1348880844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40ff5a0 0x7f82e40ff980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009910 tx=0x7f82d4009c20 comp rx=0 tx=0).stop 2024-09-18T12:47:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 -- 172.21.15.81:0/1348880844 shutdown_connections 2024-09-18T12:47:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 --2- 172.21.15.81:0/1348880844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40fff50 0x7f82e4105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 --2- 172.21.15.81:0/1348880844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40ff5a0 0x7f82e40ff980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 -- 172.21.15.81:0/1348880844 >> 172.21.15.81:0/1348880844 conn(0x7f82e4074e30 msgr2=0x7f82e4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.241+0000 7f82e90d3700 1 -- 172.21.15.81:0/1348880844 shutdown_connections 2024-09-18T12:47:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.242+0000 7f82e90d3700 1 -- 172.21.15.81:0/1348880844 wait complete. 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.242+0000 7f82e90d3700 1 Processor -- start 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.242+0000 7f82e90d3700 1 -- start start 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40ff5a0 0x7f82e41969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4197570 con 0x7f82e40fff50 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e419b380 con 0x7f82e40ff5a0 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60114/0 (socket says 172.21.15.81:60114) 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 -- 172.21.15.81:0/2003345527 learned_addr learned my addr 172.21.15.81:0/2003345527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e2d9d700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40ff5a0 0x7f82e41969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 -- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40ff5a0 msgr2=0x7f82e41969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40ff5a0 0x7f82e41969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40095f0 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82dbfff700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00b480 tx=0x7f82cc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82cc011800 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82cc011e10 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e419b660 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82cc010ea0 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.243+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e419bbb0 con 0x7f82e40fff50 2024-09-18T12:47:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.244+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82e410e150 con 0x7f82e40fff50 2024-09-18T12:47:57.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f82cc010380 con 0x7f82e40fff50 2024-09-18T12:47:57.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 0x7f82d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f82cc08afc0 con 0x7f82e40fff50 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e2d9d700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 0x7f82d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 0x7f82d00744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82d0074b50 con 0x7f82d0072080 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.245+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82cc08d690 con 0x7f82e40fff50 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.246+0000 7f82e2d9d700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 0x7f82d006e9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82d4006010 tx=0x7f82d401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.246+0000 7f82e359e700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 0x7f82d00744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.246+0000 7f82e359e700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 0x7f82d00744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.247+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== osd.5 v2:172.21.15.136:6816/538593939 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f82d0074b50 con 0x7f82d0072080 2024-09-18T12:47:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.262+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 --> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82e404f2e0 con 0x7f82d0072080 2024-09-18T12:47:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.262+0000 7f82e0d99700 1 -- 172.21.15.81:0/2003345527 <== osd.5 v2:172.21.15.136:6816/538593939 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f82e404f2e0 con 0x7f82d0072080 2024-09-18T12:47:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 msgr2=0x7f82d00744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 0x7f82d00744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 msgr2=0x7f82d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 0x7f82d006e9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82d4006010 tx=0x7f82d401a040 comp rx=0 tx=0).stop 2024-09-18T12:47:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 msgr2=0x7f82e4196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.263+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00b480 tx=0x7f82cc00b790 comp rx=0 tx=0).stop 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 shutdown_connections 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:6816/538593939,v1:172.21.15.136:6817/538593939] conn(0x7f82d0072080 0x7f82d00744a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e40ff5a0 0x7f82e41969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f82d006c4e0 0x7f82d006e9a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 --2- 172.21.15.81:0/2003345527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40fff50 0x7f82e4196ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 >> 172.21.15.81:0/2003345527 conn(0x7f82e4074e30 msgr2=0x7f82e40fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 shutdown_connections 2024-09-18T12:47:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:47:57.264+0000 7f82e90d3700 1 -- 172.21.15.81:0/2003345527 wait complete. 2024-09-18T12:47:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:171798691850 2024-09-18T12:47:57.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-18T12:47:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:57 smithi081 ceph-mon[27646]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:58.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:57 smithi136 ceph-mon[35363]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:58.349 INFO:teuthology.orchestra.run.smithi081.stdout:60129542176 2024-09-18T12:47:58.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-18T12:47:58.416 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:58.416 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:58.841 INFO:teuthology.orchestra.run.smithi081.stdout:81604378649 2024-09-18T12:47:58.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-18T12:47:58.893 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:47:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:00.092 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:47:59 smithi081 ceph-mon[27646]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:00.135 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:47:59 smithi136 ceph-mon[35363]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:01 smithi081 ceph-mon[27646]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:01 smithi136 ceph-mon[35363]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 -- 172.21.15.81:0/2989085989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 msgr2=0x7f71e41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2989085989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e41047a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009910 tx=0x7f71d4009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 -- 172.21.15.81:0/2989085989 shutdown_connections 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2989085989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e41047a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2989085989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 0x7f71e4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.632+0000 7f71eb83f700 1 -- 172.21.15.81:0/2989085989 >> 172.21.15.81:0/2989085989 conn(0x7f71e40fb650 msgr2=0x7f71e40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 -- 172.21.15.81:0/2989085989 shutdown_connections 2024-09-18T12:48:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 -- 172.21.15.81:0/2989085989 wait complete. 2024-09-18T12:48:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 Processor -- start 2024-09-18T12:48:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 -- start start 2024-09-18T12:48:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 0x7f71e41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41983c0 con 0x7f71e4100750 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71eb83f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4198500 con 0x7f71e40ffda0 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71e8dda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.633+0000 7f71e8dda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60144/0 (socket says 172.21.15.81:60144) 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e8dda700 1 -- 172.21.15.81:0/2739746553 learned_addr learned my addr 172.21.15.81:0/2739746553 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e95db700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 0x7f71e41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e8dda700 1 -- 172.21.15.81:0/2739746553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 msgr2=0x7f71e41977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e8dda700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 0x7f71e41977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e8dda700 1 -- 172.21.15.81:0/2739746553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40095f0 con 0x7f71e4100750 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71e8dda700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f71d40092e0 tx=0x7f71d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d401d070 con 0x7f71e4100750 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71d4004fa0 con 0x7f71e4100750 2024-09-18T12:48:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e41a0810 con 0x7f71e4100750 2024-09-18T12:48:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d400f690 con 0x7f71e4100750 2024-09-18T12:48:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.634+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41a0c80 con 0x7f71e4100750 2024-09-18T12:48:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.635+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e41080f0 con 0x7f71e4100750 2024-09-18T12:48:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.635+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f71d4022470 con 0x7f71e4100750 2024-09-18T12:48:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.636+0000 7f71da7fc700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 0x7f71d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.636+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f71d408cd00 con 0x7f71e4100750 2024-09-18T12:48:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.636+0000 7f71e95db700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 0x7f71d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.636+0000 7f71e95db700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 0x7f71d006e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009a10 tx=0x7f71e0009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.641+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f71d4090030 con 0x7f71e4100750 2024-09-18T12:48:03.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.837+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f71e4069500 con 0x7f71e4100750 2024-09-18T12:48:03.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.838+0000 7f71da7fc700 1 -- 172.21.15.81:0/2739746553 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71d4027020 con 0x7f71e4100750 2024-09-18T12:48:03.839 INFO:teuthology.orchestra.run.smithi081.stdout:171798691851 2024-09-18T12:48:03.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 msgr2=0x7f71d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:03.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 0x7f71d006e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009a10 tx=0x7f71e0009190 comp rx=0 tx=0).stop 2024-09-18T12:48:03.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 msgr2=0x7f71e4197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:03.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f71d40092e0 tx=0x7f71d400bd70 comp rx=0 tx=0).stop 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 shutdown_connections 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e40ffda0 0x7f71e41977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f71d006c4e0 0x7f71d006e9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 --2- 172.21.15.81:0/2739746553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71e4100750 0x7f71e4197ce0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 >> 172.21.15.81:0/2739746553 conn(0x7f71e40fb650 msgr2=0x7f71e40fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 shutdown_connections 2024-09-18T12:48:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:03.840+0000 7f71eb83f700 1 -- 172.21.15.81:0/2739746553 wait complete. 2024-09-18T12:48:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:03 smithi081 ceph-mon[27646]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:03 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2739746553' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:48:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:03 smithi136 ceph-mon[35363]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:03 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2739746553' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 -- 172.21.15.81:0/2812946391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 msgr2=0x7f85241058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 --2- 172.21.15.81:0/2812946391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f85241058a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8514009910 tx=0x7f8514009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 -- 172.21.15.81:0/2812946391 shutdown_connections 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 --2- 172.21.15.81:0/2812946391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f85241058a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 --2- 172.21.15.81:0/2812946391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 0x7f8524101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 -- 172.21.15.81:0/2812946391 >> 172.21.15.81:0/2812946391 conn(0x7f85240fc750 msgr2=0x7f85240feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 -- 172.21.15.81:0/2812946391 shutdown_connections 2024-09-18T12:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.361+0000 7f85291ea700 1 -- 172.21.15.81:0/2812946391 wait complete. 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 Processor -- start 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 -- start start 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 0x7f8524196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524197540 con 0x7f8524101850 2024-09-18T12:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f85291ea700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852419b350 con 0x7f8524100ea0 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f852259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f852259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60162/0 (socket says 172.21.15.81:60162) 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.362+0000 7f852259c700 1 -- 172.21.15.81:0/4293304641 learned_addr learned my addr 172.21.15.81:0/4293304641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f8522d9d700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 0x7f8524196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f852259c700 1 -- 172.21.15.81:0/4293304641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 msgr2=0x7f8524196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f852259c700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 0x7f8524196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f852259c700 1 -- 172.21.15.81:0/4293304641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140095f0 con 0x7f8524101850 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f852259c700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85140092e0 tx=0x7f851400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851401d070 con 0x7f8524101850 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852419b5d0 con 0x7f8524101850 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8514004fa0 con 0x7f8524101850 2024-09-18T12:48:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851400f690 con 0x7f8524101850 2024-09-18T12:48:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.363+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852419bac0 con 0x7f8524101850 2024-09-18T12:48:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.364+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85241091f0 con 0x7f8524101850 2024-09-18T12:48:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.365+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8514022470 con 0x7f8524101850 2024-09-18T12:48:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.365+0000 7f850bfff700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 0x7f850c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.365+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f851408cd00 con 0x7f8524101850 2024-09-18T12:48:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.365+0000 7f8522d9d700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 0x7f850c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.366+0000 7f8522d9d700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 0x7f850c06e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8518009a10 tx=0x7f8518009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.370+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8514090030 con 0x7f8524101850 2024-09-18T12:48:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.568+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8524197d20 con 0x7f8524101850 2024-09-18T12:48:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.568+0000 7f850bfff700 1 -- 172.21.15.81:0/4293304641 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8514027020 con 0x7f8524101850 2024-09-18T12:48:04.570 INFO:teuthology.orchestra.run.smithi081.stdout:115964117014 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.570+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 msgr2=0x7f850c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.570+0000 7f85291ea700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 0x7f850c06e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8518009a10 tx=0x7f8518009190 comp rx=0 tx=0).stop 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.570+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 msgr2=0x7f8524196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.570+0000 7f85291ea700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85140092e0 tx=0x7f851400bd70 comp rx=0 tx=0).stop 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 shutdown_connections 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524100ea0 0x7f8524196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f850c06c4e0 0x7f850c06e9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 --2- 172.21.15.81:0/4293304641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8524101850 0x7f8524196eb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 >> 172.21.15.81:0/4293304641 conn(0x7f85240fc750 msgr2=0x7f85240fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 shutdown_connections 2024-09-18T12:48:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.571+0000 7f85291ea700 1 -- 172.21.15.81:0/4293304641 wait complete. 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.574+0000 7f95c760a700 1 -- 172.21.15.81:0/338844669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 msgr2=0x7f95c0100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.574+0000 7f95c760a700 1 --2- 172.21.15.81:0/338844669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c0100a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009910 tx=0x7f95bc009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 -- 172.21.15.81:0/338844669 shutdown_connections 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 --2- 172.21.15.81:0/338844669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 0x7f95c01047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 --2- 172.21.15.81:0/338844669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c0100a90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 -- 172.21.15.81:0/338844669 >> 172.21.15.81:0/338844669 conn(0x7f95c0074e30 msgr2=0x7f95c0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 -- 172.21.15.81:0/338844669 shutdown_connections 2024-09-18T12:48:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 -- 172.21.15.81:0/338844669 wait complete. 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 Processor -- start 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.575+0000 7f95c760a700 1 -- start start 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c760a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c760a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 0x7f95c019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c760a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c019c100 con 0x7f95c01006b0 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c760a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01955b0 con 0x7f95c0101060 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60190/0 (socket says 172.21.15.81:60190) 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 -- 172.21.15.81:0/3759825030 learned_addr learned my addr 172.21.15.81:0/3759825030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c4ba5700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 0x7f95c019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 -- 172.21.15.81:0/3759825030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 msgr2=0x7f95c019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 0x7f95c019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 -- 172.21.15.81:0/3759825030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0095f0 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c53a6700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f95bc006010 tx=0x7f95bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc01d070 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c0195830 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.576+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f95bc00f460 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.577+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc017630 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.577+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c0195d20 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.577+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0108120 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.578+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f95bc0178a0 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.578+0000 7f95b67fc700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 0x7f95ac06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.578+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f95bc08ca30 con 0x7f95c01006b0 2024-09-18T12:48:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.578+0000 7f95c4ba5700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 0x7f95ac06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.579+0000 7f95c4ba5700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 0x7f95ac06e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95b0005fd0 tx=0x7f95b000a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.583+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f95bc05b080 con 0x7f95c01006b0 2024-09-18T12:48:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.783+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f95c004f2e0 con 0x7f95c01006b0 2024-09-18T12:48:04.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.784+0000 7f95b67fc700 1 -- 172.21.15.81:0/3759825030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95bc05ac10 con 0x7f95c01006b0 2024-09-18T12:48:04.786 INFO:teuthology.orchestra.run.smithi081.stdout:150323855375 2024-09-18T12:48:04.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 msgr2=0x7f95ac06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 0x7f95ac06e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95b0005fd0 tx=0x7f95b000a560 comp rx=0 tx=0).stop 2024-09-18T12:48:04.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 msgr2=0x7f95c019b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f95bc006010 tx=0x7f95bc00be20 comp rx=0 tx=0).stop 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 shutdown_connections 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f95ac06c4e0 0x7f95ac06e9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95c01006b0 0x7f95c019b530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 --2- 172.21.15.81:0/3759825030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95c0101060 0x7f95c019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 >> 172.21.15.81:0/3759825030 conn(0x7f95c0074e30 msgr2=0x7f95c00fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 shutdown_connections 2024-09-18T12:48:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:04.786+0000 7f95c760a700 1 -- 172.21.15.81:0/3759825030 wait complete. 2024-09-18T12:48:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:04 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4293304641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:48:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:04 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3759825030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:48:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:04 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/4293304641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:48:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:04 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3759825030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:48:05.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855375 for osd.4 2024-09-18T12:48:05.493 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:06.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:05 smithi081 ceph-mon[27646]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:06.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:05 smithi136 ceph-mon[35363]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:06.653 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117012 got 115964117014 for osd.3 2024-09-18T12:48:06.654 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:07.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691851 for osd.5 2024-09-18T12:48:07.263 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:07 smithi081 ceph-mon[27646]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:07 smithi136 ceph-mon[35363]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 -- 172.21.15.81:0/3516067151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1000ffc20 msgr2=0x7fd100100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 --2- 172.21.15.81:0/3516067151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1000ffc20 0x7fd100100080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009910 tx=0x7fd0f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 -- 172.21.15.81:0/3516067151 shutdown_connections 2024-09-18T12:48:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 --2- 172.21.15.81:0/3516067151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1000ffc20 0x7fd100100080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 --2- 172.21.15.81:0/3516067151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd100105bd0 0x7fd100105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 -- 172.21.15.81:0/3516067151 >> 172.21.15.81:0/3516067151 conn(0x7fd100075670 msgr2=0x7fd100075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 -- 172.21.15.81:0/3516067151 shutdown_connections 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.685+0000 7fd10668f700 1 -- 172.21.15.81:0/3516067151 wait complete. 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 Processor -- start 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 -- start start 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 0x7fd10019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10019d2b0 con 0x7fd100105bd0 2024-09-18T12:48:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd10668f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100196730 con 0x7fd1000ffc20 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.686+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54638/0 (socket says 172.21.15.81:54638) 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0ff7fe700 1 -- 172.21.15.81:0/432697104 learned_addr learned my addr 172.21.15.81:0/432697104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0fffff700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 0x7fd10019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0ff7fe700 1 -- 172.21.15.81:0/432697104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 msgr2=0x7fd10019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0ff7fe700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 0x7fd10019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0ff7fe700 1 -- 172.21.15.81:0/432697104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00095f0 con 0x7fd100105bd0 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0fffff700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 0x7fd10019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0ff7fe700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0006010 tx=0x7fd0f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f001d070 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd0f000f460 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f0021640 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1001969b0 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.687+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd100196ea0 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.688+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10004f2e0 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.689+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd0f000faf0 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.689+0000 7fd0fd7fa700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 0x7fd0ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.689+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd0f008c640 con 0x7fd100105bd0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.689+0000 7fd0fffff700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 0x7fd0ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.690+0000 7fd0fffff700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 0x7fd0ec06e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8005fd0 tx=0x7fd0e8005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.694+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd0f005ad10 con 0x7fd100105bd0 2024-09-18T12:48:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.890+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1001971b0 con 0x7fd100105bd0 2024-09-18T12:48:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.890+0000 7fd0fd7fa700 1 -- 172.21.15.81:0/432697104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0f005a8a0 con 0x7fd100105bd0 2024-09-18T12:48:08.892 INFO:teuthology.orchestra.run.smithi081.stdout:81604378651 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 msgr2=0x7fd0ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 0x7fd0ec06e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8005fd0 tx=0x7fd0e8005dc0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 msgr2=0x7fd10019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0006010 tx=0x7fd0f000be20 comp rx=0 tx=0).stop 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 shutdown_connections 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1000ffc20 0x7fd10019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd0ec06c4e0 0x7fd0ec06e9a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 --2- 172.21.15.81:0/432697104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd100105bd0 0x7fd10019cbd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 >> 172.21.15.81:0/432697104 conn(0x7fd100075670 msgr2=0x7fd100068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 shutdown_connections 2024-09-18T12:48:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:08.892+0000 7fd10668f700 1 -- 172.21.15.81:0/432697104 wait complete. 2024-09-18T12:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 -- 172.21.15.81:0/2861097007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010102780 msgr2=0x7f401010ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 --2- 172.21.15.81:0/2861097007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010102780 0x7f401010ac70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009910 tx=0x7f3ff8009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 -- 172.21.15.81:0/2861097007 shutdown_connections 2024-09-18T12:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 --2- 172.21.15.81:0/2861097007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010102780 0x7f401010ac70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 --2- 172.21.15.81:0/2861097007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010101e60 0x7f4010102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 -- 172.21.15.81:0/2861097007 >> 172.21.15.81:0/2861097007 conn(0x7f40100fb610 msgr2=0x7f40100fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 -- 172.21.15.81:0/2861097007 shutdown_connections 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.350+0000 7f4015e12700 1 -- 172.21.15.81:0/2861097007 wait complete. 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 Processor -- start 2024-09-18T12:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 -- start start 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010102780 0x7f401019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401019d280 con 0x7f4010101e60 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f4015e12700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4010196780 con 0x7f4010102780 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f400f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f400f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54662/0 (socket says 172.21.15.81:54662) 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f400f7fe700 1 -- 172.21.15.81:0/2634974738 learned_addr learned my addr 172.21.15.81:0/2634974738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.351+0000 7f400effd700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010102780 0x7f401019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400f7fe700 1 -- 172.21.15.81:0/2634974738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010102780 msgr2=0x7f401019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400f7fe700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010102780 0x7f401019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400f7fe700 1 -- 172.21.15.81:0/2634974738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80095f0 con 0x7f4010101e60 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400f7fe700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f400000ba50 tx=0x7f400000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f400000c900 con 0x7f4010101e60 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4000014440 con 0x7f4010101e60 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4010196a60 con 0x7f4010101e60 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40000075a0 con 0x7f4010101e60 2024-09-18T12:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.352+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4010196fb0 con 0x7f4010101e60 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.353+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010108370 con 0x7f4010101e60 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.353+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f40000145b0 con 0x7f4010101e60 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.354+0000 7f400cff9700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 0x7f3ffc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.354+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f4000006e40 con 0x7f4010101e60 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.354+0000 7f400effd700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 0x7f3ffc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.354+0000 7f400effd700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 0x7f3ffc06e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4010197ba0 tx=0x7f3ff801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.358+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4000059210 con 0x7f4010101e60 2024-09-18T12:48:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.552+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4010197d40 con 0x7f4010101e60 2024-09-18T12:48:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.553+0000 7f400cff9700 1 -- 172.21.15.81:0/2634974738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4010197d40 con 0x7f4010101e60 2024-09-18T12:48:09.554 INFO:teuthology.orchestra.run.smithi081.stdout:38654705704 2024-09-18T12:48:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 msgr2=0x7f3ffc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 0x7f3ffc06e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4010197ba0 tx=0x7f3ff801a040 comp rx=0 tx=0).stop 2024-09-18T12:48:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 msgr2=0x7f401019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f400000ba50 tx=0x7f400000bd60 comp rx=0 tx=0).stop 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 shutdown_connections 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3ffc06c4e0 0x7f3ffc06e9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010101e60 0x7f401019c6b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 --2- 172.21.15.81:0/2634974738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4010102780 0x7f401019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 >> 172.21.15.81:0/2634974738 conn(0x7f40100fb610 msgr2=0x7f40101054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 shutdown_connections 2024-09-18T12:48:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:09.555+0000 7f4015e12700 1 -- 172.21.15.81:0/2634974738 wait complete. 2024-09-18T12:48:09.809 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-09-18T12:48:09.809 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:10.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:09 smithi081 ceph-mon[27646]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:10.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:09 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/432697104' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:48:10.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:09 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2634974738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:48:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:09 smithi136 ceph-mon[35363]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:09 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/432697104' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:48:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:09 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2634974738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:48:10.388 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705704 for osd.0 2024-09-18T12:48:10.388 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 -- 172.21.15.81:0/3579285486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 msgr2=0x7ff4f40ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3579285486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f40ff980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009910 tx=0x7ff4e8009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 -- 172.21.15.81:0/3579285486 shutdown_connections 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3579285486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 0x7ff4f4105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3579285486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f40ff980 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 -- 172.21.15.81:0/3579285486 >> 172.21.15.81:0/3579285486 conn(0x7ff4f4074e30 msgr2=0x7ff4f4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 -- 172.21.15.81:0/3579285486 shutdown_connections 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.313+0000 7ff4f891c700 1 -- 172.21.15.81:0/3579285486 wait complete. 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 Processor -- start 2024-09-18T12:48:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 -- start start 2024-09-18T12:48:11.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:11.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 0x7ff4f419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:11.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f419d250 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.314+0000 7ff4f891c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4196700 con 0x7ff4f40fff50 2024-09-18T12:48:11.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54678/0 (socket says 172.21.15.81:54678) 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 -- 172.21.15.81:0/3342177828 learned_addr learned my addr 172.21.15.81:0/3342177828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f1d9b700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 0x7ff4f419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 -- 172.21.15.81:0/3342177828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 msgr2=0x7ff4f419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 0x7ff4f419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 -- 172.21.15.81:0/3342177828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80095f0 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f259c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006010 tx=0x7ff4e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e801d070 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4e800f460 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e8017630 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4196980 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.315+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4196e70 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.316+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f4109270 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.317+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff4e800f5d0 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.317+0000 7ff4e37fe700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 0x7ff4dc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.317+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff4e808c7f0 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.317+0000 7ff4f1d9b700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 0x7ff4dc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.317+0000 7ff4f1d9b700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 0x7ff4dc06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4197b70 tx=0x7ff4e400b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.321+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff4e805aec0 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.513+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4f4197d10 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.513+0000 7ff4e37fe700 1 -- 172.21.15.81:0/3342177828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4f4197d10 con 0x7ff4f40ff5a0 2024-09-18T12:48:11.515 INFO:teuthology.orchestra.run.smithi081.stdout:60129542179 2024-09-18T12:48:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 msgr2=0x7ff4dc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 0x7ff4dc06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4197b70 tx=0x7ff4e400b410 comp rx=0 tx=0).stop 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 msgr2=0x7ff4f419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006010 tx=0x7ff4e800bd70 comp rx=0 tx=0).stop 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 shutdown_connections 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ff4dc06c4e0 0x7ff4dc06e9a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4f40ff5a0 0x7ff4f419c680 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 --2- 172.21.15.81:0/3342177828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4f40fff50 0x7ff4f419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 >> 172.21.15.81:0/3342177828 conn(0x7ff4f4074e30 msgr2=0x7ff4f40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 shutdown_connections 2024-09-18T12:48:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:11.515+0000 7ff4f891c700 1 -- 172.21.15.81:0/3342177828 wait complete. 2024-09-18T12:48:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:11 smithi081 ceph-mon[27646]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:11 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3342177828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:48:12.165 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542176 got 60129542179 for osd.1 2024-09-18T12:48:12.168 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:12.168 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-18T12:48:12.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:48:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:11 smithi136 ceph-mon[35363]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:11 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3342177828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:48:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 -- 172.21.15.81:0/3059279607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870106cd0 msgr2=0x7fa8701070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 --2- 172.21.15.81:0/3059279607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870106cd0 0x7fa8701070b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa860009910 tx=0x7fa860009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 -- 172.21.15.81:0/3059279607 shutdown_connections 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 --2- 172.21.15.81:0/3059279607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa870068580 0x7fa8700689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 --2- 172.21.15.81:0/3059279607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870106cd0 0x7fa8701070b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 -- 172.21.15.81:0/3059279607 >> 172.21.15.81:0/3059279607 conn(0x7fa870075670 msgr2=0x7fa870075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 -- 172.21.15.81:0/3059279607 shutdown_connections 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 -- 172.21.15.81:0/3059279607 wait complete. 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.010+0000 7fa8753ac700 1 Processor -- start 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa8753ac700 1 -- start start 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa8753ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa8753ac700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa870106cd0 0x7fa87019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa8753ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87019d240 con 0x7fa870068580 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa8753ac700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870196760 con 0x7fa870106cd0 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54704/0 (socket says 172.21.15.81:54704) 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 -- 172.21.15.81:0/1713369400 learned_addr learned my addr 172.21.15.81:0/1713369400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 -- 172.21.15.81:0/1713369400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa870106cd0 msgr2=0x7fa87019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa870106cd0 0x7fa87019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 -- 172.21.15.81:0/1713369400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600095f0 con 0x7fa870068580 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86effd700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa860006010 tx=0x7fa86000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.011+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86001d070 con 0x7fa870068580 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.012+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa86000f460 con 0x7fa870068580 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.012+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8701969e0 con 0x7fa870068580 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.012+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa860021640 con 0x7fa870068580 2024-09-18T12:48:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.012+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870196ed0 con 0x7fa870068580 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.012+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8701091f0 con 0x7fa870068580 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.013+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa86000fab0 con 0x7fa870068580 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.014+0000 7fa86cff9700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 0x7fa85c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.014+0000 7fa8667fc700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 0x7fa85c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.014+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa86008cb10 con 0x7fa870068580 2024-09-18T12:48:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.014+0000 7fa8667fc700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 0x7fa85c06e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa870197bd0 tx=0x7fa858006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.018+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa86005b280 con 0x7fa870068580 2024-09-18T12:48:14.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:13 smithi081 ceph-mon[27646]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:14.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.202+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa870197200 con 0x7fa85c06c4e0 2024-09-18T12:48:14.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.204+0000 7fa86cff9700 1 -- 172.21.15.81:0/1713369400 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28205 (secure 0 0 0) 0x7fa870197200 con 0x7fa85c06c4e0 2024-09-18T12:48:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 msgr2=0x7fa85c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 0x7fa85c06e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa870197bd0 tx=0x7fa858006d20 comp rx=0 tx=0).stop 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 msgr2=0x7fa87019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa860006010 tx=0x7fa86000be20 comp rx=0 tx=0).stop 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 shutdown_connections 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa85c06c4e0 0x7fa85c06e9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa870068580 0x7fa87019c670 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 --2- 172.21.15.81:0/1713369400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa870106cd0 0x7fa87019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.206+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 >> 172.21.15.81:0/1713369400 conn(0x7fa870075670 msgr2=0x7fa8700fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.207+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 shutdown_connections 2024-09-18T12:48:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:14.207+0000 7fa8753ac700 1 -- 172.21.15.81:0/1713369400 wait complete. 2024-09-18T12:48:14.209 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T12:48:14.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:13 smithi136 ceph-mon[35363]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-18T12:48:12.475330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002556"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-18T12:47:18.869649+0000","last_change":"2024-09-18T12:46:53.251752+0000","last_active":"2024-09-18T12:47:18.869649+0000","last_peered":"2024-09-18T12:47:18.869649+0000","last_clean":"2024-09-18T12:47:18.869649+0000","last_became_active":"2024-09-18T12:46:53.251429+0000","last_became_peered":"2024-09-18T12:46:53.251429+0000","last_unstale":"2024-09-18T12:47:18.869649+0000","last_undegraded":"2024-09-18T12:47:18.869649+0000","last_fullsized":"2024-09-18T12:47:18.869649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:46:04.811366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:46:04.811366+0000","last_clean_scrub_stamp":"2024-09-18T12:46:04.811366+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:05:07.085493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.48299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.496,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.23499999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44700000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.252},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26400000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Sep 18 12:47:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.184,"15min":0.184},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.248},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46300000000000002,"5min":0.501,"15min":0.501},"last":0.316}]},{"osd":2,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.49199999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed Sep 18 12:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:47:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.23300000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.28000000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.47399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.317},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.253}]},{"osd":3,"last update":"Wed Sep 18 12:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":13.826000000000001,"5min":13.826000000000001,"15min":13.826000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:48:14.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:48:15.105 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:15.226 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:14 smithi081 ceph-mon[27646]: from='client.14500 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:48:15.226 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:14 smithi081 ceph-mon[27646]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:14 smithi136 ceph-mon[35363]: from='client.14500 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:48:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:14 smithi136 ceph-mon[35363]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.692+0000 7fa376f8d700 1 -- 172.21.15.81:0/3456564723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 msgr2=0x7fa370101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.692+0000 7fa376f8d700 1 --2- 172.21.15.81:0/3456564723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa370101280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa364009910 tx=0x7fa364009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- 172.21.15.81:0/3456564723 shutdown_connections 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 --2- 172.21.15.81:0/3456564723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 0x7fa3701058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 --2- 172.21.15.81:0/3456564723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa370101280 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- 172.21.15.81:0/3456564723 >> 172.21.15.81:0/3456564723 conn(0x7fa3700fc750 msgr2=0x7fa3700feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- 172.21.15.81:0/3456564723 shutdown_connections 2024-09-18T12:48:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- 172.21.15.81:0/3456564723 wait complete. 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 Processor -- start 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- start start 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 0x7fa37019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37019d2c0 con 0x7fa370100ea0 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.693+0000 7fa376f8d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370196770 con 0x7fa370101850 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41492/0 (socket says 172.21.15.81:41492) 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 -- 172.21.15.81:0/1978183613 learned_addr learned my addr 172.21.15.81:0/1978183613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa36ffff700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 0x7fa37019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 -- 172.21.15.81:0/1978183613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 msgr2=0x7fa37019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 0x7fa37019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 -- 172.21.15.81:0/1978183613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640095f0 con 0x7fa370100ea0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa374d29700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa364006010 tx=0x7fa36400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36401d070 con 0x7fa370100ea0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa36400f460 con 0x7fa370100ea0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3701969f0 con 0x7fa370100ea0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa364017630 con 0x7fa370100ea0 2024-09-18T12:48:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.694+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa370196ee0 con 0x7fa370100ea0 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.695+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa370109240 con 0x7fa370100ea0 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.696+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa36400f5d0 con 0x7fa370100ea0 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.696+0000 7fa36dffb700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 0x7fa36006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.696+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa36408c7a0 con 0x7fa370100ea0 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.696+0000 7fa36ffff700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 0x7fa36006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:16.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.697+0000 7fa36ffff700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 0x7fa36006e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa370197be0 tx=0x7fa35c00b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:16.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.700+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa36405ae70 con 0x7fa370100ea0 2024-09-18T12:48:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.885+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa370197cd0 con 0x7fa36006c4e0 2024-09-18T12:48:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.886+0000 7fa36dffb700 1 -- 172.21.15.81:0/1978183613 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28175 (secure 0 0 0) 0x7fa370197cd0 con 0x7fa36006c4e0 2024-09-18T12:48:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.888+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 msgr2=0x7fa36006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.888+0000 7fa376f8d700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 0x7fa36006e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa370197be0 tx=0x7fa35c00b410 comp rx=0 tx=0).stop 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.888+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 msgr2=0x7fa37019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.888+0000 7fa376f8d700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa364006010 tx=0x7fa36400bd70 comp rx=0 tx=0).stop 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 shutdown_connections 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa36006c4e0 0x7fa36006e9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa370100ea0 0x7fa37019c6f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 --2- 172.21.15.81:0/1978183613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa370101850 0x7fa37019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 >> 172.21.15.81:0/1978183613 conn(0x7fa3700fc750 msgr2=0x7fa3700fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 shutdown_connections 2024-09-18T12:48:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:16.889+0000 7fa376f8d700 1 -- 172.21.15.81:0/1978183613 wait complete. 2024-09-18T12:48:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T12:48:17.509 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-18T12:48:16.475980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002548"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-18T12:47:18.869649+0000","last_change":"2024-09-18T12:46:53.251752+0000","last_active":"2024-09-18T12:47:18.869649+0000","last_peered":"2024-09-18T12:47:18.869649+0000","last_clean":"2024-09-18T12:47:18.869649+0000","last_became_active":"2024-09-18T12:46:53.251429+0000","last_became_peered":"2024-09-18T12:46:53.251429+0000","last_unstale":"2024-09-18T12:47:18.869649+0000","last_undegraded":"2024-09-18T12:47:18.869649+0000","last_fullsized":"2024-09-18T12:47:18.869649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:46:04.811366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:46:04.811366+0000","last_clean_scrub_stamp":"2024-09-18T12:46:04.811366+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:05:07.085493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.443},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.48299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.496,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.26100000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44700000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.28699999999999998}]},{"osd":3,"last update":"Wed Sep 18 12:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.627}]},{"osd":4,"last update":"Wed Sep 18 12:47:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.184,"15min":0.184},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.248},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46300000000000002,"5min":0.501,"15min":0.501},"last":0.316}]},{"osd":2,"last update":"Wed Sep 18 12:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.49199999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed Sep 18 12:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:47:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.41599999999999998}]},{"osd":2,"last update":"Wed Sep 18 12:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.28000000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.47399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.432},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":13.826000000000001,"5min":13.826000000000001,"15min":13.826000000000001},"last":0.89000000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:48:17.510 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-18T12:48:17.510 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:48:17.511 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:48:17.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-18T12:48:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:17 smithi136 ceph-mon[35363]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:17 smithi081 ceph-mon[27646]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:18 smithi136 ceph-mon[35363]: from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:48:18.822 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:18 smithi081 ceph-mon[27646]: from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:48:19.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 -- 172.21.15.81:0/193676497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c100ea0 msgr2=0x7f8f0c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:19.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 --2- 172.21.15.81:0/193676497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c100ea0 0x7f8f0c101280 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009910 tx=0x7f8f00009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:19.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 -- 172.21.15.81:0/193676497 shutdown_connections 2024-09-18T12:48:19.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 --2- 172.21.15.81:0/193676497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f0c101850 0x7f8f0c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 --2- 172.21.15.81:0/193676497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c100ea0 0x7f8f0c101280 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 -- 172.21.15.81:0/193676497 >> 172.21.15.81:0/193676497 conn(0x7f8f0c0fc750 msgr2=0x7f8f0c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:19.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 -- 172.21.15.81:0/193676497 shutdown_connections 2024-09-18T12:48:19.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.308+0000 7f8f12e38700 1 -- 172.21.15.81:0/193676497 wait complete. 2024-09-18T12:48:19.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 Processor -- start 2024-09-18T12:48:19.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 -- start start 2024-09-18T12:48:19.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f0c100ea0 0x7f8f0c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:19.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c19d2e0 con 0x7f8f0c101850 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f12e38700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c196790 con 0x7f8f0c100ea0 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41516/0 (socket says 172.21.15.81:41516) 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 -- 172.21.15.81:0/823900263 learned_addr learned my addr 172.21.15.81:0/823900263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 -- 172.21.15.81:0/823900263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f0c100ea0 msgr2=0x7f8f0c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f0c100ea0 0x7f8f0c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.309+0000 7f8f0bfff700 1 -- 172.21.15.81:0/823900263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000095f0 con 0x7f8f0c101850 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f0bfff700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800d8d0 tx=0x7f8ef800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef8004a00 con 0x7f8f0c101850 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ef80054d0 con 0x7f8f0c101850 2024-09-18T12:48:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c196a70 con 0x7f8f0c101850 2024-09-18T12:48:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef8009d40 con 0x7f8f0c101850 2024-09-18T12:48:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.310+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c196fc0 con 0x7f8f0c101850 2024-09-18T12:48:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.311+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c109240 con 0x7f8f0c101850 2024-09-18T12:48:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.311+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8ef8005020 con 0x7f8f0c101850 2024-09-18T12:48:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.312+0000 7f8f09ffb700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 0x7f8efc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.312+0000 7f8f10bd4700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 0x7f8efc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.312+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8ef808adb0 con 0x7f8f0c101850 2024-09-18T12:48:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.312+0000 7f8f10bd4700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 0x7f8efc06e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b5c0 tx=0x7f8f00005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.316+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8ef8059400 con 0x7f8f0c101850 2024-09-18T12:48:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.551+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8f0c1971e0 con 0x7f8f0c101850 2024-09-18T12:48:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.551+0000 7f8f09ffb700 1 -- 172.21.15.81:0/823900263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8ef8020040 con 0x7f8f0c101850 2024-09-18T12:48:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:19.553 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:48:19.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 msgr2=0x7f8efc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:19.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 0x7f8efc06e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b5c0 tx=0x7f8f00005960 comp rx=0 tx=0).stop 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 msgr2=0x7f8f0c19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800d8d0 tx=0x7f8ef800dc90 comp rx=0 tx=0).stop 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 shutdown_connections 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f0c100ea0 0x7f8f0c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8efc06c4e0 0x7f8efc06e9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 --2- 172.21.15.81:0/823900263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c101850 0x7f8f0c19cc50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 >> 172.21.15.81:0/823900263 conn(0x7f8f0c0fc750 msgr2=0x7f8f0c0fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 shutdown_connections 2024-09-18T12:48:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:19.554+0000 7f8f12e38700 1 -- 172.21.15.81:0/823900263 wait complete. 2024-09-18T12:48:19.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:19 smithi081 ceph-mon[27646]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:19.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:19.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:19 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/823900263' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:48:20.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:19 smithi136 ceph-mon[35363]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:20.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:20.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:19 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/823900263' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:48:20.190 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:48:20.190 INFO:tasks.cephadm:Setup complete, yielding 2024-09-18T12:48:20.190 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:48:20.199 INFO:teuthology.task.print:**** done end installing v18.2.1 cephadm ... 2024-09-18T12:48:20.199 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:20.207 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:20.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-18T12:48:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:21.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:21 smithi081 ceph-mon[27646]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:21.811 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 -- 172.21.15.81:0/2270179211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb548100da0 msgr2=0x7fb548101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 --2- 172.21.15.81:0/2270179211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb548100da0 0x7fb548101200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009910 tx=0x7fb53c009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 -- 172.21.15.81:0/2270179211 shutdown_connections 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 --2- 172.21.15.81:0/2270179211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb548100da0 0x7fb548101200 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 --2- 172.21.15.81:0/2270179211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5480ffba0 0x7fb5480fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 -- 172.21.15.81:0/2270179211 >> 172.21.15.81:0/2270179211 conn(0x7fb5480fb120 msgr2=0x7fb5480fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 -- 172.21.15.81:0/2270179211 shutdown_connections 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.030+0000 7fb54da64700 1 -- 172.21.15.81:0/2270179211 wait complete. 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 Processor -- start 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 -- start start 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb548100da0 0x7fb54819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54819b800 con 0x7fb5480ffba0 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb54da64700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54819b940 con 0x7fb548100da0 2024-09-18T12:48:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb5477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb5477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41528/0 (socket says 172.21.15.81:41528) 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.031+0000 7fb5477fe700 1 -- 172.21.15.81:0/3938574112 learned_addr learned my addr 172.21.15.81:0/3938574112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb546ffd700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb548100da0 0x7fb54819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb5477fe700 1 -- 172.21.15.81:0/3938574112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb548100da0 msgr2=0x7fb54819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb5477fe700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb548100da0 0x7fb54819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb5477fe700 1 -- 172.21.15.81:0/3938574112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0095f0 con 0x7fb5480ffba0 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb5477fe700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d900 tx=0x7fb53800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5380041f0 con 0x7fb5480ffba0 2024-09-18T12:48:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb538004350 con 0x7fb5480ffba0 2024-09-18T12:48:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54819bc20 con 0x7fb5480ffba0 2024-09-18T12:48:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb538003d20 con 0x7fb5480ffba0 2024-09-18T12:48:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.032+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54819c170 con 0x7fb5480ffba0 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fb538009730 con 0x7fb5480ffba0 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb548108700 con 0x7fb5480ffba0 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb544ff9700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 0x7fb53006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb53808b370 con 0x7fb5480ffba0 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb546ffd700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 0x7fb53006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.034+0000 7fb546ffd700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 0x7fb53006e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb53c006010 tx=0x7fb53c00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.038+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb538059960 con 0x7fb5480ffba0 2024-09-18T12:48:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:21 smithi136 ceph-mon[35363]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:22.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.230+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fb5481088f0 con 0x7fb5480ffba0 2024-09-18T12:48:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.237+0000 7fb544ff9700 1 -- 172.21.15.81:0/3938574112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v38)=0 v38) v1 ==== 143+0+0 (secure 0 0 0) 0x7fb538003e80 con 0x7fb5480ffba0 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 msgr2=0x7fb53006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 0x7fb53006e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb53c006010 tx=0x7fb53c00b540 comp rx=0 tx=0).stop 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 msgr2=0x7fb5480699f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d900 tx=0x7fb53800dc10 comp rx=0 tx=0).stop 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 shutdown_connections 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fb53006c4e0 0x7fb53006e9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5480ffba0 0x7fb5480699f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 --2- 172.21.15.81:0/3938574112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb548100da0 0x7fb54819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 >> 172.21.15.81:0/3938574112 conn(0x7fb5480fb120 msgr2=0x7fb548103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 shutdown_connections 2024-09-18T12:48:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:22.239+0000 7fb54da64700 1 -- 172.21.15.81:0/3938574112 wait complete. 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3938574112' entity='client.admin' 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:22.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:22.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:22 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:22.944 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:48:22.952 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-18T12:48:22.952 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:23.003 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:23.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3938574112' entity='client.admin' 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:23.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:22 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:24.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:23 smithi136 ceph-mon[35363]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:24.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:23 smithi081 ceph-mon[27646]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 -- 172.21.15.81:0/2256268653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 msgr2=0x7fadb80fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 --2- 172.21.15.81:0/2256268653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb80fffc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fada800b0a0 tx=0x7fada800b3b0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 -- 172.21.15.81:0/2256268653 shutdown_connections 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 --2- 172.21.15.81:0/2256268653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 0x7fadb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 --2- 172.21.15.81:0/2256268653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb80fffc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 -- 172.21.15.81:0/2256268653 >> 172.21.15.81:0/2256268653 conn(0x7fadb80fb120 msgr2=0x7fadb80fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.883+0000 7fadc0498700 1 -- 172.21.15.81:0/2256268653 shutdown_connections 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 -- 172.21.15.81:0/2256268653 wait complete. 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 Processor -- start 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 -- start start 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:24.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 0x7fadb8196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8197120 con 0x7fadb80ffba0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadc0498700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8197260 con 0x7fadb8100da0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadbe234700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadbe234700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41546/0 (socket says 172.21.15.81:41546) 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.884+0000 7fadbe234700 1 -- 172.21.15.81:0/2522302859 learned_addr learned my addr 172.21.15.81:0/2522302859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadbda33700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 0x7fadb8196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadbe234700 1 -- 172.21.15.81:0/2522302859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 msgr2=0x7fadb8196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadbe234700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 0x7fadb8196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadbe234700 1 -- 172.21.15.81:0/2522302859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009d00 con 0x7fadb80ffba0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadbe234700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fada80077b0 tx=0x7fada8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada800e040 con 0x7fadb80ffba0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fada800ce60 con 0x7fadb80ffba0 2024-09-18T12:48:24.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb819bcb0 con 0x7fadb80ffba0 2024-09-18T12:48:24.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada801db10 con 0x7fadb80ffba0 2024-09-18T12:48:24.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.885+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb819c1a0 con 0x7fadb80ffba0 2024-09-18T12:48:24.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.886+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8109880 con 0x7fadb80ffba0 2024-09-18T12:48:24.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.886+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fada801dc90 con 0x7fadb80ffba0 2024-09-18T12:48:24.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.887+0000 7fadb77fe700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 0x7fada006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:24.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.887+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fada808ce40 con 0x7fadb80ffba0 2024-09-18T12:48:24.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.887+0000 7fadbda33700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 0x7fada006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:24.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.887+0000 7fadbda33700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 0x7fada006e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadac006fd0 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:24.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:24.891+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fada805b510 con 0x7fadb80ffba0 2024-09-18T12:48:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.093+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadb81056f0 con 0x7fada006c4e0 2024-09-18T12:48:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.094+0000 7fadb77fe700 1 -- 172.21.15.81:0/2522302859 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fadb81056f0 con 0x7fada006c4e0 2024-09-18T12:48:25.095 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-09-18T12:48:25.095 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-09-18T12:48:25.095 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-09-18T12:48:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 msgr2=0x7fada006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 0x7fada006e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadac006fd0 tx=0x7fadac008040 comp rx=0 tx=0).stop 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 msgr2=0x7fadb81965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fada80077b0 tx=0x7fada8003ce0 comp rx=0 tx=0).stop 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 shutdown_connections 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fada006c4e0 0x7fada006e9a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80ffba0 0x7fadb81965c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 --2- 172.21.15.81:0/2522302859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb8100da0 0x7fadb8196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 >> 172.21.15.81:0/2522302859 conn(0x7fadb80fb120 msgr2=0x7fadb8103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 shutdown_connections 2024-09-18T12:48:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:25.096+0000 7fadc0498700 1 -- 172.21.15.81:0/2522302859 wait complete. 2024-09-18T12:48:25.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-18T12:48:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:26.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:25 smithi136 ceph-mon[35363]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:26.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:25 smithi081 ceph-mon[27646]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:27.060 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:26 smithi081 ceph-mon[27646]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:27.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:26 smithi136 ceph-mon[35363]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 -- 172.21.15.81:0/4233888318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990104060 msgr2=0x7f0990106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 --2- 172.21.15.81:0/4233888318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990104060 0x7f0990106450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0984009910 tx=0x7f0984009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 -- 172.21.15.81:0/4233888318 shutdown_connections 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 --2- 172.21.15.81:0/4233888318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990104060 0x7f0990106450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 --2- 172.21.15.81:0/4233888318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990101730 0x7f0990103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.581+0000 7f09958e2700 1 -- 172.21.15.81:0/4233888318 >> 172.21.15.81:0/4233888318 conn(0x7f09900fb120 msgr2=0x7f09900fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 -- 172.21.15.81:0/4233888318 shutdown_connections 2024-09-18T12:48:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 -- 172.21.15.81:0/4233888318 wait complete. 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 Processor -- start 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 -- start start 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.582+0000 7f09958e2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990104060 0x7f09900ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09958e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900ffc20 con 0x7f0990101730 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09958e2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900ffd60 con 0x7f0990104060 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46948/0 (socket says 172.21.15.81:46948) 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 -- 172.21.15.81:0/2895921987 learned_addr learned my addr 172.21.15.81:0/2895921987 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098e7fc700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990104060 0x7f09900ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 -- 172.21.15.81:0/2895921987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990104060 msgr2=0x7f09900ff6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990104060 0x7f09900ff6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 -- 172.21.15.81:0/2895921987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840095f0 con 0x7f0990101730 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f098effd700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f098000b4b0 tx=0x7f098000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0980011800 con 0x7f0990101730 2024-09-18T12:48:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0980011e10 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0990100040 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098000f2e0 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.583+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099019e530 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.584+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0990190690 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.585+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0980011960 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.585+0000 7f09948e0700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 0x7f097806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.585+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f098008b040 con 0x7f0990101730 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.585+0000 7f098e7fc700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 0x7f097806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.586+0000 7f098e7fc700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 0x7f097806e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0984006010 tx=0x7f098400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.590+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0980059690 con 0x7f0990101730 2024-09-18T12:48:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.787+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09900611d0 con 0x7f097806c4e0 2024-09-18T12:48:27.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.796+0000 7f09948e0700 1 -- 172.21.15.81:0/2895921987 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7f09900611d0 con 0x7f097806c4e0 2024-09-18T12:48:27.797 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (3m) 2m ago 5m 26.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (6m) 2m ago 6m 7008k - 18.2.1 5be31c24972a 2dd4371065e4 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (5m) 70s ago 5m 6929k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 2m ago 6m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (5m) 70s ago 5m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (3m) 2m ago 5m 78.1M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (7m) 2m ago 7m 482M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (4m) 70s ago 4m 441M - 18.2.1 5be31c24972a d081f5286368 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (7m) 2m ago 7m 46.0M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (4m) 70s ago 4m 44.7M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (6m) 2m ago 6m 15.7M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:48:27.798 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (5m) 70s ago 5m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (3m) 2m ago 3m 43.1M 3946M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 2m ago 3m 41.6M 3946M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (2m) 2m ago 2m 43.2M 3946M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (2m) 70s ago 2m 41.9M 4970M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (101s) 70s ago 101s 41.4M 4970M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (75s) 70s ago 75s 10.5M 4970M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:48:27.799 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (3m) 2m ago 5m 39.8M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 msgr2=0x7f097806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 0x7f097806e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0984006010 tx=0x7f098400b540 comp rx=0 tx=0).stop 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 msgr2=0x7f0990101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f098000b4b0 tx=0x7f098000b7c0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 shutdown_connections 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f097806c4e0 0x7f097806e9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0990101730 0x7f0990101090 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 --2- 172.21.15.81:0/2895921987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0990104060 0x7f09900ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 >> 172.21.15.81:0/2895921987 conn(0x7f09900fb120 msgr2=0x7f09900fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:27.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 shutdown_connections 2024-09-18T12:48:27.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:27.798+0000 7f09958e2700 1 -- 172.21.15.81:0/2895921987 wait complete. 2024-09-18T12:48:28.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:27 smithi136 ceph-mon[35363]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:28.099 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:27 smithi081 ceph-mon[27646]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:28.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-18T12:48:28.646 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:29.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:28 smithi136 ceph-mon[35363]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:29.070 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:28 smithi081 ceph-mon[27646]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:29.992 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:29 smithi081 ceph-mon[27646]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:29 smithi136 ceph-mon[35363]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/1721630700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84101eb0 msgr2=0x7ffb84102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/1721630700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84101eb0 0x7ffb84102310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009910 tx=0x7ffb70009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/1721630700 shutdown_connections 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/1721630700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84101eb0 0x7ffb84102310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/1721630700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84100cb0 0x7ffb841010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/1721630700 >> 172.21.15.81:0/1721630700 conn(0x7ffb840fc230 msgr2=0x7ffb840fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/1721630700 shutdown_connections 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.329+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/1721630700 wait complete. 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 Processor -- start 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 -- start start 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84101eb0 0x7ffb84198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84199240 con 0x7ffb84100cb0 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb8ae9f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84199380 con 0x7ffb84101eb0 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb88c3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb88c3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46954/0 (socket says 172.21.15.81:46954) 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb88c3b700 1 -- 172.21.15.81:0/2664444507 learned_addr learned my addr 172.21.15.81:0/2664444507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.330+0000 7ffb83fff700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84101eb0 0x7ffb84198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb88c3b700 1 -- 172.21.15.81:0/2664444507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84101eb0 msgr2=0x7ffb84198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb88c3b700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84101eb0 0x7ffb84198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb88c3b700 1 -- 172.21.15.81:0/2664444507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700095f0 con 0x7ffb84100cb0 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb88c3b700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800d900 tx=0x7ffb7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb780041f0 con 0x7ffb84100cb0 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8419de30 con 0x7ffb84100cb0 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb78004350 con 0x7ffb84100cb0 2024-09-18T12:48:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb78003d20 con 0x7ffb84100cb0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.331+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8419e2f0 con 0x7ffb84100cb0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.332+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84105f90 con 0x7ffb84100cb0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.333+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ffb78009730 con 0x7ffb84100cb0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.333+0000 7ffb81ffb700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 0x7ffb7406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.333+0000 7ffb83fff700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 0x7ffb7406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.333+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ffb7808b2f0 con 0x7ffb84100cb0 2024-09-18T12:48:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.334+0000 7ffb83fff700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 0x7ffb7406e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb70006010 tx=0x7ffb7000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.338+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ffb78059940 con 0x7ffb84100cb0 2024-09-18T12:48:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.538+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb840611d0 con 0x7ffb7406c4e0 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.543+0000 7ffb81ffb700 1 -- 172.21.15.81:0/2664444507 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7ffb840611d0 con 0x7ffb7406c4e0 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:crash 2/2 2m ago 6m * 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 2/2 2m ago 6m count:2 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:mon 2/2 2m ago 6m smithi081:172.21.15.81=smithi081;smithi136:172.21.15.136=smithi136;count:2 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-09-18T12:48:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:osd 6 2m ago - 2024-09-18T12:48:30.545 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-18T12:48:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 msgr2=0x7ffb7406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 0x7ffb7406e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb70006010 tx=0x7ffb7000b540 comp rx=0 tx=0).stop 2024-09-18T12:48:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 msgr2=0x7ffb841986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800d900 tx=0x7ffb7800dc10 comp rx=0 tx=0).stop 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 shutdown_connections 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7ffb7406c4e0 0x7ffb7406e9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84100cb0 0x7ffb841986e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 --2- 172.21.15.81:0/2664444507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb84101eb0 0x7ffb84198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 >> 172.21.15.81:0/2664444507 conn(0x7ffb840fc230 msgr2=0x7ffb841030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 shutdown_connections 2024-09-18T12:48:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:30.545+0000 7ffb8ae9f700 1 -- 172.21.15.81:0/2664444507 wait complete. 2024-09-18T12:48:31.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-18T12:48:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:31 smithi136 ceph-mon[35363]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:31 smithi136 ceph-mon[35363]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:31 smithi081 ceph-mon[27646]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:31 smithi081 ceph-mon[27646]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 -- 172.21.15.81:0/3601633107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 msgr2=0x7f418c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 --2- 172.21.15.81:0/3601633107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c1010d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b0a0 tx=0x7f417c00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 -- 172.21.15.81:0/3601633107 shutdown_connections 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 --2- 172.21.15.81:0/3601633107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 0x7f418c102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 --2- 172.21.15.81:0/3601633107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c1010d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 -- 172.21.15.81:0/3601633107 >> 172.21.15.81:0/3601633107 conn(0x7f418c0fc230 msgr2=0x7f418c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 -- 172.21.15.81:0/3601633107 shutdown_connections 2024-09-18T12:48:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.963+0000 7f4193373700 1 -- 172.21.15.81:0/3601633107 wait complete. 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 Processor -- start 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 -- start start 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 0x7f418c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0736c0 con 0x7f418c100cb0 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f4193373700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c073800 con 0x7f418c101eb0 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46962/0 (socket says 172.21.15.81:46962) 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 -- 172.21.15.81:0/1427129748 learned_addr learned my addr 172.21.15.81:0/1427129748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419090e700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 0x7f418c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 -- 172.21.15.81:0/1427129748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 msgr2=0x7f418c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 0x7f418c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 -- 172.21.15.81:0/1427129748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009d00 con 0x7f418c100cb0 2024-09-18T12:48:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f419110f700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f417c0077b0 tx=0x7f417c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.964+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417c00e040 con 0x7f418c100cb0 2024-09-18T12:48:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.965+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f417c0044f0 con 0x7f418c100cb0 2024-09-18T12:48:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.965+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c073a80 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.965+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417c01d9e0 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.965+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c073f70 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.966+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c109810 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.966+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f417c004040 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.966+0000 7f418a7fc700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 0x7f417406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.967+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f417c08cdd0 con 0x7f418c100cb0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.967+0000 7f419090e700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 0x7f417406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.967+0000 7f419090e700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 0x7f417406e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4180005950 tx=0x7f41800058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:32.971+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f417c05b4a0 con 0x7f418c100cb0 2024-09-18T12:48:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.167+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f418c106800 con 0x7f417406c4e0 2024-09-18T12:48:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.168+0000 7f418a7fc700 1 -- 172.21.15.81:0/1427129748 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f418c106800 con 0x7f417406c4e0 2024-09-18T12:48:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-09-18T12:48:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-09-18T12:48:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:smithi136 172.21.15.136 2024-09-18T12:48:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:2 hosts in cluster 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 msgr2=0x7f417406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 0x7f417406e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4180005950 tx=0x7f41800058e0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 msgr2=0x7f418c074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f417c0077b0 tx=0x7f417c009810 comp rx=0 tx=0).stop 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 shutdown_connections 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f417406c4e0 0x7f417406e9a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c100cb0 0x7f418c074b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 --2- 172.21.15.81:0/1427129748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c101eb0 0x7f418c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 >> 172.21.15.81:0/1427129748 conn(0x7f418c0fc230 msgr2=0x7f418c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 shutdown_connections 2024-09-18T12:48:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:33.170+0000 7f4193373700 1 -- 172.21.15.81:0/1427129748 wait complete. 2024-09-18T12:48:33.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-18T12:48:33.982 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:34.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:33 smithi136 ceph-mon[35363]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:34.103 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:33 smithi081 ceph-mon[27646]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:34 smithi136 ceph-mon[35363]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:35.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:35.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:34 smithi081 ceph-mon[27646]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:35.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.598+0000 7fcbd905e700 1 -- 172.21.15.81:0/1408148101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 msgr2=0x7fcbd41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.598+0000 7fcbd905e700 1 --2- 172.21.15.81:0/1408148101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd41010d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009910 tx=0x7fcbc4009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.598+0000 7fcbd905e700 1 -- 172.21.15.81:0/1408148101 shutdown_connections 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.598+0000 7fcbd905e700 1 --2- 172.21.15.81:0/1408148101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 0x7fcbd4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.598+0000 7fcbd905e700 1 --2- 172.21.15.81:0/1408148101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd41010d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.599+0000 7fcbd905e700 1 -- 172.21.15.81:0/1408148101 >> 172.21.15.81:0/1408148101 conn(0x7fcbd40fc230 msgr2=0x7fcbd40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.599+0000 7fcbd905e700 1 -- 172.21.15.81:0/1408148101 shutdown_connections 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.599+0000 7fcbd905e700 1 -- 172.21.15.81:0/1408148101 wait complete. 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.599+0000 7fcbd905e700 1 Processor -- start 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd905e700 1 -- start start 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd905e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd905e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 0x7fcbd4196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd905e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41970c0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd905e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4197200 con 0x7fcbd4101eb0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50078/0 (socket says 172.21.15.81:50078) 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 -- 172.21.15.81:0/83022857 learned_addr learned my addr 172.21.15.81:0/83022857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 -- 172.21.15.81:0/83022857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 msgr2=0x7fcbd4196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd259c700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 0x7fcbd4196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 0x7fcbd4196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 -- 172.21.15.81:0/83022857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40095f0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbd2d9d700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bda0 tx=0x7fcbc400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:35.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.600+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbc401d070 con 0x7fcbd4100cb0 2024-09-18T12:48:35.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.601+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd419bc50 con 0x7fcbd4100cb0 2024-09-18T12:48:35.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.601+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcbc4004c50 con 0x7fcbd4100cb0 2024-09-18T12:48:35.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.601+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbc400f690 con 0x7fcbd4100cb0 2024-09-18T12:48:35.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.601+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4072fc0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.602+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4109890 con 0x7fcbd4100cb0 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.602+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fcbc40229b0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.602+0000 7fcbbbfff700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 0x7fcbbc072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.603+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fcbc408cba0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.603+0000 7fcbd259c700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 0x7fcbbc072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.603+0000 7fcbd259c700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 0x7fcbbc072db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006fd0 tx=0x7fcbc8008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.607+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcbc405b2a0 con 0x7fcbd4100cb0 2024-09-18T12:48:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.810+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbd4106800 con 0x7fcbbc0708f0 2024-09-18T12:48:35.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.812+0000 7fcbbbfff700 1 -- 172.21.15.81:0/83022857 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fcbd4106800 con 0x7fcbbc0708f0 2024-09-18T12:48:35.813 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-18T12:48:35.814 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-18T12:48:35.814 INFO:teuthology.orchestra.run.smithi081.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 1863G No 74s ago Has a FileSystem, LVM detected 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 msgr2=0x7fcbbc072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 0x7fcbbc072db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006fd0 tx=0x7fcbc8008040 comp rx=0 tx=0).stop 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 msgr2=0x7fcbd4196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bda0 tx=0x7fcbc400be80 comp rx=0 tx=0).stop 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 shutdown_connections 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcbbc0708f0 0x7fcbbc072db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4196560 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 --2- 172.21.15.81:0/83022857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbd4101eb0 0x7fcbd4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 >> 172.21.15.81:0/83022857 conn(0x7fcbd40fc230 msgr2=0x7fcbd41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 shutdown_connections 2024-09-18T12:48:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:35.814+0000 7fcbd905e700 1 -- 172.21.15.81:0/83022857 wait complete. 2024-09-18T12:48:36.048 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:35 smithi136 ceph-mon[35363]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:36.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:35 smithi081 ceph-mon[27646]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:36.382 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:36.392 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:36.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-18T12:48:36.591 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:37.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:36 smithi081 ceph-mon[27646]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:37.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:36 smithi136 ceph-mon[35363]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:38.062 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:37 smithi081 ceph-mon[27646]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:38.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:37 smithi136 ceph-mon[35363]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 -- 172.21.15.81:0/2037432275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 msgr2=0x7f24941026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 --2- 172.21.15.81:0/2037432275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24941026c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f248400b0a0 tx=0x7f248400b3b0 comp rx=0 tx=0).stop 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 -- 172.21.15.81:0/2037432275 shutdown_connections 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 --2- 172.21.15.81:0/2037432275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24940ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 --2- 172.21.15.81:0/2037432275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24941026c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 -- 172.21.15.81:0/2037432275 >> 172.21.15.81:0/2037432275 conn(0x7f24940fa8c0 msgr2=0x7f24940fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 -- 172.21.15.81:0/2037432275 shutdown_connections 2024-09-18T12:48:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 -- 172.21.15.81:0/2037432275 wait complete. 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.295+0000 7f249a02d700 1 Processor -- start 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 -- start start 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24941019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494100530 con 0x7f24941022a0 2024-09-18T12:48:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494100670 con 0x7f24940fed20 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50102/0 (socket says 172.21.15.81:50102) 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 -- 172.21.15.81:0/575213608 learned_addr learned my addr 172.21.15.81:0/575213608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f24937fe700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24941019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 -- 172.21.15.81:0/575213608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 msgr2=0x7f24941019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24941019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 -- 172.21.15.81:0/575213608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484009d00 con 0x7f24941022a0 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f24937fe700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24941019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:48:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2492ffd700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f248800c910 tx=0x7f248800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24880041f0 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2494100950 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2488007db0 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.296+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2488003d60 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.297+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249419e540 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.297+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2494109820 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.298+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f2488007900 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.298+0000 7f2490ff9700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 0x7f247c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.299+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f248808b160 con 0x7f24941022a0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.299+0000 7f24937fe700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 0x7f247c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.299+0000 7f24937fe700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 0x7f247c06e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2484000f80 tx=0x7f248400b7b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.303+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f24880597b0 con 0x7f24941022a0 2024-09-18T12:48:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:38.519+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2494106990 con 0x7f247c06c4e0 2024-09-18T12:48:39.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:38 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:48:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:38 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:48:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.816+0000 7f2490ff9700 1 -- 172.21.15.81:0/575213608 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2494106990 con 0x7f247c06c4e0 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 msgr2=0x7f247c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 0x7f247c06e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2484000f80 tx=0x7f248400b7b0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 msgr2=0x7f24940ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f248800c910 tx=0x7f248800ccd0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 shutdown_connections 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24940fed20 0x7f24941019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.818+0000 7f249a02d700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f247c06c4e0 0x7f247c06e9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.819+0000 7f249a02d700 1 --2- 172.21.15.81:0/575213608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24941022a0 0x7f24940ffff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.819+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 >> 172.21.15.81:0/575213608 conn(0x7f24940fa8c0 msgr2=0x7f2494105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.819+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 shutdown_connections 2024-09-18T12:48:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:39.819+0000 7f249a02d700 1 -- 172.21.15.81:0/575213608 wait complete. 2024-09-18T12:48:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:39 smithi136 ceph-mon[35363]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:39 smithi136 ceph-mon[35363]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:39 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:48:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:39 smithi136 ceph-mon[35363]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:48:40.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:39 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-mon[27646]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-mon[27646]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-mon[27646]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:48:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:39 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[27642]: 2024-09-18T12:48:39.794+0000 7f4a38754700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:48:40.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:48:40.927 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:48:40.927 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:48:40.927 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:48:40.927 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:48:40.927 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: fsmap cephfs:0 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:40.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:40.929 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:40.929 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:40 smithi081 ceph-mon[27646]: Deploying daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:48:41.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:48:41.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:48:41.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:48:41.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:48:41.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: fsmap cephfs:0 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:41.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:41.066 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:40 smithi136 ceph-mon[35363]: Deploying daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:48:41.743 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:41.962 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:41 smithi081 ceph-mon[27646]: pgmap v200: 65 pgs: 10 creating+peering, 8 active+clean, 47 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:41.963 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:41 smithi081 ceph-mon[27646]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:48:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:41 smithi136 ceph-mon[35363]: pgmap v200: 65 pgs: 10 creating+peering, 8 active+clean, 47 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:41 smithi136 ceph-mon[35363]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:48:42.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:42 smithi081 ceph-mon[27646]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:48:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:42 smithi136 ceph-mon[35363]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 -- 172.21.15.81:0/546611698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 msgr2=0x7f348c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 --2- 172.21.15.81:0/546611698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c1009a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f348800aa20 tx=0x7f348800ad30 comp rx=0 tx=0).stop 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 -- 172.21.15.81:0/546611698 shutdown_connections 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 --2- 172.21.15.81:0/546611698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c1009a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 --2- 172.21.15.81:0/546611698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 -- 172.21.15.81:0/546611698 >> 172.21.15.81:0/546611698 conn(0x7f348c0fa8c0 msgr2=0x7f348c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 -- 172.21.15.81:0/546611698 shutdown_connections 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 -- 172.21.15.81:0/546611698 wait complete. 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.537+0000 7f3494268700 1 Processor -- start 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 -- start start 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c194350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c194eb0 con 0x7f348c100540 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c194ff0 con 0x7f348c0ff340 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50124/0 (socket says 172.21.15.81:50124) 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 -- 172.21.15.81:0/1394215689 learned_addr learned my addr 172.21.15.81:0/1394215689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3492004700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c194350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 -- 172.21.15.81:0/1394215689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 msgr2=0x7f348c194350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c194350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 -- 172.21.15.81:0/1394215689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348800a700 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3492004700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c194350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3491803700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f348800d010 tx=0x7f3488005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348800ccc0 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c199a40 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34880050d0 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34880168d0 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.538+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c199f30 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.539+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c107610 con 0x7f348c100540 2024-09-18T12:48:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.540+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f3488016b90 con 0x7f348c100540 2024-09-18T12:48:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.540+0000 7f34837fe700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 0x7f347806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.540+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3488012070 con 0x7f348c100540 2024-09-18T12:48:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.540+0000 7f3492004700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 0x7f347806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.541+0000 7f3492004700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 0x7f347806e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f347c005d90 tx=0x7f347c005d00 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.545+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f348805c880 con 0x7f348c100540 2024-09-18T12:48:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.781+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f348c19a8a0 con 0x7f348c100540 2024-09-18T12:48:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.782+0000 7f34837fe700 1 -- 172.21.15.81:0/1394215689 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f348805c410 con 0x7f348c100540 2024-09-18T12:48:43.783 INFO:teuthology.orchestra.run.smithi081.stdout:e2 2024-09-18T12:48:43.783 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 2 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:48:39.795027+0000 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:48:43.784 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:in 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:up {} 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:48:43.785 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.784+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 msgr2=0x7f347806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.784+0000 7f3494268700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 0x7f347806e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f347c005d90 tx=0x7f347c005d00 comp rx=0 tx=0).stop 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 msgr2=0x7f348c194890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f348800d010 tx=0x7f3488005e80 comp rx=0 tx=0).stop 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 shutdown_connections 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ff340 0x7f348c194350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f347806c4e0 0x7f347806e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 --2- 172.21.15.81:0/1394215689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c100540 0x7f348c194890 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 >> 172.21.15.81:0/1394215689 conn(0x7f348c0fa8c0 msgr2=0x7f348c103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 shutdown_connections 2024-09-18T12:48:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:43.785+0000 7f3494268700 1 -- 172.21.15.81:0/1394215689 wait complete. 2024-09-18T12:48:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-18T12:48:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:43 smithi081 ceph-mon[27646]: pgmap v203: 65 pgs: 10 creating+peering, 17 active+clean, 38 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:43 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1394215689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:48:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:43 smithi136 ceph-mon[35363]: pgmap v203: 65 pgs: 10 creating+peering, 17 active+clean, 38 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:43 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1394215689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:48:44.843 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:44.853 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:44.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-18T12:48:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: Deploying daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: pgmap v204: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:boot 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: daemon mds.cephfs.smithi081.irimad assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: Cluster is now healthy 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: fsmap cephfs:0 1 up:standby 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:creating} 2024-09-18T12:48:45.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:45 smithi136 ceph-mon[35363]: daemon mds.cephfs.smithi081.irimad is now active in filesystem cephfs as rank 0 2024-09-18T12:48:45.344 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: Deploying daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: pgmap v204: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:boot 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: daemon mds.cephfs.smithi081.irimad assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:48:45.345 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:48:45.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: Cluster is now healthy 2024-09-18T12:48:45.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: fsmap cephfs:0 1 up:standby 2024-09-18T12:48:45.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:48:45.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:creating} 2024-09-18T12:48:45.346 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:45 smithi081 ceph-mon[27646]: daemon mds.cephfs.smithi081.irimad is now active in filesystem cephfs as rank 0 2024-09-18T12:48:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 -- 172.21.15.81:0/637424422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 msgr2=0x7f5fa81026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 --2- 172.21.15.81:0/637424422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa81026a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800b0a0 tx=0x7f5f9800b3b0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 -- 172.21.15.81:0/637424422 shutdown_connections 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 --2- 172.21.15.81:0/637424422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 0x7f5fa80ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 --2- 172.21.15.81:0/637424422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa81026a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 -- 172.21.15.81:0/637424422 >> 172.21.15.81:0/637424422 conn(0x7f5fa80fa8c0 msgr2=0x7f5fa80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 -- 172.21.15.81:0/637424422 shutdown_connections 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.601+0000 7f5faddc0700 1 -- 172.21.15.81:0/637424422 wait complete. 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 Processor -- start 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 -- start start 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 0x7f5fa8196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa81971c0 con 0x7f5fa8102280 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5faddc0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8197300 con 0x7f5fa80fed00 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5fa6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5fa77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 0x7f5fa8196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5fa6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58594/0 (socket says 172.21.15.81:58594) 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.602+0000 7f5fa6ffd700 1 -- 172.21.15.81:0/2537935520 learned_addr learned my addr 172.21.15.81:0/2537935520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa6ffd700 1 -- 172.21.15.81:0/2537935520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 msgr2=0x7f5fa8196660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa6ffd700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 0x7f5fa8196660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa6ffd700 1 -- 172.21.15.81:0/2537935520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009d00 con 0x7f5fa8102280 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa6ffd700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000b4b0 tx=0x7f5f9000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f90011800 con 0x7f5fa8102280 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f90011e10 con 0x7f5fa8102280 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa819bdb0 con 0x7f5fa8102280 2024-09-18T12:48:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9000f2e0 con 0x7f5fa8102280 2024-09-18T12:48:46.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.603+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa819c2d0 con 0x7f5fa8102280 2024-09-18T12:48:46.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.604+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8109890 con 0x7f5fa8102280 2024-09-18T12:48:46.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.605+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f5f90010380 con 0x7f5fa8102280 2024-09-18T12:48:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.605+0000 7f5fa4ff9700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 0x7f5f9406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.605+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f9008b320 con 0x7f5fa8102280 2024-09-18T12:48:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.605+0000 7f5fa77fe700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 0x7f5f9406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.605+0000 7f5fa77fe700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 0x7f5f9406e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f98007710 tx=0x7f5f980076a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.609+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5f90059640 con 0x7f5fa8102280 2024-09-18T12:48:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:46.858+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f5fa819c970 con 0x7f5fa8102280 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:active 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:46 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:active 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:47.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:46 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.841+0000 7f5fa4ff9700 1 -- 172.21.15.81:0/2537935520 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5f900591d0 con 0x7f5fa8102280 2024-09-18T12:48:47.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 msgr2=0x7f5f9406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 0x7f5f9406e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f98007710 tx=0x7f5f980076a0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 msgr2=0x7f5fa8196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000b4b0 tx=0x7f5f9000b7c0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 shutdown_connections 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5fa80fed00 0x7f5fa8196660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f9406c4e0 0x7f5f9406e9a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 --2- 172.21.15.81:0/2537935520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa8102280 0x7f5fa8196ba0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 >> 172.21.15.81:0/2537935520 conn(0x7f5fa80fa8c0 msgr2=0x7f5fa8105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 shutdown_connections 2024-09-18T12:48:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:47.844+0000 7f5faddc0700 1 -- 172.21.15.81:0/2537935520 wait complete. 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: pgmap v205: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 306 B/s wr, 0 op/s 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: Deploying daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.136:6824/4063418833,v1:172.21.15.136:6825/4063418833] up:boot 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:48.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:47 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2537935520' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: pgmap v205: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 306 B/s wr, 0 op/s 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: Deploying daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.136:6824/4063418833,v1:172.21.15.136:6825/4063418833] up:boot 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:47 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2537935520' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-18T12:48:48.854 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2537935520' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: daemon mds.cephfs.smithi136.tfcykk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:creating} 2024-09-18T12:48:48.855 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:48 smithi136 ceph-mon[35363]: daemon mds.cephfs.smithi136.tfcykk is now active in filesystem cephfs as rank 1 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2537935520' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: daemon mds.cephfs.smithi136.tfcykk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 1 up:standby 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:creating} 2024-09-18T12:48:49.089 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:48 smithi081 ceph-mon[27646]: daemon mds.cephfs.smithi136.tfcykk is now active in filesystem cephfs as rank 1 2024-09-18T12:48:49.090 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:49.100 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:49.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-18T12:48:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:49.899 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.136:6824/4063418833,v1:172.21.15.136:6825/4063418833] up:active 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:49.900 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.136:6824/4063418833,v1:172.21.15.136:6825/4063418833] up:active 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:48:50.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: Deploying daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: Cluster is now healthy 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:boot 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 1 up:standby 2024-09-18T12:48:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:50 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:48:51.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: Deploying daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:48:51.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-18T12:48:51.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: Cluster is now healthy 2024-09-18T12:48:51.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:boot 2024-09-18T12:48:51.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 1 up:standby 2024-09-18T12:48:51.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:50 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:48:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 -- 172.21.15.81:0/1415977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4101eb0 msgr2=0x7f0cd4102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 --2- 172.21.15.81:0/1415977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4101eb0 0x7f0cd4102310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009910 tx=0x7f0cc8009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 -- 172.21.15.81:0/1415977 shutdown_connections 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 --2- 172.21.15.81:0/1415977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4101eb0 0x7f0cd4102310 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 --2- 172.21.15.81:0/1415977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 -- 172.21.15.81:0/1415977 >> 172.21.15.81:0/1415977 conn(0x7f0cd40fc230 msgr2=0x7f0cd40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 -- 172.21.15.81:0/1415977 shutdown_connections 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.388+0000 7f0cdb808700 1 -- 172.21.15.81:0/1415977 wait complete. 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 Processor -- start 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 -- start start 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 0x7f0cd41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4197010 con 0x7f0cd4100cb0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cdb808700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4197150 con 0x7f0cd4101eb0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cd95a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cd95a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58642/0 (socket says 172.21.15.81:58642) 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cd95a4700 1 -- 172.21.15.81:0/432186529 learned_addr learned my addr 172.21.15.81:0/432186529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.389+0000 7f0cd8da3700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 0x7f0cd41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cd95a4700 1 -- 172.21.15.81:0/432186529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 msgr2=0x7f0cd41969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cd95a4700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 0x7f0cd41969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cd95a4700 1 -- 172.21.15.81:0/432186529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80095f0 con 0x7f0cd4100cb0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cd8da3700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 0x7f0cd41969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cd95a4700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000d900 tx=0x7f0cd000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd00041f0 con 0x7f0cd4100cb0 2024-09-18T12:48:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0cd0004350 con 0x7f0cd4100cb0 2024-09-18T12:48:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd419bc00 con 0x7f0cd4100cb0 2024-09-18T12:48:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd0003d20 con 0x7f0cd4100cb0 2024-09-18T12:48:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.390+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd419c150 con 0x7f0cd4100cb0 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.391+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd4109810 con 0x7f0cd4100cb0 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.392+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0cd0009730 con 0x7f0cd4100cb0 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.392+0000 7f0cc67fc700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 0x7f0cc006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.392+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0cd008b600 con 0x7f0cd4100cb0 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.392+0000 7f0cd8da3700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 0x7f0cc006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.392+0000 7f0cd8da3700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 0x7f0cc006e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b5c0 tx=0x7f0cc8005610 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.397+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0cd0059920 con 0x7f0cd4100cb0 2024-09-18T12:48:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:51.629+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0cd419c8b0 con 0x7f0cd4100cb0 2024-09-18T12:48:52.101 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:51 smithi136 ceph-mon[35363]: pgmap v207: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-18T12:48:52.102 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:51 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/432186529' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T12:48:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:51 smithi081 ceph-mon[27646]: pgmap v207: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-18T12:48:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:51 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/432186529' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T12:48:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.483+0000 7f0cc67fc700 1 -- 172.21.15.81:0/432186529 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0cd0003e80 con 0x7f0cd4100cb0 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.485+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 msgr2=0x7f0cc006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.485+0000 7f0cdb808700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 0x7f0cc006e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b5c0 tx=0x7f0cc8005610 comp rx=0 tx=0).stop 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.485+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 msgr2=0x7f0cd41964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.485+0000 7f0cdb808700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000d900 tx=0x7f0cd000dc10 comp rx=0 tx=0).stop 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 shutdown_connections 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0cc006c4e0 0x7f0cc006e9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cd4100cb0 0x7f0cd41964b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 --2- 172.21.15.81:0/432186529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cd4101eb0 0x7f0cd41969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 >> 172.21.15.81:0/432186529 conn(0x7f0cd40fc230 msgr2=0x7f0cd41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 shutdown_connections 2024-09-18T12:48:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:52.486+0000 7f0cdb808700 1 -- 172.21.15.81:0/432186529 wait complete. 2024-09-18T12:48:53.236 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:53.245 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:53.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: pgmap v208: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-18T12:48:53.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/432186529' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T12:48:53.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:boot 2024-09-18T12:48:53.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2 up:standby 2024-09-18T12:48:53.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:53.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:53.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: pgmap v208: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-18T12:48:53.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/432186529' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T12:48:53.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:boot 2024-09-18T12:48:53.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2 up:standby 2024-09-18T12:48:53.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:48:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:54.748 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:active 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2 up:standby 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: Dropping low affinity active daemon mds.cephfs.smithi136.tfcykk in favor of higher affinity standby. 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: Replacing daemon mds.cephfs.smithi136.tfcykk as rank 1 with standby daemon mds.cephfs.smithi081.hmnvyn 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:standby 2024-09-18T12:48:54.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:54 smithi081 ceph-mon[27646]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:replay} 1 up:standby 2024-09-18T12:48:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] up:active 2024-09-18T12:48:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi136.tfcykk=up:active} 2 up:standby 2024-09-18T12:48:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: Dropping low affinity active daemon mds.cephfs.smithi136.tfcykk in favor of higher affinity standby. 2024-09-18T12:48:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: Replacing daemon mds.cephfs.smithi136.tfcykk as rank 1 with standby daemon mds.cephfs.smithi081.hmnvyn 2024-09-18T12:48:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:48:54.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:48:54.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:standby 2024-09-18T12:48:54.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:54 smithi136 ceph-mon[35363]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:replay} 1 up:standby 2024-09-18T12:48:55.753 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: pgmap v210: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:resolve 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] up:boot 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:resolve} 2 up:standby 2024-09-18T12:48:55.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:55 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: pgmap v210: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:resolve 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] up:boot 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:resolve} 2 up:standby 2024-09-18T12:48:55.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:55 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:48:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2433789901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 msgr2=0x7f7ff8100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2433789901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8100ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009910 tx=0x7f7fe8009c20 comp rx=0 tx=0).stop 2024-09-18T12:48:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2433789901 shutdown_connections 2024-09-18T12:48:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2433789901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff8102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2433789901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8100ef0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2433789901 >> 172.21.15.81:0/2433789901 conn(0x7f7ff80fc070 msgr2=0x7f7ff80fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2433789901 shutdown_connections 2024-09-18T12:48:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.860+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2433789901 wait complete. 2024-09-18T12:48:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 Processor -- start 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 -- start start 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8196dc0 con 0x7f7ff8100ad0 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.861+0000 7f7ff7fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8196f00 con 0x7f7ff8101cd0 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55446/0 (socket says 172.21.15.81:55446) 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 -- 172.21.15.81:0/2219010016 learned_addr learned my addr 172.21.15.81:0/2219010016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff67fc700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 -- 172.21.15.81:0/2219010016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 msgr2=0x7f7ff81967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff81967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 -- 172.21.15.81:0/2219010016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80095f0 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff67fc700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff6ffd700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800bda0 tx=0x7f7fe800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe801d070 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fe8004c50 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff819b950 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe800f690 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.862+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff819be40 con 0x7f7ff8100ad0 2024-09-18T12:48:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.863+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff8109630 con 0x7f7ff8100ad0 2024-09-18T12:48:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.864+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f7fe80229b0 con 0x7f7ff8100ad0 2024-09-18T12:48:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.864+0000 7f7ffc800700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 0x7f7fe006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.864+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7fe808cf30 con 0x7f7ff8100ad0 2024-09-18T12:48:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.864+0000 7f7ff67fc700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 0x7f7fe006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.864+0000 7f7ff67fc700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 0x7f7fe006e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005950 tx=0x7f7fec005f50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:55.868+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7fe80c00e0 con 0x7f7ff8100ad0 2024-09-18T12:48:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.113+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f7ff819c4b0 con 0x7f7ff8100ad0 2024-09-18T12:48:56.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.804+0000 7f7ffc800700 1 -- 172.21.15.81:0/2219010016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v17) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7fe805b2a0 con 0x7f7ff8100ad0 2024-09-18T12:48:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 msgr2=0x7f7fe006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 0x7f7fe006e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005950 tx=0x7f7fec005f50 comp rx=0 tx=0).stop 2024-09-18T12:48:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 msgr2=0x7f7ff8196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800bda0 tx=0x7f7fe800be80 comp rx=0 tx=0).stop 2024-09-18T12:48:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 shutdown_connections 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7fe006c4e0 0x7f7fe006e9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ff8100ad0 0x7f7ff8196260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 --2- 172.21.15.81:0/2219010016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ff8101cd0 0x7f7ff81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 >> 172.21.15.81:0/2219010016 conn(0x7f7ff80fc070 msgr2=0x7f7ff8104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 shutdown_connections 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:48:56.807+0000 7f7ff7fff700 1 -- 172.21.15.81:0/2219010016 wait complete. 2024-09-18T12:48:56.809 INFO:teuthology.orchestra.run.smithi081.stderr:inline data disabled 2024-09-18T12:48:57.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:56 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:reconnect 2024-09-18T12:48:57.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:56 smithi136 ceph-mon[35363]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:reconnect} 2 up:standby 2024-09-18T12:48:57.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:56 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2219010016' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-18T12:48:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:56 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:reconnect 2024-09-18T12:48:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:56 smithi081 ceph-mon[27646]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:reconnect} 2 up:standby 2024-09-18T12:48:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:56 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2219010016' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-18T12:48:57.660 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:48:57.671 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:48:57.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:48:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:48:58.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: pgmap v211: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-18T12:48:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:rejoin 2024-09-18T12:48:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2219010016' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-18T12:48:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:standby 2024-09-18T12:48:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:rejoin} 2 up:standby 2024-09-18T12:48:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:57 smithi136 ceph-mon[35363]: daemon mds.cephfs.smithi081.hmnvyn is now active in filesystem cephfs as rank 1 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: pgmap v211: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:rejoin 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2219010016' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:standby 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: fsmap cephfs:2/2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:rejoin} 2 up:standby 2024-09-18T12:48:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:57 smithi081 ceph-mon[27646]: daemon mds.cephfs.smithi081.hmnvyn is now active in filesystem cephfs as rank 1 2024-09-18T12:48:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:58 smithi136 ceph-mon[35363]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:48:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:58 smithi136 ceph-mon[35363]: Cluster is now healthy 2024-09-18T12:48:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:58 smithi136 ceph-mon[35363]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:active 2024-09-18T12:48:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:58 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:48:59.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:58 smithi081 ceph-mon[27646]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:48:59.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:58 smithi081 ceph-mon[27646]: Cluster is now healthy 2024-09-18T12:48:59.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:58 smithi081 ceph-mon[27646]: mds.? [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] up:active 2024-09-18T12:48:59.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:58 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:49:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:48:59 smithi081 ceph-mon[27646]: pgmap v212: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-18T12:49:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:48:59 smithi136 ceph-mon[35363]: pgmap v212: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-18T12:49:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 -- 172.21.15.81:0/683496019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494100cb0 msgr2=0x7fa4941010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/683496019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494100cb0 0x7fa4941010d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa488009910 tx=0x7fa488009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 -- 172.21.15.81:0/683496019 shutdown_connections 2024-09-18T12:49:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/683496019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494101eb0 0x7fa494102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/683496019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494100cb0 0x7fa4941010d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.351+0000 7fa49ac5c700 1 -- 172.21.15.81:0/683496019 >> 172.21.15.81:0/683496019 conn(0x7fa4940fc230 msgr2=0x7fa4940fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 -- 172.21.15.81:0/683496019 shutdown_connections 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 -- 172.21.15.81:0/683496019 wait complete. 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 Processor -- start 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 -- start start 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494100cb0 0x7fa494196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4941970c0 con 0x7fa494101eb0 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa49ac5c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa494197200 con 0x7fa494100cb0 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa493fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa493fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55476/0 (socket says 172.21.15.81:55476) 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.352+0000 7fa493fff700 1 -- 172.21.15.81:0/2409231032 learned_addr learned my addr 172.21.15.81:0/2409231032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa4989f8700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494100cb0 0x7fa494196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa493fff700 1 -- 172.21.15.81:0/2409231032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494100cb0 msgr2=0x7fa494196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa493fff700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494100cb0 0x7fa494196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa493fff700 1 -- 172.21.15.81:0/2409231032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880095f0 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa493fff700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b4b0 tx=0x7fa48000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa480011800 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa480011e10 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48000f2e0 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49419bcb0 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.353+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49419c200 con 0x7fa494101eb0 2024-09-18T12:49:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.354+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa494109890 con 0x7fa494101eb0 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.355+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa480010380 con 0x7fa494101eb0 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.355+0000 7fa491ffb700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 0x7fa48406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.355+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa48008b340 con 0x7fa494101eb0 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.355+0000 7fa4989f8700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 0x7fa48406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.355+0000 7fa4989f8700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 0x7fa48406e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa488006010 tx=0x7fa488005920 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.360+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa480059680 con 0x7fa494101eb0 2024-09-18T12:49:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.618+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa494109a80 con 0x7fa494101eb0 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.619+0000 7fa491ffb700 1 -- 172.21.15.81:0/2409231032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7fa480015740 con 0x7fa494101eb0 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:49:01.621 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 18 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:48:57.803376+0000 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:49:01.622 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:01.624 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 msgr2=0x7fa48406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 0x7fa48406e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa488006010 tx=0x7fa488005920 comp rx=0 tx=0).stop 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 msgr2=0x7fa494196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b4b0 tx=0x7fa48000b870 comp rx=0 tx=0).stop 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 shutdown_connections 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa494100cb0 0x7fa494196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa48406c4e0 0x7fa48406e9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 --2- 172.21.15.81:0/2409231032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa494101eb0 0x7fa494196aa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 >> 172.21.15.81:0/2409231032 conn(0x7fa4940fc230 msgr2=0x7fa4941050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 shutdown_connections 2024-09-18T12:49:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:01.621+0000 7fa49ac5c700 1 -- 172.21.15.81:0/2409231032 wait complete. 2024-09-18T12:49:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-18T12:49:01.980 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: pgmap v213: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:01.980 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2409231032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:01.981 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:01 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:02.091 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: pgmap v213: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:02.091 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:02.091 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:02.091 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:02.091 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:02.092 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:02.092 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2409231032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:02.092 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:01 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:02.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-18T12:49:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:03 smithi081 ceph-mon[27646]: pgmap v214: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:03 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:03 smithi136 ceph-mon[35363]: pgmap v214: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:03 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 -- 172.21.15.81:0/1063549407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 msgr2=0x7f8fa80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1063549407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa80fffd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800b0a0 tx=0x7f8f9800b3b0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 -- 172.21.15.81:0/1063549407 shutdown_connections 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1063549407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fa8100db0 0x7f8fa8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1063549407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa80fffd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 -- 172.21.15.81:0/1063549407 >> 172.21.15.81:0/1063549407 conn(0x7f8fa80fb150 msgr2=0x7f8fa80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 -- 172.21.15.81:0/1063549407 shutdown_connections 2024-09-18T12:49:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.897+0000 7f8faccd9700 1 -- 172.21.15.81:0/1063549407 wait complete. 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 Processor -- start 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 -- start start 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fa8100db0 0x7f8fa819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa819b900 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8faccd9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa819ba40 con 0x7f8fa8100db0 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55482/0 (socket says 172.21.15.81:55482) 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 -- 172.21.15.81:0/1649475792 learned_addr learned my addr 172.21.15.81:0/1649475792 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 -- 172.21.15.81:0/1649475792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fa8100db0 msgr2=0x7f8fa819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fa8100db0 0x7f8fa819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 -- 172.21.15.81:0/1649475792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009d00 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.898+0000 7f8fa659c700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f980077b0 tx=0x7f8f98003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.899+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9800e040 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.899+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f9800ce60 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.899+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa819bcc0 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.899+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9801daf0 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.899+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa819c1b0 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.900+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa8108790 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.900+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8f98004250 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.901+0000 7f8f9f7fe700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 0x7f8f9406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.901+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8f9808d240 con 0x7f8fa80ffbb0 2024-09-18T12:49:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.901+0000 7f8fa5d9b700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 0x7f8f9406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:04.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.901+0000 7f8fa5d9b700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 0x7f8f9406e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8069ef0 tx=0x7f8f90006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:04.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:04.905+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8f9805b500 con 0x7f8fa80ffbb0 2024-09-18T12:49:05.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.139+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fa819c7c0 con 0x7f8fa80ffbb0 2024-09-18T12:49:05.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.140+0000 7f8f9f7fe700 1 -- 172.21.15.81:0/1649475792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4760 (secure 0 0 0) 0x7f8f9805b090 con 0x7f8fa80ffbb0 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 msgr2=0x7f8f9406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 0x7f8f9406e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8069ef0 tx=0x7f8f90006d20 comp rx=0 tx=0).stop 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 msgr2=0x7f8fa8069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f980077b0 tx=0x7f8f98003ce0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 shutdown_connections 2024-09-18T12:49:05.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8f9406c4e0 0x7f8f9406e9a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80ffbb0 0x7f8fa8069970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 --2- 172.21.15.81:0/1649475792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fa8100db0 0x7f8fa819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 >> 172.21.15.81:0/1649475792 conn(0x7f8fa80fb150 msgr2=0x7f8fa8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 shutdown_connections 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:05.142+0000 7f8faccd9700 1 -- 172.21.15.81:0/1649475792 wait complete. 2024-09-18T12:49:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-18T12:49:05.153 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:49:05.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:05.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:05 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:05.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:05 smithi136 ceph-mon[35363]: pgmap v215: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:05.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:05 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1649475792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:05.816 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:05.817 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:05 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:05.817 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:05 smithi081 ceph-mon[27646]: pgmap v215: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:49:05.817 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:05 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1649475792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:05.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-18T12:49:06.995 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:07.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:07 smithi136 ceph-mon[35363]: pgmap v216: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T12:49:07.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:07 smithi081 ceph-mon[27646]: pgmap v216: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 -- 172.21.15.81:0/1777092662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48041017f0 msgr2=0x7f4804103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 --2- 172.21.15.81:0/1777092662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48041017f0 0x7f4804103be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009910 tx=0x7f47f4009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 -- 172.21.15.81:0/1777092662 shutdown_connections 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 --2- 172.21.15.81:0/1777092662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4804104120 0x7f4804106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 --2- 172.21.15.81:0/1777092662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48041017f0 0x7f4804103be0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 -- 172.21.15.81:0/1777092662 >> 172.21.15.81:0/1777092662 conn(0x7f48040fb160 msgr2=0x7f48040fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 -- 172.21.15.81:0/1777092662 shutdown_connections 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.239+0000 7f4809f10700 1 -- 172.21.15.81:0/1777092662 wait complete. 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 Processor -- start 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 -- start start 2024-09-18T12:49:09.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48041017f0 0x7f4804101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040ffce0 con 0x7f4804104120 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4809f10700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040ffe20 con 0x7f48041017f0 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59014/0 (socket says 172.21.15.81:59014) 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4802ffd700 1 -- 172.21.15.81:0/4095911342 learned_addr learned my addr 172.21.15.81:0/4095911342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f48037fe700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48041017f0 0x7f4804101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4802ffd700 1 -- 172.21.15.81:0/4095911342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48041017f0 msgr2=0x7f4804101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.240+0000 7f4802ffd700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48041017f0 0x7f4804101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4802ffd700 1 -- 172.21.15.81:0/4095911342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40095f0 con 0x7f4804104120 2024-09-18T12:49:09.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4802ffd700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47f800b4b0 tx=0x7f47f800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f8011800 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47f8011e10 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4804100100 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f800f2e0 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.241+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480419e8c0 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.242+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48041906c0 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.242+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f47f8011960 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.243+0000 7f4800ff9700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 0x7f47ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.243+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f47f808b3d0 con 0x7f4804104120 2024-09-18T12:49:09.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.243+0000 7f48037fe700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 0x7f47ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.243+0000 7f48037fe700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 0x7f47ec06e9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47f4006010 tx=0x7f47f400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.248+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f47f8059690 con 0x7f4804104120 2024-09-18T12:49:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.529+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f4804068af0 con 0x7f4804104120 2024-09-18T12:49:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.529+0000 7f4800ff9700 1 -- 172.21.15.81:0/4095911342 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+83 (secure 0 0 0) 0x7f47f8089e60 con 0x7f4804104120 2024-09-18T12:49:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 msgr2=0x7f47ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 0x7f47ec06e9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47f4006010 tx=0x7f47f400b540 comp rx=0 tx=0).stop 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 msgr2=0x7f48040ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47f800b4b0 tx=0x7f47f800b7c0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 shutdown_connections 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48041017f0 0x7f4804101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f47ec06c4e0 0x7f47ec06e9a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 --2- 172.21.15.81:0/4095911342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4804104120 0x7f48040ff7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 >> 172.21.15.81:0/4095911342 conn(0x7f48040fb160 msgr2=0x7f48040fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 shutdown_connections 2024-09-18T12:49:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:09.531+0000 7f4809f10700 1 -- 172.21.15.81:0/4095911342 wait complete. 2024-09-18T12:49:09.542 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:49:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:09 smithi136 ceph-mon[35363]: pgmap v217: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:49:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:09 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/4095911342' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:49:10.101 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:09 smithi081 ceph-mon[27646]: pgmap v217: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:49:10.101 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:09 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4095911342' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:49:10.668 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-18T12:49:10.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T12:49:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: pgmap v218: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:11 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: pgmap v218: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:11 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 -- 172.21.15.81:0/4196775930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80fff50 msgr2=0x7f9ab8105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 --2- 172.21.15.81:0/4196775930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80fff50 0x7f9ab8105840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009910 tx=0x7f9aa4009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 -- 172.21.15.81:0/4196775930 shutdown_connections 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 --2- 172.21.15.81:0/4196775930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80fff50 0x7f9ab8105840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 --2- 172.21.15.81:0/4196775930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab80ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 -- 172.21.15.81:0/4196775930 >> 172.21.15.81:0/4196775930 conn(0x7f9ab8074e30 msgr2=0x7f9ab8075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 -- 172.21.15.81:0/4196775930 shutdown_connections 2024-09-18T12:49:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.705+0000 7f9abf045700 1 -- 172.21.15.81:0/4196775930 wait complete. 2024-09-18T12:49:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.706+0000 7f9abf045700 1 Processor -- start 2024-09-18T12:49:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.706+0000 7f9abf045700 1 -- start start 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80fff50 0x7f9ab8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8100fa0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81010e0 con 0x7f9ab80fff50 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59036/0 (socket says 172.21.15.81:59036) 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 -- 172.21.15.81:0/585143594 learned_addr learned my addr 172.21.15.81:0/585143594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9ab7fff700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80fff50 0x7f9ab8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 -- 172.21.15.81:0/585143594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80fff50 msgr2=0x7f9ab8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80fff50 0x7f9ab8100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 -- 172.21.15.81:0/585143594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40095f0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abcde1700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d8d0 tx=0x7f9aac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac009940 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9aac010460 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab81a2a40 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac00f5f0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.707+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81a2e50 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.708+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8109200 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.709+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f9aac0105d0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.709+0000 7f9ab5ffb700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 0x7f9aa806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.709+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9aac08b7d0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.709+0000 7f9ab7fff700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 0x7f9aa806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.710+0000 7f9ab7fff700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 0x7f9aa806e9a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40059d0 tx=0x7f9aa4005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.714+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9aac056000 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.951+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ab804f2e0 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.951+0000 7f9ab5ffb700 1 -- 172.21.15.81:0/585143594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4760 (secure 0 0 0) 0x7f9aac059620 con 0x7f9ab80ff5a0 2024-09-18T12:49:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:12.953 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:48:57.803376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 msgr2=0x7f9aa806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 0x7f9aa806e9a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40059d0 tx=0x7f9aa4005960 comp rx=0 tx=0).stop 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 msgr2=0x7f9ab8100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d8d0 tx=0x7f9aac00dc90 comp rx=0 tx=0).stop 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 shutdown_connections 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9aa806c4e0 0x7f9aa806e9a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab80ff5a0 0x7f9ab8100520 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.953+0000 7f9abf045700 1 --2- 172.21.15.81:0/585143594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ab80fff50 0x7f9ab8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.954+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 >> 172.21.15.81:0/585143594 conn(0x7f9ab8074e30 msgr2=0x7f9ab80fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.954+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 shutdown_connections 2024-09-18T12:49:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:12.954+0000 7f9abf045700 1 -- 172.21.15.81:0/585143594 wait complete. 2024-09-18T12:49:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-18T12:49:13.727 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-18T12:49:13.727 INFO:teuthology.run_tasks:Running task kclient... 2024-09-18T12:49:13.766 INFO:tasks.kclient:Mounting kernel clients... 2024-09-18T12:49:13.766 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-18T12:49:13.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:13.766 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-18T12:49:13.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:13.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-18T12:49:13.857 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-18T12:49:13.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:49:13.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:13.859 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-09-18T12:49:13.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:13.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-09-18T12:49:13.953 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-09-18T12:49:13.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:49:13.955 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-18T12:49:13.955 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:49:13.955 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:13.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:49:13.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:13 smithi081 ceph-mon[27646]: pgmap v219: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-18T12:49:13.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:13 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/585143594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:14.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:13 smithi136 ceph-mon[35363]: pgmap v219: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-18T12:49:14.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:13 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/585143594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- 172.21.15.81:0/494550871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c4100750 msgr2=0x7f83c41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 --2- 172.21.15.81:0/494550871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c4100750 0x7f83c41047a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009910 tx=0x7f83c0009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- 172.21.15.81:0/494550871 shutdown_connections 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 --2- 172.21.15.81:0/494550871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c4100750 0x7f83c41047a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 --2- 172.21.15.81:0/494550871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c40ffda0 0x7f83c4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- 172.21.15.81:0/494550871 >> 172.21.15.81:0/494550871 conn(0x7f83c40fb650 msgr2=0x7f83c40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- 172.21.15.81:0/494550871 shutdown_connections 2024-09-18T12:49:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- 172.21.15.81:0/494550871 wait complete. 2024-09-18T12:49:16.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:15 smithi081 ceph-mon[27646]: pgmap v220: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:16.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 Processor -- start 2024-09-18T12:49:16.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.003+0000 7f83cc33a700 1 -- start start 2024-09-18T12:49:16.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83cc33a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83cc33a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c4100750 0x7f83c4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83cc33a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4198320 con 0x7f83c40ffda0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83cc33a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4198460 con 0x7f83c4100750 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41972/0 (socket says 172.21.15.81:41972) 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 -- 172.21.15.81:0/3629585345 learned_addr learned my addr 172.21.15.81:0/3629585345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83c98d5700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c4100750 0x7f83c4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 -- 172.21.15.81:0/3629585345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c4100750 msgr2=0x7f83c4197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c4100750 0x7f83c4197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 -- 172.21.15.81:0/3629585345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00095f0 con 0x7f83c40ffda0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83ca0d6700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c8a0 tx=0x7f83b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.004+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b400cea0 con 0x7f83c40ffda0 2024-09-18T12:49:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.005+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c41a0830 con 0x7f83c40ffda0 2024-09-18T12:49:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.005+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83b4004830 con 0x7f83c40ffda0 2024-09-18T12:49:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.005+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b40055b0 con 0x7f83c40ffda0 2024-09-18T12:49:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.005+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c41a0cf0 con 0x7f83c40ffda0 2024-09-18T12:49:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.006+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c41081a0 con 0x7f83c40ffda0 2024-09-18T12:49:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.006+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f83b4007ad0 con 0x7f83c40ffda0 2024-09-18T12:49:16.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.007+0000 7f83bb7fe700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 0x7f83b006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.007+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f83b408b530 con 0x7f83c40ffda0 2024-09-18T12:49:16.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.007+0000 7f83c98d5700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 0x7f83b006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.007+0000 7f83c98d5700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 0x7f83b006e9a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83c0006010 tx=0x7f83c001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.011+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f83b4055d60 con 0x7f83c40ffda0 2024-09-18T12:49:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.246+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83c4107b80 con 0x7f83c40ffda0 2024-09-18T12:49:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.246+0000 7f83bb7fe700 1 -- 172.21.15.81:0/3629585345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f83b4059380 con 0x7f83c40ffda0 2024-09-18T12:49:16.247 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:49:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 msgr2=0x7f83b006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 0x7f83b006e9a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83c0006010 tx=0x7f83c001a040 comp rx=0 tx=0).stop 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 msgr2=0x7f83c41977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c8a0 tx=0x7f83b400cc60 comp rx=0 tx=0).stop 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 shutdown_connections 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f83b006c4e0 0x7f83b006e9a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c40ffda0 0x7f83c41977c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 --2- 172.21.15.81:0/3629585345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83c4100750 0x7f83c4197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 >> 172.21.15.81:0/3629585345 conn(0x7f83c40fb650 msgr2=0x7f83c40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 shutdown_connections 2024-09-18T12:49:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:16.248+0000 7f83cc33a700 1 -- 172.21.15.81:0/3629585345 wait complete. 2024-09-18T12:49:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:15 smithi136 ceph-mon[35363]: pgmap v220: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:16.865 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:16 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3629585345' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:49:16.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:49:16.888 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:49:16.888 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:49:16.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:16.888 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-18T12:49:16.944 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-18T12:49:16.945 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42303sec preferred_lft 42303sec 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-18T12:49:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:16.946 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:49:16.947 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-18T12:49:17.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:17.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:17.153 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:49:17.178 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-18T12:49:17.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:17.179 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-18T12:49:17.250 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-18T12:49:17.250 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:49:17.250 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T12:49:17.250 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T12:49:17.250 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:49:17.251 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:17.251 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-18T12:49:17.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T12:49:17.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T12:49:17.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T12:49:17.252 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-18T12:49:17.295 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:16 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3629585345' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:17.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:17.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:17.559 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-18T12:49:17.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:17.575 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-18T12:49:17.631 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:17.631 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-18T12:49:17.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:17.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-18T12:49:17.631 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-18T12:49:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:17.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-18T12:49:17.748 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-18T12:49:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:17.903 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:17.903 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-18T12:49:17.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-18T12:49:17.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:49:17.904 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-18T12:49:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:17.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:17.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:17.980 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:17.999 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:49:17.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:17.999 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:18.054 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-18T12:49:18.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:18.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-18T12:49:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:17 smithi081 ceph-mon[27646]: pgmap v221: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:18.156 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-18T12:49:18.157 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-18T12:49:18.157 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-18T12:49:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-18T12:49:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-18T12:49:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-18T12:49:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300" 2024-09-18T12:49:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-18T12:49:18.293 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300" 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.136:6789" 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.136:6789:/ 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2a553466-75bb-11ef-bceb-c7b262605968" will pass to kernel 2024-09-18T12:49:18.294 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-18T12:49:18.295 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-18T12:49:18.295 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-18T12:49:18.295 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-18T12:49:18.295 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-18T12:49:18.297 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-18T12:49:18.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:18.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:17 smithi136 ceph-mon[35363]: pgmap v221: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:18.368 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:18.468 INFO:teuthology.orchestra.run.smithi081.stdout:client24323 2024-09-18T12:49:18.468 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:49:18.468 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T12:49:18.486 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:18.585 INFO:teuthology.orchestra.run.smithi081.stdout:client24323 2024-09-18T12:49:18.586 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:18.646 INFO:teuthology.orchestra.run.smithi081.stdout:client24323 2024-09-18T12:49:18.646 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a553466-75bb-11ef-bceb-c7b262605968.client24323/status') 2024-09-18T12:49:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:18.710 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.24323 (3)172.21.15.81:0/2933002301 2024-09-18T12:49:18.711 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-18T12:49:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-18T12:49:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-18T12:49:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:71 bytes copied, 2.2487e-05 s, 3.2 MB/s 2024-09-18T12:49:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:18.715 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-18T12:49:18.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:49:18.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:18.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:49:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:20.100 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:19 smithi081 ceph-mon[27646]: pgmap v222: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:20.100 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:19 smithi136 ceph-mon[35363]: pgmap v222: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:20.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/1462303794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 msgr2=0x7f4bf4105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/1462303794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf4105730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00b0a0 tx=0x7f4bec00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/1462303794 shutdown_connections 2024-09-18T12:49:20.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/1462303794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 0x7f4bf40ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/1462303794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf4105730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/1462303794 >> 172.21.15.81:0/1462303794 conn(0x7f4bf4074e30 msgr2=0x7f4bf4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/1462303794 shutdown_connections 2024-09-18T12:49:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.653+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/1462303794 wait complete. 2024-09-18T12:49:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 Processor -- start 2024-09-18T12:49:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 -- start start 2024-09-18T12:49:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 0x7f4bf419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf419d210 con 0x7f4bf4105350 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf9c7b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41966c0 con 0x7f4bf40ff340 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41990/0 (socket says 172.21.15.81:41990) 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.654+0000 7f4bf2ffd700 1 -- 172.21.15.81:0/4034601155 learned_addr learned my addr 172.21.15.81:0/4034601155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf37fe700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 0x7f4bf419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf2ffd700 1 -- 172.21.15.81:0/4034601155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 msgr2=0x7f4bf419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf2ffd700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 0x7f4bf419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf2ffd700 1 -- 172.21.15.81:0/4034601155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009d00 con 0x7f4bf4105350 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf2ffd700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00d8d0 tx=0x7f4bdc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc0098a0 con 0x7f4bf4105350 2024-09-18T12:49:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf41969a0 con 0x7f4bf4105350 2024-09-18T12:49:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bdc010460 con 0x7f4bf4105350 2024-09-18T12:49:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc00f5f0 con 0x7f4bf4105350 2024-09-18T12:49:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.655+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf4196ef0 con 0x7f4bf4105350 2024-09-18T12:49:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.656+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf4109880 con 0x7f4bf4105350 2024-09-18T12:49:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.657+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4bdc009a00 con 0x7f4bf4105350 2024-09-18T12:49:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.657+0000 7f4bf0ff9700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 0x7f4be006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.657+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4bdc08b6c0 con 0x7f4bf4105350 2024-09-18T12:49:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.657+0000 7f4bf37fe700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 0x7f4be006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.658+0000 7f4bf37fe700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 0x7f4be006e9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000f80 tx=0x7f4bec0060c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:20.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.662+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4bdc059980 con 0x7f4bf4105350 2024-09-18T12:49:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.897+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4bf404f2e0 con 0x7f4bf4105350 2024-09-18T12:49:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.897+0000 7f4bf0ff9700 1 -- 172.21.15.81:0/4034601155 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f4bdc059510 con 0x7f4bf4105350 2024-09-18T12:49:20.899 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 msgr2=0x7f4be006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 0x7f4be006e9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000f80 tx=0x7f4bec0060c0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 msgr2=0x7f4bf419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00d8d0 tx=0x7f4bdc00dbe0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 shutdown_connections 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bf40ff340 0x7f4bf419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4be006c4e0 0x7f4be006e9a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 --2- 172.21.15.81:0/4034601155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf4105350 0x7f4bf419cb80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.899+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 >> 172.21.15.81:0/4034601155 conn(0x7f4bf4074e30 msgr2=0x7f4bf4103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.900+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 shutdown_connections 2024-09-18T12:49:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:20.900+0000 7f4bf9c7b700 1 -- 172.21.15.81:0/4034601155 wait complete. 2024-09-18T12:49:21.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:49:21.580 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:49:21.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:21.581 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-09-18T12:49:21.600 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:21.601 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:49:21.602 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:21.602 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T12:49:21.602 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42297sec preferred_lft 42297sec 2024-09-18T12:49:21.602 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link noprefixroute 2024-09-18T12:49:21.602 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:21.602 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:49:21.602 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:21.602 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-09-18T12:49:21.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:49:21.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-09-18T12:49:21.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-09-18T12:49:21.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:49:21.603 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-09-18T12:49:21.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:21.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:21.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:21.820 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:49:21.846 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-09-18T12:49:21.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:21.848 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-09-18T12:49:21.911 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-09-18T12:49:21.911 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:49:21.911 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T12:49:21.911 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T12:49:21.911 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T12:49:21.912 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-09-18T12:49:21.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:22.007 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:21 smithi136 ceph-mon[35363]: pgmap v223: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:22.007 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:21 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/4034601155' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:21 smithi081 ceph-mon[27646]: pgmap v223: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:21 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4034601155' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:22.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:22.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:22.210 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-09-18T12:49:22.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:22.226 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-09-18T12:49:22.281 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:22.282 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-09-18T12:49:22.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:22.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-18T12:49:22.282 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-09-18T12:49:22.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:22.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:22.400 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-18T12:49:22.400 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-18T12:49:22.401 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-09-18T12:49:22.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:22.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:22.536 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:22.536 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-09-18T12:49:22.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-09-18T12:49:22.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:49:22.537 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-09-18T12:49:22.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:22.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:22.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:22.614 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:22.629 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:49:22.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:22.629 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:22.685 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-18T12:49:22.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:22.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-18T12:49:22.783 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-18T12:49:22.783 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-18T12:49:22.783 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2024-09-18T12:49:22.912 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-18T12:49:22.912 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-18T12:49:22.912 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2024-09-18T12:49:22.912 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300" 2024-09-18T12:49:22.912 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-18T12:49:22.917 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-18T12:49:22.917 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-18T12:49:22.917 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2024-09-18T12:49:22.918 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300" 2024-09-18T12:49:22.918 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-18T12:49:22.918 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.136:6789" 2024-09-18T12:49:22.918 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.136:6789:/ 2024-09-18T12:49:22.918 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2a553466-75bb-11ef-bceb-c7b262605968" will pass to kernel 2024-09-18T12:49:22.919 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-18T12:49:22.919 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-09-18T12:49:22.919 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-18T12:49:22.919 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-09-18T12:49:22.919 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-18T12:49:22.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-18T12:49:22.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:22.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:22.946 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:23.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:23.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:23.042 INFO:teuthology.orchestra.run.smithi136.stdout:client14598 2024-09-18T12:49:23.042 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:49:23.042 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T12:49:23.060 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:23.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:23.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:23.156 INFO:teuthology.orchestra.run.smithi136.stdout:client14598 2024-09-18T12:49:23.156 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-18T12:49:23.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-18T12:49:23.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:23.212 INFO:teuthology.orchestra.run.smithi136.stdout:client14598 2024-09-18T12:49:23.213 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a553466-75bb-11ef-bceb-c7b262605968.client14598/status') 2024-09-18T12:49:23.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:23.271 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.14598 (3)172.21.15.136:0/975665321 2024-09-18T12:49:23.271 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-09-18T12:49:23.271 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-09-18T12:49:23.271 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-09-18T12:49:23.272 INFO:teuthology.orchestra.run.smithi136.stderr:71 bytes copied, 2.3016e-05 s, 3.1 MB/s 2024-09-18T12:49:23.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-18T12:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:23.281 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:49:23.292 INFO:teuthology.task.print:**** done client 2024-09-18T12:49:23.292 INFO:teuthology.run_tasks:Running task parallel... 2024-09-18T12:49:23.302 INFO:teuthology.task.parallel:starting parallel... 2024-09-18T12:49:23.303 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:49:23.304 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:49:23.304 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:49:23.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-18T12:49:23.305 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:49:23.305 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-18T12:49:23.309 INFO:tasks.workunit:Pulling workunits from ref e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:23.310 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:49:23.310 INFO:tasks.workunit:timeout=3h 2024-09-18T12:49:23.310 INFO:tasks.workunit:cleanup=True 2024-09-18T12:49:23.310 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 12:48:44.825749403 +0000 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 12:49:18.364388324 +0000 2024-09-18T12:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 12:48:44.825749403 +0000 2024-09-18T12:49:23.332 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:23.332 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-18T12:49:23.406 DEBUG:teuthology.orchestra.run.smithi136:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:23.423 INFO:teuthology.orchestra.run.smithi136.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-18 12:49:23.398293910 +0000 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-18 12:49:23.398293910 +0000 2024-09-18T12:49:23.424 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-18 12:48:44.825749403 +0000 2024-09-18T12:49:23.424 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:23.424 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-18T12:49:23.495 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:23.496 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:23.512 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:49:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:23.551 INFO:tasks.workunit.client.1.smithi136.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-18T12:49:23.950 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:23 smithi081 ceph-mon[27646]: pgmap v224: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:23 smithi136 ceph-mon[35363]: pgmap v224: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.333+0000 7f86511e1700 1 -- 172.21.15.81:0/1419854432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 msgr2=0x7f864c102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 --2- 172.21.15.81:0/1419854432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c102310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8640009910 tx=0x7f8640009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 -- 172.21.15.81:0/1419854432 shutdown_connections 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 --2- 172.21.15.81:0/1419854432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c102310 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 --2- 172.21.15.81:0/1419854432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 0x7f864c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 -- 172.21.15.81:0/1419854432 >> 172.21.15.81:0/1419854432 conn(0x7f864c0fc230 msgr2=0x7f864c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 -- 172.21.15.81:0/1419854432 shutdown_connections 2024-09-18T12:49:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 -- 172.21.15.81:0/1419854432 wait complete. 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.334+0000 7f86511e1700 1 Processor -- start 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 -- start start 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 0x7f864c196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1970b0 con 0x7f864c101eb0 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1971f0 con 0x7f864c100cb0 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43772/0 (socket says 172.21.15.81:43772) 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 -- 172.21.15.81:0/2207127792 learned_addr learned my addr 172.21.15.81:0/2207127792 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864ad9d700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 0x7f864c196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 -- 172.21.15.81:0/2207127792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 msgr2=0x7f864c196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 0x7f864c196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 -- 172.21.15.81:0/2207127792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400095f0 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f864a59c700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8640006010 tx=0x7f864000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f864001d070 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c19bc40 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f864000f460 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.335+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8640021640 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.336+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c19c130 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.336+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c1098b0 con 0x7f864c101eb0 2024-09-18T12:49:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.337+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f864000fab0 con 0x7f864c101eb0 2024-09-18T12:49:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.337+0000 7f8633fff700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 0x7f863406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.338+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f864008cc70 con 0x7f864c101eb0 2024-09-18T12:49:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.338+0000 7f864ad9d700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 0x7f863406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.338+0000 7f864ad9d700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 0x7f863406e9a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f863c006fd0 tx=0x7f863c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.342+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f864005af30 con 0x7f864c101eb0 2024-09-18T12:49:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.530+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f864c19c740 con 0x7f864c101eb0 2024-09-18T12:49:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.535+0000 7f8633fff700 1 -- 172.21.15.81:0/2207127792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v40)=0 v40) v1 ==== 126+0+0 (secure 0 0 0) 0x7f864005aac0 con 0x7f864c101eb0 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 msgr2=0x7f863406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 0x7f863406e9a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f863c006fd0 tx=0x7f863c008040 comp rx=0 tx=0).stop 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 msgr2=0x7f864c196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8640006010 tx=0x7f864000be20 comp rx=0 tx=0).stop 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 shutdown_connections 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f864c100cb0 0x7f864c196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f863406c4e0 0x7f863406e9a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 --2- 172.21.15.81:0/2207127792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f864c101eb0 0x7f864c196a90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.537+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 >> 172.21.15.81:0/2207127792 conn(0x7f864c0fc230 msgr2=0x7f864c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.538+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 shutdown_connections 2024-09-18T12:49:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:25.538+0000 7f86511e1700 1 -- 172.21.15.81:0/2207127792 wait complete. 2024-09-18T12:49:26.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:25 smithi081 ceph-mon[27646]: pgmap v225: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-18T12:49:26.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:25 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2207127792' entity='client.admin' 2024-09-18T12:49:26.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:25 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:26.253 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:49:26.253 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:49:26.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T12:49:26.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:25 smithi136 ceph-mon[35363]: pgmap v225: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-18T12:49:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:25 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2207127792' entity='client.admin' 2024-09-18T12:49:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:25 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:26.969 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:26.970 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:26.970 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:26 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:26 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:28.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:27 smithi081 ceph-mon[27646]: pgmap v226: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 -- 172.21.15.81:0/1372918710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 msgr2=0x7f0f981010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 --2- 172.21.15.81:0/1372918710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f981010d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009910 tx=0x7f0f88009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 -- 172.21.15.81:0/1372918710 shutdown_connections 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 --2- 172.21.15.81:0/1372918710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 0x7f0f98102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 --2- 172.21.15.81:0/1372918710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f981010d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 -- 172.21.15.81:0/1372918710 >> 172.21.15.81:0/1372918710 conn(0x7f0f980fc230 msgr2=0x7f0f980fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 -- 172.21.15.81:0/1372918710 shutdown_connections 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.259+0000 7f0f9d549700 1 -- 172.21.15.81:0/1372918710 wait complete. 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 Processor -- start 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 -- start start 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 0x7f0f98196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f981970c0 con 0x7f0f98100cb0 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f9d549700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98197200 con 0x7f0f98101eb0 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43788/0 (socket says 172.21.15.81:43788) 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 -- 172.21.15.81:0/3693408590 learned_addr learned my addr 172.21.15.81:0/3693408590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f8ffff700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 0x7f0f98196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 -- 172.21.15.81:0/3693408590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 msgr2=0x7f0f98196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 0x7f0f98196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 -- 172.21.15.81:0/3693408590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880095f0 con 0x7f0f98100cb0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f96ffd700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800bda0 tx=0x7f0f8800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.260+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f8801d070 con 0x7f0f98100cb0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.261+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9819bc50 con 0x7f0f98100cb0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.261+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f88004c50 con 0x7f0f98100cb0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.261+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f8800f690 con 0x7f0f98100cb0 2024-09-18T12:49:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.261+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9819c140 con 0x7f0f98100cb0 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.262+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f98109890 con 0x7f0f98100cb0 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.262+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0f880229b0 con 0x7f0f98100cb0 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.263+0000 7f0f94ff9700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 0x7f0f8406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.263+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0f8808cfa0 con 0x7f0f98100cb0 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.263+0000 7f0f8ffff700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 0x7f0f8406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.263+0000 7f0f8ffff700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 0x7f0f8406e9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f80006fd0 tx=0x7f0f80008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.267+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0f8805b390 con 0x7f0f98100cb0 2024-09-18T12:49:28.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:27 smithi136 ceph-mon[35363]: pgmap v226: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:49:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.455+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0f98109a80 con 0x7f0f98100cb0 2024-09-18T12:49:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.455+0000 7f0f94ff9700 1 -- 172.21.15.81:0/3693408590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v40)=0 v40) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0f880270e0 con 0x7f0f98100cb0 2024-09-18T12:49:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 msgr2=0x7f0f8406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 0x7f0f8406e9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f80006fd0 tx=0x7f0f80008040 comp rx=0 tx=0).stop 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 msgr2=0x7f0f98196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800bda0 tx=0x7f0f8800be80 comp rx=0 tx=0).stop 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 shutdown_connections 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f0f8406c4e0 0x7f0f8406e9a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f98100cb0 0x7f0f98196560 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 --2- 172.21.15.81:0/3693408590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f98101eb0 0x7f0f98196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 >> 172.21.15.81:0/3693408590 conn(0x7f0f980fc230 msgr2=0x7f0f981050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 shutdown_connections 2024-09-18T12:49:28.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:28.457+0000 7f0f9d549700 1 -- 172.21.15.81:0/3693408590 wait complete. 2024-09-18T12:49:29.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T12:49:29.399 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:30.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:29 smithi081 ceph-mon[27646]: pgmap v227: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-18T12:49:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:29 smithi136 ceph-mon[35363]: pgmap v227: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-18T12:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 -- 172.21.15.81:0/1515571263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200104130 msgr2=0x7f5200106520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 --2- 172.21.15.81:0/1515571263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200104130 0x7f5200106520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009910 tx=0x7f51f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 -- 172.21.15.81:0/1515571263 shutdown_connections 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 --2- 172.21.15.81:0/1515571263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200104130 0x7f5200106520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 --2- 172.21.15.81:0/1515571263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200101800 0x7f5200103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 -- 172.21.15.81:0/1515571263 >> 172.21.15.81:0/1515571263 conn(0x7f52000fb190 msgr2=0x7f52000fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 -- 172.21.15.81:0/1515571263 shutdown_connections 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.112+0000 7f5207df9700 1 -- 172.21.15.81:0/1515571263 wait complete. 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 Processor -- start 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 -- start start 2024-09-18T12:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 0x7f5200196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200196f20 con 0x7f5200101800 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5207df9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200197060 con 0x7f5200104130 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43804/0 (socket says 172.21.15.81:43804) 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 -- 172.21.15.81:0/4102067280 learned_addr learned my addr 172.21.15.81:0/4102067280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205394700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 0x7f5200196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 -- 172.21.15.81:0/4102067280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 msgr2=0x7f5200196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 0x7f5200196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 -- 172.21.15.81:0/4102067280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00095f0 con 0x7f5200101800 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205394700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 0x7f5200196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f5205b95700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c930 tx=0x7f51fc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.113+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc007ad0 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.114+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51fc007c30 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.114+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520019bb20 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.114+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc018630 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.114+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520019c040 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.114+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200190610 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.115+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f51fc00f450 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.115+0000 7f51f6ffd700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 0x7f51ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.116+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f51fc08b8d0 con 0x7f5200101800 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.116+0000 7f5205394700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 0x7f51ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.116+0000 7f5205394700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 0x7f51ec06e9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f000b5c0 tx=0x7f51f0005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:31.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.120+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f51fc059c10 con 0x7f5200101800 2024-09-18T12:49:31.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.308+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f520002cc70 con 0x7f5200101800 2024-09-18T12:49:31.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.309+0000 7f51f6ffd700 1 -- 172.21.15.81:0/4102067280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v40)=0 v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f51fc0597a0 con 0x7f5200101800 2024-09-18T12:49:31.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 msgr2=0x7f51ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:31.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 0x7f51ec06e9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f000b5c0 tx=0x7f51f0005960 comp rx=0 tx=0).stop 2024-09-18T12:49:31.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 msgr2=0x7f5200196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:31.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c930 tx=0x7f51fc00ccf0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 shutdown_connections 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f51ec06c4e0 0x7f51ec06e9a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5200101800 0x7f5200196450 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 --2- 172.21.15.81:0/4102067280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5200104130 0x7f5200196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 >> 172.21.15.81:0/4102067280 conn(0x7f52000fb190 msgr2=0x7f52000fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:31.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 shutdown_connections 2024-09-18T12:49:31.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:31.311+0000 7f5207df9700 1 -- 172.21.15.81:0/4102067280 wait complete. 2024-09-18T12:49:32.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:31 smithi081 ceph-mon[27646]: pgmap v228: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:32.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T12:49:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:31 smithi136 ceph-mon[35363]: pgmap v228: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:32.376 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 -- 172.21.15.81:0/2780468438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 msgr2=0x7fca241023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 --2- 172.21.15.81:0/2780468438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca241023a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009910 tx=0x7fca0c009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 -- 172.21.15.81:0/2780468438 shutdown_connections 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 --2- 172.21.15.81:0/2780468438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca241023a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 --2- 172.21.15.81:0/2780468438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca240fef60 0x7fca240ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 -- 172.21.15.81:0/2780468438 >> 172.21.15.81:0/2780468438 conn(0x7fca240fa8c0 msgr2=0x7fca240fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 -- 172.21.15.81:0/2780468438 shutdown_connections 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 -- 172.21.15.81:0/2780468438 wait complete. 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.078+0000 7fca294b8700 1 Processor -- start 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 -- start start 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca240fef60 0x7fca241964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca24196fb0 con 0x7fca24101f40 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca241970f0 con 0x7fca240fef60 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43826/0 (socket says 172.21.15.81:43826) 2024-09-18T12:49:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 -- 172.21.15.81:0/3037570174 learned_addr learned my addr 172.21.15.81:0/3037570174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 -- 172.21.15.81:0/3037570174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca240fef60 msgr2=0x7fca241964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca240fef60 0x7fca241964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 -- 172.21.15.81:0/3037570174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0095f0 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca1a7fc700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00bd70 tx=0x7fca0c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0c01d070 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2419bb50 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca0c022470 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0c00f670 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.079+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2419c010 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.080+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca24109800 con 0x7fca24101f40 2024-09-18T12:49:34.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:33 smithi081 ceph-mon[27646]: pgmap v229: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.081+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fca0c022a50 con 0x7fca24101f40 2024-09-18T12:49:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.082+0000 7fca20ff9700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 0x7fca1006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.082+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fca0c08ce40 con 0x7fca24101f40 2024-09-18T12:49:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.082+0000 7fca22ffd700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 0x7fca1006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.082+0000 7fca22ffd700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 0x7fca1006e9a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca24068380 tx=0x7fca14005d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:34.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.086+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fca0c05b1b0 con 0x7fca24101f40 2024-09-18T12:49:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.274+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fca2419c6e0 con 0x7fca24101f40 2024-09-18T12:49:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.274+0000 7fca20ff9700 1 -- 172.21.15.81:0/3037570174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v40)=0 v40) v1 ==== 135+0+0 (secure 0 0 0) 0x7fca0c05ad40 con 0x7fca24101f40 2024-09-18T12:49:34.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 msgr2=0x7fca1006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 0x7fca1006e9a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca24068380 tx=0x7fca14005d20 comp rx=0 tx=0).stop 2024-09-18T12:49:34.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 msgr2=0x7fca24196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00bd70 tx=0x7fca0c00be50 comp rx=0 tx=0).stop 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 shutdown_connections 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca240fef60 0x7fca241964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fca1006c4e0 0x7fca1006e9a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 --2- 172.21.15.81:0/3037570174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24101f40 0x7fca24196a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 >> 172.21.15.81:0/3037570174 conn(0x7fca240fa8c0 msgr2=0x7fca24105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 shutdown_connections 2024-09-18T12:49:34.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:34.277+0000 7fca294b8700 1 -- 172.21.15.81:0/3037570174 wait complete. 2024-09-18T12:49:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:33 smithi136 ceph-mon[35363]: pgmap v229: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:35.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:35.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-18T12:49:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:35.333 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:36.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:35 smithi081 ceph-mon[27646]: pgmap v230: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:36.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:35 smithi136 ceph-mon[35363]: pgmap v230: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T12:49:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/690294455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a81022c0 msgr2=0x7fa5a81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/690294455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a81022c0 0x7fa5a81026e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa598009910 tx=0x7fa598009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/690294455 shutdown_connections 2024-09-18T12:49:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/690294455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a80fed40 0x7fa5a80ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/690294455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a81022c0 0x7fa5a81026e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/690294455 >> 172.21.15.81:0/690294455 conn(0x7fa5a80fa8c0 msgr2=0x7fa5a80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/690294455 shutdown_connections 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.009+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/690294455 wait complete. 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 Processor -- start 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 -- start start 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 0x7fa5a8196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81970b0 con 0x7fa5a80fed40 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5ae5d1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81971f0 con 0x7fa5a81022c0 2024-09-18T12:49:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37310/0 (socket says 172.21.15.81:37310) 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2843514334 learned_addr learned my addr 172.21.15.81:0/2843514334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa59ffff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 0x7fa5a8196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2843514334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 msgr2=0x7fa5a8196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 0x7fa5a8196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2843514334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980095f0 con 0x7fa5a80fed40 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa59ffff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 0x7fa5a8196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.010+0000 7fa5a7fff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa59800bda0 tx=0x7fa59800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.011+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59801d070 con 0x7fa5a80fed40 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.011+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a819bc40 con 0x7fa5a80fed40 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.011+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa598004c50 con 0x7fa5a80fed40 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.011+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59800f690 con 0x7fa5a80fed40 2024-09-18T12:49:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.011+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a819c130 con 0x7fa5a80fed40 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.012+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8109880 con 0x7fa5a80fed40 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.012+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa598022a20 con 0x7fa5a80fed40 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.013+0000 7fa5a5ffb700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 0x7fa59406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.013+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa59808cef0 con 0x7fa5a80fed40 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.013+0000 7fa59ffff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 0x7fa59406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.013+0000 7fa59ffff700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 0x7fa59406e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa590007900 tx=0x7fa590008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.017+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa59805b260 con 0x7fa5a80fed40 2024-09-18T12:49:37.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.224+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5a8106a50 con 0x7fa59406c4e0 2024-09-18T12:49:37.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.229+0000 7fa5a5ffb700 1 -- 172.21.15.81:0/2843514334 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa5a8106a50 con 0x7fa59406c4e0 2024-09-18T12:49:37.231 INFO:teuthology.orchestra.run.smithi081.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:37.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.231+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 msgr2=0x7fa59406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 0x7fa59406e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa590007900 tx=0x7fa590008040 comp rx=0 tx=0).stop 2024-09-18T12:49:37.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 msgr2=0x7fa5a8196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa59800bda0 tx=0x7fa59800be80 comp rx=0 tx=0).stop 2024-09-18T12:49:37.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 shutdown_connections 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fa59406c4e0 0x7fa59406e9a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a80fed40 0x7fa5a8196550 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 --2- 172.21.15.81:0/2843514334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a81022c0 0x7fa5a8196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 >> 172.21.15.81:0/2843514334 conn(0x7fa5a80fa8c0 msgr2=0x7fa5a8105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 shutdown_connections 2024-09-18T12:49:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:37.232+0000 7fa5ae5d1700 1 -- 172.21.15.81:0/2843514334 wait complete. 2024-09-18T12:49:37.840 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:49:37.840 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T12:49:37.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-18T12:49:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: pgmap v231: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:37 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: pgmap v231: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:37 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:49:39.213 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:38 smithi081 ceph-mon[27646]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:39.214 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:38 smithi081 ceph-mon[27646]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:39.214 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:38 smithi081 ceph-mon[27646]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:38 smithi136 ceph-mon[35363]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:38 smithi136 ceph-mon[35363]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:38 smithi136 ceph-mon[35363]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:40.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- 172.21.15.81:0/1557200248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 msgr2=0x7f1120101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 --2- 172.21.15.81:0/1557200248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120101220 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1110009910 tx=0x7f1110009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:40.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- 172.21.15.81:0/1557200248 shutdown_connections 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 --2- 172.21.15.81:0/1557200248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120101220 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 --2- 172.21.15.81:0/1557200248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f11200fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- 172.21.15.81:0/1557200248 >> 172.21.15.81:0/1557200248 conn(0x7f11200fb160 msgr2=0x7f11200fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- 172.21.15.81:0/1557200248 shutdown_connections 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- 172.21.15.81:0/1557200248 wait complete. 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 Processor -- start 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.988+0000 7f11272e6700 1 -- start start 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11272e6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f1120196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11272e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11272e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201973d0 con 0x7f1120100dc0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11272e6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120197510 con 0x7f11200ffbc0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37334/0 (socket says 172.21.15.81:37334) 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 -- 172.21.15.81:0/1671055415 learned_addr learned my addr 172.21.15.81:0/1671055415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1125082700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f1120196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 -- 172.21.15.81:0/1671055415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 msgr2=0x7f1120196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f1120196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 -- 172.21.15.81:0/1671055415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100095f0 con 0x7f1120100dc0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1125082700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f1120196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f1124881700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1110006010 tx=0x7f111000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f111001d070 con 0x7f1120100dc0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f111000f460 con 0x7f1120100dc0 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110021640 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.989+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120101fe0 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.990+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1120102430 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.991+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120068af0 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.992+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f111000fab0 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.992+0000 7f11167fc700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 0x7f110c072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.992+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f111008cb00 con 0x7f1120100dc0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.992+0000 7f1125082700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 0x7f110c072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.993+0000 7f1125082700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 0x7f110c072db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1120100c20 tx=0x7f111c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:39.997+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f111005ae40 con 0x7f1120100dc0 2024-09-18T12:49:40.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.240+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1120069560 con 0x7f110c0708f0 2024-09-18T12:49:40.243 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:39 smithi081 ceph-mon[27646]: pgmap v232: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:49:40.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.241+0000 7f11167fc700 1 -- 172.21.15.81:0/1671055415 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f1120069560 con 0x7f110c0708f0 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 msgr2=0x7f110c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 0x7f110c072db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1120100c20 tx=0x7f111c008040 comp rx=0 tx=0).stop 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 msgr2=0x7f1120196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1110006010 tx=0x7f111000be20 comp rx=0 tx=0).stop 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 shutdown_connections 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11200ffbc0 0x7f1120196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f110c0708f0 0x7f110c072db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 --2- 172.21.15.81:0/1671055415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1120100dc0 0x7f1120196db0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 >> 172.21.15.81:0/1671055415 conn(0x7f11200fb160 msgr2=0x7f1120068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:40.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 shutdown_connections 2024-09-18T12:49:40.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.244+0000 7f11272e6700 1 -- 172.21.15.81:0/1671055415 wait complete. 2024-09-18T12:49:40.257 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:49:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:39 smithi136 ceph-mon[35363]: pgmap v232: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:49:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 -- 172.21.15.81:0/811983173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0100cb0 msgr2=0x7f4fd01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/811983173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01010d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009910 tx=0x7f4fcc009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 -- 172.21.15.81:0/811983173 shutdown_connections 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/811983173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/811983173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01010d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.358+0000 7f4fd7de9700 1 -- 172.21.15.81:0/811983173 >> 172.21.15.81:0/811983173 conn(0x7f4fd00fc230 msgr2=0x7f4fd00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 -- 172.21.15.81:0/811983173 shutdown_connections 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 -- 172.21.15.81:0/811983173 wait complete. 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 Processor -- start 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 -- start start 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0197050 con 0x7f4fd0101eb0 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.359+0000 7f4fd7de9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0197190 con 0x7f4fd0100cb0 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37358/0 (socket says 172.21.15.81:37358) 2024-09-18T12:49:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 -- 172.21.15.81:0/635666076 learned_addr learned my addr 172.21.15.81:0/635666076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5b85700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 -- 172.21.15.81:0/635666076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0100cb0 msgr2=0x7f4fd01964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 -- 172.21.15.81:0/635666076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0095f0 con 0x7f4fd0101eb0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd5384700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000d8d0 tx=0x7f4fc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc0009940 con 0x7f4fd0101eb0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd019bc40 con 0x7f4fd0101eb0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0010460 con 0x7f4fd0101eb0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc000f5f0 con 0x7f4fd0101eb0 2024-09-18T12:49:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.360+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd019c190 con 0x7f4fd0101eb0 2024-09-18T12:49:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.361+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd0109810 con 0x7f4fd0101eb0 2024-09-18T12:49:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.362+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4fc00105d0 con 0x7f4fd0101eb0 2024-09-18T12:49:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.362+0000 7f4fc6ffd700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 0x7f4fbc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.362+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4fc008b7e0 con 0x7f4fd0101eb0 2024-09-18T12:49:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.363+0000 7f4fd5b85700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 0x7f4fbc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.363+0000 7f4fd5b85700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 0x7f4fbc06e9a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.367+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4fc0059aa0 con 0x7f4fd0101eb0 2024-09-18T12:49:40.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.598+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fd0106800 con 0x7f4fbc06c4e0 2024-09-18T12:49:40.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.600+0000 7f4fc6ffd700 1 -- 172.21.15.81:0/635666076 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4fd0106800 con 0x7f4fbc06c4e0 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 msgr2=0x7f4fbc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 0x7f4fbc06e9a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc005a90 comp rx=0 tx=0).stop 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 msgr2=0x7f4fd0196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000d8d0 tx=0x7f4fc000dc90 comp rx=0 tx=0).stop 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 shutdown_connections 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd0100cb0 0x7f4fd01964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f4fbc06c4e0 0x7f4fbc06e9a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 --2- 172.21.15.81:0/635666076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd0101eb0 0x7f4fd0196a30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 >> 172.21.15.81:0/635666076 conn(0x7f4fd00fc230 msgr2=0x7f4fd01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 shutdown_connections 2024-09-18T12:49:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.602+0000 7f4fd7de9700 1 -- 172.21.15.81:0/635666076 wait complete. 2024-09-18T12:49:40.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 -- 172.21.15.81:0/1890266295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 msgr2=0x7febb40fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 --2- 172.21.15.81:0/1890266295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb40fffc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feba4009910 tx=0x7feba4009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 -- 172.21.15.81:0/1890266295 shutdown_connections 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 --2- 172.21.15.81:0/1890266295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febb4100da0 0x7febb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 --2- 172.21.15.81:0/1890266295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb40fffc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 -- 172.21.15.81:0/1890266295 >> 172.21.15.81:0/1890266295 conn(0x7febb40fb120 msgr2=0x7febb40fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 -- 172.21.15.81:0/1890266295 shutdown_connections 2024-09-18T12:49:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.720+0000 7febb95f6700 1 -- 172.21.15.81:0/1890266295 wait complete. 2024-09-18T12:49:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 Processor -- start 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 -- start start 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febb4100da0 0x7febb4102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb41026c0 con 0x7febb40ffba0 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb95f6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb4102800 con 0x7febb4100da0 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37386/0 (socket says 172.21.15.81:37386) 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.721+0000 7febb2ffd700 1 -- 172.21.15.81:0/3787910065 learned_addr learned my addr 172.21.15.81:0/3787910065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb2ffd700 1 -- 172.21.15.81:0/3787910065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febb4100da0 msgr2=0x7febb4102180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb2ffd700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febb4100da0 0x7febb4102180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb2ffd700 1 -- 172.21.15.81:0/3787910065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40095f0 con 0x7febb40ffba0 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb2ffd700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feba400bda0 tx=0x7feba400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feba401d070 con 0x7febb40ffba0 2024-09-18T12:49:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feba400f460 con 0x7febb40ffba0 2024-09-18T12:49:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb4102a80 con 0x7febb40ffba0 2024-09-18T12:49:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feba4021640 con 0x7febb40ffba0 2024-09-18T12:49:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.722+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb4102f70 con 0x7febb40ffba0 2024-09-18T12:49:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.723+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb4108700 con 0x7febb40ffba0 2024-09-18T12:49:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.724+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7feba400fa00 con 0x7febb40ffba0 2024-09-18T12:49:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.724+0000 7feb9bfff700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 0x7feb9c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.724+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7feba408caa0 con 0x7febb40ffba0 2024-09-18T12:49:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.724+0000 7febb27fc700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 0x7feb9c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.725+0000 7febb27fc700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 0x7feb9c06e9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feba800ba10 tx=0x7feba800b3f0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:40.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.729+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feba405ad60 con 0x7febb40ffba0 2024-09-18T12:49:40.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:40.993+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febb4069520 con 0x7feb9c06c4e0 2024-09-18T12:49:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.005+0000 7feb9bfff700 1 -- 172.21.15.81:0/3787910065 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7febb4069520 con 0x7feb9c06c4e0 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (5m) 30s ago 7m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (7m) 30s ago 7m 7532k - 18.2.1 5be31c24972a 2dd4371065e4 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (6m) 37s ago 6m 7306k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (7m) 30s ago 7m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (6m) 37s ago 6m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (5m) 30s ago 6m 83.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (51s) 30s ago 51s 18.3M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (57s) 30s ago 56s 16.6M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:49:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (49s) 37s ago 48s 15.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (54s) 37s ago 54s 11.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (8m) 30s ago 8m 488M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (6m) 37s ago 6m 442M - 18.2.1 5be31c24972a d081f5286368 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (8m) 30s ago 8m 47.0M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (6m) 37s ago 6m 37.0M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (7m) 30s ago 7m 16.3M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (6m) 37s ago 6m 15.0M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 30s ago 4m 49.6M 3946M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 30s ago 4m 48.5M 3946M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (3m) 30s ago 3m 48.8M 3946M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (3m) 37s ago 3m 47.3M 4970M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:49:41.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (2m) 37s ago 2m 46.8M 4970M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:49:41.010 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (2m) 37s ago 2m 41.7M 4970M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:49:41.010 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 30s ago 6m 59.0M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:49:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 msgr2=0x7feb9c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 0x7feb9c06e9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feba800ba10 tx=0x7feba800b3f0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 msgr2=0x7febb4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feba400bda0 tx=0x7feba400be80 comp rx=0 tx=0).stop 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 shutdown_connections 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7feb9c06c4e0 0x7feb9c06e9a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40ffba0 0x7febb4103b30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 --2- 172.21.15.81:0/3787910065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febb4100da0 0x7febb4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 >> 172.21.15.81:0/3787910065 conn(0x7febb40fb120 msgr2=0x7febb4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 shutdown_connections 2024-09-18T12:49:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.008+0000 7febb95f6700 1 -- 172.21.15.81:0/3787910065 wait complete. 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 -- 172.21.15.81:0/3390312475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 msgr2=0x7fd20c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 --2- 172.21.15.81:0/3390312475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c101270 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd200009910 tx=0x7fd200009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 -- 172.21.15.81:0/3390312475 shutdown_connections 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 --2- 172.21.15.81:0/3390312475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c101270 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 --2- 172.21.15.81:0/3390312475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 -- 172.21.15.81:0/3390312475 >> 172.21.15.81:0/3390312475 conn(0x7fd20c0fb190 msgr2=0x7fd20c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.134+0000 7fd21176e700 1 -- 172.21.15.81:0/3390312475 shutdown_connections 2024-09-18T12:49:41.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.135+0000 7fd21176e700 1 -- 172.21.15.81:0/3390312475 wait complete. 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.135+0000 7fd21176e700 1 Processor -- start 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.135+0000 7fd21176e700 1 -- start start 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd21176e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd21176e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd21176e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c19b7c0 con 0x7fd20c100e10 2024-09-18T12:49:41.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd21176e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c19b900 con 0x7fd20c0ffc10 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:49588/0 (socket says 172.21.15.81:49588) 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 -- 172.21.15.81:0/3704362646 learned_addr learned my addr 172.21.15.81:0/3704362646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37410/0 (socket says 172.21.15.81:37410) 2024-09-18T12:49:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 -- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 msgr2=0x7fd20c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 -- 172.21.15.81:0/3704362646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000095f0 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.136+0000 7fd20affd700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00e8f0 tx=0x7fd1fc00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.137+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc009790 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.137+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1fc00c810 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.137+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c19bbe0 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.137+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc003d20 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.137+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c19c130 con 0x7fd20c0ffc10 2024-09-18T12:49:41.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.138+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c108700 con 0x7fd20c0ffc10 2024-09-18T12:49:41.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.138+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd1fc018430 con 0x7fd20c0ffc10 2024-09-18T12:49:41.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.139+0000 7fd1f3fff700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 0x7fd1f406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.139+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd1fc014070 con 0x7fd20c0ffc10 2024-09-18T12:49:41.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.139+0000 7fd20a7fc700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 0x7fd1f406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.140+0000 7fd20a7fc700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 0x7fd1f406e9a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fd0 tx=0x7fd200005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.144+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd1fc059d90 con 0x7fd20c0ffc10 2024-09-18T12:49:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.484+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd20c19c6e0 con 0x7fd20c0ffc10 2024-09-18T12:49:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.484+0000 7fd1f3fff700 1 -- 172.21.15.81:0/3704362646 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fd1fc059920 con 0x7fd20c0ffc10 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:49:41.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:49:41.488 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:49:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 msgr2=0x7fd1f406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 0x7fd1f406e9a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fd0 tx=0x7fd200005940 comp rx=0 tx=0).stop 2024-09-18T12:49:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 msgr2=0x7fd20c069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00e8f0 tx=0x7fd1fc00ec00 comp rx=0 tx=0).stop 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 shutdown_connections 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20c0ffc10 0x7fd20c069140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd1f406c4e0 0x7fd1f406e9a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 --2- 172.21.15.81:0/3704362646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20c100e10 0x7fd20c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 >> 172.21.15.81:0/3704362646 conn(0x7fd20c0fb190 msgr2=0x7fd20c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 shutdown_connections 2024-09-18T12:49:41.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.487+0000 7fd21176e700 1 -- 172.21.15.81:0/3704362646 wait complete. 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 -- 172.21.15.81:0/2622967339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601017a0 msgr2=0x7fbd60103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2622967339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601017a0 0x7fbd60103b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009910 tx=0x7fbd50009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 -- 172.21.15.81:0/2622967339 shutdown_connections 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2622967339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601040d0 0x7fbd601064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2622967339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601017a0 0x7fbd60103b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 -- 172.21.15.81:0/2622967339 >> 172.21.15.81:0/2622967339 conn(0x7fbd600fb190 msgr2=0x7fbd600fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 -- 172.21.15.81:0/2622967339 shutdown_connections 2024-09-18T12:49:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.611+0000 7fbd6496f700 1 -- 172.21.15.81:0/2622967339 wait complete. 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 Processor -- start 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 -- start start 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 0x7fbd60196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60196fc0 con 0x7fbd601040d0 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd6496f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60197100 con 0x7fbd601017a0 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37434/0 (socket says 172.21.15.81:37434) 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd5dd9b700 1 -- 172.21.15.81:0/2726708650 learned_addr learned my addr 172.21.15.81:0/2726708650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.612+0000 7fbd5e59c700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 0x7fbd60196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd5dd9b700 1 -- 172.21.15.81:0/2726708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 msgr2=0x7fbd60196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd5dd9b700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 0x7fbd60196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd5dd9b700 1 -- 172.21.15.81:0/2726708650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500095f0 con 0x7fbd601040d0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd5e59c700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 0x7fbd60196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd5dd9b700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e920 tx=0x7fbd5400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5400c9d0 con 0x7fbd601040d0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd54010430 con 0x7fbd601040d0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6019bbb0 con 0x7fbd601040d0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd54018650 con 0x7fbd601040d0 2024-09-18T12:49:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.613+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6019c100 con 0x7fbd601040d0 2024-09-18T12:49:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.614+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd60190610 con 0x7fbd601040d0 2024-09-18T12:49:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.616+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fbd540105a0 con 0x7fbd601040d0 2024-09-18T12:49:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.616+0000 7fbd4f7fe700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 0x7fbd4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.616+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbd54014070 con 0x7fbd601040d0 2024-09-18T12:49:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.616+0000 7fbd5e59c700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 0x7fbd4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.617+0000 7fbd5e59c700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 0x7fbd4806e9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009fd0 tx=0x7fbd50005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.621+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbd540520e0 con 0x7fbd601040d0 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.908+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd6002cc70 con 0x7fbd601040d0 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.908+0000 7fbd4f7fe700 1 -- 172.21.15.81:0/2726708650 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7fbd54059d60 con 0x7fbd601040d0 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:49:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 18 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:48:57.803376+0000 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:49:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:49:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:41.915 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:49:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 msgr2=0x7fbd4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 0x7fbd4806e9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009fd0 tx=0x7fbd50005940 comp rx=0 tx=0).stop 2024-09-18T12:49:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 msgr2=0x7fbd601969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e920 tx=0x7fbd5400ec30 comp rx=0 tx=0).stop 2024-09-18T12:49:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 shutdown_connections 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd601017a0 0x7fbd60196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbd4806c4e0 0x7fbd4806e9a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 --2- 172.21.15.81:0/2726708650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd601040d0 0x7fbd601969a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 >> 172.21.15.81:0/2726708650 conn(0x7fbd600fb190 msgr2=0x7fbd600fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 shutdown_connections 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:41.911+0000 7fbd6496f700 1 -- 172.21.15.81:0/2726708650 wait complete. 2024-09-18T12:49:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-18T12:49:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 -- 172.21.15.81:0/524237546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 msgr2=0x7f3dd8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/524237546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8102310 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009910 tx=0x7f3dcc009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 -- 172.21.15.81:0/524237546 shutdown_connections 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/524237546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8102310 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/524237546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 -- 172.21.15.81:0/524237546 >> 172.21.15.81:0/524237546 conn(0x7f3dd80fc230 msgr2=0x7f3dd80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 -- 172.21.15.81:0/524237546 shutdown_connections 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.035+0000 7f3ddcf61700 1 -- 172.21.15.81:0/524237546 wait complete. 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 Processor -- start 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 -- start start 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8197040 con 0x7f3dd8101eb0 2024-09-18T12:49:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.036+0000 7f3ddcf61700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8197180 con 0x7f3dd8100cb0 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:49624/0 (socket says 172.21.15.81:49624) 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd659c700 1 -- 172.21.15.81:0/158993135 learned_addr learned my addr 172.21.15.81:0/158993135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd5d9b700 1 -- 172.21.15.81:0/158993135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 msgr2=0x7f3dd81964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd5d9b700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd5d9b700 1 -- 172.21.15.81:0/158993135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0095f0 con 0x7f3dd8101eb0 2024-09-18T12:49:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dd5d9b700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8196a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009910 tx=0x7f3dcc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dcc01d070 con 0x7f3dd8101eb0 2024-09-18T12:49:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3dcc00f460 con 0x7f3dd8101eb0 2024-09-18T12:49:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dcc021640 con 0x7f3dd8101eb0 2024-09-18T12:49:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd819bbd0 con 0x7f3dd8101eb0 2024-09-18T12:49:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.037+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd819c070 con 0x7f3dd8101eb0 2024-09-18T12:49:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.039+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd8109810 con 0x7f3dd8101eb0 2024-09-18T12:49:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.039+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f3dcc00f9d0 con 0x7f3dd8101eb0 2024-09-18T12:49:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.039+0000 7f3dc77fe700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 0x7f3dc006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.040+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3dcc08ca40 con 0x7f3dd8101eb0 2024-09-18T12:49:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.040+0000 7f3dd659c700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 0x7f3dc006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.040+0000 7f3dd659c700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 0x7f3dc006e9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007c70 tx=0x7f3dc8007480 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.045+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3dcc05ae20 con 0x7f3dd8101eb0 2024-09-18T12:49:42.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:41 smithi136 ceph-mon[35363]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:42.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:41 smithi136 ceph-mon[35363]: pgmap v233: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:41 smithi136 ceph-mon[35363]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:41 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3704362646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:42.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.304+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd8106800 con 0x7f3dc006c4e0 2024-09-18T12:49:42.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:41 smithi081 ceph-mon[27646]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:42.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:41 smithi081 ceph-mon[27646]: pgmap v233: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:42.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:41 smithi081 ceph-mon[27646]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:42.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:41 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3704362646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.306+0000 7f3dc77fe700 1 -- 172.21.15.81:0/158993135 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3dd8106800 con 0x7f3dc006c4e0 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-09-18T12:49:42.308 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e image", 2024-09-18T12:49:42.309 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:49:42.309 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 msgr2=0x7f3dc006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 0x7f3dc006e9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007c70 tx=0x7f3dc8007480 comp rx=0 tx=0).stop 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 msgr2=0x7f3dd8196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8196a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009910 tx=0x7f3dcc00bd70 comp rx=0 tx=0).stop 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 shutdown_connections 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dd8100cb0 0x7f3dd81964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3dc006c4e0 0x7f3dc006e9a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 --2- 172.21.15.81:0/158993135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8101eb0 0x7f3dd8196a20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.308+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 >> 172.21.15.81:0/158993135 conn(0x7f3dd80fc230 msgr2=0x7f3dd81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:42.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.309+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 shutdown_connections 2024-09-18T12:49:42.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.309+0000 7f3ddcf61700 1 -- 172.21.15.81:0/158993135 wait complete. 2024-09-18T12:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 -- 172.21.15.81:0/914238588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c074dc0 msgr2=0x7fcc9c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 --2- 172.21.15.81:0/914238588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c073220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009910 tx=0x7fcc98009c20 comp rx=0 tx=0).stop 2024-09-18T12:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 -- 172.21.15.81:0/914238588 shutdown_connections 2024-09-18T12:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 --2- 172.21.15.81:0/914238588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 --2- 172.21.15.81:0/914238588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c073220 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.438+0000 7fcca4466700 1 -- 172.21.15.81:0/914238588 >> 172.21.15.81:0/914238588 conn(0x7fcc9c0fc230 msgr2=0x7fcc9c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.439+0000 7fcca4466700 1 -- 172.21.15.81:0/914238588 shutdown_connections 2024-09-18T12:49:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.439+0000 7fcca4466700 1 -- 172.21.15.81:0/914238588 wait complete. 2024-09-18T12:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 Processor -- start 2024-09-18T12:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 -- start start 2024-09-18T12:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c199260 con 0x7fcc9c0737f0 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca4466700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1993a0 con 0x7fcc9c074dc0 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca2202700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca2202700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37458/0 (socket says 172.21.15.81:37458) 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca1a01700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca1a01700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:49644/0 (socket says 172.21.15.81:49644) 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.440+0000 7fcca2202700 1 -- 172.21.15.81:0/103990485 learned_addr learned my addr 172.21.15.81:0/103990485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca2202700 1 -- 172.21.15.81:0/103990485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 msgr2=0x7fcc9c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca2202700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca2202700 1 -- 172.21.15.81:0/103990485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980095f0 con 0x7fcc9c0737f0 2024-09-18T12:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca1a01700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca2202700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800fa00 tx=0x7fcc9800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc9801d070 con 0x7fcc9c0737f0 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc9800fe90 con 0x7fcc9c0737f0 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c19ddf0 con 0x7fcc9c0737f0 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc98017630 con 0x7fcc9c0737f0 2024-09-18T12:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.441+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c19e250 con 0x7fcc9c0737f0 2024-09-18T12:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.442+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c10ba20 con 0x7fcc9c0737f0 2024-09-18T12:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.443+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fcc98003680 con 0x7fcc9c0737f0 2024-09-18T12:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.443+0000 7fcc937fe700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 0x7fcc8806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.444+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcc9808ca70 con 0x7fcc9c0737f0 2024-09-18T12:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.444+0000 7fcca1a01700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 0x7fcc8806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:42.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.444+0000 7fcca1a01700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 0x7fcc8806e9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c074af0 tx=0x7fcc8c009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:42.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.449+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcc9805adb0 con 0x7fcc9c0737f0 2024-09-18T12:49:42.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.785+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcc9c19e8e0 con 0x7fcc9c0737f0 2024-09-18T12:49:42.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.785+0000 7fcc937fe700 1 -- 172.21.15.81:0/103990485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcc98003e60 con 0x7fcc9c0737f0 2024-09-18T12:49:42.787 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 msgr2=0x7fcc8806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 0x7fcc8806e9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c074af0 tx=0x7fcc8c009260 comp rx=0 tx=0).stop 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 msgr2=0x7fcc9c198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800fa00 tx=0x7fcc9800fa30 comp rx=0 tx=0).stop 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 shutdown_connections 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fcc8806c4e0 0x7fcc8806e9a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc9c0737f0 0x7fcc9c198700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 --2- 172.21.15.81:0/103990485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc9c074dc0 0x7fcc9c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.787+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 >> 172.21.15.81:0/103990485 conn(0x7fcc9c0fc230 msgr2=0x7fcc9c106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:42.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.788+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 shutdown_connections 2024-09-18T12:49:42.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:49:42.788+0000 7fcca4466700 1 -- 172.21.15.81:0/103990485 wait complete. 2024-09-18T12:49:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:42 smithi081 ceph-mon[27646]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2726708650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:42 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/103990485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:49:43.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:42 smithi136 ceph-mon[35363]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2726708650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:42 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/103990485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:49:44.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:43 smithi136 ceph-mon[35363]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:44.352 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:43 smithi136 ceph-mon[35363]: pgmap v234: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:44.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:43 smithi081 ceph-mon[27646]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:43 smithi081 ceph-mon[27646]: pgmap v234: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:46.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:45 smithi136 ceph-mon[35363]: pgmap v235: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:46.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:45 smithi081 ceph-mon[27646]: pgmap v235: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:48.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:47 smithi136 ceph-mon[35363]: pgmap v236: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:47 smithi081 ceph-mon[27646]: pgmap v236: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:50.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:49 smithi136 ceph-mon[35363]: pgmap v237: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:50.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:49 smithi081 ceph-mon[27646]: pgmap v237: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:52.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:51 smithi136 ceph-mon[35363]: pgmap v238: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:51 smithi081 ceph-mon[27646]: pgmap v238: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:53.937 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:53 smithi081 ceph-mon[27646]: pgmap v239: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:54.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:53 smithi136 ceph-mon[35363]: pgmap v239: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:54 smithi136 ceph-mon[35363]: pgmap v240: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:55.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:54 smithi081 ceph-mon[27646]: pgmap v240: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:57 smithi136 ceph-mon[35363]: pgmap v241: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:57.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:57 smithi081 ceph-mon[27646]: pgmap v241: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:49:59 smithi136 ceph-mon[35363]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T12:50:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:49:59 smithi081 ceph-mon[27646]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T12:50:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:00 smithi136 ceph-mon[35363]: overall HEALTH_OK 2024-09-18T12:50:01.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:00 smithi081 ceph-mon[27646]: overall HEALTH_OK 2024-09-18T12:50:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:01 smithi136 ceph-mon[35363]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:01 smithi081 ceph-mon[27646]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:03 smithi136 ceph-mon[35363]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:03 smithi081 ceph-mon[27646]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:05 smithi136 ceph-mon[35363]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:06.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:05 smithi081 ceph-mon[27646]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:50:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:07 smithi136 ceph-mon[35363]: pgmap v246: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:50:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:07 smithi081 ceph-mon[27646]: pgmap v246: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:50:10.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:09 smithi136 ceph-mon[35363]: pgmap v247: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:50:10.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:09 smithi081 ceph-mon[27646]: pgmap v247: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:50:12.045 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:11 smithi081 ceph-mon[27646]: pgmap v248: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:50:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:11 smithi136 ceph-mon[35363]: pgmap v248: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 -- 172.21.15.81:0/2601388982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 msgr2=0x7fd2f01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 --2- 172.21.15.81:0/2601388982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f01023a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009910 tx=0x7fd2e4009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 -- 172.21.15.81:0/2601388982 shutdown_connections 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 --2- 172.21.15.81:0/2601388982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f01023a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 --2- 172.21.15.81:0/2601388982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f00ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 -- 172.21.15.81:0/2601388982 >> 172.21.15.81:0/2601388982 conn(0x7fd2f00fa8c0 msgr2=0x7fd2f00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 -- 172.21.15.81:0/2601388982 shutdown_connections 2024-09-18T12:50:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.924+0000 7fd2f544a700 1 -- 172.21.15.81:0/2601388982 wait complete. 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.925+0000 7fd2f544a700 1 Processor -- start 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.925+0000 7fd2f544a700 1 -- start start 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.925+0000 7fd2f544a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f01942d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2f544a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f0194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f0194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f0194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52260/0 (socket says 172.21.15.81:52260) 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2ee7fc700 1 -- 172.21.15.81:0/735870226 learned_addr learned my addr 172.21.15.81:0/735870226 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0194e30 con 0x7fd2f0101f40 2024-09-18T12:50:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2eeffd700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f01942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0194f70 con 0x7fd2f00fef60 2024-09-18T12:50:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2eeffd700 1 -- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 msgr2=0x7fd2f0194810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2eeffd700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f0194810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2eeffd700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40095f0 con 0x7fd2f00fef60 2024-09-18T12:50:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.926+0000 7fd2eeffd700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f01942d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000d6c0 tx=0x7fd2e000d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.927+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e00041f0 con 0x7fd2f00fef60 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.927+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f0199a20 con 0x7fd2f00fef60 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.927+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f0199f70 con 0x7fd2f00fef60 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.927+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2e0004350 con 0x7fd2f00fef60 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.927+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e0003d20 con 0x7fd2f00fef60 2024-09-18T12:50:12.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.928+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc005320 con 0x7fd2f00fef60 2024-09-18T12:50:12.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.930+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd2e000f690 con 0x7fd2f00fef60 2024-09-18T12:50:12.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.930+0000 7fd2d7fff700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 0x7fd2d806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:12.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.930+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd2e008b3a0 con 0x7fd2f00fef60 2024-09-18T12:50:12.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.931+0000 7fd2ee7fc700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 0x7fd2d806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:12.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.931+0000 7fd2ee7fc700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 0x7fd2d806e9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005090 tx=0x7fd2e400b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:12.938+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd2e0059680 con 0x7fd2f00fef60 2024-09-18T12:50:13.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.364+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2dc000bf0 con 0x7fd2d806c4e0 2024-09-18T12:50:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.366+0000 7fd2d7fff700 1 -- 172.21.15.81:0/735870226 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd2dc000bf0 con 0x7fd2d806c4e0 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 msgr2=0x7fd2d806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 0x7fd2d806e9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005090 tx=0x7fd2e400b560 comp rx=0 tx=0).stop 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 msgr2=0x7fd2f01942d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f01942d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000d6c0 tx=0x7fd2e000d9d0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 shutdown_connections 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2f00fef60 0x7fd2f01942d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.368+0000 7fd2f544a700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fd2d806c4e0 0x7fd2d806e9a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.369+0000 7fd2f544a700 1 --2- 172.21.15.81:0/735870226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0101f40 0x7fd2f0194810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.369+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 >> 172.21.15.81:0/735870226 conn(0x7fd2f00fa8c0 msgr2=0x7fd2f0103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:13.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.369+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 shutdown_connections 2024-09-18T12:50:13.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.369+0000 7fd2f544a700 1 -- 172.21.15.81:0/735870226 wait complete. 2024-09-18T12:50:13.384 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 -- 172.21.15.81:0/1633257452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80400ff9a0 msgr2=0x7f80400ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 --2- 172.21.15.81:0/1633257452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80400ff9a0 0x7f80400ffdc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8030009910 tx=0x7f8030009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 -- 172.21.15.81:0/1633257452 shutdown_connections 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 --2- 172.21.15.81:0/1633257452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 --2- 172.21.15.81:0/1633257452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80400ff9a0 0x7f80400ffdc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 -- 172.21.15.81:0/1633257452 >> 172.21.15.81:0/1633257452 conn(0x7f80400faf40 msgr2=0x7f80400fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 -- 172.21.15.81:0/1633257452 shutdown_connections 2024-09-18T12:50:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.483+0000 7f804499d700 1 -- 172.21.15.81:0/1633257452 wait complete. 2024-09-18T12:50:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 Processor -- start 2024-09-18T12:50:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 -- start start 2024-09-18T12:50:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 0x7f8040106420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040106960 con 0x7f8040105fa0 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.484+0000 7f804499d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040106ad0 con 0x7f8040100ba0 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 0x7f8040106420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47434/0 (socket says 172.21.15.81:47434) 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 0x7f8040106420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52286/0 (socket says 172.21.15.81:52286) 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 -- 172.21.15.81:0/4250048500 learned_addr learned my addr 172.21.15.81:0/4250048500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 -- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 msgr2=0x7f8040106420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 0x7f8040106420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 -- 172.21.15.81:0/4250048500 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300095f0 con 0x7f8040100ba0 2024-09-18T12:50:13.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.485+0000 7f803f7fe700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8030000c00 tx=0x7f803000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:13.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.486+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803001d070 con 0x7f8040100ba0 2024-09-18T12:50:13.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.486+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040106d50 con 0x7f8040100ba0 2024-09-18T12:50:13.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.486+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8030005dc0 con 0x7f8040100ba0 2024-09-18T12:50:13.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.486+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804019e7b0 con 0x7f8040100ba0 2024-09-18T12:50:13.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.486+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8030017400 con 0x7f8040100ba0 2024-09-18T12:50:13.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.487+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8040109600 con 0x7f8040100ba0 2024-09-18T12:50:13.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.488+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8030003780 con 0x7f8040100ba0 2024-09-18T12:50:13.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.489+0000 7f803cff9700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 0x7f802806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.489+0000 7f803effd700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 0x7f802806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.489+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f803008cc10 con 0x7f8040100ba0 2024-09-18T12:50:13.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.489+0000 7f803effd700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 0x7f802806e9a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8034009c60 tx=0x7f8034009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:13.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.497+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f803005aeb0 con 0x7f8040100ba0 2024-09-18T12:50:13.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.716+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80401054f0 con 0x7f802806c4e0 2024-09-18T12:50:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.718+0000 7f803cff9700 1 -- 172.21.15.81:0/4250048500 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f80401054f0 con 0x7f802806c4e0 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 msgr2=0x7f802806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 0x7f802806e9a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8034009c60 tx=0x7f8034009260 comp rx=0 tx=0).stop 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 msgr2=0x7f8040107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8030000c00 tx=0x7f803000f690 comp rx=0 tx=0).stop 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 shutdown_connections 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8040100ba0 0x7f8040107950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f802806c4e0 0x7f802806e9a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 --2- 172.21.15.81:0/4250048500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8040105fa0 0x7f8040106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.720+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 >> 172.21.15.81:0/4250048500 conn(0x7f80400faf40 msgr2=0x7f8040103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.721+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 shutdown_connections 2024-09-18T12:50:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.721+0000 7f804499d700 1 -- 172.21.15.81:0/4250048500 wait complete. 2024-09-18T12:50:13.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 -- 172.21.15.81:0/158221919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 msgr2=0x7f38000fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 --2- 172.21.15.81:0/158221919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f38000fffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009910 tx=0x7f37f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 -- 172.21.15.81:0/158221919 shutdown_connections 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 --2- 172.21.15.81:0/158221919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 0x7f3800101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 --2- 172.21.15.81:0/158221919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f38000fffe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 -- 172.21.15.81:0/158221919 >> 172.21.15.81:0/158221919 conn(0x7f38000fb160 msgr2=0x7f38000fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 -- 172.21.15.81:0/158221919 shutdown_connections 2024-09-18T12:50:13.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.832+0000 7f3804bd7700 1 -- 172.21.15.81:0/158221919 wait complete. 2024-09-18T12:50:13.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 Processor -- start 2024-09-18T12:50:13.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 -- start start 2024-09-18T12:50:13.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 0x7f3800199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001998e0 con 0x7f38000ffbc0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f3804bd7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800199a50 con 0x7f3800100dc0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52308/0 (socket says 172.21.15.81:52308) 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f37fe59c700 1 -- 172.21.15.81:0/2757075993 learned_addr learned my addr 172.21.15.81:0/2757075993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.833+0000 7f37fdd9b700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 0x7f3800199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37fe59c700 1 -- 172.21.15.81:0/2757075993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 msgr2=0x7f3800199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37fe59c700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 0x7f3800199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37fe59c700 1 -- 172.21.15.81:0/2757075993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00095f0 con 0x7f38000ffbc0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37fe59c700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37f0006010 tx=0x7f37f000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f001d070 con 0x7f38000ffbc0 2024-09-18T12:50:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37f0005dc0 con 0x7f38000ffbc0 2024-09-18T12:50:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f3804bd7700 1 -- 172.21.15.81:0/2757075993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800199cd0 con 0x7f38000ffbc0 2024-09-18T12:50:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f00226a0 con 0x7f38000ffbc0 2024-09-18T12:50:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.834+0000 7f3804bd7700 1 -- 172.21.15.81:0/2757075993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380019a1c0 con 0x7f38000ffbc0 2024-09-18T12:50:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.836+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800068af0 con 0x7f38000ffbc0 2024-09-18T12:50:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.836+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f37f00038a0 con 0x7f38000ffbc0 2024-09-18T12:50:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.837+0000 7f37ef7fe700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 0x7f37e806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.837+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f37f008ccd0 con 0x7f38000ffbc0 2024-09-18T12:50:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.837+0000 7f37fdd9b700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 0x7f37e806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.838+0000 7f37fdd9b700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 0x7f37e806e9a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3800069ef0 tx=0x7f37f4009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:13.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:13.842+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f37f005af70 con 0x7f38000ffbc0 2024-09-18T12:50:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.053+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f380019b790 con 0x7f37e806c4e0 2024-09-18T12:50:14.056 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:13 smithi081 ceph-mon[27646]: pgmap v249: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.064+0000 7f37ef7fe700 1 -- 172.21.15.81:0/2757075993 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f37f4011a40 con 0x7f37e806c4e0 2024-09-18T12:50:14.065 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (5m) 63s ago 7m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (8m) 63s ago 7m 7532k - 18.2.1 5be31c24972a 2dd4371065e4 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (6m) 70s ago 6m 7306k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (7m) 63s ago 7m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (6m) 70s ago 6m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (5m) 63s ago 7m 83.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (84s) 63s ago 84s 18.3M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (90s) 63s ago 90s 16.6M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:50:14.066 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (82s) 70s ago 81s 15.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (87s) 70s ago 87s 11.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (9m) 63s ago 9m 488M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (6m) 70s ago 6m 442M - 18.2.1 5be31c24972a d081f5286368 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (9m) 63s ago 9m 47.0M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (6m) 70s ago 6m 37.0M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (7m) 63s ago 7m 16.3M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:50:14.067 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (6m) 70s ago 6m 15.0M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 63s ago 5m 49.6M 3946M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 63s ago 4m 48.5M 3946M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 63s ago 4m 48.8M 3946M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (3m) 70s ago 3m 47.3M 4970M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (3m) 70s ago 3m 46.8M 4970M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (3m) 70s ago 3m 41.7M 4970M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:50:14.068 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 63s ago 7m 59.0M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 msgr2=0x7f37e806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 0x7f37e806e9a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3800069ef0 tx=0x7f37f4009260 comp rx=0 tx=0).stop 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 msgr2=0x7f3800069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37f0006010 tx=0x7f37f000f690 comp rx=0 tx=0).stop 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 shutdown_connections 2024-09-18T12:50:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f37e806c4e0 0x7f37e806e9a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38000ffbc0 0x7f3800069990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 --2- 172.21.15.81:0/2757075993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3800100dc0 0x7f3800199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.066+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 >> 172.21.15.81:0/2757075993 conn(0x7f38000fb160 msgr2=0x7f38001040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.067+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 shutdown_connections 2024-09-18T12:50:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.067+0000 7f37ed7fa700 1 -- 172.21.15.81:0/2757075993 wait complete. 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 -- 172.21.15.81:0/3818151025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 msgr2=0x7f2400101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 --2- 172.21.15.81:0/3818151025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400101270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009910 tx=0x7f23f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 -- 172.21.15.81:0/3818151025 shutdown_connections 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 --2- 172.21.15.81:0/3818151025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400101270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 --2- 172.21.15.81:0/3818151025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 -- 172.21.15.81:0/3818151025 >> 172.21.15.81:0/3818151025 conn(0x7f24000fb190 msgr2=0x7f24000fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.178+0000 7f2407772700 1 -- 172.21.15.81:0/3818151025 shutdown_connections 2024-09-18T12:50:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 -- 172.21.15.81:0/3818151025 wait complete. 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 Processor -- start 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 -- start start 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24001970b0 con 0x7f24000ffc10 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.179+0000 7f2407772700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24001971f0 con 0x7f2400100e10 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f2404d0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f240550e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f2404d0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47482/0 (socket says 172.21.15.81:47482) 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f2404d0d700 1 -- 172.21.15.81:0/884763430 learned_addr learned my addr 172.21.15.81:0/884763430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f240550e700 1 -- 172.21.15.81:0/884763430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 msgr2=0x7f2400196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f240550e700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f240550e700 1 -- 172.21.15.81:0/884763430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00095f0 con 0x7f24000ffc10 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.180+0000 7f240550e700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400196550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2400100c70 tx=0x7f23fc00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.181+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc011800 con 0x7f24000ffc10 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.181+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23fc00be60 con 0x7f24000ffc10 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.181+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc010e70 con 0x7f24000ffc10 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.181+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240019bca0 con 0x7f24000ffc10 2024-09-18T12:50:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.182+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240019c1c0 con 0x7f24000ffc10 2024-09-18T12:50:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.183+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24001087a0 con 0x7f24000ffc10 2024-09-18T12:50:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.183+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f23fc010380 con 0x7f24000ffc10 2024-09-18T12:50:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.184+0000 7f23f67fc700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 0x7f23ec06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.184+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f23fc08b150 con 0x7f24000ffc10 2024-09-18T12:50:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.184+0000 7f2404d0d700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 0x7f23ec06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.185+0000 7f2404d0d700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 0x7f23ec06e7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005100 tx=0x7f23f001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.189+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f23fc059530 con 0x7f24000ffc10 2024-09-18T12:50:14.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:13 smithi136 ceph-mon[35363]: pgmap v249: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.717+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f240019c7d0 con 0x7f24000ffc10 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.717+0000 7f23f67fc700 1 -- 172.21.15.81:0/884763430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f23fc0590c0 con 0x7f24000ffc10 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:50:14.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:50:14.720 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:50:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 msgr2=0x7f23ec06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 0x7f23ec06e7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005100 tx=0x7f23f001a040 comp rx=0 tx=0).stop 2024-09-18T12:50:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 msgr2=0x7f2400196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400196550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2400100c70 tx=0x7f23fc00b6b0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 shutdown_connections 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f23ec06c330 0x7f23ec06e7f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24000ffc10 0x7f2400196550 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 --2- 172.21.15.81:0/884763430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2400100e10 0x7f2400196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 >> 172.21.15.81:0/884763430 conn(0x7f24000fb190 msgr2=0x7f2400068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 shutdown_connections 2024-09-18T12:50:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.720+0000 7f2407772700 1 -- 172.21.15.81:0/884763430 wait complete. 2024-09-18T12:50:14.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 -- 172.21.15.81:0/4002591528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 msgr2=0x7f90b8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 --2- 172.21.15.81:0/4002591528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b8101270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009910 tx=0x7f90ac009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 -- 172.21.15.81:0/4002591528 shutdown_connections 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 --2- 172.21.15.81:0/4002591528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b8101270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 --2- 172.21.15.81:0/4002591528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b8100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 -- 172.21.15.81:0/4002591528 >> 172.21.15.81:0/4002591528 conn(0x7f90b80fb190 msgr2=0x7f90b80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 -- 172.21.15.81:0/4002591528 shutdown_connections 2024-09-18T12:50:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.834+0000 7f90bd412700 1 -- 172.21.15.81:0/4002591528 wait complete. 2024-09-18T12:50:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 Processor -- start 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 -- start start 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819b7d0 con 0x7f90b8100e10 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90bd412700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819b910 con 0x7f90b80ffc10 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90b6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90b67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90b6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47504/0 (socket says 172.21.15.81:47504) 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.835+0000 7f90b6ffd700 1 -- 172.21.15.81:0/2377541575 learned_addr learned my addr 172.21.15.81:0/2377541575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90b6ffd700 1 -- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 msgr2=0x7f90b819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90b6ffd700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90b6ffd700 1 -- 172.21.15.81:0/2377541575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0095f0 con 0x7f90b80ffc10 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90b67fc700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90b6ffd700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90a800e920 tx=0x7f90a800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a8009790 con 0x7f90b80ffc10 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b8195030 con 0x7f90b80ffc10 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a800ce80 con 0x7f90b80ffc10 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a8003d60 con 0x7f90b80ffc10 2024-09-18T12:50:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.836+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b8195550 con 0x7f90b80ffc10 2024-09-18T12:50:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.838+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b8108700 con 0x7f90b80ffc10 2024-09-18T12:50:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.838+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f90a800c9d0 con 0x7f90b80ffc10 2024-09-18T12:50:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.839+0000 7f909ffff700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 0x7f90a006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.839+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f90a8014070 con 0x7f90b80ffc10 2024-09-18T12:50:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.839+0000 7f90b67fc700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 0x7f90a006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.840+0000 7f90b67fc700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 0x7f90a006e9a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009fd0 tx=0x7f90ac005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:14.847+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f90a8059d30 con 0x7f90b80ffc10 2024-09-18T12:50:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.091+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f90b81960a0 con 0x7f90b80ffc10 2024-09-18T12:50:15.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:14 smithi081 ceph-mon[27646]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:15.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:14 smithi081 ceph-mon[27646]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:15.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:14 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/884763430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.092+0000 7f909ffff700 1 -- 172.21.15.81:0/2377541575 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f90a80598c0 con 0x7f90b80ffc10 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:50:15.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 18 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:48:57.803376+0000 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:50:15.095 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:50:15.096 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.094+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 msgr2=0x7f90a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.094+0000 7f90bd412700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 0x7f90a006e9a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009fd0 tx=0x7f90ac005940 comp rx=0 tx=0).stop 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.094+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 msgr2=0x7f90b80690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.094+0000 7f90bd412700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90a800e920 tx=0x7f90a800ec30 comp rx=0 tx=0).stop 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 shutdown_connections 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90b80ffc10 0x7f90b80690e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f90a006c4e0 0x7f90a006e9a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 --2- 172.21.15.81:0/2377541575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b8100e10 0x7f90b819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 >> 172.21.15.81:0/2377541575 conn(0x7f90b80fb190 msgr2=0x7f90b8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 shutdown_connections 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.095+0000 7f90bd412700 1 -- 172.21.15.81:0/2377541575 wait complete. 2024-09-18T12:50:15.099 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-18T12:50:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 -- 172.21.15.81:0/118281805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c0ffc10 msgr2=0x7fbc5c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 --2- 172.21.15.81:0/118281805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c100030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009910 tx=0x7fbc58009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 -- 172.21.15.81:0/118281805 shutdown_connections 2024-09-18T12:50:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 --2- 172.21.15.81:0/118281805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c100e10 0x7fbc5c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 --2- 172.21.15.81:0/118281805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c100030 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.203+0000 7fbc6456e700 1 -- 172.21.15.81:0/118281805 >> 172.21.15.81:0/118281805 conn(0x7fbc5c0fb190 msgr2=0x7fbc5c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.204+0000 7fbc6456e700 1 -- 172.21.15.81:0/118281805 shutdown_connections 2024-09-18T12:50:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.204+0000 7fbc6456e700 1 -- 172.21.15.81:0/118281805 wait complete. 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.204+0000 7fbc6456e700 1 Processor -- start 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.204+0000 7fbc6456e700 1 -- start start 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6456e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6456e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6456e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c197030 con 0x7fbc5c100e10 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6456e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c197170 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc61b09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc61b09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59430/0 (socket says 172.21.15.81:59430) 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:51122/0 (socket says 172.21.15.81:51122) 2024-09-18T12:50:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc61b09700 1 -- 172.21.15.81:0/4077425860 learned_addr learned my addr 172.21.15.81:0/4077425860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 -- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 msgr2=0x7fbc5c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 -- 172.21.15.81:0/4077425860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580095f0 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc61b09700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.205+0000 7fbc6230a700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009910 tx=0x7fbc5800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.206+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc58027070 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.206+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc58023720 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.206+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5801d070 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.206+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c106050 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.206+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c106540 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.207+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c109990 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.208+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fbc58023890 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.209+0000 7fbc537fe700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 0x7fbc4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.209+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbc58090c20 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.209+0000 7fbc61b09700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 0x7fbc4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.209+0000 7fbc61b09700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 0x7fbc4806e9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0104e0 tx=0x7fbc4c007480 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.216+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbc5805f0a0 con 0x7fbc5c0ffc10 2024-09-18T12:50:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:14 smithi136 ceph-mon[35363]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:14 smithi136 ceph-mon[35363]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:14 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/884763430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:15.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.436+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5c105760 con 0x7fbc4806c4e0 2024-09-18T12:50:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.437+0000 7fbc537fe700 1 -- 172.21.15.81:0/4077425860 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbc5c105760 con 0x7fbc4806c4e0 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e image", 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:50:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 msgr2=0x7fbc4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 0x7fbc4806e9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0104e0 tx=0x7fbc4c007480 comp rx=0 tx=0).stop 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 msgr2=0x7fbc5c1964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009910 tx=0x7fbc5800bd70 comp rx=0 tx=0).stop 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 shutdown_connections 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc5c0ffc10 0x7fbc5c1964d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7fbc4806c4e0 0x7fbc4806e9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 --2- 172.21.15.81:0/4077425860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100e10 0x7fbc5c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 >> 172.21.15.81:0/4077425860 conn(0x7fbc5c0fb190 msgr2=0x7fbc5c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 shutdown_connections 2024-09-18T12:50:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.440+0000 7fbc6456e700 1 -- 172.21.15.81:0/4077425860 wait complete. 2024-09-18T12:50:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 -- 172.21.15.81:0/2638868827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc1000c0 msgr2=0x7f22fc1004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 --2- 172.21.15.81:0/2638868827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc1000c0 0x7f22fc1004e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009910 tx=0x7f22ec009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 -- 172.21.15.81:0/2638868827 shutdown_connections 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 --2- 172.21.15.81:0/2638868827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc100de0 0x7f22fc101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 --2- 172.21.15.81:0/2638868827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc1000c0 0x7f22fc1004e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 -- 172.21.15.81:0/2638868827 >> 172.21.15.81:0/2638868827 conn(0x7f22fc0fa8c0 msgr2=0x7f22fc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 -- 172.21.15.81:0/2638868827 shutdown_connections 2024-09-18T12:50:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.601+0000 7f2301109700 1 -- 172.21.15.81:0/2638868827 wait complete. 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 Processor -- start 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 -- start start 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc1000c0 0x7f22fc196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc197060 con 0x7f22fc100de0 2024-09-18T12:50:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.602+0000 7f2301109700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1971a0 con 0x7f22fc1000c0 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc1000c0 0x7f22fc196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59456/0 (socket says 172.21.15.81:59456) 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 -- 172.21.15.81:0/4223084894 learned_addr learned my addr 172.21.15.81:0/4223084894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 -- 172.21.15.81:0/4223084894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc1000c0 msgr2=0x7f22fc196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc1000c0 0x7f22fc196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 -- 172.21.15.81:0/4223084894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0095f0 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.603+0000 7f22fa59c700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f22f000e8f0 tx=0x7f22f000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.604+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0009790 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.604+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22f000c810 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.604+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0003d20 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.604+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc102060 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.604+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc102550 con 0x7f22fc100de0 2024-09-18T12:50:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.605+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc108730 con 0x7f22fc100de0 2024-09-18T12:50:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.606+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f22f00041f0 con 0x7f22fc100de0 2024-09-18T12:50:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.607+0000 7f22e3fff700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 0x7f22e406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.607+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f22f0014070 con 0x7f22fc100de0 2024-09-18T12:50:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.607+0000 7f22fad9d700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 0x7f22e406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.608+0000 7f22fad9d700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 0x7f22e406e9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00b6f0 tx=0x7f22ec005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:15.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:15.612+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f22f0059d00 con 0x7f22fc100de0 2024-09-18T12:50:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:15 smithi081 ceph-mon[27646]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:15 smithi081 ceph-mon[27646]: pgmap v250: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:15 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2377541575' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:50:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.116+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22fc108920 con 0x7f22fc100de0 2024-09-18T12:50:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.116+0000 7f22e3fff700 1 -- 172.21.15.81:0/4223084894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f22f0059890 con 0x7f22fc100de0 2024-09-18T12:50:16.118 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:50:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 msgr2=0x7f22e406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 0x7f22e406e9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00b6f0 tx=0x7f22ec005940 comp rx=0 tx=0).stop 2024-09-18T12:50:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 msgr2=0x7f22fc196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f22f000e8f0 tx=0x7f22f000ec00 comp rx=0 tx=0).stop 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 shutdown_connections 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc1000c0 0x7f22fc196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f22e406c4e0 0x7f22e406e9a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 --2- 172.21.15.81:0/4223084894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22fc100de0 0x7f22fc196a40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 >> 172.21.15.81:0/4223084894 conn(0x7f22fc0fa8c0 msgr2=0x7f22fc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 shutdown_connections 2024-09-18T12:50:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:16.119+0000 7f2301109700 1 -- 172.21.15.81:0/4223084894 wait complete. 2024-09-18T12:50:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:15 smithi136 ceph-mon[35363]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:15 smithi136 ceph-mon[35363]: pgmap v250: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:15 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2377541575' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:50:17.081 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:16 smithi136 ceph-mon[35363]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:17.081 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:16 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/4223084894' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:50:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:16 smithi081 ceph-mon[27646]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:17.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:16 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/4223084894' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:50:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:17 smithi081 ceph-mon[27646]: pgmap v251: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:18.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:17 smithi136 ceph-mon[35363]: pgmap v251: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (unknown) 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:18 smithi081 ceph-mon[27646]: Upgrade: Need to upgrade myself (mgr.smithi081.pfnvgp) 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (unknown) 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:18 smithi136 ceph-mon[35363]: Upgrade: Need to upgrade myself (mgr.smithi081.pfnvgp) 2024-09-18T12:50:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:19 smithi081 ceph-mon[27646]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi136 2024-09-18T12:50:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:19 smithi081 ceph-mon[27646]: pgmap v252: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:19 smithi136 ceph-mon[35363]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi136 2024-09-18T12:50:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:19 smithi136 ceph-mon[35363]: pgmap v252: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:21 smithi081 ceph-mon[27646]: pgmap v253: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:22.156 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:21 smithi136 ceph-mon[35363]: pgmap v253: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:23.915 INFO:tasks.workunit.client.1.smithi136.stderr:Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-18T12:50:24.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:23 smithi081 ceph-mon[27646]: pgmap v254: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:24.292 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:23 smithi136 ceph-mon[35363]: pgmap v254: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.056 INFO:tasks.workunit.client.1.smithi136.stderr: git switch -c 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr:Or undo this operation with: 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr: git switch - 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr: 2024-09-18T12:50:25.057 INFO:tasks.workunit.client.1.smithi136.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:50:25.061 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-18T12:50:25.126 INFO:tasks.workunit.client.1.smithi136.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:50:25.128 INFO:tasks.workunit.client.1.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:50:25.128 INFO:tasks.workunit.client.1.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:50:26.134 INFO:tasks.workunit.client.1.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:50:26.203 INFO:tasks.workunit.client.1.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:50:26.245 INFO:tasks.workunit.client.1.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:50:26.247 INFO:tasks.workunit.client.1.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:50:26.247 INFO:tasks.workunit.client.1.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:50:26.289 INFO:tasks.workunit.client.1.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:50:26.292 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T12:50:26.292 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-18T12:50:26.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:25 smithi136 ceph-mon[35363]: pgmap v255: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:26.329 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-18T12:50:26.330 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:50:26.331 DEBUG:teuthology.orchestra.run.smithi136:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-18T12:50:26.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:25 smithi081 ceph-mon[27646]: pgmap v255: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:26.392 INFO:tasks.workunit.client.1.smithi136.stderr:+ mkdir -p fsstress 2024-09-18T12:50:26.394 INFO:tasks.workunit.client.1.smithi136.stderr:+ pushd fsstress 2024-09-18T12:50:26.395 INFO:tasks.workunit.client.1.smithi136.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:50:26.395 INFO:tasks.workunit.client.1.smithi136.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:50:27.103 INFO:tasks.workunit.client.1.smithi136.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:50:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:27 smithi136 ceph-mon[35363]: pgmap v256: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:28.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:27 smithi081 ceph-mon[27646]: pgmap v256: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:50:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:29 smithi136 ceph-mon[35363]: pgmap v257: 65 pgs: 65 active+clean; 2.9 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 197 KiB/s wr, 0 op/s 2024-09-18T12:50:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:29 smithi081 ceph-mon[27646]: pgmap v257: 65 pgs: 65 active+clean; 2.9 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 197 KiB/s wr, 0 op/s 2024-09-18T12:50:30.717 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 83% (10618/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-18T12:50:31.538 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-09-18T12:50:31.539 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.540 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:50:31.540 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-18T12:50:31.540 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:50:31.544 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:50:31.570 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:50:31.572 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:50:31.572 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:50:32.166 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:31 smithi081 ceph-mon[27646]: pgmap v258: 65 pgs: 65 active+clean; 6.9 MiB data, 173 MiB used, 536 GiB / 536 GiB avail; 546 KiB/s wr, 0 op/s 2024-09-18T12:50:32.261 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:31 smithi136 ceph-mon[35363]: pgmap v258: 65 pgs: 65 active+clean; 6.9 MiB data, 173 MiB used, 536 GiB / 536 GiB avail; 546 KiB/s wr, 0 op/s 2024-09-18T12:50:32.516 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:50:32.578 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:50:32.617 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:50:32.619 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:50:32.619 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:50:32.658 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:50:32.661 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T12:50:32.661 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:50:32.718 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-18T12:50:32.719 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:50:32.719 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-18T12:50:32.780 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir -p fsstress 2024-09-18T12:50:32.782 INFO:tasks.workunit.client.0.smithi081.stderr:+ pushd fsstress 2024-09-18T12:50:32.782 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:50:32.782 INFO:tasks.workunit.client.0.smithi081.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:50:33.646 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:50:34.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:33 smithi136 ceph-mon[35363]: pgmap v259: 65 pgs: 65 active+clean; 8.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 702 KiB/s wr, 19 op/s 2024-09-18T12:50:34.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:33 smithi081 ceph-mon[27646]: pgmap v259: 65 pgs: 65 active+clean; 8.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 702 KiB/s wr, 19 op/s 2024-09-18T12:50:35.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:34 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:34 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:36.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:35 smithi136 ceph-mon[35363]: pgmap v260: 65 pgs: 65 active+clean; 31 MiB data, 275 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 207 op/s 2024-09-18T12:50:36.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:35 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:50:36.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:35 smithi081 ceph-mon[27646]: pgmap v260: 65 pgs: 65 active+clean; 31 MiB data, 275 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 207 op/s 2024-09-18T12:50:36.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:35 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:50:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:37 smithi136 ceph-mon[35363]: pgmap v261: 65 pgs: 65 active+clean; 41 MiB data, 302 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 253 op/s 2024-09-18T12:50:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:37 smithi081 ceph-mon[27646]: pgmap v261: 65 pgs: 65 active+clean; 41 MiB data, 302 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 253 op/s 2024-09-18T12:50:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:39 smithi136 ceph-mon[35363]: pgmap v262: 65 pgs: 65 active+clean; 57 MiB data, 342 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s wr, 294 op/s 2024-09-18T12:50:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:39 smithi081 ceph-mon[27646]: pgmap v262: 65 pgs: 65 active+clean; 57 MiB data, 342 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s wr, 294 op/s 2024-09-18T12:50:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:41 smithi081 ceph-mon[27646]: pgmap v263: 65 pgs: 65 active+clean; 69 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s wr, 373 op/s 2024-09-18T12:50:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:41 smithi136 ceph-mon[35363]: pgmap v263: 65 pgs: 65 active+clean; 69 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s wr, 373 op/s 2024-09-18T12:50:44.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:43 smithi081 ceph-mon[27646]: pgmap v264: 65 pgs: 65 active+clean; 78 MiB data, 426 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s wr, 401 op/s 2024-09-18T12:50:44.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:43 smithi136 ceph-mon[35363]: pgmap v264: 65 pgs: 65 active+clean; 78 MiB data, 426 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s wr, 401 op/s 2024-09-18T12:50:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 -- 172.21.15.81:0/1670025106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6284100dc0 msgr2=0x7f6284101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 --2- 172.21.15.81:0/1670025106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6284100dc0 0x7f6284101220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6278009910 tx=0x7f6278009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 -- 172.21.15.81:0/1670025106 shutdown_connections 2024-09-18T12:50:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 --2- 172.21.15.81:0/1670025106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6284100dc0 0x7f6284101220 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 --2- 172.21.15.81:0/1670025106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62840ffbc0 0x7f62840fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 -- 172.21.15.81:0/1670025106 >> 172.21.15.81:0/1670025106 conn(0x7f62840fb160 msgr2=0x7f62840fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.261+0000 7f628a6e0700 1 -- 172.21.15.81:0/1670025106 shutdown_connections 2024-09-18T12:50:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.262+0000 7f628a6e0700 1 -- 172.21.15.81:0/1670025106 wait complete. 2024-09-18T12:50:46.264 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:45 smithi081 ceph-mon[27646]: pgmap v265: 65 pgs: 65 active+clean; 90 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 423 op/s 2024-09-18T12:50:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.262+0000 7f628a6e0700 1 Processor -- start 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.262+0000 7f628a6e0700 1 -- start start 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f628a6e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62840ffbc0 0x7f6284103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f628a6e0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f628a6e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419a420 con 0x7f62840ffbc0 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f628a6e0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419a560 con 0x7f6284100dc0 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:54994/0 (socket says 172.21.15.81:54994) 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 -- 172.21.15.81:0/3826201418 learned_addr learned my addr 172.21.15.81:0/3826201418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f6283fff700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62840ffbc0 0x7f6284103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 -- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62840ffbc0 msgr2=0x7f6284103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62840ffbc0 0x7f6284103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.263+0000 7f62837fe700 1 -- 172.21.15.81:0/3826201418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62780095f0 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f62837fe700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6278000c00 tx=0x7f627800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f627801d070 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62841026e0 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6284102ba0 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6278005dc0 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.264+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62780226a0 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.265+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270005320 con 0x7f6284100dc0 2024-09-18T12:50:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.266+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f627800fba0 con 0x7f6284100dc0 2024-09-18T12:50:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.267+0000 7f62817fa700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 0x7f626c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.267+0000 7f6283fff700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 0x7f626c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.267+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f627808cd80 con 0x7f6284100dc0 2024-09-18T12:50:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.267+0000 7f6283fff700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 0x7f626c06e9a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6284100c20 tx=0x7f6274009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.271+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f627805b020 con 0x7f6284100dc0 2024-09-18T12:50:46.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:45 smithi136 ceph-mon[35363]: pgmap v265: 65 pgs: 65 active+clean; 90 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 423 op/s 2024-09-18T12:50:46.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.622+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6270000bf0 con 0x7f626c06c4e0 2024-09-18T12:50:46.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.624+0000 7f62817fa700 1 -- 172.21.15.81:0/3826201418 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6270000bf0 con 0x7f626c06c4e0 2024-09-18T12:50:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 msgr2=0x7f626c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 0x7f626c06e9a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6284100c20 tx=0x7f6274009260 comp rx=0 tx=0).stop 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 msgr2=0x7f62841021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6278000c00 tx=0x7f627800f740 comp rx=0 tx=0).stop 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 shutdown_connections 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f626c06c4e0 0x7f626c06e9a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62840ffbc0 0x7f6284103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 --2- 172.21.15.81:0/3826201418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6284100dc0 0x7f62841021a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.627+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 >> 172.21.15.81:0/3826201418 conn(0x7f62840fb160 msgr2=0x7f6284068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:46.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.628+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 shutdown_connections 2024-09-18T12:50:46.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.628+0000 7f628a6e0700 1 -- 172.21.15.81:0/3826201418 wait complete. 2024-09-18T12:50:46.643 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:50:46.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.771+0000 7f8ffcd79700 1 -- 172.21.15.81:0/103303028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff8100520 msgr2=0x7f8ff8100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.771+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/103303028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff8100520 0x7f8ff8100980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009910 tx=0x7f8fec009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:46.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 -- 172.21.15.81:0/103303028 shutdown_connections 2024-09-18T12:50:46.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/103303028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff8100520 0x7f8ff8100980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/103303028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff80ff320 0x7f8ff80ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 -- 172.21.15.81:0/103303028 >> 172.21.15.81:0/103303028 conn(0x7f8ff80fa8c0 msgr2=0x7f8ff80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 -- 172.21.15.81:0/103303028 shutdown_connections 2024-09-18T12:50:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.772+0000 7f8ffcd79700 1 -- 172.21.15.81:0/103303028 wait complete. 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 Processor -- start 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 -- start start 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 0x7f8ff8196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff8197060 con 0x7f8ff80ff320 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ffcd79700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff81971a0 con 0x7f8ff8100520 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ff659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ff659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38862/0 (socket says 172.21.15.81:38862) 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.773+0000 7f8ff659c700 1 -- 172.21.15.81:0/3818950689 learned_addr learned my addr 172.21.15.81:0/3818950689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff5d9b700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 0x7f8ff8196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff659c700 1 -- 172.21.15.81:0/3818950689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 msgr2=0x7f8ff8196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff659c700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 0x7f8ff8196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff659c700 1 -- 172.21.15.81:0/3818950689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0095f0 con 0x7f8ff80ff320 2024-09-18T12:50:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff5d9b700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 0x7f8ff8196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8ff659c700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800d900 tx=0x7f8fe800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe800b920 con 0x7f8ff80ff320 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8fe8010460 con 0x7f8ff80ff320 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.774+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe800f590 con 0x7f8ff80ff320 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.775+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff819bc50 con 0x7f8ff80ff320 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.775+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff819c1a0 con 0x7f8ff80ff320 2024-09-18T12:50:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.776+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff81075f0 con 0x7f8ff80ff320 2024-09-18T12:50:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.777+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8fe80105d0 con 0x7f8ff80ff320 2024-09-18T12:50:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.777+0000 7f8fe77fe700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 0x7f8fe006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.777+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8fe808afb0 con 0x7f8ff80ff320 2024-09-18T12:50:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.777+0000 7f8ff5d9b700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 0x7f8fe006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.778+0000 7f8ff5d9b700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 0x7f8fe006ea40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c6d0 tx=0x7f8fec005fb0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:46.782+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8fe8059390 con 0x7f8ff80ff320 2024-09-18T12:50:47.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.178+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ff80fcc10 con 0x7f8fe006c580 2024-09-18T12:50:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.181+0000 7f8fe77fe700 1 -- 172.21.15.81:0/3818950689 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f8ff80fcc10 con 0x7f8fe006c580 2024-09-18T12:50:47.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.184+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 msgr2=0x7f8fe006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:47.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.184+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 0x7f8fe006ea40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c6d0 tx=0x7f8fec005fb0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.184+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 msgr2=0x7f8ff8196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:47.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.184+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800d900 tx=0x7f8fe800dc10 comp rx=0 tx=0).stop 2024-09-18T12:50:47.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:46 smithi081 ceph-mon[27646]: pgmap v266: 65 pgs: 65 active+clean; 97 MiB data, 486 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 238 op/s 2024-09-18T12:50:47.187 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:46 smithi081 ceph-mon[27646]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.185+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 shutdown_connections 2024-09-18T12:50:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.185+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f8fe006c580 0x7f8fe006ea40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.185+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ff80ff320 0x7f8ff8196500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.185+0000 7f8ffcd79700 1 --2- 172.21.15.81:0/3818950689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ff8100520 0x7f8ff8196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.185+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 >> 172.21.15.81:0/3818950689 conn(0x7f8ff80fa8c0 msgr2=0x7f8ff80fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:47.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.186+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 shutdown_connections 2024-09-18T12:50:47.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.187+0000 7f8ffcd79700 1 -- 172.21.15.81:0/3818950689 wait complete. 2024-09-18T12:50:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:46 smithi136 ceph-mon[35363]: pgmap v266: 65 pgs: 65 active+clean; 97 MiB data, 486 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 238 op/s 2024-09-18T12:50:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:46 smithi136 ceph-mon[35363]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:47.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.385+0000 7f5f61f88700 1 -- 172.21.15.81:0/3756398549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 msgr2=0x7f5f5c101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 --2- 172.21.15.81:0/3756398549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c101960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009fc0 tx=0x7f5f5401c340 comp rx=0 tx=0).stop 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 -- 172.21.15.81:0/3756398549 shutdown_connections 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 --2- 172.21.15.81:0/3756398549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f5c101ea0 0x7f5f5c104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 --2- 172.21.15.81:0/3756398549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c101960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 -- 172.21.15.81:0/3756398549 >> 172.21.15.81:0/3756398549 conn(0x7f5f5c0fb150 msgr2=0x7f5f5c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 -- 172.21.15.81:0/3756398549 shutdown_connections 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.386+0000 7f5f61f88700 1 -- 172.21.15.81:0/3756398549 wait complete. 2024-09-18T12:50:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.387+0000 7f5f61f88700 1 Processor -- start 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f61f88700 1 -- start start 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f61f88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f61f88700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f5c101ea0 0x7f5f5c107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f61f88700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c107b70 con 0x7f5f5c0ff530 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f61f88700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c107cb0 con 0x7f5f5c101ea0 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.390+0000 7f5f5b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38888/0 (socket says 172.21.15.81:38888) 2024-09-18T12:50:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 -- 172.21.15.81:0/856609047 learned_addr learned my addr 172.21.15.81:0/856609047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 -- 172.21.15.81:0/856609047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f5c101ea0 msgr2=0x7f5f5c107550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-18T12:50:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f5c101ea0 0x7f5f5c107550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 -- 172.21.15.81:0/856609047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f54009d00 con 0x7f5f5c0ff530 2024-09-18T12:50:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.391+0000 7f5f5b7fe700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006070 tx=0x7f5f5401ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.397+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f54003a00 con 0x7f5f5c0ff530 2024-09-18T12:50:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.397+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f54003b60 con 0x7f5f5c0ff530 2024-09-18T12:50:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.397+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5402f680 con 0x7f5f5c0ff530 2024-09-18T12:50:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.397+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c10c5c0 con 0x7f5f5c0ff530 2024-09-18T12:50:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.398+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c10cb10 con 0x7f5f5c0ff530 2024-09-18T12:50:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.404+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f5f54003cd0 con 0x7f5f5c0ff530 2024-09-18T12:50:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.404+0000 7f5f58ff9700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 0x7f5f4406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.405+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5f5409d7f0 con 0x7f5f5c0ff530 2024-09-18T12:50:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.405+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48005320 con 0x7f5f5c0ff530 2024-09-18T12:50:47.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.410+0000 7f5f5affd700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 0x7f5f4406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.415+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5f5406bb10 con 0x7f5f5c0ff530 2024-09-18T12:50:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.419+0000 7f5f5affd700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 0x7f5f4406eac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009710 tx=0x7f5f4c006c60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.843+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f48000bf0 con 0x7f5f4406c600 2024-09-18T12:50:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.875+0000 7f5f58ff9700 1 -- 172.21.15.81:0/856609047 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f5f48000bf0 con 0x7f5f4406c600 2024-09-18T12:50:47.876 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:47.876 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (6m) 97s ago 8m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (8m) 97s ago 8m 7532k - 18.2.1 5be31c24972a 2dd4371065e4 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (7m) 104s ago 7m 7306k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (8m) 97s ago 8m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (7m) 104s ago 7m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 97s ago 8m 83.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (118s) 97s ago 118s 18.3M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (2m) 97s ago 2m 16.6M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (116s) 104s ago 115s 15.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (2m) 104s ago 2m 11.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (9m) 97s ago 9m 488M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:50:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (7m) 104s ago 7m 442M - 18.2.1 5be31c24972a d081f5286368 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (9m) 97s ago 9m 47.0M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (7m) 104s ago 7m 37.0M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 97s ago 8m 16.3M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (7m) 104s ago 7m 15.0M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 97s ago 5m 49.6M 3946M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 97s ago 5m 48.5M 3946M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 97s ago 4m 48.8M 3946M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (4m) 104s ago 4m 47.3M 4970M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (4m) 104s ago 4m 46.8M 4970M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (3m) 104s ago 3m 41.7M 4970M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:50:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 97s ago 7m 59.0M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:50:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 msgr2=0x7f5f4406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 0x7f5f4406eac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009710 tx=0x7f5f4c006c60 comp rx=0 tx=0).stop 2024-09-18T12:50:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 msgr2=0x7f5f5c107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006070 tx=0x7f5f5401ce20 comp rx=0 tx=0).stop 2024-09-18T12:50:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 shutdown_connections 2024-09-18T12:50:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f5f4406c600 0x7f5f4406eac0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f5c0ff530 0x7f5f5c107010 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 --2- 172.21.15.81:0/856609047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f5c101ea0 0x7f5f5c107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.879+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 >> 172.21.15.81:0/856609047 conn(0x7f5f5c0fb150 msgr2=0x7f5f5c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.881+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 shutdown_connections 2024-09-18T12:50:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:47.883+0000 7f5f61f88700 1 -- 172.21.15.81:0/856609047 wait complete. 2024-09-18T12:50:48.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.086+0000 7f238aaad700 1 -- 172.21.15.81:0/1462947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2384074dc0 msgr2=0x7f2384073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.086+0000 7f238aaad700 1 --2- 172.21.15.81:0/1462947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2384074dc0 0x7f2384073220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f237c00b0a0 tx=0x7f237c00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.091+0000 7f238aaad700 1 -- 172.21.15.81:0/1462947041 shutdown_connections 2024-09-18T12:50:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.091+0000 7f238aaad700 1 --2- 172.21.15.81:0/1462947041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23840737f0 0x7f2384073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.091+0000 7f238aaad700 1 --2- 172.21.15.81:0/1462947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2384074dc0 0x7f2384073220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.091+0000 7f238aaad700 1 -- 172.21.15.81:0/1462947041 >> 172.21.15.81:0/1462947041 conn(0x7f23840fc230 msgr2=0x7f23840fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.092+0000 7f238aaad700 1 -- 172.21.15.81:0/1462947041 shutdown_connections 2024-09-18T12:50:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.093+0000 7f238aaad700 1 -- 172.21.15.81:0/1462947041 wait complete. 2024-09-18T12:50:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 Processor -- start 2024-09-18T12:50:48.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:47 smithi081 ceph-mon[27646]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:48.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:47 smithi081 ceph-mon[27646]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 -- start start 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2384074dc0 0x7f2384072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840729b0 con 0x7f2384074dc0 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.094+0000 7f238aaad700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384072af0 con 0x7f23840737f0 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.095+0000 7f2388849700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.095+0000 7f2388849700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55038/0 (socket says 172.21.15.81:55038) 2024-09-18T12:50:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.095+0000 7f2388849700 1 -- 172.21.15.81:0/3269262327 learned_addr learned my addr 172.21.15.81:0/3269262327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.096+0000 7f2383fff700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2384074dc0 0x7f2384072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.097+0000 7f2388849700 1 -- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2384074dc0 msgr2=0x7f2384072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.097+0000 7f2388849700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2384074dc0 0x7f2384072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.098+0000 7f2388849700 1 -- 172.21.15.81:0/3269262327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009d00 con 0x7f23840737f0 2024-09-18T12:50:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.099+0000 7f2388849700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f237c015040 tx=0x7f237c0075c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.102+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f237c00e040 con 0x7f23840737f0 2024-09-18T12:50:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.102+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f237c003de0 con 0x7f23840737f0 2024-09-18T12:50:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.102+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f237c01da10 con 0x7f23840737f0 2024-09-18T12:50:48.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.104+0000 7f238aaad700 1 -- 172.21.15.81:0/3269262327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23841aaa20 con 0x7f23840737f0 2024-09-18T12:50:48.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.105+0000 7f238aaad700 1 -- 172.21.15.81:0/3269262327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841aae20 con 0x7f23840737f0 2024-09-18T12:50:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.107+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238410fe20 con 0x7f23840737f0 2024-09-18T12:50:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.111+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f237c01db70 con 0x7f23840737f0 2024-09-18T12:50:48.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.112+0000 7f2381ffb700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 0x7f236c06eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.112+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f237c08cc60 con 0x7f23840737f0 2024-09-18T12:50:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.118+0000 7f2383fff700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 0x7f236c06eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.119+0000 7f2383fff700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 0x7f236c06eb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2384074af0 tx=0x7f2378009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.123+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f237c05af80 con 0x7f23840737f0 2024-09-18T12:50:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:47 smithi136 ceph-mon[35363]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:47 smithi136 ceph-mon[35363]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.714+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f238410ffb0 con 0x7f23840737f0 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.717+0000 7f2381ffb700 1 -- 172.21.15.81:0/3269262327 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f237c05ab10 con 0x7f23840737f0 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:50:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:50:48.719 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.722+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 msgr2=0x7f236c06eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.722+0000 7f236b7fe700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 0x7f236c06eb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2384074af0 tx=0x7f2378009260 comp rx=0 tx=0).stop 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.722+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 msgr2=0x7f2384071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.722+0000 7f236b7fe700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f237c015040 tx=0x7f237c0075c0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.723+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 shutdown_connections 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.723+0000 7f236b7fe700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23840737f0 0x7f2384071e50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.723+0000 7f236b7fe700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f236c06c650 0x7f236c06eb10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.723+0000 7f236b7fe700 1 --2- 172.21.15.81:0/3269262327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2384074dc0 0x7f2384072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.723+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 >> 172.21.15.81:0/3269262327 conn(0x7f23840fc230 msgr2=0x7f2384102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.724+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 shutdown_connections 2024-09-18T12:50:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.725+0000 7f236b7fe700 1 -- 172.21.15.81:0/3269262327 wait complete. 2024-09-18T12:50:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.910+0000 7f7f11704700 1 -- 172.21.15.81:0/452973971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 msgr2=0x7f7f0c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.910+0000 7f7f11704700 1 --2- 172.21.15.81:0/452973971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c101270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009910 tx=0x7f7ef4009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.910+0000 7f7f09ffb700 1 -- 172.21.15.81:0/452973971 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef400baf0 con 0x7f7f0c100e10 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 -- 172.21.15.81:0/452973971 shutdown_connections 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 --2- 172.21.15.81:0/452973971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c101270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 --2- 172.21.15.81:0/452973971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 -- 172.21.15.81:0/452973971 >> 172.21.15.81:0/452973971 conn(0x7f7f0c0fb190 msgr2=0x7f7f0c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 -- 172.21.15.81:0/452973971 shutdown_connections 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 -- 172.21.15.81:0/452973971 wait complete. 2024-09-18T12:50:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.911+0000 7f7f11704700 1 Processor -- start 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f11704700 1 -- start start 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f11704700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f11704700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f11704700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10cf50 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f11704700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10d090 con 0x7f7f0c100e10 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f0affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f0affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38910/0 (socket says 172.21.15.81:38910) 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f0affd700 1 -- 172.21.15.81:0/1653104374 learned_addr learned my addr 172.21.15.81:0/1653104374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.912+0000 7f7f0a7fc700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f0affd700 1 -- 172.21.15.81:0/1653104374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 msgr2=0x7f7f0c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f0affd700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f0affd700 1 -- 172.21.15.81:0/1653104374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40095f0 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f0a7fc700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f0affd700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400e920 tx=0x7f7f0400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f04009790 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f0400ce80 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.913+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f04003d60 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.914+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c072c70 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.914+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c071370 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.915+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c107630 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.916+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f7f0400c9d0 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.916+0000 7f7f03fff700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 0x7f7ef806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:48.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.917+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7f04014070 con 0x7f7f0c0ffc10 2024-09-18T12:50:48.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.917+0000 7f7f0a7fc700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 0x7f7ef806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:48.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.918+0000 7f7f0a7fc700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 0x7f7ef806e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400b6f0 tx=0x7f7ef4005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:48.924+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7f04059d80 con 0x7f7f0c0ffc10 2024-09-18T12:50:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:48 smithi081 ceph-mon[27646]: pgmap v267: 65 pgs: 65 active+clean; 116 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 338 op/s 2024-09-18T12:50:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:48 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3269262327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:48 smithi136 ceph-mon[35363]: pgmap v267: 65 pgs: 65 active+clean; 116 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 338 op/s 2024-09-18T12:50:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:48 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3269262327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.385+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f0c1a3100 con 0x7f7f0c0ffc10 2024-09-18T12:50:49.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.387+0000 7f7f03fff700 1 -- 172.21.15.81:0/1653104374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f7f04059910 con 0x7f7f0c0ffc10 2024-09-18T12:50:49.389 INFO:teuthology.orchestra.run.smithi081.stdout:e19 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 19 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:50:34.867341+0000 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:50:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:50:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:50:49.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:50:49.393 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:49.393 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:50:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.394+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 msgr2=0x7f7ef806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.394+0000 7f7f11704700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 0x7f7ef806e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400b6f0 tx=0x7f7ef4005940 comp rx=0 tx=0).stop 2024-09-18T12:50:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.394+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 msgr2=0x7f7f0c072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.394+0000 7f7f11704700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400e920 tx=0x7f7f0400ec30 comp rx=0 tx=0).stop 2024-09-18T12:50:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.394+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 shutdown_connections 2024-09-18T12:50:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.395+0000 7f7f11704700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f7ef806c530 0x7f7ef806e9f0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400b6f0 tx=0x7f7ef4005940 comp rx=0 tx=0).stop 2024-09-18T12:50:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.395+0000 7f7f11704700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f0c0ffc10 0x7f7f0c072610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.395+0000 7f7f11704700 1 --2- 172.21.15.81:0/1653104374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f0c100e10 0x7f7f0c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.395+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 >> 172.21.15.81:0/1653104374 conn(0x7f7f0c0fb190 msgr2=0x7f7f0c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.396+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 shutdown_connections 2024-09-18T12:50:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.396+0000 7f7f11704700 1 -- 172.21.15.81:0/1653104374 wait complete. 2024-09-18T12:50:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2024-09-18T12:50:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.606+0000 7f64e27ea700 1 -- 172.21.15.81:0/955469673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc101ea0 msgr2=0x7f64dc102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.606+0000 7f64e27ea700 1 --2- 172.21.15.81:0/955469673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc101ea0 0x7f64dc102300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009910 tx=0x7f64c4009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.608+0000 7f64e27ea700 1 -- 172.21.15.81:0/955469673 shutdown_connections 2024-09-18T12:50:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.608+0000 7f64e27ea700 1 --2- 172.21.15.81:0/955469673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc101ea0 0x7f64dc102300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.608+0000 7f64e27ea700 1 --2- 172.21.15.81:0/955469673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc100ca0 0x7f64dc1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.608+0000 7f64e27ea700 1 -- 172.21.15.81:0/955469673 >> 172.21.15.81:0/955469673 conn(0x7f64dc0fc260 msgr2=0x7f64dc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:49.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.613+0000 7f64e27ea700 1 -- 172.21.15.81:0/955469673 shutdown_connections 2024-09-18T12:50:49.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.613+0000 7f64e27ea700 1 -- 172.21.15.81:0/955469673 wait complete. 2024-09-18T12:50:49.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.614+0000 7f64e27ea700 1 Processor -- start 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.614+0000 7f64e27ea700 1 -- start start 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.615+0000 7f64e27ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc100ca0 0x7f64dc071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.615+0000 7f64e27ea700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.615+0000 7f64e27ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc072920 con 0x7f64dc100ca0 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.615+0000 7f64e27ea700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1a64a0 con 0x7f64dc101ea0 2024-09-18T12:50:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.616+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.616+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55058/0 (socket says 172.21.15.81:55058) 2024-09-18T12:50:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.616+0000 7f64db7fe700 1 -- 172.21.15.81:0/2774288723 learned_addr learned my addr 172.21.15.81:0/2774288723 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.618+0000 7f64db7fe700 1 -- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc100ca0 msgr2=0x7f64dc071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.618+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc100ca0 0x7f64dc071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.618+0000 7f64db7fe700 1 -- 172.21.15.81:0/2774288723 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40095f0 con 0x7f64dc101ea0 2024-09-18T12:50:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.618+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64c400bd70 tx=0x7f64c400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.618+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c401d070 con 0x7f64dc101ea0 2024-09-18T12:50:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.619+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64c4022470 con 0x7f64dc101ea0 2024-09-18T12:50:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.619+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c400f690 con 0x7f64dc101ea0 2024-09-18T12:50:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.619+0000 7f64e27ea700 1 -- 172.21.15.81:0/2774288723 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc1a6640 con 0x7f64dc101ea0 2024-09-18T12:50:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.619+0000 7f64e27ea700 1 -- 172.21.15.81:0/2774288723 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc1a6ae0 con 0x7f64dc101ea0 2024-09-18T12:50:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.624+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f64c4004b10 con 0x7f64dc101ea0 2024-09-18T12:50:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.624+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc10baa0 con 0x7f64dc101ea0 2024-09-18T12:50:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.625+0000 7f64d97fa700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 0x7f64c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.625+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f64c408cf10 con 0x7f64dc101ea0 2024-09-18T12:50:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.630+0000 7f64dbfff700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 0x7f64c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.632+0000 7f64dbfff700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 0x7f64c806e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64dc101d00 tx=0x7f64cc009250 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:49.635+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f64c405b260 con 0x7f64dc101ea0 2024-09-18T12:50:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.075+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64dc10bc30 con 0x7f64c806c530 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.077+0000 7f64d97fa700 1 -- 172.21.15.81:0/2774288723 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f64dc10bc30 con 0x7f64c806c530 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "0/23 daemons upgraded", 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 image on host smithi136", 2024-09-18T12:50:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:50:50.079 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:50:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 msgr2=0x7f64c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 0x7f64c806e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64dc101d00 tx=0x7f64cc009250 comp rx=0 tx=0).stop 2024-09-18T12:50:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 msgr2=0x7f64dc072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64c400bd70 tx=0x7f64c400be50 comp rx=0 tx=0).stop 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 shutdown_connections 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f64c806c530 0x7f64c806e9f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc100ca0 0x7f64dc071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 --2- 172.21.15.81:0/2774288723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64dc101ea0 0x7f64dc072300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 >> 172.21.15.81:0/2774288723 conn(0x7f64dc0fc260 msgr2=0x7f64dc1050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 shutdown_connections 2024-09-18T12:50:50.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.080+0000 7f64d2ffd700 1 -- 172.21.15.81:0/2774288723 wait complete. 2024-09-18T12:50:50.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.209+0000 7f14c14c5700 1 -- 172.21.15.81:0/1232532867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc100520 msgr2=0x7f14bc100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.209+0000 7f14c14c5700 1 --2- 172.21.15.81:0/1232532867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc100520 0x7f14bc100980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009910 tx=0x7f14b0009c20 comp rx=0 tx=0).stop 2024-09-18T12:50:50.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 -- 172.21.15.81:0/1232532867 shutdown_connections 2024-09-18T12:50:50.212 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:49 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1653104374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:50:50.212 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:49 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 --2- 172.21.15.81:0/1232532867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc100520 0x7f14bc100980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 --2- 172.21.15.81:0/1232532867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc0ff320 0x7f14bc0ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 -- 172.21.15.81:0/1232532867 >> 172.21.15.81:0/1232532867 conn(0x7f14bc0fa8c0 msgr2=0x7f14bc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 -- 172.21.15.81:0/1232532867 shutdown_connections 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.210+0000 7f14c14c5700 1 -- 172.21.15.81:0/1232532867 wait complete. 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 Processor -- start 2024-09-18T12:50:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 -- start start 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0ff320 0x7f14bc196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc196fe0 con 0x7f14bc0ff320 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14c14c5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc197120 con 0x7f14bc100520 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14ba7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.211+0000 7f14ba7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55076/0 (socket says 172.21.15.81:55076) 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14ba7fc700 1 -- 172.21.15.81:0/3044031394 learned_addr learned my addr 172.21.15.81:0/3044031394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14baffd700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0ff320 0x7f14bc196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14ba7fc700 1 -- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0ff320 msgr2=0x7f14bc196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14ba7fc700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0ff320 0x7f14bc196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14ba7fc700 1 -- 172.21.15.81:0/3044031394 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00095f0 con 0x7f14bc100520 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14ba7fc700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b001d070 con 0x7f14bc100520 2024-09-18T12:50:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc19bb70 con 0x7f14bc100520 2024-09-18T12:50:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc19c060 con 0x7f14bc100520 2024-09-18T12:50:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f14b0005dc0 con 0x7f14bc100520 2024-09-18T12:50:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.212+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b00226a0 con 0x7f14bc100520 2024-09-18T12:50:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.214+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a8005320 con 0x7f14bc100520 2024-09-18T12:50:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.215+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f14b0022800 con 0x7f14bc100520 2024-09-18T12:50:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.215+0000 7f14a3fff700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 0x7f14a406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.215+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f14b008cc90 con 0x7f14bc100520 2024-09-18T12:50:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.215+0000 7f14baffd700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 0x7f14a406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.216+0000 7f14baffd700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 0x7f14a406e9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14bc100380 tx=0x7f14ac009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.221+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f14b005afc0 con 0x7f14bc100520 2024-09-18T12:50:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:49 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1653104374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:50:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:49 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:50.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.572+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f14a8005190 con 0x7f14bc100520 2024-09-18T12:50:50.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.573+0000 7f14a3fff700 1 -- 172.21.15.81:0/3044031394 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f14b005ab50 con 0x7f14bc100520 2024-09-18T12:50:50.575 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:50:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 msgr2=0x7f14a406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 0x7f14a406e9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14bc100380 tx=0x7f14ac009260 comp rx=0 tx=0).stop 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 msgr2=0x7f14bc1969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b000f740 comp rx=0 tx=0).stop 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 shutdown_connections 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f14a406c4e0 0x7f14a406e9a0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14bc100380 tx=0x7f14ac009260 comp rx=0 tx=0).stop 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0ff320 0x7f14bc196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 --2- 172.21.15.81:0/3044031394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14bc100520 0x7f14bc1969c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 >> 172.21.15.81:0/3044031394 conn(0x7f14bc0fa8c0 msgr2=0x7f14bc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 shutdown_connections 2024-09-18T12:50:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:50:50.576+0000 7f14c14c5700 1 -- 172.21.15.81:0/3044031394 wait complete. 2024-09-18T12:50:51.270 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:50 smithi136 ceph-mon[35363]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:51.270 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:50 smithi136 ceph-mon[35363]: pgmap v268: 65 pgs: 65 active+clean; 139 MiB data, 642 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 638 op/s 2024-09-18T12:50:51.270 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:50 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3044031394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:50:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:50 smithi081 ceph-mon[27646]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:50 smithi081 ceph-mon[27646]: pgmap v268: 65 pgs: 65 active+clean; 139 MiB data, 642 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 638 op/s 2024-09-18T12:50:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:50 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3044031394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:50:53.295 INFO:tasks.workunit.client.1.smithi136.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:50:53.296 INFO:tasks.workunit.client.1.smithi136.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:50:53.296 INFO:tasks.workunit.client.1.smithi136.stderr:+ make 2024-09-18T12:50:53.726 INFO:tasks.workunit.client.1.smithi136.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: pgmap v269: 65 pgs: 65 active+clean; 151 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 726 op/s 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: Upgrade: Updating mgr.smithi136.vdkrdt 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:53.991 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:53 smithi136 ceph-mon[35363]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: pgmap v269: 65 pgs: 65 active+clean; 151 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 726 op/s 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: Upgrade: Updating mgr.smithi136.vdkrdt 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:53 smithi081 ceph-mon[27646]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:50:55.697 INFO:tasks.workunit.client.1.smithi136.stderr:++ readlink -f fsstress 2024-09-18T12:50:55.698 INFO:tasks.workunit.client.1.smithi136.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:50:55.698 INFO:tasks.workunit.client.1.smithi136.stderr:+ popd 2024-09-18T12:50:55.699 INFO:tasks.workunit.client.1.smithi136.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:50:55.699 INFO:tasks.workunit.client.1.smithi136.stderr:+ popd 2024-09-18T12:50:55.700 INFO:tasks.workunit.client.1.smithi136.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:50:55.700 INFO:tasks.workunit.client.1.smithi136.stderr:++ mktemp -d -p . 2024-09-18T12:50:55.701 INFO:tasks.workunit.client.1.smithi136.stderr:+ T=./tmp.s9CV0n89Fr 2024-09-18T12:50:55.701 INFO:tasks.workunit.client.1.smithi136.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.s9CV0n89Fr -l 1 -n 1000 -p 10 -v 2024-09-18T12:50:55.702 INFO:tasks.workunit.client.1.smithi136.stdout:seed = 1725985919 2024-09-18T12:50:55.706 INFO:tasks.workunit.client.1.smithi136.stdout:0/0: dwrite - no filename 2024-09-18T12:50:55.706 INFO:tasks.workunit.client.1.smithi136.stdout:0/1: write - no filename 2024-09-18T12:50:55.706 INFO:tasks.workunit.client.1.smithi136.stdout:0/2: write - no filename 2024-09-18T12:50:55.706 INFO:tasks.workunit.client.1.smithi136.stdout:1/0: dwrite - no filename 2024-09-18T12:50:55.707 INFO:tasks.workunit.client.1.smithi136.stdout:0/3: symlink l0 0 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/0: rmdir - no directory 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/1: fdatasync - no filename 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/2: dread - no filename 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/3: chown . 2061 1 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/4: dread - no filename 2024-09-18T12:50:55.709 INFO:tasks.workunit.client.1.smithi136.stdout:1/1: symlink l0 0 2024-09-18T12:50:55.711 INFO:tasks.workunit.client.1.smithi136.stdout:0/4: mkdir d1 0 2024-09-18T12:50:55.711 INFO:tasks.workunit.client.1.smithi136.stdout:0/5: dread - no filename 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/6: dread - no filename 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/7: rename d1 to d1/d2 22 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/8: chown d1 651082 1 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/9: write - no filename 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/10: dwrite - no filename 2024-09-18T12:50:55.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/11: chown l0 54190 1 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:3/0: dread - no filename 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:3/1: chown . 65093 1 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:3/2: dread - no filename 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:3/3: dread - no filename 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:3/4: chown . 3422 1 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:2/5: creat f0 x:0 0 0 2024-09-18T12:50:55.713 INFO:tasks.workunit.client.1.smithi136.stdout:2/6: creat f1 x:0 0 0 2024-09-18T12:50:55.717 INFO:tasks.workunit.client.1.smithi136.stdout:3/5: symlink l0 0 2024-09-18T12:50:55.718 INFO:tasks.workunit.client.1.smithi136.stdout:1/2: creat f1 x:0 0 0 2024-09-18T12:50:55.722 INFO:tasks.workunit.client.1.smithi136.stdout:2/7: rename f0 to f2 0 2024-09-18T12:50:55.722 INFO:tasks.workunit.client.1.smithi136.stdout:2/8: readlink - no filename 2024-09-18T12:50:55.722 INFO:tasks.workunit.client.1.smithi136.stdout:2/9: write f1 [967444,108979] 0 2024-09-18T12:50:55.722 INFO:tasks.workunit.client.1.smithi136.stdout:2/10: write f2 [721018,125362] 0 2024-09-18T12:50:55.725 INFO:tasks.workunit.client.1.smithi136.stdout:3/6: unlink l0 0 2024-09-18T12:50:55.725 INFO:tasks.workunit.client.1.smithi136.stdout:3/7: chown . 6334787 1 2024-09-18T12:50:55.727 INFO:tasks.workunit.client.1.smithi136.stdout:2/11: rename f1 to f3 0 2024-09-18T12:50:55.729 INFO:tasks.workunit.client.1.smithi136.stdout:1/3: mkdir d2 0 2024-09-18T12:50:55.729 INFO:tasks.workunit.client.1.smithi136.stdout:3/8: creat f1 x:0 0 0 2024-09-18T12:50:55.729 INFO:tasks.workunit.client.1.smithi136.stdout:3/9: dread - f1 zero size 2024-09-18T12:50:55.770 INFO:tasks.workunit.client.1.smithi136.stdout:8/0: write - no filename 2024-09-18T12:50:55.770 INFO:tasks.workunit.client.1.smithi136.stdout:5/0: fsync - no filename 2024-09-18T12:50:55.770 INFO:tasks.workunit.client.1.smithi136.stdout:4/0: unlink - no file 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:4/1: write - no filename 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:5/1: stat - no entries 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:5/2: truncate - no filename 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:5/3: rmdir - no directory 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:4/2: link - no file 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:7/0: chown . 87853 1 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:7/1: chown . 385262 1 2024-09-18T12:50:55.771 INFO:tasks.workunit.client.1.smithi136.stdout:7/2: dwrite - no filename 2024-09-18T12:50:55.788 INFO:tasks.workunit.client.1.smithi136.stdout:1/4: fsync f1 0 2024-09-18T12:50:55.788 INFO:tasks.workunit.client.1.smithi136.stdout:1/5: truncate f1 357761 0 2024-09-18T12:50:55.788 INFO:tasks.workunit.client.1.smithi136.stdout:1/6: stat d2 0 2024-09-18T12:50:55.792 INFO:tasks.workunit.client.1.smithi136.stdout:7/3: mkdir d0 0 2024-09-18T12:50:55.794 INFO:tasks.workunit.client.1.smithi136.stdout:5/4: symlink l0 0 2024-09-18T12:50:55.795 INFO:tasks.workunit.client.1.smithi136.stdout:6/0: mknod c0 0 2024-09-18T12:50:55.797 INFO:tasks.workunit.client.1.smithi136.stdout:8/1: symlink l0 0 2024-09-18T12:50:55.797 INFO:tasks.workunit.client.1.smithi136.stdout:8/2: chown l0 6 1 2024-09-18T12:50:55.797 INFO:tasks.workunit.client.1.smithi136.stdout:8/3: dread - no filename 2024-09-18T12:50:55.798 INFO:tasks.workunit.client.1.smithi136.stdout:9/0: symlink l0 0 2024-09-18T12:50:55.798 INFO:tasks.workunit.client.1.smithi136.stdout:9/1: readlink l0 0 2024-09-18T12:50:55.798 INFO:tasks.workunit.client.1.smithi136.stdout:9/2: dread - no filename 2024-09-18T12:50:55.798 INFO:tasks.workunit.client.1.smithi136.stdout:9/3: write - no filename 2024-09-18T12:50:55.800 INFO:tasks.workunit.client.1.smithi136.stdout:3/10: getdents . 0 2024-09-18T12:50:55.800 INFO:tasks.workunit.client.1.smithi136.stdout:3/11: write f1 [603438,62336] 0 2024-09-18T12:50:55.810 INFO:tasks.workunit.client.1.smithi136.stdout:7/4: creat d0/f1 x:0 0 0 2024-09-18T12:50:55.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/1: creat f1 x:0 0 0 2024-09-18T12:50:55.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/2: creat f2 x:0 0 0 2024-09-18T12:50:55.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/3: read - f1 zero size 2024-09-18T12:50:55.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/4: rmdir - no directory 2024-09-18T12:50:55.812 INFO:tasks.workunit.client.1.smithi136.stdout:8/4: mknod c1 0 2024-09-18T12:50:55.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/4: symlink l1 0 2024-09-18T12:50:55.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/5: truncate - no filename 2024-09-18T12:50:55.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/6: dwrite - no filename 2024-09-18T12:50:55.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/7: write - no filename 2024-09-18T12:50:55.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/8: chown l0 1212494294 1 2024-09-18T12:50:55.814 INFO:tasks.workunit.client.1.smithi136.stdout:3/12: creat f2 x:0 0 0 2024-09-18T12:50:55.815 INFO:tasks.workunit.client.1.smithi136.stdout:7/5: symlink d0/l2 0 2024-09-18T12:50:55.816 INFO:tasks.workunit.client.1.smithi136.stdout:2/12: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.818 INFO:tasks.workunit.client.1.smithi136.stdout:6/5: symlink l3 0 2024-09-18T12:50:55.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/5: mknod c2 0 2024-09-18T12:50:55.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/9: link l1 l2 0 2024-09-18T12:50:55.825 INFO:tasks.workunit.client.1.smithi136.stdout:6/6: mknod c4 0 2024-09-18T12:50:55.825 INFO:tasks.workunit.client.1.smithi136.stdout:6/7: read - f2 zero size 2024-09-18T12:50:55.826 INFO:tasks.workunit.client.1.smithi136.stdout:8/6: creat f3 x:0 0 0 2024-09-18T12:50:55.826 INFO:tasks.workunit.client.1.smithi136.stdout:8/7: write f3 [132718,123356] 0 2024-09-18T12:50:55.827 INFO:tasks.workunit.client.1.smithi136.stdout:9/10: creat f3 x:0 0 0 2024-09-18T12:50:55.829 INFO:tasks.workunit.client.1.smithi136.stdout:3/13: mkdir d3 0 2024-09-18T12:50:55.830 INFO:tasks.workunit.client.1.smithi136.stdout:2/13: getdents . 0 2024-09-18T12:50:55.830 INFO:tasks.workunit.client.1.smithi136.stdout:2/14: stat f3 0 2024-09-18T12:50:55.830 INFO:tasks.workunit.client.1.smithi136.stdout:2/15: rmdir - no directory 2024-09-18T12:50:55.831 INFO:tasks.workunit.client.1.smithi136.stdout:9/11: mknod c4 0 2024-09-18T12:50:55.834 INFO:tasks.workunit.client.1.smithi136.stdout:3/14: symlink d3/l4 0 2024-09-18T12:50:55.835 INFO:tasks.workunit.client.1.smithi136.stdout:2/16: creat f4 x:0 0 0 2024-09-18T12:50:55.836 INFO:tasks.workunit.client.1.smithi136.stdout:9/12: symlink l5 0 2024-09-18T12:50:55.836 INFO:tasks.workunit.client.1.smithi136.stdout:9/13: write f3 [241984,36392] 0 2024-09-18T12:50:55.838 INFO:tasks.workunit.client.1.smithi136.stdout:9/14: mkdir d6 0 2024-09-18T12:50:55.839 INFO:tasks.workunit.client.1.smithi136.stdout:9/15: truncate f3 982197 0 2024-09-18T12:50:55.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/17: mkdir d5 0 2024-09-18T12:50:55.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/18: dread - f4 zero size 2024-09-18T12:50:55.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/19: truncate f4 362093 0 2024-09-18T12:50:55.841 INFO:tasks.workunit.client.1.smithi136.stdout:9/16: creat d6/f7 x:0 0 0 2024-09-18T12:50:55.843 INFO:tasks.workunit.client.1.smithi136.stdout:2/20: creat d5/f6 x:0 0 0 2024-09-18T12:50:55.845 INFO:tasks.workunit.client.1.smithi136.stdout:9/17: link d6/f7 d6/f8 0 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/5: getdents . 0 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/6: getdents . 0 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/7: dread - no filename 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/8: rmdir - no directory 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/9: dread - no filename 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/10: dread - no filename 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/11: getdents . 0 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/12: getdents . 0 2024-09-18T12:50:55.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/13: read - no filename 2024-09-18T12:50:55.850 INFO:tasks.workunit.client.1.smithi136.stdout:5/14: creat f1 x:0 0 0 2024-09-18T12:50:55.850 INFO:tasks.workunit.client.1.smithi136.stdout:5/15: write f1 [236416,83271] 0 2024-09-18T12:50:55.859 INFO:tasks.workunit.client.1.smithi136.stdout:7/6: getdents d0 0 2024-09-18T12:50:55.859 INFO:tasks.workunit.client.1.smithi136.stdout:7/7: rename d0 to d0/d3 22 2024-09-18T12:50:55.860 INFO:tasks.workunit.client.1.smithi136.stdout:7/8: mknod d0/c4 0 2024-09-18T12:50:55.862 INFO:tasks.workunit.client.1.smithi136.stdout:7/9: rename d0/f1 to d0/f5 0 2024-09-18T12:50:55.862 INFO:tasks.workunit.client.1.smithi136.stdout:7/10: readlink d0/l2 0 2024-09-18T12:50:55.864 INFO:tasks.workunit.client.1.smithi136.stdout:7/11: link d0/c4 d0/c6 0 2024-09-18T12:50:55.865 INFO:tasks.workunit.client.1.smithi136.stdout:7/12: mkdir d0/d7 0 2024-09-18T12:50:55.865 INFO:tasks.workunit.client.1.smithi136.stdout:7/13: write d0/f5 [26992,117558] 0 2024-09-18T12:50:55.866 INFO:tasks.workunit.client.1.smithi136.stdout:6/8: getdents . 0 2024-09-18T12:50:55.867 INFO:tasks.workunit.client.1.smithi136.stdout:8/8: fsync f3 0 2024-09-18T12:50:55.868 INFO:tasks.workunit.client.1.smithi136.stdout:8/9: rename l0 to l4 0 2024-09-18T12:50:55.873 INFO:tasks.workunit.client.1.smithi136.stdout:9/18: dwrite f3 [0,4194304] 0 2024-09-18T12:50:55.873 INFO:tasks.workunit.client.1.smithi136.stdout:9/19: rename d6 to d6/d9 22 2024-09-18T12:50:55.873 INFO:tasks.workunit.client.1.smithi136.stdout:5/16: dwrite f1 [0,4194304] 0 2024-09-18T12:50:55.874 INFO:tasks.workunit.client.1.smithi136.stdout:5/17: rmdir - no directory 2024-09-18T12:50:55.874 INFO:tasks.workunit.client.1.smithi136.stdout:3/15: truncate f1 330614 0 2024-09-18T12:50:55.874 INFO:tasks.workunit.client.1.smithi136.stdout:3/16: stat f1 0 2024-09-18T12:50:55.875 INFO:tasks.workunit.client.1.smithi136.stdout:3/17: chown d3 38 1 2024-09-18T12:50:55.875 INFO:tasks.workunit.client.1.smithi136.stdout:3/18: stat f1 0 2024-09-18T12:50:55.876 INFO:tasks.workunit.client.1.smithi136.stdout:9/20: mkdir d6/da 0 2024-09-18T12:50:55.877 INFO:tasks.workunit.client.1.smithi136.stdout:2/21: rmdir d5 39 2024-09-18T12:50:55.881 INFO:tasks.workunit.client.1.smithi136.stdout:3/19: rmdir d3 39 2024-09-18T12:50:55.881 INFO:tasks.workunit.client.1.smithi136.stdout:3/20: chown f1 283655388 1 2024-09-18T12:50:55.883 INFO:tasks.workunit.client.1.smithi136.stdout:6/9: dwrite f1 [0,4194304] 0 2024-09-18T12:50:55.884 INFO:tasks.workunit.client.1.smithi136.stdout:9/21: mkdir d6/db 0 2024-09-18T12:50:55.885 INFO:tasks.workunit.client.1.smithi136.stdout:2/22: mkdir d5/d7 0 2024-09-18T12:50:55.886 INFO:tasks.workunit.client.1.smithi136.stdout:3/21: mkdir d3/d5 0 2024-09-18T12:50:55.886 INFO:tasks.workunit.client.1.smithi136.stdout:3/22: fdatasync f2 0 2024-09-18T12:50:55.890 INFO:tasks.workunit.client.1.smithi136.stdout:9/22: symlink d6/db/lc 0 2024-09-18T12:50:55.890 INFO:tasks.workunit.client.1.smithi136.stdout:9/23: fdatasync f3 0 2024-09-18T12:50:55.891 INFO:tasks.workunit.client.1.smithi136.stdout:2/23: symlink d5/d7/l8 0 2024-09-18T12:50:55.894 INFO:tasks.workunit.client.1.smithi136.stdout:2/24: link f3 d5/f9 0 2024-09-18T12:50:55.895 INFO:tasks.workunit.client.1.smithi136.stdout:7/14: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:50:55.896 INFO:tasks.workunit.client.1.smithi136.stdout:8/10: dwrite f3 [0,4194304] 0 2024-09-18T12:50:55.896 INFO:tasks.workunit.client.1.smithi136.stdout:8/11: creat f5 x:0 0 0 2024-09-18T12:50:55.897 INFO:tasks.workunit.client.1.smithi136.stdout:7/15: symlink d0/l8 0 2024-09-18T12:50:55.897 INFO:tasks.workunit.client.1.smithi136.stdout:6/10: dread f1 [0,4194304] 0 2024-09-18T12:50:55.902 INFO:tasks.workunit.client.1.smithi136.stdout:3/23: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.902 INFO:tasks.workunit.client.1.smithi136.stdout:7/16: mknod d0/d7/c9 0 2024-09-18T12:50:55.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/24: read f1 [234362,82779] 0 2024-09-18T12:50:55.907 INFO:tasks.workunit.client.1.smithi136.stdout:2/25: getdents d5/d7 0 2024-09-18T12:50:55.910 INFO:tasks.workunit.client.1.smithi136.stdout:2/26: truncate d5/f9 668824 0 2024-09-18T12:50:55.913 INFO:tasks.workunit.client.1.smithi136.stdout:8/12: dread f3 [0,4194304] 0 2024-09-18T12:50:55.914 INFO:tasks.workunit.client.1.smithi136.stdout:8/13: chown f5 52725 1 2024-09-18T12:50:55.916 INFO:tasks.workunit.client.1.smithi136.stdout:8/14: rename l4 to l6 0 2024-09-18T12:50:55.916 INFO:tasks.workunit.client.1.smithi136.stdout:8/15: stat c2 0 2024-09-18T12:50:55.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/16: symlink l7 0 2024-09-18T12:50:55.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/17: dread - f5 zero size 2024-09-18T12:50:55.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/18: chown l7 121 1 2024-09-18T12:50:55.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/19: read - f5 zero size 2024-09-18T12:50:55.919 INFO:tasks.workunit.client.1.smithi136.stdout:3/25: read f2 [3809534,121501] 0 2024-09-18T12:50:55.920 INFO:tasks.workunit.client.1.smithi136.stdout:3/26: chown d3/l4 258 1 2024-09-18T12:50:55.920 INFO:tasks.workunit.client.1.smithi136.stdout:8/20: link c1 c8 0 2024-09-18T12:50:55.921 INFO:tasks.workunit.client.1.smithi136.stdout:6/11: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.922 INFO:tasks.workunit.client.1.smithi136.stdout:8/21: mkdir d9 0 2024-09-18T12:50:55.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/17: dread d0/f5 [0,4194304] 0 2024-09-18T12:50:55.922 INFO:tasks.workunit.client.1.smithi136.stdout:9/24: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:50:55.926 INFO:tasks.workunit.client.1.smithi136.stdout:8/22: creat d9/fa x:0 0 0 2024-09-18T12:50:55.929 INFO:tasks.workunit.client.1.smithi136.stdout:7/18: creat d0/fa x:0 0 0 2024-09-18T12:50:55.929 INFO:tasks.workunit.client.1.smithi136.stdout:7/19: write d0/fa [1022204,43118] 0 2024-09-18T12:50:55.929 INFO:tasks.workunit.client.1.smithi136.stdout:7/20: rename d0 to d0/d7/db 22 2024-09-18T12:50:55.929 INFO:tasks.workunit.client.1.smithi136.stdout:7/21: chown d0/fa 3427 1 2024-09-18T12:50:55.931 INFO:tasks.workunit.client.1.smithi136.stdout:9/25: creat d6/da/fd x:0 0 0 2024-09-18T12:50:55.932 INFO:tasks.workunit.client.1.smithi136.stdout:5/18: dwrite f1 [4194304,4194304] 0 2024-09-18T12:50:55.932 INFO:tasks.workunit.client.1.smithi136.stdout:5/19: fsync f1 0 2024-09-18T12:50:55.933 INFO:tasks.workunit.client.1.smithi136.stdout:7/22: mknod d0/cc 0 2024-09-18T12:50:55.933 INFO:tasks.workunit.client.1.smithi136.stdout:9/26: getdents d6/db 0 2024-09-18T12:50:55.940 INFO:tasks.workunit.client.1.smithi136.stdout:5/20: read f1 [5358415,96831] 0 2024-09-18T12:50:55.941 INFO:tasks.workunit.client.1.smithi136.stdout:5/21: creat f2 x:0 0 0 2024-09-18T12:50:55.942 INFO:tasks.workunit.client.1.smithi136.stdout:6/12: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.942 INFO:tasks.workunit.client.1.smithi136.stdout:2/27: dwrite d5/f6 [0,4194304] 0 2024-09-18T12:50:55.942 INFO:tasks.workunit.client.1.smithi136.stdout:2/28: write f4 [644376,59383] 0 2024-09-18T12:50:55.943 INFO:tasks.workunit.client.1.smithi136.stdout:5/22: symlink l3 0 2024-09-18T12:50:55.943 INFO:tasks.workunit.client.1.smithi136.stdout:5/23: readlink l3 0 2024-09-18T12:50:55.945 INFO:tasks.workunit.client.1.smithi136.stdout:6/13: creat f5 x:0 0 0 2024-09-18T12:50:55.948 INFO:tasks.workunit.client.1.smithi136.stdout:9/27: write f3 [1495439,112363] 0 2024-09-18T12:50:55.948 INFO:tasks.workunit.client.1.smithi136.stdout:9/28: getdents d6/db 0 2024-09-18T12:50:55.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/29: mknod d5/ca 0 2024-09-18T12:50:55.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/14: rename c0 to c6 0 2024-09-18T12:50:55.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/15: write f5 [772505,51278] 0 2024-09-18T12:50:55.953 INFO:tasks.workunit.client.1.smithi136.stdout:8/23: getdents d9 0 2024-09-18T12:50:55.953 INFO:tasks.workunit.client.1.smithi136.stdout:8/24: fsync d9/fa 0 2024-09-18T12:50:55.956 INFO:tasks.workunit.client.1.smithi136.stdout:9/29: rename d6/f8 to d6/db/fe 0 2024-09-18T12:50:55.957 INFO:tasks.workunit.client.1.smithi136.stdout:2/30: rmdir d5/d7 39 2024-09-18T12:50:55.958 INFO:tasks.workunit.client.1.smithi136.stdout:5/24: symlink l4 0 2024-09-18T12:50:55.958 INFO:tasks.workunit.client.1.smithi136.stdout:5/25: write f1 [5331599,44716] 0 2024-09-18T12:50:55.959 INFO:tasks.workunit.client.1.smithi136.stdout:6/16: rename f2 to f7 0 2024-09-18T12:50:55.960 INFO:tasks.workunit.client.1.smithi136.stdout:7/23: getdents d0 0 2024-09-18T12:50:55.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/25: creat d9/fb x:0 0 0 2024-09-18T12:50:55.962 INFO:tasks.workunit.client.1.smithi136.stdout:2/31: truncate d5/f9 293045 0 2024-09-18T12:50:55.964 INFO:tasks.workunit.client.1.smithi136.stdout:6/17: mkdir d8 0 2024-09-18T12:50:55.965 INFO:tasks.workunit.client.1.smithi136.stdout:7/24: rmdir d0 39 2024-09-18T12:50:55.965 INFO:tasks.workunit.client.1.smithi136.stdout:7/25: readlink d0/l8 0 2024-09-18T12:50:55.966 INFO:tasks.workunit.client.1.smithi136.stdout:8/26: read - d9/fa zero size 2024-09-18T12:50:55.966 INFO:tasks.workunit.client.1.smithi136.stdout:8/27: chown d9 48747084 1 2024-09-18T12:50:55.966 INFO:tasks.workunit.client.1.smithi136.stdout:8/28: readlink l7 0 2024-09-18T12:50:55.968 INFO:tasks.workunit.client.1.smithi136.stdout:9/30: dwrite d6/da/fd [0,4194304] 0 2024-09-18T12:50:55.969 INFO:tasks.workunit.client.1.smithi136.stdout:6/18: mkdir d8/d9 0 2024-09-18T12:50:55.969 INFO:tasks.workunit.client.1.smithi136.stdout:6/19: write f7 [4982316,101460] 0 2024-09-18T12:50:55.972 INFO:tasks.workunit.client.1.smithi136.stdout:7/26: rename d0/cc to d0/d7/cd 0 2024-09-18T12:50:55.972 INFO:tasks.workunit.client.1.smithi136.stdout:7/27: write d0/fa [2058277,63390] 0 2024-09-18T12:50:55.976 INFO:tasks.workunit.client.1.smithi136.stdout:7/28: dread d0/f5 [0,4194304] 0 2024-09-18T12:50:55.976 INFO:tasks.workunit.client.1.smithi136.stdout:5/26: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.977 INFO:tasks.workunit.client.1.smithi136.stdout:6/20: creat d8/d9/fa x:0 0 0 2024-09-18T12:50:55.981 INFO:tasks.workunit.client.1.smithi136.stdout:8/29: symlink d9/lc 0 2024-09-18T12:50:55.986 INFO:tasks.workunit.client.1.smithi136.stdout:6/21: read f1 [2085446,42699] 0 2024-09-18T12:50:55.987 INFO:tasks.workunit.client.1.smithi136.stdout:8/30: mkdir d9/dd 0 2024-09-18T12:50:55.987 INFO:tasks.workunit.client.1.smithi136.stdout:8/31: write d9/fb [951133,14619] 0 2024-09-18T12:50:55.987 INFO:tasks.workunit.client.1.smithi136.stdout:8/32: dread - f5 zero size 2024-09-18T12:50:55.990 INFO:tasks.workunit.client.1.smithi136.stdout:2/32: dwrite f2 [0,4194304] 0 2024-09-18T12:50:55.991 INFO:tasks.workunit.client.1.smithi136.stdout:2/33: mknod d5/cb 0 2024-09-18T12:50:56.005 INFO:tasks.workunit.client.1.smithi136.stdout:7/29: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:50:56.005 INFO:tasks.workunit.client.1.smithi136.stdout:6/22: dwrite f1 [4194304,4194304] 0 2024-09-18T12:50:56.005 INFO:tasks.workunit.client.1.smithi136.stdout:5/27: dwrite f2 [0,4194304] 0 2024-09-18T12:50:56.005 INFO:tasks.workunit.client.1.smithi136.stdout:5/28: write f1 [7887603,13089] 0 2024-09-18T12:50:56.006 INFO:tasks.workunit.client.1.smithi136.stdout:7/30: symlink d0/le 0 2024-09-18T12:50:56.008 INFO:tasks.workunit.client.1.smithi136.stdout:6/23: getdents d8 0 2024-09-18T12:50:56.008 INFO:tasks.workunit.client.1.smithi136.stdout:6/24: creat d8/d9/fb x:0 0 0 2024-09-18T12:50:56.012 INFO:tasks.workunit.client.1.smithi136.stdout:6/25: mkdir d8/dc 0 2024-09-18T12:50:56.012 INFO:tasks.workunit.client.1.smithi136.stdout:7/31: write d0/f5 [1969565,116143] 0 2024-09-18T12:50:56.013 INFO:tasks.workunit.client.1.smithi136.stdout:2/34: getdents d5 0 2024-09-18T12:50:56.013 INFO:tasks.workunit.client.1.smithi136.stdout:2/35: write d5/f9 [612515,98316] 0 2024-09-18T12:50:56.013 INFO:tasks.workunit.client.1.smithi136.stdout:2/36: fdatasync d5/f6 0 2024-09-18T12:50:56.013 INFO:tasks.workunit.client.1.smithi136.stdout:2/37: getdents d5 0 2024-09-18T12:50:56.014 INFO:tasks.workunit.client.1.smithi136.stdout:2/38: chown d5/cb 59448168 1 2024-09-18T12:50:56.014 INFO:tasks.workunit.client.1.smithi136.stdout:5/29: mkdir d5 0 2024-09-18T12:50:56.017 INFO:tasks.workunit.client.1.smithi136.stdout:7/32: rename d0/f5 to d0/d7/ff 0 2024-09-18T12:50:56.017 INFO:tasks.workunit.client.1.smithi136.stdout:7/33: chown d0/c4 26794102 1 2024-09-18T12:50:56.019 INFO:tasks.workunit.client.1.smithi136.stdout:5/30: mknod d5/c6 0 2024-09-18T12:50:56.019 INFO:tasks.workunit.client.1.smithi136.stdout:2/39: dread f2 [0,4194304] 0 2024-09-18T12:50:56.019 INFO:tasks.workunit.client.1.smithi136.stdout:2/40: stat d5/f6 0 2024-09-18T12:50:56.021 INFO:tasks.workunit.client.1.smithi136.stdout:5/31: mknod d5/c7 0 2024-09-18T12:50:56.023 INFO:tasks.workunit.client.1.smithi136.stdout:7/34: truncate d0/fa 379148 0 2024-09-18T12:50:56.023 INFO:tasks.workunit.client.1.smithi136.stdout:7/35: readlink d0/le 0 2024-09-18T12:50:56.023 INFO:tasks.workunit.client.1.smithi136.stdout:6/26: getdents d8/d9 0 2024-09-18T12:50:56.023 INFO:tasks.workunit.client.1.smithi136.stdout:6/27: write f5 [1211396,119955] 0 2024-09-18T12:50:56.025 INFO:tasks.workunit.client.1.smithi136.stdout:5/32: unlink f1 0 2024-09-18T12:50:56.030 INFO:tasks.workunit.client.1.smithi136.stdout:6/28: mknod d8/dc/cd 0 2024-09-18T12:50:56.031 INFO:tasks.workunit.client.1.smithi136.stdout:6/29: mkdir d8/d9/de 0 2024-09-18T12:50:56.032 INFO:tasks.workunit.client.1.smithi136.stdout:6/30: creat d8/dc/ff x:0 0 0 2024-09-18T12:50:56.036 INFO:tasks.workunit.client.1.smithi136.stdout:2/41: truncate d5/f9 312060 0 2024-09-18T12:50:56.036 INFO:tasks.workunit.client.1.smithi136.stdout:2/42: getdents d5/d7 0 2024-09-18T12:50:56.036 INFO:tasks.workunit.client.1.smithi136.stdout:2/43: readlink d5/d7/l8 0 2024-09-18T12:50:56.037 INFO:tasks.workunit.client.1.smithi136.stdout:7/36: dread d0/fa [0,4194304] 0 2024-09-18T12:50:56.038 INFO:tasks.workunit.client.1.smithi136.stdout:2/44: symlink d5/d7/lc 0 2024-09-18T12:50:56.038 INFO:tasks.workunit.client.1.smithi136.stdout:2/45: fdatasync d5/f9 0 2024-09-18T12:50:56.039 INFO:tasks.workunit.client.1.smithi136.stdout:7/37: symlink d0/l10 0 2024-09-18T12:50:56.041 INFO:tasks.workunit.client.1.smithi136.stdout:7/38: mkdir d0/d11 0 2024-09-18T12:50:56.041 INFO:tasks.workunit.client.1.smithi136.stdout:5/33: dwrite f2 [0,4194304] 0 2024-09-18T12:50:56.043 INFO:tasks.workunit.client.1.smithi136.stdout:5/34: chown l0 48 1 2024-09-18T12:50:56.045 INFO:tasks.workunit.client.1.smithi136.stdout:7/39: fdatasync d0/d7/ff 0 2024-09-18T12:50:56.048 INFO:tasks.workunit.client.1.smithi136.stdout:6/31: dwrite f5 [0,4194304] 0 2024-09-18T12:50:56.054 INFO:tasks.workunit.client.1.smithi136.stdout:7/40: dread d0/d7/ff [0,4194304] 0 2024-09-18T12:50:56.056 INFO:tasks.workunit.client.1.smithi136.stdout:7/41: mkdir d0/d12 0 2024-09-18T12:50:56.057 INFO:tasks.workunit.client.1.smithi136.stdout:2/46: dwrite f2 [0,4194304] 0 2024-09-18T12:50:56.058 INFO:tasks.workunit.client.1.smithi136.stdout:7/42: rename d0/d7 to d0/d12/d13 0 2024-09-18T12:50:56.062 INFO:tasks.workunit.client.1.smithi136.stdout:7/43: symlink d0/d12/d13/l14 0 2024-09-18T12:50:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:55 smithi136 ceph-mon[35363]: pgmap v270: 65 pgs: 65 active+clean; 184 MiB data, 854 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s wr, 939 op/s 2024-09-18T12:50:56.064 INFO:tasks.workunit.client.1.smithi136.stdout:6/32: dwrite f1 [4194304,4194304] 0 2024-09-18T12:50:56.066 INFO:tasks.workunit.client.1.smithi136.stdout:6/33: rmdir d8/d9 39 2024-09-18T12:50:56.069 INFO:tasks.workunit.client.1.smithi136.stdout:2/47: dwrite f3 [0,4194304] 0 2024-09-18T12:50:56.069 INFO:tasks.workunit.client.1.smithi136.stdout:2/48: readlink d5/d7/lc 0 2024-09-18T12:50:56.069 INFO:tasks.workunit.client.1.smithi136.stdout:2/49: write f4 [350182,7361] 0 2024-09-18T12:50:56.069 INFO:tasks.workunit.client.1.smithi136.stdout:2/50: stat d5/d7/l8 0 2024-09-18T12:50:56.069 INFO:tasks.workunit.client.1.smithi136.stdout:2/51: stat d5/d7 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:7/44: dwrite d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:7/45: chown d0/c6 1 1 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:2/52: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:2/53: write f4 [464737,130043] 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:2/54: getdents d5 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:2/55: fsync f2 0 2024-09-18T12:50:56.092 INFO:tasks.workunit.client.1.smithi136.stdout:6/34: dwrite d8/d9/fb [0,4194304] 0 2024-09-18T12:50:56.093 INFO:tasks.workunit.client.1.smithi136.stdout:7/46: mknod d0/d12/c15 0 2024-09-18T12:50:56.093 INFO:tasks.workunit.client.1.smithi136.stdout:7/47: chown d0/d11 509736 1 2024-09-18T12:50:56.094 INFO:tasks.workunit.client.1.smithi136.stdout:2/56: link d5/cb d5/cd 0 2024-09-18T12:50:56.094 INFO:tasks.workunit.client.1.smithi136.stdout:7/48: dread d0/fa [0,4194304] 0 2024-09-18T12:50:56.096 INFO:tasks.workunit.client.1.smithi136.stdout:6/35: mknod d8/c10 0 2024-09-18T12:50:56.101 INFO:tasks.workunit.client.1.smithi136.stdout:6/36: truncate f5 301623 0 2024-09-18T12:50:56.102 INFO:tasks.workunit.client.1.smithi136.stdout:2/57: dread f2 [0,4194304] 0 2024-09-18T12:50:56.102 INFO:tasks.workunit.client.1.smithi136.stdout:6/37: rename d8 to d8/d11 22 2024-09-18T12:50:56.103 INFO:tasks.workunit.client.1.smithi136.stdout:6/38: creat d8/f12 x:0 0 0 2024-09-18T12:50:56.103 INFO:tasks.workunit.client.1.smithi136.stdout:6/39: write d8/f12 [133364,36618] 0 2024-09-18T12:50:56.105 INFO:tasks.workunit.client.1.smithi136.stdout:2/58: fdatasync f4 0 2024-09-18T12:50:56.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:55 smithi081 ceph-mon[27646]: pgmap v270: 65 pgs: 65 active+clean; 184 MiB data, 854 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s wr, 939 op/s 2024-09-18T12:50:56.108 INFO:tasks.workunit.client.1.smithi136.stdout:7/49: dwrite d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.110 INFO:tasks.workunit.client.1.smithi136.stdout:7/50: link d0/l2 d0/d12/l16 0 2024-09-18T12:50:56.115 INFO:tasks.workunit.client.1.smithi136.stdout:2/59: write d5/f9 [1299142,111303] 0 2024-09-18T12:50:56.116 INFO:tasks.workunit.client.1.smithi136.stdout:2/60: creat d5/d7/fe x:0 0 0 2024-09-18T12:50:56.116 INFO:tasks.workunit.client.1.smithi136.stdout:2/61: write d5/f9 [4987416,122451] 0 2024-09-18T12:50:56.117 INFO:tasks.workunit.client.1.smithi136.stdout:2/62: creat d5/ff x:0 0 0 2024-09-18T12:50:56.117 INFO:tasks.workunit.client.1.smithi136.stdout:2/63: stat d5/d7/fe 0 2024-09-18T12:50:56.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/51: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/52: stat d0 0 2024-09-18T12:50:56.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/53: rmdir d0/d12 39 2024-09-18T12:50:56.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/54: write d0/fa [691281,66432] 0 2024-09-18T12:50:56.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/55: chown d0/c4 680 1 2024-09-18T12:50:56.121 INFO:tasks.workunit.client.1.smithi136.stdout:6/40: dwrite d8/dc/ff [0,4194304] 0 2024-09-18T12:50:56.121 INFO:tasks.workunit.client.1.smithi136.stdout:6/41: write f1 [3607450,77405] 0 2024-09-18T12:50:56.126 INFO:tasks.workunit.client.1.smithi136.stdout:6/42: link f1 d8/d9/de/f13 0 2024-09-18T12:50:56.126 INFO:tasks.workunit.client.1.smithi136.stdout:6/43: write d8/f12 [916414,74545] 0 2024-09-18T12:50:56.126 INFO:tasks.workunit.client.1.smithi136.stdout:6/44: write d8/f12 [642131,96553] 0 2024-09-18T12:50:56.129 INFO:tasks.workunit.client.1.smithi136.stdout:6/45: dread f5 [0,4194304] 0 2024-09-18T12:50:56.131 INFO:tasks.workunit.client.1.smithi136.stdout:6/46: unlink d8/d9/de/f13 0 2024-09-18T12:50:56.131 INFO:tasks.workunit.client.1.smithi136.stdout:6/47: creat d8/dc/f14 x:0 0 0 2024-09-18T12:50:56.152 INFO:tasks.workunit.client.1.smithi136.stdout:2/64: dwrite f2 [4194304,4194304] 0 2024-09-18T12:50:56.152 INFO:tasks.workunit.client.1.smithi136.stdout:7/56: dwrite d0/fa [0,4194304] 0 2024-09-18T12:50:56.152 INFO:tasks.workunit.client.1.smithi136.stdout:7/57: chown d0/fa 3 1 2024-09-18T12:50:56.153 INFO:tasks.workunit.client.1.smithi136.stdout:6/48: dwrite f5 [0,4194304] 0 2024-09-18T12:50:56.153 INFO:tasks.workunit.client.1.smithi136.stdout:6/49: truncate d8/f12 1246683 0 2024-09-18T12:50:56.153 INFO:tasks.workunit.client.1.smithi136.stdout:6/50: write d8/d9/fa [940718,114554] 0 2024-09-18T12:50:56.161 INFO:tasks.workunit.client.1.smithi136.stdout:2/65: truncate f4 519419 0 2024-09-18T12:50:56.161 INFO:tasks.workunit.client.1.smithi136.stdout:2/66: readlink d5/d7/l8 0 2024-09-18T12:50:56.161 INFO:tasks.workunit.client.1.smithi136.stdout:2/67: creat d5/d7/f10 x:0 0 0 2024-09-18T12:50:56.166 INFO:tasks.workunit.client.1.smithi136.stdout:7/58: dread d0/fa [0,4194304] 0 2024-09-18T12:50:56.169 INFO:tasks.workunit.client.1.smithi136.stdout:7/59: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.171 INFO:tasks.workunit.client.1.smithi136.stdout:2/68: fsync d5/d7/f10 0 2024-09-18T12:50:56.173 INFO:tasks.workunit.client.1.smithi136.stdout:2/69: mkdir d5/d7/d11 0 2024-09-18T12:50:56.173 INFO:tasks.workunit.client.1.smithi136.stdout:2/70: creat d5/d7/f12 x:0 0 0 2024-09-18T12:50:56.173 INFO:tasks.workunit.client.1.smithi136.stdout:7/60: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.173 INFO:tasks.workunit.client.1.smithi136.stdout:6/51: dwrite d8/d9/fb [0,4194304] 0 2024-09-18T12:50:56.174 INFO:tasks.workunit.client.1.smithi136.stdout:2/71: mknod d5/c13 0 2024-09-18T12:50:56.176 INFO:tasks.workunit.client.1.smithi136.stdout:7/61: link d0/l2 d0/d12/d13/l17 0 2024-09-18T12:50:56.177 INFO:tasks.workunit.client.1.smithi136.stdout:6/52: rename d8/dc/ff to d8/dc/f15 0 2024-09-18T12:50:56.178 INFO:tasks.workunit.client.1.smithi136.stdout:2/72: symlink d5/l14 0 2024-09-18T12:50:56.179 INFO:tasks.workunit.client.1.smithi136.stdout:7/62: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.179 INFO:tasks.workunit.client.1.smithi136.stdout:6/53: rename d8/f12 to d8/d9/de/f16 0 2024-09-18T12:50:56.180 INFO:tasks.workunit.client.1.smithi136.stdout:7/63: unlink d0/d12/d13/l17 0 2024-09-18T12:50:56.185 INFO:tasks.workunit.client.1.smithi136.stdout:7/64: read d0/fa [2127696,105790] 0 2024-09-18T12:50:56.187 INFO:tasks.workunit.client.1.smithi136.stdout:7/65: creat d0/f18 x:0 0 0 2024-09-18T12:50:56.187 INFO:tasks.workunit.client.1.smithi136.stdout:7/66: readlink d0/l8 0 2024-09-18T12:50:56.187 INFO:tasks.workunit.client.1.smithi136.stdout:7/67: write d0/fa [2459544,98981] 0 2024-09-18T12:50:56.187 INFO:tasks.workunit.client.1.smithi136.stdout:2/73: write f2 [5912258,17188] 0 2024-09-18T12:50:56.188 INFO:tasks.workunit.client.1.smithi136.stdout:2/74: creat d5/f15 x:0 0 0 2024-09-18T12:50:56.188 INFO:tasks.workunit.client.1.smithi136.stdout:2/75: dread - d5/f15 zero size 2024-09-18T12:50:56.188 INFO:tasks.workunit.client.1.smithi136.stdout:2/76: fdatasync d5/f6 0 2024-09-18T12:50:56.189 INFO:tasks.workunit.client.1.smithi136.stdout:7/68: rmdir d0/d11 0 2024-09-18T12:50:56.190 INFO:tasks.workunit.client.1.smithi136.stdout:2/77: symlink d5/d7/l16 0 2024-09-18T12:50:56.192 INFO:tasks.workunit.client.1.smithi136.stdout:7/69: mknod d0/d12/d13/c19 0 2024-09-18T12:50:56.193 INFO:tasks.workunit.client.1.smithi136.stdout:6/54: dwrite f5 [0,4194304] 0 2024-09-18T12:50:56.194 INFO:tasks.workunit.client.1.smithi136.stdout:6/55: fsync d8/dc/f14 0 2024-09-18T12:50:56.197 INFO:tasks.workunit.client.1.smithi136.stdout:6/56: getdents d8/dc 0 2024-09-18T12:50:56.199 INFO:tasks.workunit.client.1.smithi136.stdout:6/57: mknod d8/d9/c17 0 2024-09-18T12:50:56.199 INFO:tasks.workunit.client.1.smithi136.stdout:6/58: chown c4 4 1 2024-09-18T12:50:56.204 INFO:tasks.workunit.client.1.smithi136.stdout:7/70: truncate d0/d12/d13/ff 2231549 0 2024-09-18T12:50:56.205 INFO:tasks.workunit.client.1.smithi136.stdout:7/71: mkdir d0/d12/d1a 0 2024-09-18T12:50:56.206 INFO:tasks.workunit.client.1.smithi136.stdout:7/72: mkdir d0/d12/d1b 0 2024-09-18T12:50:56.206 INFO:tasks.workunit.client.1.smithi136.stdout:7/73: readlink d0/l2 0 2024-09-18T12:50:56.207 INFO:tasks.workunit.client.1.smithi136.stdout:2/78: dwrite d5/ff [0,4194304] 0 2024-09-18T12:50:56.207 INFO:tasks.workunit.client.1.smithi136.stdout:7/74: symlink d0/d12/d1b/l1c 0 2024-09-18T12:50:56.207 INFO:tasks.workunit.client.1.smithi136.stdout:7/75: fdatasync d0/f18 0 2024-09-18T12:50:56.211 INFO:tasks.workunit.client.1.smithi136.stdout:2/79: mkdir d5/d7/d17 0 2024-09-18T12:50:56.212 INFO:tasks.workunit.client.1.smithi136.stdout:7/76: link d0/d12/d13/l14 d0/d12/d1b/l1d 0 2024-09-18T12:50:56.213 INFO:tasks.workunit.client.1.smithi136.stdout:2/80: mknod d5/d7/d11/c18 0 2024-09-18T12:50:56.215 INFO:tasks.workunit.client.1.smithi136.stdout:7/77: mknod d0/d12/d1a/c1e 0 2024-09-18T12:50:56.217 INFO:tasks.workunit.client.1.smithi136.stdout:2/81: link d5/f9 d5/f19 0 2024-09-18T12:50:56.219 INFO:tasks.workunit.client.1.smithi136.stdout:7/78: truncate d0/d12/d13/ff 1219738 0 2024-09-18T12:50:56.221 INFO:tasks.workunit.client.1.smithi136.stdout:2/82: symlink d5/l1a 0 2024-09-18T12:50:56.221 INFO:tasks.workunit.client.1.smithi136.stdout:2/83: write f3 [5976256,35670] 0 2024-09-18T12:50:56.221 INFO:tasks.workunit.client.1.smithi136.stdout:6/59: dwrite f1 [0,4194304] 0 2024-09-18T12:50:56.224 INFO:tasks.workunit.client.1.smithi136.stdout:6/60: rmdir d8/dc 39 2024-09-18T12:50:56.224 INFO:tasks.workunit.client.1.smithi136.stdout:6/61: truncate d8/dc/f14 300371 0 2024-09-18T12:50:56.225 INFO:tasks.workunit.client.1.smithi136.stdout:6/62: getdents d8/d9/de 0 2024-09-18T12:50:56.231 INFO:tasks.workunit.client.1.smithi136.stdout:6/63: unlink l3 0 2024-09-18T12:50:56.233 INFO:tasks.workunit.client.1.smithi136.stdout:6/64: creat d8/d9/de/f18 x:0 0 0 2024-09-18T12:50:56.242 INFO:tasks.workunit.client.1.smithi136.stdout:7/79: dwrite d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.243 INFO:tasks.workunit.client.1.smithi136.stdout:6/65: truncate d8/d9/fb 2361156 0 2024-09-18T12:50:56.244 INFO:tasks.workunit.client.1.smithi136.stdout:7/80: mknod d0/d12/d1a/c1f 0 2024-09-18T12:50:56.258 INFO:tasks.workunit.client.1.smithi136.stdout:7/81: dwrite d0/fa [4194304,4194304] 0 2024-09-18T12:50:56.272 INFO:tasks.workunit.client.1.smithi136.stdout:7/82: dwrite d0/fa [4194304,4194304] 0 2024-09-18T12:50:56.273 INFO:tasks.workunit.client.1.smithi136.stdout:7/83: creat d0/d12/d1a/f20 x:0 0 0 2024-09-18T12:50:56.274 INFO:tasks.workunit.client.1.smithi136.stdout:7/84: unlink d0/l10 0 2024-09-18T12:50:56.274 INFO:tasks.workunit.client.1.smithi136.stdout:7/85: rename d0/d12 to d0/d12/d21 22 2024-09-18T12:50:56.278 INFO:tasks.workunit.client.1.smithi136.stdout:7/86: truncate d0/d12/d13/ff 742775 0 2024-09-18T12:50:56.278 INFO:tasks.workunit.client.1.smithi136.stdout:7/87: write d0/f18 [885489,95416] 0 2024-09-18T12:50:56.278 INFO:tasks.workunit.client.1.smithi136.stdout:7/88: truncate d0/d12/d1a/f20 164910 0 2024-09-18T12:50:56.278 INFO:tasks.workunit.client.1.smithi136.stdout:7/89: chown d0/d12/d13/l14 491536207 1 2024-09-18T12:50:56.279 INFO:tasks.workunit.client.1.smithi136.stdout:7/90: creat d0/d12/d13/f22 x:0 0 0 2024-09-18T12:50:56.281 INFO:tasks.workunit.client.1.smithi136.stdout:7/91: symlink d0/d12/d13/l23 0 2024-09-18T12:50:56.282 INFO:tasks.workunit.client.1.smithi136.stdout:7/92: link d0/d12/d1b/l1d d0/d12/l24 0 2024-09-18T12:50:56.283 INFO:tasks.workunit.client.1.smithi136.stdout:7/93: rmdir d0/d12/d1a 39 2024-09-18T12:50:56.284 INFO:tasks.workunit.client.1.smithi136.stdout:7/94: creat d0/d12/d13/f25 x:0 0 0 2024-09-18T12:50:56.288 INFO:tasks.workunit.client.1.smithi136.stdout:7/95: rmdir d0/d12/d13 39 2024-09-18T12:50:56.291 INFO:tasks.workunit.client.1.smithi136.stdout:7/96: rename d0/d12/l24 to d0/d12/l26 0 2024-09-18T12:50:56.291 INFO:tasks.workunit.client.1.smithi136.stdout:7/97: chown d0/d12 4 1 2024-09-18T12:50:56.303 INFO:tasks.workunit.client.1.smithi136.stdout:7/98: dwrite d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:50:56.306 INFO:tasks.workunit.client.1.smithi136.stdout:7/99: mknod d0/d12/d1a/c27 0 2024-09-18T12:50:56.306 INFO:tasks.workunit.client.1.smithi136.stdout:7/100: stat d0/d12/d1a/c1f 0 2024-09-18T12:50:56.307 INFO:tasks.workunit.client.1.smithi136.stdout:7/101: mknod d0/d12/d1a/c28 0 2024-09-18T12:50:56.309 INFO:tasks.workunit.client.1.smithi136.stdout:7/102: getdents d0 0 2024-09-18T12:50:56.309 INFO:tasks.workunit.client.1.smithi136.stdout:7/103: write d0/fa [288458,69388] 0 2024-09-18T12:50:56.311 INFO:tasks.workunit.client.1.smithi136.stdout:7/104: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.311 INFO:tasks.workunit.client.1.smithi136.stdout:7/105: dread - d0/d12/d13/f22 zero size 2024-09-18T12:50:56.311 INFO:tasks.workunit.client.1.smithi136.stdout:7/106: truncate d0/d12/d13/f22 477177 0 2024-09-18T12:50:56.312 INFO:tasks.workunit.client.1.smithi136.stdout:7/107: creat d0/f29 x:0 0 0 2024-09-18T12:50:56.313 INFO:tasks.workunit.client.1.smithi136.stdout:7/108: write d0/f18 [757256,83384] 0 2024-09-18T12:50:56.315 INFO:tasks.workunit.client.1.smithi136.stdout:7/109: rename d0/d12/d1b to d0/d12/d2a 0 2024-09-18T12:50:56.316 INFO:tasks.workunit.client.1.smithi136.stdout:7/110: symlink d0/l2b 0 2024-09-18T12:50:56.325 INFO:tasks.workunit.client.1.smithi136.stdout:7/111: dread d0/fa [4194304,4194304] 0 2024-09-18T12:50:56.325 INFO:tasks.workunit.client.1.smithi136.stdout:7/112: dread - d0/d12/d13/f25 zero size 2024-09-18T12:50:56.325 INFO:tasks.workunit.client.1.smithi136.stdout:7/113: chown d0/d12/d13 5 1 2024-09-18T12:50:56.326 INFO:tasks.workunit.client.1.smithi136.stdout:7/114: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.326 INFO:tasks.workunit.client.1.smithi136.stdout:7/115: chown d0/d12/d1a/f20 383 1 2024-09-18T12:50:56.505 INFO:tasks.workunit.client.1.smithi136.stdout:7/116: dwrite d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.506 INFO:tasks.workunit.client.1.smithi136.stdout:7/117: mkdir d0/d2c 0 2024-09-18T12:50:56.508 INFO:tasks.workunit.client.1.smithi136.stdout:7/118: mknod d0/d12/d2a/c2d 0 2024-09-18T12:50:56.508 INFO:tasks.workunit.client.1.smithi136.stdout:7/119: stat d0/d2c 0 2024-09-18T12:50:56.508 INFO:tasks.workunit.client.1.smithi136.stdout:7/120: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-18T12:50:56.510 INFO:tasks.workunit.client.1.smithi136.stdout:7/121: mkdir d0/d2c/d2e 0 2024-09-18T12:50:56.528 INFO:tasks.workunit.client.1.smithi136.stdout:7/122: dwrite d0/f18 [0,4194304] 0 2024-09-18T12:50:56.537 INFO:tasks.workunit.client.1.smithi136.stdout:7/123: dread d0/f18 [0,4194304] 0 2024-09-18T12:50:56.538 INFO:tasks.workunit.client.1.smithi136.stdout:7/124: getdents d0/d12 0 2024-09-18T12:50:56.540 INFO:tasks.workunit.client.1.smithi136.stdout:7/125: creat d0/d2c/f2f x:0 0 0 2024-09-18T12:50:56.563 INFO:tasks.workunit.client.1.smithi136.stdout:7/126: dwrite d0/f29 [0,4194304] 0 2024-09-18T12:50:56.565 INFO:tasks.workunit.client.1.smithi136.stdout:7/127: rename d0/d12/d2a/l1c to d0/d12/d13/l30 0 2024-09-18T12:50:56.565 INFO:tasks.workunit.client.1.smithi136.stdout:7/128: creat d0/f31 x:0 0 0 2024-09-18T12:50:56.568 INFO:tasks.workunit.client.1.smithi136.stdout:7/129: rename d0/f18 to d0/d2c/d2e/f32 0 2024-09-18T12:50:56.568 INFO:tasks.workunit.client.1.smithi136.stdout:7/130: read - d0/f31 zero size 2024-09-18T12:50:56.568 INFO:tasks.workunit.client.1.smithi136.stdout:7/131: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-18T12:50:56.569 INFO:tasks.workunit.client.1.smithi136.stdout:7/132: stat d0/d12/l26 0 2024-09-18T12:50:56.570 INFO:tasks.workunit.client.1.smithi136.stdout:7/133: creat d0/d12/d1a/f33 x:0 0 0 2024-09-18T12:50:56.575 INFO:tasks.workunit.client.1.smithi136.stdout:7/134: dread d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:50:56.576 INFO:tasks.workunit.client.1.smithi136.stdout:7/135: mknod d0/d12/d13/c34 0 2024-09-18T12:50:56.582 INFO:tasks.workunit.client.1.smithi136.stdout:7/136: dread d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:50:56.583 INFO:tasks.workunit.client.1.smithi136.stdout:7/137: mkdir d0/d35 0 2024-09-18T12:50:56.589 INFO:tasks.workunit.client.1.smithi136.stdout:7/138: dread d0/d12/d13/ff [0,4194304] 0 2024-09-18T12:50:56.589 INFO:tasks.workunit.client.1.smithi136.stdout:7/139: fsync d0/fa 0 2024-09-18T12:50:56.596 INFO:tasks.workunit.client.1.smithi136.stdout:7/140: rename d0/d12/d13 to d0/d35/d36 0 2024-09-18T12:50:56.598 INFO:tasks.workunit.client.1.smithi136.stdout:7/141: creat d0/d12/d2a/f37 x:0 0 0 2024-09-18T12:50:56.599 INFO:tasks.workunit.client.1.smithi136.stdout:7/142: unlink d0/le 0 2024-09-18T12:50:56.599 INFO:tasks.workunit.client.1.smithi136.stdout:7/143: chown d0/d35/d36/l14 179728104 1 2024-09-18T12:50:56.599 INFO:tasks.workunit.client.1.smithi136.stdout:7/144: mknod d0/d12/d2a/c38 0 2024-09-18T12:50:56.600 INFO:tasks.workunit.client.1.smithi136.stdout:7/145: getdents d0/d35/d36 0 2024-09-18T12:50:56.601 INFO:tasks.workunit.client.1.smithi136.stdout:7/146: chown d0/d12/d1a/c27 0 1 2024-09-18T12:50:56.601 INFO:tasks.workunit.client.1.smithi136.stdout:7/147: truncate d0/d35/d36/f25 491015 0 2024-09-18T12:50:56.601 INFO:tasks.workunit.client.1.smithi136.stdout:7/148: dread d0/d35/d36/f25 [0,4194304] 0 2024-09-18T12:50:56.602 INFO:tasks.workunit.client.1.smithi136.stdout:7/149: mkdir d0/d39 0 2024-09-18T12:50:56.602 INFO:tasks.workunit.client.1.smithi136.stdout:7/150: chown d0/d35/d36/f25 2855250 1 2024-09-18T12:50:56.603 INFO:tasks.workunit.client.1.smithi136.stdout:7/151: symlink d0/d12/d1a/l3a 0 2024-09-18T12:50:56.619 INFO:tasks.workunit.client.1.smithi136.stdout:7/152: dwrite d0/d35/d36/f25 [0,4194304] 0 2024-09-18T12:50:56.624 INFO:tasks.workunit.client.1.smithi136.stdout:7/153: read d0/d2c/d2e/f32 [1038527,11570] 0 2024-09-18T12:50:56.625 INFO:tasks.workunit.client.1.smithi136.stdout:7/154: truncate d0/d12/d1a/f20 3566441 0 2024-09-18T12:50:56.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/155: truncate d0/d2c/d2e/f32 3501864 0 2024-09-18T12:50:56.631 INFO:tasks.workunit.client.1.smithi136.stdout:7/156: mkdir d0/d12/d2a/d3b 0 2024-09-18T12:50:56.631 INFO:tasks.workunit.client.1.smithi136.stdout:7/157: fsync d0/d35/d36/ff 0 2024-09-18T12:50:56.631 INFO:tasks.workunit.client.1.smithi136.stdout:7/158: dread - d0/d12/d2a/f37 zero size 2024-09-18T12:50:56.631 INFO:tasks.workunit.client.1.smithi136.stdout:7/159: fsync d0/d35/d36/f25 0 2024-09-18T12:50:56.641 INFO:tasks.workunit.client.1.smithi136.stdout:7/160: dread d0/d35/d36/f25 [0,4194304] 0 2024-09-18T12:50:56.650 INFO:tasks.workunit.client.1.smithi136.stdout:7/161: write d0/f29 [2850089,57353] 0 2024-09-18T12:50:56.650 INFO:tasks.workunit.client.1.smithi136.stdout:7/162: write d0/d2c/d2e/f32 [1552962,83520] 0 2024-09-18T12:50:56.651 INFO:tasks.workunit.client.1.smithi136.stdout:7/163: mkdir d0/d12/d2a/d3c 0 2024-09-18T12:50:56.657 INFO:tasks.workunit.client.1.smithi136.stdout:7/164: dread d0/fa [0,4194304] 0 2024-09-18T12:50:56.659 INFO:tasks.workunit.client.1.smithi136.stdout:7/165: symlink d0/d2c/l3d 0 2024-09-18T12:50:56.665 INFO:tasks.workunit.client.1.smithi136.stdout:7/166: dread d0/f29 [0,4194304] 0 2024-09-18T12:50:56.665 INFO:tasks.workunit.client.1.smithi136.stdout:7/167: fsync d0/d12/d1a/f20 0 2024-09-18T12:50:56.668 INFO:tasks.workunit.client.1.smithi136.stdout:7/168: dread d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:50:56.668 INFO:tasks.workunit.client.1.smithi136.stdout:7/169: creat d0/d12/d1a/f3e x:0 0 0 2024-09-18T12:50:56.668 INFO:tasks.workunit.client.1.smithi136.stdout:7/170: write d0/f31 [542106,125663] 0 2024-09-18T12:50:56.669 INFO:tasks.workunit.client.1.smithi136.stdout:7/171: truncate d0/d35/d36/ff 1944470 0 2024-09-18T12:50:56.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/172: creat d0/d2c/d2e/f3f x:0 0 0 2024-09-18T12:50:56.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/173: fdatasync d0/d12/d1a/f33 0 2024-09-18T12:50:56.671 INFO:tasks.workunit.client.1.smithi136.stdout:7/174: truncate d0/d2c/d2e/f32 3986650 0 2024-09-18T12:50:56.671 INFO:tasks.workunit.client.1.smithi136.stdout:7/175: symlink d0/d35/d36/l40 0 2024-09-18T12:50:56.671 INFO:tasks.workunit.client.1.smithi136.stdout:7/176: truncate d0/d2c/f2f 71118 0 2024-09-18T12:50:56.672 INFO:tasks.workunit.client.1.smithi136.stdout:7/177: mkdir d0/d35/d41 0 2024-09-18T12:50:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:57 smithi136 ceph-mon[35363]: pgmap v271: 65 pgs: 65 active+clean; 188 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s wr, 910 op/s 2024-09-18T12:50:58.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:57 smithi081 ceph-mon[27646]: pgmap v271: 65 pgs: 65 active+clean; 188 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s wr, 910 op/s 2024-09-18T12:50:59.874 INFO:tasks.workunit.client.0.smithi081.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:50:59.888 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:50:59.888 INFO:tasks.workunit.client.0.smithi081.stderr:+ make 2024-09-18T12:50:59.927 INFO:tasks.workunit.client.0.smithi081.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:51:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:50:59 smithi136 ceph-mon[35363]: pgmap v272: 65 pgs: 65 active+clean; 240 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 16 MiB/s wr, 929 op/s 2024-09-18T12:51:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:50:59 smithi081 ceph-mon[27646]: pgmap v272: 65 pgs: 65 active+clean; 240 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 16 MiB/s wr, 929 op/s 2024-09-18T12:51:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:01 smithi136 ceph-mon[35363]: pgmap v273: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 23 MiB/s wr, 813 op/s 2024-09-18T12:51:02.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:01 smithi081 ceph-mon[27646]: pgmap v273: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 23 MiB/s wr, 813 op/s 2024-09-18T12:51:03.368 INFO:tasks.workunit.client.0.smithi081.stderr:++ readlink -f fsstress 2024-09-18T12:51:03.369 INFO:tasks.workunit.client.0.smithi081.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:51:03.369 INFO:tasks.workunit.client.0.smithi081.stderr:+ popd 2024-09-18T12:51:03.370 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:51:03.370 INFO:tasks.workunit.client.0.smithi081.stderr:+ popd 2024-09-18T12:51:03.370 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:51:03.370 INFO:tasks.workunit.client.0.smithi081.stderr:++ mktemp -d -p . 2024-09-18T12:51:03.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ T=./tmp.rQwyjbFSGc 2024-09-18T12:51:03.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.rQwyjbFSGc -l 1 -n 1000 -p 10 -v 2024-09-18T12:51:03.373 INFO:tasks.workunit.client.0.smithi081.stdout:seed = 1726971573 2024-09-18T12:51:03.375 INFO:tasks.workunit.client.0.smithi081.stdout:1/0: dwrite - no filename 2024-09-18T12:51:03.376 INFO:tasks.workunit.client.0.smithi081.stdout:0/0: creat f0 x:0 0 0 2024-09-18T12:51:03.378 INFO:tasks.workunit.client.0.smithi081.stdout:1/1: mkdir d0 0 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/2: truncate - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/3: dwrite - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/4: dread - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/5: fdatasync - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:2/0: dread - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:2/1: fdatasync - no filename 2024-09-18T12:51:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:2/2: write - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/3: dread - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/4: fsync - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/5: truncate - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/6: unlink - no file 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/7: rename - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/8: fdatasync - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/9: dwrite - no filename 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/10: stat - no entries 2024-09-18T12:51:03.380 INFO:tasks.workunit.client.0.smithi081.stdout:2/11: write - no filename 2024-09-18T12:51:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:1/6: creat d0/f1 x:0 0 0 2024-09-18T12:51:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:2/12: symlink l0 0 2024-09-18T12:51:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:2/13: dwrite - no filename 2024-09-18T12:51:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/0: write - no filename 2024-09-18T12:51:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/1: dread - no filename 2024-09-18T12:51:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/2: read - no filename 2024-09-18T12:51:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/3: rename - no filename 2024-09-18T12:51:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/4: read - no filename 2024-09-18T12:51:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:4/5: chown . 750160106 1 2024-09-18T12:51:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:3/0: mknod c0 0 2024-09-18T12:51:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/7: rename d0/f1 to d0/f2 0 2024-09-18T12:51:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:4/6: creat f0 x:0 0 0 2024-09-18T12:51:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:4/7: read - f0 zero size 2024-09-18T12:51:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:3/1: creat f1 x:0 0 0 2024-09-18T12:51:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:3/2: creat f2 x:0 0 0 2024-09-18T12:51:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:3/3: dread - f1 zero size 2024-09-18T12:51:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:5/0: mknod c0 0 2024-09-18T12:51:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:4/8: symlink l1 0 2024-09-18T12:51:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:3/4: mkdir d3 0 2024-09-18T12:51:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:3/5: truncate f1 594126 0 2024-09-18T12:51:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:3/6: chown d3 0 1 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/0: chown . 232 1 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/1: dwrite - no filename 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/2: rmdir - no directory 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/3: truncate - no filename 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/4: unlink - no file 2024-09-18T12:51:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:7/5: stat - no entries 2024-09-18T12:51:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:6/0: creat f0 x:0 0 0 2024-09-18T12:51:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:5/1: rename c0 to c1 0 2024-09-18T12:51:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:5/2: write - no filename 2024-09-18T12:51:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:5/3: truncate - no filename 2024-09-18T12:51:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:3/7: mknod d3/c4 0 2024-09-18T12:51:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:3/8: stat f2 0 2024-09-18T12:51:03.398 INFO:tasks.workunit.client.0.smithi081.stdout:8/0: unlink - no file 2024-09-18T12:51:03.398 INFO:tasks.workunit.client.0.smithi081.stdout:8/1: read - no filename 2024-09-18T12:51:03.399 INFO:tasks.workunit.client.0.smithi081.stdout:7/6: creat f0 x:0 0 0 2024-09-18T12:51:03.400 INFO:tasks.workunit.client.0.smithi081.stdout:5/4: mkdir d2 0 2024-09-18T12:51:03.401 INFO:tasks.workunit.client.0.smithi081.stdout:5/5: read - no filename 2024-09-18T12:51:03.401 INFO:tasks.workunit.client.0.smithi081.stdout:5/6: readlink - no filename 2024-09-18T12:51:03.403 INFO:tasks.workunit.client.0.smithi081.stdout:9/0: fsync - no filename 2024-09-18T12:51:03.403 INFO:tasks.workunit.client.0.smithi081.stdout:8/2: mknod c0 0 2024-09-18T12:51:03.403 INFO:tasks.workunit.client.0.smithi081.stdout:8/3: fdatasync - no filename 2024-09-18T12:51:03.404 INFO:tasks.workunit.client.0.smithi081.stdout:8/4: dwrite - no filename 2024-09-18T12:51:03.404 INFO:tasks.workunit.client.0.smithi081.stdout:1/8: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:03.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/9: chown d0/f2 26899582 1 2024-09-18T12:51:03.405 INFO:tasks.workunit.client.0.smithi081.stdout:5/7: creat d2/f3 x:0 0 0 2024-09-18T12:51:03.405 INFO:tasks.workunit.client.0.smithi081.stdout:5/8: dread - d2/f3 zero size 2024-09-18T12:51:03.407 INFO:tasks.workunit.client.0.smithi081.stdout:9/1: creat f0 x:0 0 0 2024-09-18T12:51:03.407 INFO:tasks.workunit.client.0.smithi081.stdout:9/2: dread - f0 zero size 2024-09-18T12:51:03.408 INFO:tasks.workunit.client.0.smithi081.stdout:9/3: write f0 [768305,12129] 0 2024-09-18T12:51:03.408 INFO:tasks.workunit.client.0.smithi081.stdout:8/5: mknod c1 0 2024-09-18T12:51:03.411 INFO:tasks.workunit.client.0.smithi081.stdout:1/10: mknod d0/c3 0 2024-09-18T12:51:03.411 INFO:tasks.workunit.client.0.smithi081.stdout:1/11: chown d0/f2 259734 1 2024-09-18T12:51:03.413 INFO:tasks.workunit.client.0.smithi081.stdout:5/9: mkdir d2/d4 0 2024-09-18T12:51:03.413 INFO:tasks.workunit.client.0.smithi081.stdout:5/10: chown d2/d4 147655 1 2024-09-18T12:51:03.413 INFO:tasks.workunit.client.0.smithi081.stdout:5/11: read - d2/f3 zero size 2024-09-18T12:51:03.414 INFO:tasks.workunit.client.0.smithi081.stdout:8/6: rename c1 to c2 0 2024-09-18T12:51:03.414 INFO:tasks.workunit.client.0.smithi081.stdout:8/7: readlink - no filename 2024-09-18T12:51:03.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/8: mkdir d3 0 2024-09-18T12:51:03.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/9: dread - no filename 2024-09-18T12:51:03.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/10: getdents d3 0 2024-09-18T12:51:03.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/11: stat d3 0 2024-09-18T12:51:03.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/12: symlink d3/l4 0 2024-09-18T12:51:03.418 INFO:tasks.workunit.client.0.smithi081.stdout:8/13: mknod d3/c5 0 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/14: truncate - no filename 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/15: stat d3/c5 0 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/16: chown d3/c5 57 1 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/17: rename d3 to d3/d6 22 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/18: dread - no filename 2024-09-18T12:51:03.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/19: write - no filename 2024-09-18T12:51:03.423 INFO:tasks.workunit.client.0.smithi081.stdout:1/12: dread d0/f2 [0,4194304] 0 2024-09-18T12:51:03.425 INFO:tasks.workunit.client.0.smithi081.stdout:6/1: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.425 INFO:tasks.workunit.client.0.smithi081.stdout:7/7: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.425 INFO:tasks.workunit.client.0.smithi081.stdout:4/9: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/10: mknod c2 0 2024-09-18T12:51:03.435 INFO:tasks.workunit.client.0.smithi081.stdout:6/2: write f0 [1353889,116259] 0 2024-09-18T12:51:03.435 INFO:tasks.workunit.client.0.smithi081.stdout:6/3: creat f1 x:0 0 0 2024-09-18T12:51:03.435 INFO:tasks.workunit.client.0.smithi081.stdout:6/4: read f0 [2743738,86598] 0 2024-09-18T12:51:03.436 INFO:tasks.workunit.client.0.smithi081.stdout:7/8: write f0 [198627,102922] 0 2024-09-18T12:51:03.437 INFO:tasks.workunit.client.0.smithi081.stdout:7/9: mknod c1 0 2024-09-18T12:51:03.444 INFO:tasks.workunit.client.0.smithi081.stdout:7/10: dread f0 [0,4194304] 0 2024-09-18T12:51:03.446 INFO:tasks.workunit.client.0.smithi081.stdout:7/11: mkdir d2 0 2024-09-18T12:51:03.449 INFO:tasks.workunit.client.0.smithi081.stdout:7/12: dread f0 [0,4194304] 0 2024-09-18T12:51:03.450 INFO:tasks.workunit.client.0.smithi081.stdout:7/13: creat d2/f3 x:0 0 0 2024-09-18T12:51:03.451 INFO:tasks.workunit.client.0.smithi081.stdout:7/14: mknod d2/c4 0 2024-09-18T12:51:03.454 INFO:tasks.workunit.client.0.smithi081.stdout:6/5: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.462 INFO:tasks.workunit.client.0.smithi081.stdout:6/6: dread f0 [0,4194304] 0 2024-09-18T12:51:03.462 INFO:tasks.workunit.client.0.smithi081.stdout:6/7: mknod c2 0 2024-09-18T12:51:03.463 INFO:tasks.workunit.client.0.smithi081.stdout:7/15: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.463 INFO:tasks.workunit.client.0.smithi081.stdout:7/16: dread - d2/f3 zero size 2024-09-18T12:51:03.464 INFO:tasks.workunit.client.0.smithi081.stdout:6/8: link f0 f3 0 2024-09-18T12:51:03.477 INFO:tasks.workunit.client.0.smithi081.stdout:6/9: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/10: mkdir d4 0 2024-09-18T12:51:03.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/11: creat d4/f5 x:0 0 0 2024-09-18T12:51:03.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/12: dread - d4/f5 zero size 2024-09-18T12:51:03.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/13: fdatasync f3 0 2024-09-18T12:51:03.554 INFO:tasks.workunit.client.0.smithi081.stdout:5/12: fsync d2/f3 0 2024-09-18T12:51:03.554 INFO:tasks.workunit.client.0.smithi081.stdout:5/13: truncate d2/f3 162450 0 2024-09-18T12:51:03.554 INFO:tasks.workunit.client.0.smithi081.stdout:5/14: write d2/f3 [706982,122521] 0 2024-09-18T12:51:03.555 INFO:tasks.workunit.client.0.smithi081.stdout:1/13: rmdir d0 39 2024-09-18T12:51:03.556 INFO:tasks.workunit.client.0.smithi081.stdout:1/14: creat d0/f4 x:0 0 0 2024-09-18T12:51:03.557 INFO:tasks.workunit.client.0.smithi081.stdout:9/4: truncate f0 669311 0 2024-09-18T12:51:03.557 INFO:tasks.workunit.client.0.smithi081.stdout:9/5: rmdir - no directory 2024-09-18T12:51:03.558 INFO:tasks.workunit.client.0.smithi081.stdout:9/6: creat f1 x:0 0 0 2024-09-18T12:51:03.558 INFO:tasks.workunit.client.0.smithi081.stdout:9/7: creat f2 x:0 0 0 2024-09-18T12:51:03.558 INFO:tasks.workunit.client.0.smithi081.stdout:9/8: write f2 [1007648,51439] 0 2024-09-18T12:51:03.558 INFO:tasks.workunit.client.0.smithi081.stdout:5/15: dread d2/f3 [0,4194304] 0 2024-09-18T12:51:03.561 INFO:tasks.workunit.client.0.smithi081.stdout:8/20: getdents d3 0 2024-09-18T12:51:03.563 INFO:tasks.workunit.client.0.smithi081.stdout:9/9: mknod c3 0 2024-09-18T12:51:03.567 INFO:tasks.workunit.client.0.smithi081.stdout:8/21: rename c2 to d3/c7 0 2024-09-18T12:51:03.568 INFO:tasks.workunit.client.0.smithi081.stdout:8/22: readlink d3/l4 0 2024-09-18T12:51:03.568 INFO:tasks.workunit.client.0.smithi081.stdout:4/11: write f0 [4816399,13794] 0 2024-09-18T12:51:03.569 INFO:tasks.workunit.client.0.smithi081.stdout:4/12: rmdir - no directory 2024-09-18T12:51:03.570 INFO:tasks.workunit.client.0.smithi081.stdout:8/23: mknod d3/c8 0 2024-09-18T12:51:03.571 INFO:tasks.workunit.client.0.smithi081.stdout:4/13: mkdir d3 0 2024-09-18T12:51:03.572 INFO:tasks.workunit.client.0.smithi081.stdout:8/24: creat d3/f9 x:0 0 0 2024-09-18T12:51:03.573 INFO:tasks.workunit.client.0.smithi081.stdout:4/14: symlink d3/l4 0 2024-09-18T12:51:03.573 INFO:tasks.workunit.client.0.smithi081.stdout:4/15: write f0 [4281768,56885] 0 2024-09-18T12:51:03.573 INFO:tasks.workunit.client.0.smithi081.stdout:4/16: chown l1 64209367 1 2024-09-18T12:51:03.573 INFO:tasks.workunit.client.0.smithi081.stdout:4/17: stat f0 0 2024-09-18T12:51:03.576 INFO:tasks.workunit.client.0.smithi081.stdout:8/25: rename c0 to d3/ca 0 2024-09-18T12:51:03.576 INFO:tasks.workunit.client.0.smithi081.stdout:8/26: write d3/f9 [965972,43575] 0 2024-09-18T12:51:03.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/17: fsync d2/f3 0 2024-09-18T12:51:03.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/18: chown d2/c4 20 1 2024-09-18T12:51:03.578 INFO:tasks.workunit.client.0.smithi081.stdout:7/19: symlink d2/l5 0 2024-09-18T12:51:03.579 INFO:tasks.workunit.client.0.smithi081.stdout:1/15: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:03.579 INFO:tasks.workunit.client.0.smithi081.stdout:1/16: write d0/f2 [4620943,43645] 0 2024-09-18T12:51:03.582 INFO:tasks.workunit.client.0.smithi081.stdout:5/16: dwrite d2/f3 [0,4194304] 0 2024-09-18T12:51:03.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/14: truncate f3 461759 0 2024-09-18T12:51:03.583 INFO:tasks.workunit.client.0.smithi081.stdout:9/10: dwrite f1 [0,4194304] 0 2024-09-18T12:51:03.585 INFO:tasks.workunit.client.0.smithi081.stdout:5/17: symlink d2/l5 0 2024-09-18T12:51:03.586 INFO:tasks.workunit.client.0.smithi081.stdout:1/17: getdents d0 0 2024-09-18T12:51:03.593 INFO:tasks.workunit.client.0.smithi081.stdout:9/11: rename c3 to c4 0 2024-09-18T12:51:03.594 INFO:tasks.workunit.client.0.smithi081.stdout:5/18: creat d2/d4/f6 x:0 0 0 2024-09-18T12:51:03.595 INFO:tasks.workunit.client.0.smithi081.stdout:5/19: write d2/d4/f6 [844876,72152] 0 2024-09-18T12:51:03.597 INFO:tasks.workunit.client.0.smithi081.stdout:9/12: unlink f1 0 2024-09-18T12:51:03.600 INFO:tasks.workunit.client.0.smithi081.stdout:8/27: rmdir d3 39 2024-09-18T12:51:03.601 INFO:tasks.workunit.client.0.smithi081.stdout:9/13: dread f2 [0,4194304] 0 2024-09-18T12:51:03.601 INFO:tasks.workunit.client.0.smithi081.stdout:8/28: write d3/f9 [63871,78079] 0 2024-09-18T12:51:03.604 INFO:tasks.workunit.client.0.smithi081.stdout:4/18: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/15: dwrite f1 [0,4194304] 0 2024-09-18T12:51:03.605 INFO:tasks.workunit.client.0.smithi081.stdout:4/19: creat d3/f5 x:0 0 0 2024-09-18T12:51:03.605 INFO:tasks.workunit.client.0.smithi081.stdout:4/20: chown l1 2864876 1 2024-09-18T12:51:03.611 INFO:tasks.workunit.client.0.smithi081.stdout:8/29: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:03.611 INFO:tasks.workunit.client.0.smithi081.stdout:8/30: write d3/f9 [1752041,72383] 0 2024-09-18T12:51:03.612 INFO:tasks.workunit.client.0.smithi081.stdout:9/14: rename c4 to c5 0 2024-09-18T12:51:03.612 INFO:tasks.workunit.client.0.smithi081.stdout:9/15: chown f2 71112424 1 2024-09-18T12:51:03.612 INFO:tasks.workunit.client.0.smithi081.stdout:9/16: creat f6 x:0 0 0 2024-09-18T12:51:03.612 INFO:tasks.workunit.client.0.smithi081.stdout:9/17: fsync f0 0 2024-09-18T12:51:03.613 INFO:tasks.workunit.client.0.smithi081.stdout:8/31: creat d3/fb x:0 0 0 2024-09-18T12:51:03.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/20: getdents d2/d4 0 2024-09-18T12:51:03.616 INFO:tasks.workunit.client.0.smithi081.stdout:9/18: unlink f2 0 2024-09-18T12:51:03.617 INFO:tasks.workunit.client.0.smithi081.stdout:1/18: truncate d0/f2 164372 0 2024-09-18T12:51:03.619 INFO:tasks.workunit.client.0.smithi081.stdout:6/16: dwrite f0 [0,4194304] 0 2024-09-18T12:51:03.619 INFO:tasks.workunit.client.0.smithi081.stdout:1/19: rmdir d0 39 2024-09-18T12:51:03.620 INFO:tasks.workunit.client.0.smithi081.stdout:4/21: rmdir d3 39 2024-09-18T12:51:03.620 INFO:tasks.workunit.client.0.smithi081.stdout:4/22: dread - d3/f5 zero size 2024-09-18T12:51:03.626 INFO:tasks.workunit.client.0.smithi081.stdout:1/20: symlink d0/l5 0 2024-09-18T12:51:03.627 INFO:tasks.workunit.client.0.smithi081.stdout:4/23: mknod d3/c6 0 2024-09-18T12:51:03.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/21: mkdir d0/d6 0 2024-09-18T12:51:03.630 INFO:tasks.workunit.client.0.smithi081.stdout:4/24: unlink d3/f5 0 2024-09-18T12:51:03.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/25: unlink c2 0 2024-09-18T12:51:03.634 INFO:tasks.workunit.client.0.smithi081.stdout:4/26: rename f0 to d3/f7 0 2024-09-18T12:51:03.640 INFO:tasks.workunit.client.0.smithi081.stdout:9/19: dwrite f6 [0,4194304] 0 2024-09-18T12:51:03.640 INFO:tasks.workunit.client.0.smithi081.stdout:9/20: write f0 [904894,66885] 0 2024-09-18T12:51:03.640 INFO:tasks.workunit.client.0.smithi081.stdout:6/17: dwrite f1 [0,4194304] 0 2024-09-18T12:51:03.640 INFO:tasks.workunit.client.0.smithi081.stdout:9/21: creat f7 x:0 0 0 2024-09-18T12:51:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:8/32: truncate d3/f9 528776 0 2024-09-18T12:51:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:9/22: write f0 [587640,69106] 0 2024-09-18T12:51:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:9/23: stat f7 0 2024-09-18T12:51:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:9/24: creat f8 x:0 0 0 2024-09-18T12:51:03.642 INFO:tasks.workunit.client.0.smithi081.stdout:5/21: truncate d2/f3 137046 0 2024-09-18T12:51:03.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/22: dread d0/f2 [0,4194304] 0 2024-09-18T12:51:03.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/23: write d0/f2 [434728,56505] 0 2024-09-18T12:51:03.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/24: truncate d0/f2 1187422 0 2024-09-18T12:51:03.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/25: chown d0 239971730 1 2024-09-18T12:51:03.645 INFO:tasks.workunit.client.0.smithi081.stdout:1/26: write d0/f2 [985297,112929] 0 2024-09-18T12:51:03.645 INFO:tasks.workunit.client.0.smithi081.stdout:5/22: stat c1 0 2024-09-18T12:51:03.647 INFO:tasks.workunit.client.0.smithi081.stdout:8/33: rename d3/l4 to d3/lc 0 2024-09-18T12:51:03.648 INFO:tasks.workunit.client.0.smithi081.stdout:1/27: mkdir d0/d6/d7 0 2024-09-18T12:51:03.648 INFO:tasks.workunit.client.0.smithi081.stdout:1/28: truncate d0/f2 1347816 0 2024-09-18T12:51:03.649 INFO:tasks.workunit.client.0.smithi081.stdout:5/23: rmdir d2/d4 39 2024-09-18T12:51:03.651 INFO:tasks.workunit.client.0.smithi081.stdout:1/29: mkdir d0/d6/d7/d8 0 2024-09-18T12:51:03.653 INFO:tasks.workunit.client.0.smithi081.stdout:5/24: getdents d2 0 2024-09-18T12:51:03.654 INFO:tasks.workunit.client.0.smithi081.stdout:6/18: dread f0 [0,4194304] 0 2024-09-18T12:51:03.655 INFO:tasks.workunit.client.0.smithi081.stdout:5/25: mknod d2/c7 0 2024-09-18T12:51:03.655 INFO:tasks.workunit.client.0.smithi081.stdout:6/19: mkdir d4/d6 0 2024-09-18T12:51:03.656 INFO:tasks.workunit.client.0.smithi081.stdout:6/20: creat d4/f7 x:0 0 0 2024-09-18T12:51:03.657 INFO:tasks.workunit.client.0.smithi081.stdout:4/27: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:03.659 INFO:tasks.workunit.client.0.smithi081.stdout:5/26: creat d2/d4/f8 x:0 0 0 2024-09-18T12:51:03.659 INFO:tasks.workunit.client.0.smithi081.stdout:5/27: creat d2/d4/f9 x:0 0 0 2024-09-18T12:51:03.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/30: dread d0/f2 [0,4194304] 0 2024-09-18T12:51:03.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/31: write d0/f4 [306099,56595] 0 2024-09-18T12:51:03.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/28: mknod d2/d4/ca 0 2024-09-18T12:51:03.665 INFO:tasks.workunit.client.0.smithi081.stdout:8/34: dwrite d3/fb [0,4194304] 0 2024-09-18T12:51:03.671 INFO:tasks.workunit.client.0.smithi081.stdout:5/29: truncate d2/f3 520548 0 2024-09-18T12:51:03.671 INFO:tasks.workunit.client.0.smithi081.stdout:5/30: dread - d2/d4/f9 zero size 2024-09-18T12:51:03.675 INFO:tasks.workunit.client.0.smithi081.stdout:4/28: dwrite d3/f7 [4194304,4194304] 0 2024-09-18T12:51:03.677 INFO:tasks.workunit.client.0.smithi081.stdout:1/32: dread d0/f4 [0,4194304] 0 2024-09-18T12:51:03.679 INFO:tasks.workunit.client.0.smithi081.stdout:1/33: creat d0/d6/f9 x:0 0 0 2024-09-18T12:51:03.679 INFO:tasks.workunit.client.0.smithi081.stdout:1/34: write d0/f2 [511110,57265] 0 2024-09-18T12:51:03.679 INFO:tasks.workunit.client.0.smithi081.stdout:1/35: rename d0 to d0/d6/da 22 2024-09-18T12:51:03.680 INFO:tasks.workunit.client.0.smithi081.stdout:1/36: mkdir d0/db 0 2024-09-18T12:51:03.680 INFO:tasks.workunit.client.0.smithi081.stdout:1/37: chown d0/f2 32 1 2024-09-18T12:51:03.682 INFO:tasks.workunit.client.0.smithi081.stdout:1/38: link d0/f2 d0/d6/d7/d8/fc 0 2024-09-18T12:51:03.683 INFO:tasks.workunit.client.0.smithi081.stdout:1/39: link d0/d6/d7/d8/fc d0/d6/fd 0 2024-09-18T12:51:03.685 INFO:tasks.workunit.client.0.smithi081.stdout:5/31: dread d2/f3 [0,4194304] 0 2024-09-18T12:51:03.685 INFO:tasks.workunit.client.0.smithi081.stdout:5/32: creat d2/d4/fb x:0 0 0 2024-09-18T12:51:03.685 INFO:tasks.workunit.client.0.smithi081.stdout:5/33: chown d2/f3 1749079 1 2024-09-18T12:51:03.686 INFO:tasks.workunit.client.0.smithi081.stdout:4/29: truncate d3/f7 892091 0 2024-09-18T12:51:03.688 INFO:tasks.workunit.client.0.smithi081.stdout:4/30: link d3/c6 d3/c8 0 2024-09-18T12:51:03.693 INFO:tasks.workunit.client.0.smithi081.stdout:1/40: truncate d0/d6/fd 1276632 0 2024-09-18T12:51:03.700 INFO:tasks.workunit.client.0.smithi081.stdout:5/34: dwrite d2/d4/f6 [0,4194304] 0 2024-09-18T12:51:03.701 INFO:tasks.workunit.client.0.smithi081.stdout:5/35: rename d2 to d2/dc 22 2024-09-18T12:51:03.702 INFO:tasks.workunit.client.0.smithi081.stdout:5/36: getdents d2 0 2024-09-18T12:51:03.703 INFO:tasks.workunit.client.0.smithi081.stdout:4/31: write d3/f7 [41182,119341] 0 2024-09-18T12:51:03.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/37: unlink d2/d4/fb 0 2024-09-18T12:51:03.708 INFO:tasks.workunit.client.0.smithi081.stdout:4/32: creat d3/f9 x:0 0 0 2024-09-18T12:51:03.708 INFO:tasks.workunit.client.0.smithi081.stdout:4/33: link d3/c8 d3/ca 0 2024-09-18T12:51:03.708 INFO:tasks.workunit.client.0.smithi081.stdout:4/34: dread - d3/f9 zero size 2024-09-18T12:51:03.710 INFO:tasks.workunit.client.0.smithi081.stdout:1/41: dwrite d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:03.711 INFO:tasks.workunit.client.0.smithi081.stdout:1/42: write d0/d6/d7/d8/fc [1026385,40446] 0 2024-09-18T12:51:03.722 INFO:tasks.workunit.client.0.smithi081.stdout:5/38: dwrite d2/f3 [0,4194304] 0 2024-09-18T12:51:03.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/39: mkdir d2/dd 0 2024-09-18T12:51:03.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/43: dread d0/d6/fd [0,4194304] 0 2024-09-18T12:51:03.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/44: creat d0/d6/fe x:0 0 0 2024-09-18T12:51:03.729 INFO:tasks.workunit.client.0.smithi081.stdout:1/45: truncate d0/d6/fd 812698 0 2024-09-18T12:51:03.730 INFO:tasks.workunit.client.0.smithi081.stdout:1/46: creat d0/ff x:0 0 0 2024-09-18T12:51:03.730 INFO:tasks.workunit.client.0.smithi081.stdout:1/47: dread - d0/d6/fe zero size 2024-09-18T12:51:03.742 INFO:tasks.workunit.client.0.smithi081.stdout:5/40: dwrite d2/d4/f9 [0,4194304] 0 2024-09-18T12:51:03.742 INFO:tasks.workunit.client.0.smithi081.stdout:1/48: dread d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:03.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/49: dread d0/d6/fd [0,4194304] 0 2024-09-18T12:51:03.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/50: stat d0/f2 0 2024-09-18T12:51:03.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/51: write d0/f2 [1008065,38696] 0 2024-09-18T12:51:03.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/52: mknod d0/d6/d7/d8/c10 0 2024-09-18T12:51:03.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/41: dwrite d2/d4/f9 [0,4194304] 0 2024-09-18T12:51:03.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/42: read - d2/d4/f8 zero size 2024-09-18T12:51:03.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/43: write d2/d4/f8 [952734,7634] 0 2024-09-18T12:51:03.759 INFO:tasks.workunit.client.0.smithi081.stdout:5/44: link d2/f3 d2/fe 0 2024-09-18T12:51:03.759 INFO:tasks.workunit.client.0.smithi081.stdout:5/45: write d2/d4/f9 [4426383,48464] 0 2024-09-18T12:51:03.760 INFO:tasks.workunit.client.0.smithi081.stdout:5/46: unlink d2/d4/f9 0 2024-09-18T12:51:03.773 INFO:tasks.workunit.client.0.smithi081.stdout:5/47: dwrite d2/f3 [0,4194304] 0 2024-09-18T12:51:03.787 INFO:tasks.workunit.client.0.smithi081.stdout:5/48: dwrite d2/f3 [0,4194304] 0 2024-09-18T12:51:03.788 INFO:tasks.workunit.client.0.smithi081.stdout:5/49: creat d2/ff x:0 0 0 2024-09-18T12:51:03.796 INFO:tasks.workunit.client.0.smithi081.stdout:5/50: dread d2/d4/f6 [0,4194304] 0 2024-09-18T12:51:03.801 INFO:tasks.workunit.client.0.smithi081.stdout:5/51: truncate d2/fe 1635900 0 2024-09-18T12:51:03.810 INFO:tasks.workunit.client.0.smithi081.stdout:5/52: dread d2/f3 [0,4194304] 0 2024-09-18T12:51:03.812 INFO:tasks.workunit.client.0.smithi081.stdout:5/53: unlink d2/c7 0 2024-09-18T12:51:03.812 INFO:tasks.workunit.client.0.smithi081.stdout:5/54: creat d2/dd/f10 x:0 0 0 2024-09-18T12:51:03.813 INFO:tasks.workunit.client.0.smithi081.stdout:5/55: symlink d2/d4/l11 0 2024-09-18T12:51:03.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/56: mkdir d2/d12 0 2024-09-18T12:51:03.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/57: creat d2/d4/f13 x:0 0 0 2024-09-18T12:51:03.815 INFO:tasks.workunit.client.0.smithi081.stdout:5/58: chown d2/d4/ca 15202773 1 2024-09-18T12:51:03.815 INFO:tasks.workunit.client.0.smithi081.stdout:5/59: dread - d2/dd/f10 zero size 2024-09-18T12:51:03.816 INFO:tasks.workunit.client.0.smithi081.stdout:5/60: mkdir d2/d14 0 2024-09-18T12:51:03.817 INFO:tasks.workunit.client.0.smithi081.stdout:5/61: mknod d2/d12/c15 0 2024-09-18T12:51:03.833 INFO:tasks.workunit.client.0.smithi081.stdout:5/62: dwrite d2/d4/f13 [0,4194304] 0 2024-09-18T12:51:03.834 INFO:tasks.workunit.client.0.smithi081.stdout:5/63: mkdir d2/d4/d16 0 2024-09-18T12:51:03.851 INFO:tasks.workunit.client.0.smithi081.stdout:5/64: dwrite d2/d4/f13 [0,4194304] 0 2024-09-18T12:51:03.853 INFO:tasks.workunit.client.0.smithi081.stdout:5/65: rename d2/d4/f6 to d2/d14/f17 0 2024-09-18T12:51:03.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/66: unlink c1 0 2024-09-18T12:51:03.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/67: mkdir d2/d4/d18 0 2024-09-18T12:51:03.855 INFO:tasks.workunit.client.0.smithi081.stdout:5/68: write d2/d4/f8 [1990967,55823] 0 2024-09-18T12:51:03.855 INFO:tasks.workunit.client.0.smithi081.stdout:5/69: link d2/d4/ca d2/d12/c19 0 2024-09-18T12:51:03.864 INFO:tasks.workunit.client.0.smithi081.stdout:5/70: write d2/d4/f13 [771540,55815] 0 2024-09-18T12:51:03.865 INFO:tasks.workunit.client.0.smithi081.stdout:5/71: mkdir d2/d12/d1a 0 2024-09-18T12:51:03.865 INFO:tasks.workunit.client.0.smithi081.stdout:5/72: fdatasync d2/fe 0 2024-09-18T12:51:03.882 INFO:tasks.workunit.client.0.smithi081.stdout:5/73: dwrite d2/d4/f8 [0,4194304] 0 2024-09-18T12:51:03.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/74: link d2/d4/ca d2/d4/d16/c1b 0 2024-09-18T12:51:03.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/75: dread - d2/dd/f10 zero size 2024-09-18T12:51:03.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/76: chown d2/d4/d16 451 1 2024-09-18T12:51:03.885 INFO:tasks.workunit.client.0.smithi081.stdout:5/77: symlink d2/d14/l1c 0 2024-09-18T12:51:03.886 INFO:tasks.workunit.client.0.smithi081.stdout:5/78: truncate d2/d14/f17 2789953 0 2024-09-18T12:51:03.886 INFO:tasks.workunit.client.0.smithi081.stdout:5/79: fsync d2/fe 0 2024-09-18T12:51:03.890 INFO:tasks.workunit.client.0.smithi081.stdout:5/80: rename d2/d12 to d2/d14/d1d 0 2024-09-18T12:51:03.891 INFO:tasks.workunit.client.0.smithi081.stdout:5/81: rename d2/f3 to d2/d14/f1e 0 2024-09-18T12:51:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:03 smithi136 ceph-mon[35363]: pgmap v274: 65 pgs: 65 active+clean; 310 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 21 MiB/s wr, 553 op/s 2024-09-18T12:51:04.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:03 smithi081 ceph-mon[27646]: pgmap v274: 65 pgs: 65 active+clean; 310 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 21 MiB/s wr, 553 op/s 2024-09-18T12:51:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:04 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:04 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:06.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:05 smithi081 ceph-mon[27646]: pgmap v275: 65 pgs: 65 active+clean; 365 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 27 MiB/s wr, 684 op/s 2024-09-18T12:51:06.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:05 smithi136 ceph-mon[35363]: pgmap v275: 65 pgs: 65 active+clean; 365 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 27 MiB/s wr, 684 op/s 2024-09-18T12:51:07.568 INFO:tasks.workunit.client.1.smithi136.stdout:0/12: sync 2024-09-18T12:51:07.569 INFO:tasks.workunit.client.1.smithi136.stdout:0/13: write - no filename 2024-09-18T12:51:07.569 INFO:tasks.workunit.client.1.smithi136.stdout:0/14: mkdir d1/d3 0 2024-09-18T12:51:07.571 INFO:tasks.workunit.client.1.smithi136.stdout:0/15: rename l0 to d1/d3/l4 0 2024-09-18T12:51:07.572 INFO:tasks.workunit.client.1.smithi136.stdout:0/16: creat d1/d3/f5 x:0 0 0 2024-09-18T12:51:07.572 INFO:tasks.workunit.client.1.smithi136.stdout:0/17: write d1/d3/f5 [673308,66897] 0 2024-09-18T12:51:07.576 INFO:tasks.workunit.client.1.smithi136.stdout:0/18: rename d1/d3/l4 to d1/l6 0 2024-09-18T12:51:07.579 INFO:tasks.workunit.client.1.smithi136.stdout:0/19: rmdir d1/d3 39 2024-09-18T12:51:07.602 INFO:tasks.workunit.client.1.smithi136.stdout:0/20: dwrite d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:07.623 INFO:tasks.workunit.client.1.smithi136.stdout:0/21: dwrite d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:07.623 INFO:tasks.workunit.client.1.smithi136.stdout:0/22: stat d1 0 2024-09-18T12:51:07.642 INFO:tasks.workunit.client.1.smithi136.stdout:0/23: dwrite d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:07.662 INFO:tasks.workunit.client.1.smithi136.stdout:0/24: dwrite d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:07.665 INFO:tasks.workunit.client.1.smithi136.stdout:0/25: truncate d1/d3/f5 1842439 0 2024-09-18T12:51:07.673 INFO:tasks.workunit.client.1.smithi136.stdout:0/26: write d1/d3/f5 [59010,9652] 0 2024-09-18T12:51:07.695 INFO:tasks.workunit.client.1.smithi136.stdout:0/27: dwrite d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:07.695 INFO:tasks.workunit.client.1.smithi136.stdout:0/28: rename d1 to d1/d3/d7 22 2024-09-18T12:51:07.703 INFO:tasks.workunit.client.1.smithi136.stdout:0/29: write d1/d3/f5 [2528419,39942] 0 2024-09-18T12:51:07.703 INFO:tasks.workunit.client.1.smithi136.stdout:0/30: read d1/d3/f5 [479297,50931] 0 2024-09-18T12:51:07.703 INFO:tasks.workunit.client.1.smithi136.stdout:0/31: rmdir d1 39 2024-09-18T12:51:07.704 INFO:tasks.workunit.client.1.smithi136.stdout:0/32: creat d1/d3/f8 x:0 0 0 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:8/33: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:3/27: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:9/31: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:5/35: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:7/178: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:1/7: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/3: sync 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/4: chown . 29 1 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/5: dwrite - no filename 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/6: rename - no filename 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/7: link - no file 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:4/8: dread - no filename 2024-09-18T12:51:07.714 INFO:tasks.workunit.client.1.smithi136.stdout:2/84: sync 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:7/179: stat d0/d12/d1a/c28 0 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/85: chown d5/cd 670414671 1 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:6/66: sync 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/86: write d5/d7/f10 [16866,102924] 0 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/87: truncate d5/f19 6137673 0 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:8/34: creat d9/dd/fe x:0 0 0 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:3/28: dread f1 [0,4194304] 0 2024-09-18T12:51:07.715 INFO:tasks.workunit.client.1.smithi136.stdout:8/35: dread - d9/dd/fe zero size 2024-09-18T12:51:07.716 INFO:tasks.workunit.client.1.smithi136.stdout:9/32: truncate d6/da/fd 3251986 0 2024-09-18T12:51:07.716 INFO:tasks.workunit.client.1.smithi136.stdout:1/8: symlink d2/l3 0 2024-09-18T12:51:07.716 INFO:tasks.workunit.client.1.smithi136.stdout:1/9: readlink d2/l3 0 2024-09-18T12:51:07.716 INFO:tasks.workunit.client.1.smithi136.stdout:7/180: dread d0/f31 [0,4194304] 0 2024-09-18T12:51:07.717 INFO:tasks.workunit.client.1.smithi136.stdout:3/29: symlink d3/d5/l6 0 2024-09-18T12:51:07.718 INFO:tasks.workunit.client.1.smithi136.stdout:8/36: symlink d9/lf 0 2024-09-18T12:51:07.718 INFO:tasks.workunit.client.1.smithi136.stdout:8/37: write d9/dd/fe [513310,3354] 0 2024-09-18T12:51:07.718 INFO:tasks.workunit.client.1.smithi136.stdout:1/10: dread f1 [0,4194304] 0 2024-09-18T12:51:07.719 INFO:tasks.workunit.client.1.smithi136.stdout:3/30: unlink f1 0 2024-09-18T12:51:07.719 INFO:tasks.workunit.client.1.smithi136.stdout:3/31: write f2 [123156,106356] 0 2024-09-18T12:51:07.719 INFO:tasks.workunit.client.1.smithi136.stdout:7/181: write d0/d35/d36/ff [205129,125898] 0 2024-09-18T12:51:07.719 INFO:tasks.workunit.client.1.smithi136.stdout:7/182: write d0/d2c/f2f [745188,79934] 0 2024-09-18T12:51:07.720 INFO:tasks.workunit.client.1.smithi136.stdout:7/183: creat d0/d12/d2a/f42 x:0 0 0 2024-09-18T12:51:07.722 INFO:tasks.workunit.client.1.smithi136.stdout:3/32: mknod d3/c7 0 2024-09-18T12:51:07.725 INFO:tasks.workunit.client.1.smithi136.stdout:6/67: dread f7 [0,4194304] 0 2024-09-18T12:51:07.730 INFO:tasks.workunit.client.1.smithi136.stdout:5/36: read f2 [258487,7913] 0 2024-09-18T12:51:07.739 INFO:tasks.workunit.client.1.smithi136.stdout:9/33: dread d6/f7 [0,4194304] 0 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/88: dwrite d5/ff [0,4194304] 0 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:9/34: truncate d6/f7 5169725 0 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/89: dread - d5/d7/f12 zero size 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/90: truncate f4 1348343 0 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/91: readlink d5/d7/l16 0 2024-09-18T12:51:07.740 INFO:tasks.workunit.client.1.smithi136.stdout:8/38: dwrite f5 [0,4194304] 0 2024-09-18T12:51:07.741 INFO:tasks.workunit.client.1.smithi136.stdout:2/92: getdents d5/d7 0 2024-09-18T12:51:07.744 INFO:tasks.workunit.client.1.smithi136.stdout:8/39: symlink d9/dd/l10 0 2024-09-18T12:51:07.744 INFO:tasks.workunit.client.1.smithi136.stdout:8/40: chown d9/dd/l10 3370340 1 2024-09-18T12:51:07.747 INFO:tasks.workunit.client.1.smithi136.stdout:6/68: dwrite f7 [0,4194304] 0 2024-09-18T12:51:07.749 INFO:tasks.workunit.client.1.smithi136.stdout:8/41: link f3 d9/dd/f11 0 2024-09-18T12:51:07.749 INFO:tasks.workunit.client.1.smithi136.stdout:2/93: dread d5/f9 [4194304,4194304] 0 2024-09-18T12:51:07.751 INFO:tasks.workunit.client.1.smithi136.stdout:8/42: symlink d9/dd/l12 0 2024-09-18T12:51:07.754 INFO:tasks.workunit.client.1.smithi136.stdout:2/94: link d5/d7/lc d5/l1b 0 2024-09-18T12:51:07.754 INFO:tasks.workunit.client.1.smithi136.stdout:2/95: chown d5/l14 10 1 2024-09-18T12:51:07.754 INFO:tasks.workunit.client.1.smithi136.stdout:8/43: mknod d9/dd/c13 0 2024-09-18T12:51:07.756 INFO:tasks.workunit.client.1.smithi136.stdout:5/37: write f2 [2202945,30910] 0 2024-09-18T12:51:07.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/96: rename f2 to d5/f1c 0 2024-09-18T12:51:07.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/69: dread f7 [0,4194304] 0 2024-09-18T12:51:07.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/70: write d8/d9/fa [1171855,22786] 0 2024-09-18T12:51:07.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/71: stat d8/c10 0 2024-09-18T12:51:07.760 INFO:tasks.workunit.client.1.smithi136.stdout:6/72: creat d8/f19 x:0 0 0 2024-09-18T12:51:07.761 INFO:tasks.workunit.client.1.smithi136.stdout:9/35: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:51:07.764 INFO:tasks.workunit.client.1.smithi136.stdout:1/11: dwrite f1 [0,4194304] 0 2024-09-18T12:51:07.764 INFO:tasks.workunit.client.1.smithi136.stdout:1/12: chown f1 101213 1 2024-09-18T12:51:07.764 INFO:tasks.workunit.client.1.smithi136.stdout:9/36: mkdir d6/df 0 2024-09-18T12:51:07.769 INFO:tasks.workunit.client.1.smithi136.stdout:1/13: link f1 d2/f4 0 2024-09-18T12:51:07.769 INFO:tasks.workunit.client.1.smithi136.stdout:1/14: chown d2/f4 103808 1 2024-09-18T12:51:07.770 INFO:tasks.workunit.client.1.smithi136.stdout:8/44: dread f3 [0,4194304] 0 2024-09-18T12:51:07.772 INFO:tasks.workunit.client.1.smithi136.stdout:7/184: dwrite d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:07.773 INFO:tasks.workunit.client.1.smithi136.stdout:2/97: truncate d5/f9 1189848 0 2024-09-18T12:51:07.777 INFO:tasks.workunit.client.1.smithi136.stdout:1/15: dread d2/f4 [0,4194304] 0 2024-09-18T12:51:07.778 INFO:tasks.workunit.client.1.smithi136.stdout:7/185: creat d0/d39/f43 x:0 0 0 2024-09-18T12:51:07.778 INFO:tasks.workunit.client.1.smithi136.stdout:7/186: chown d0/d12/d2a/f37 11063036 1 2024-09-18T12:51:07.779 INFO:tasks.workunit.client.1.smithi136.stdout:6/73: write d8/dc/f14 [130585,117601] 0 2024-09-18T12:51:07.781 INFO:tasks.workunit.client.1.smithi136.stdout:5/38: dwrite f2 [4194304,4194304] 0 2024-09-18T12:51:07.781 INFO:tasks.workunit.client.1.smithi136.stdout:5/39: write f2 [2230640,8848] 0 2024-09-18T12:51:07.781 INFO:tasks.workunit.client.1.smithi136.stdout:1/16: mkdir d2/d5 0 2024-09-18T12:51:07.783 INFO:tasks.workunit.client.1.smithi136.stdout:6/74: symlink d8/d9/de/l1a 0 2024-09-18T12:51:07.784 INFO:tasks.workunit.client.1.smithi136.stdout:1/17: read f1 [1922971,101684] 0 2024-09-18T12:51:07.784 INFO:tasks.workunit.client.1.smithi136.stdout:8/45: rename d9/dd to d9/d14 0 2024-09-18T12:51:07.786 INFO:tasks.workunit.client.1.smithi136.stdout:2/98: truncate f3 2003902 0 2024-09-18T12:51:07.786 INFO:tasks.workunit.client.1.smithi136.stdout:2/99: chown d5/d7/lc 19450 1 2024-09-18T12:51:07.786 INFO:tasks.workunit.client.1.smithi136.stdout:2/100: chown d5/f19 34497244 1 2024-09-18T12:51:07.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/187: getdents d0/d12/d1a 0 2024-09-18T12:51:07.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/188: dread - d0/d12/d2a/f42 zero size 2024-09-18T12:51:07.792 INFO:tasks.workunit.client.1.smithi136.stdout:6/75: symlink d8/dc/l1b 0 2024-09-18T12:51:07.793 INFO:tasks.workunit.client.1.smithi136.stdout:6/76: stat d8/d9/de/f18 0 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:1/18: creat d2/d5/f6 x:0 0 0 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:1/19: read f1 [1622626,60130] 0 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:1/20: chown f1 27694 1 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:1/21: readlink l0 0 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:1/22: fsync f1 0 2024-09-18T12:51:07.794 INFO:tasks.workunit.client.1.smithi136.stdout:9/37: write d6/da/fd [42134,20421] 0 2024-09-18T12:51:07.795 INFO:tasks.workunit.client.1.smithi136.stdout:8/46: creat d9/d14/f15 x:0 0 0 2024-09-18T12:51:07.798 INFO:tasks.workunit.client.1.smithi136.stdout:6/77: mkdir d8/d9/de/d1c 0 2024-09-18T12:51:07.798 INFO:tasks.workunit.client.1.smithi136.stdout:6/78: write d8/f19 [730619,36903] 0 2024-09-18T12:51:07.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/23: truncate f1 4095956 0 2024-09-18T12:51:07.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/24: fdatasync d2/d5/f6 0 2024-09-18T12:51:07.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/25: truncate d2/d5/f6 900295 0 2024-09-18T12:51:07.801 INFO:tasks.workunit.client.1.smithi136.stdout:2/101: dwrite d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:07.801 INFO:tasks.workunit.client.1.smithi136.stdout:8/47: symlink d9/d14/l16 0 2024-09-18T12:51:07.802 INFO:tasks.workunit.client.1.smithi136.stdout:6/79: creat d8/dc/f1d x:0 0 0 2024-09-18T12:51:07.803 INFO:tasks.workunit.client.1.smithi136.stdout:1/26: creat d2/f7 x:0 0 0 2024-09-18T12:51:07.804 INFO:tasks.workunit.client.1.smithi136.stdout:9/38: rmdir d6/da 39 2024-09-18T12:51:07.808 INFO:tasks.workunit.client.1.smithi136.stdout:5/40: truncate f2 2920375 0 2024-09-18T12:51:07.809 INFO:tasks.workunit.client.1.smithi136.stdout:2/102: creat d5/d7/d17/f1d x:0 0 0 2024-09-18T12:51:07.809 INFO:tasks.workunit.client.1.smithi136.stdout:1/27: write f1 [464790,21182] 0 2024-09-18T12:51:07.809 INFO:tasks.workunit.client.1.smithi136.stdout:1/28: truncate d2/f4 4464138 0 2024-09-18T12:51:07.809 INFO:tasks.workunit.client.1.smithi136.stdout:8/48: symlink d9/d14/l17 0 2024-09-18T12:51:07.810 INFO:tasks.workunit.client.1.smithi136.stdout:6/80: unlink d8/c10 0 2024-09-18T12:51:07.811 INFO:tasks.workunit.client.1.smithi136.stdout:9/39: mknod d6/db/c10 0 2024-09-18T12:51:07.811 INFO:tasks.workunit.client.1.smithi136.stdout:9/40: read d6/da/fd [3028497,85126] 0 2024-09-18T12:51:07.813 INFO:tasks.workunit.client.1.smithi136.stdout:1/29: symlink d2/d5/l8 0 2024-09-18T12:51:07.813 INFO:tasks.workunit.client.1.smithi136.stdout:1/30: write f1 [319543,80605] 0 2024-09-18T12:51:07.813 INFO:tasks.workunit.client.1.smithi136.stdout:1/31: truncate d2/f7 77165 0 2024-09-18T12:51:07.813 INFO:tasks.workunit.client.1.smithi136.stdout:5/41: write f2 [2779389,84483] 0 2024-09-18T12:51:07.814 INFO:tasks.workunit.client.1.smithi136.stdout:9/41: mknod d6/db/c11 0 2024-09-18T12:51:07.816 INFO:tasks.workunit.client.1.smithi136.stdout:2/103: dread d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:07.816 INFO:tasks.workunit.client.1.smithi136.stdout:2/104: chown d5/d7/lc 0 1 2024-09-18T12:51:07.816 INFO:tasks.workunit.client.1.smithi136.stdout:1/32: mkdir d2/d5/d9 0 2024-09-18T12:51:07.817 INFO:tasks.workunit.client.1.smithi136.stdout:1/33: creat d2/d5/fa x:0 0 0 2024-09-18T12:51:07.819 INFO:tasks.workunit.client.1.smithi136.stdout:5/42: rename l3 to d5/l8 0 2024-09-18T12:51:07.819 INFO:tasks.workunit.client.1.smithi136.stdout:5/43: chown l0 238975288 1 2024-09-18T12:51:07.820 INFO:tasks.workunit.client.1.smithi136.stdout:8/49: mkdir d9/d18 0 2024-09-18T12:51:07.820 INFO:tasks.workunit.client.1.smithi136.stdout:8/50: chown d9/d14/l17 1604 1 2024-09-18T12:51:07.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/42: mkdir d6/db/d12 0 2024-09-18T12:51:07.823 INFO:tasks.workunit.client.1.smithi136.stdout:8/51: unlink d9/fb 0 2024-09-18T12:51:07.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/43: rmdir d6/db 39 2024-09-18T12:51:07.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/44: write f3 [4336695,16837] 0 2024-09-18T12:51:07.825 INFO:tasks.workunit.client.1.smithi136.stdout:8/52: creat d9/f19 x:0 0 0 2024-09-18T12:51:07.826 INFO:tasks.workunit.client.1.smithi136.stdout:5/44: dread f2 [0,4194304] 0 2024-09-18T12:51:07.827 INFO:tasks.workunit.client.1.smithi136.stdout:9/45: mkdir d6/d13 0 2024-09-18T12:51:07.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/53: mkdir d9/d14/d1a 0 2024-09-18T12:51:07.829 INFO:tasks.workunit.client.1.smithi136.stdout:5/45: creat d5/f9 x:0 0 0 2024-09-18T12:51:07.831 INFO:tasks.workunit.client.1.smithi136.stdout:9/46: symlink d6/d13/l14 0 2024-09-18T12:51:07.836 INFO:tasks.workunit.client.1.smithi136.stdout:2/105: dwrite d5/d7/d17/f1d [0,4194304] 0 2024-09-18T12:51:07.836 INFO:tasks.workunit.client.1.smithi136.stdout:1/34: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:07.837 INFO:tasks.workunit.client.1.smithi136.stdout:8/54: dread f3 [0,4194304] 0 2024-09-18T12:51:07.838 INFO:tasks.workunit.client.1.smithi136.stdout:2/106: rmdir d5/d7/d11 39 2024-09-18T12:51:07.847 INFO:tasks.workunit.client.1.smithi136.stdout:1/35: getdents d2/d5 0 2024-09-18T12:51:07.848 INFO:tasks.workunit.client.1.smithi136.stdout:1/36: creat d2/fb x:0 0 0 2024-09-18T12:51:07.851 INFO:tasks.workunit.client.1.smithi136.stdout:8/55: rmdir d9/d14 39 2024-09-18T12:51:07.851 INFO:tasks.workunit.client.1.smithi136.stdout:8/56: getdents d9/d18 0 2024-09-18T12:51:07.852 INFO:tasks.workunit.client.1.smithi136.stdout:8/57: truncate d9/d14/fe 42134 0 2024-09-18T12:51:07.852 INFO:tasks.workunit.client.1.smithi136.stdout:8/58: truncate d9/d14/f15 633688 0 2024-09-18T12:51:07.853 INFO:tasks.workunit.client.1.smithi136.stdout:8/59: symlink d9/d18/l1b 0 2024-09-18T12:51:07.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/46: dwrite f2 [0,4194304] 0 2024-09-18T12:51:07.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/47: creat d5/fa x:0 0 0 2024-09-18T12:51:07.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/48: fsync f2 0 2024-09-18T12:51:07.854 INFO:tasks.workunit.client.1.smithi136.stdout:8/60: creat d9/d18/f1c x:0 0 0 2024-09-18T12:51:07.857 INFO:tasks.workunit.client.1.smithi136.stdout:8/61: creat d9/d14/f1d x:0 0 0 2024-09-18T12:51:07.857 INFO:tasks.workunit.client.1.smithi136.stdout:8/62: truncate d9/d14/f1d 782220 0 2024-09-18T12:51:07.859 INFO:tasks.workunit.client.1.smithi136.stdout:9/47: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:51:07.864 INFO:tasks.workunit.client.1.smithi136.stdout:1/37: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:07.864 INFO:tasks.workunit.client.1.smithi136.stdout:1/38: stat d2/d5/f6 0 2024-09-18T12:51:07.864 INFO:tasks.workunit.client.1.smithi136.stdout:1/39: chown d2/d5/f6 266425 1 2024-09-18T12:51:07.864 INFO:tasks.workunit.client.1.smithi136.stdout:2/107: dwrite d5/f1c [0,4194304] 0 2024-09-18T12:51:07.864 INFO:tasks.workunit.client.1.smithi136.stdout:2/108: chown d5/f9 969986 1 2024-09-18T12:51:07.865 INFO:tasks.workunit.client.1.smithi136.stdout:2/109: write d5/d7/f12 [92524,64999] 0 2024-09-18T12:51:07.866 INFO:tasks.workunit.client.1.smithi136.stdout:8/63: read d9/d14/f11 [2838128,110031] 0 2024-09-18T12:51:07.866 INFO:tasks.workunit.client.1.smithi136.stdout:2/110: rename d5/f6 to d5/d7/f1e 0 2024-09-18T12:51:07.870 INFO:tasks.workunit.client.1.smithi136.stdout:2/111: creat d5/f1f x:0 0 0 2024-09-18T12:51:07.872 INFO:tasks.workunit.client.1.smithi136.stdout:8/64: rename d9/f19 to d9/f1e 0 2024-09-18T12:51:07.872 INFO:tasks.workunit.client.1.smithi136.stdout:8/65: creat d9/d14/f1f x:0 0 0 2024-09-18T12:51:07.874 INFO:tasks.workunit.client.1.smithi136.stdout:2/112: creat d5/d7/d11/f20 x:0 0 0 2024-09-18T12:51:07.874 INFO:tasks.workunit.client.1.smithi136.stdout:2/113: chown d5/cb 33941610 1 2024-09-18T12:51:07.874 INFO:tasks.workunit.client.1.smithi136.stdout:2/114: creat d5/f21 x:0 0 0 2024-09-18T12:51:07.874 INFO:tasks.workunit.client.1.smithi136.stdout:5/49: truncate f2 229938 0 2024-09-18T12:51:07.874 INFO:tasks.workunit.client.1.smithi136.stdout:5/50: fsync d5/fa 0 2024-09-18T12:51:07.878 INFO:tasks.workunit.client.1.smithi136.stdout:8/66: creat d9/f20 x:0 0 0 2024-09-18T12:51:07.878 INFO:tasks.workunit.client.1.smithi136.stdout:8/67: readlink d9/d14/l16 0 2024-09-18T12:51:07.879 INFO:tasks.workunit.client.1.smithi136.stdout:8/68: truncate f3 2669409 0 2024-09-18T12:51:07.881 INFO:tasks.workunit.client.1.smithi136.stdout:8/69: mknod d9/d14/c21 0 2024-09-18T12:51:07.881 INFO:tasks.workunit.client.1.smithi136.stdout:8/70: chown f5 419 1 2024-09-18T12:51:07.882 INFO:tasks.workunit.client.1.smithi136.stdout:1/40: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:07.883 INFO:tasks.workunit.client.1.smithi136.stdout:8/71: symlink d9/d14/d1a/l22 0 2024-09-18T12:51:07.884 INFO:tasks.workunit.client.1.smithi136.stdout:9/48: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:51:07.884 INFO:tasks.workunit.client.1.smithi136.stdout:9/49: stat d6/db/c11 0 2024-09-18T12:51:07.884 INFO:tasks.workunit.client.1.smithi136.stdout:9/50: fdatasync d6/da/fd 0 2024-09-18T12:51:07.884 INFO:tasks.workunit.client.1.smithi136.stdout:9/51: write f3 [3657271,75427] 0 2024-09-18T12:51:07.884 INFO:tasks.workunit.client.1.smithi136.stdout:1/41: creat d2/d5/d9/fc x:0 0 0 2024-09-18T12:51:07.886 INFO:tasks.workunit.client.1.smithi136.stdout:8/72: mknod d9/d14/d1a/c23 0 2024-09-18T12:51:07.886 INFO:tasks.workunit.client.1.smithi136.stdout:8/73: write d9/f20 [590519,67084] 0 2024-09-18T12:51:07.886 INFO:tasks.workunit.client.1.smithi136.stdout:8/74: fsync d9/d14/fe 0 2024-09-18T12:51:07.887 INFO:tasks.workunit.client.1.smithi136.stdout:9/52: mkdir d6/d13/d15 0 2024-09-18T12:51:07.888 INFO:tasks.workunit.client.1.smithi136.stdout:1/42: creat d2/d5/fd x:0 0 0 2024-09-18T12:51:07.889 INFO:tasks.workunit.client.1.smithi136.stdout:1/43: symlink d2/d5/d9/le 0 2024-09-18T12:51:07.890 INFO:tasks.workunit.client.1.smithi136.stdout:1/44: symlink d2/lf 0 2024-09-18T12:51:07.898 INFO:tasks.workunit.client.1.smithi136.stdout:8/75: dread d9/d14/f11 [0,4194304] 0 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:9/53: dread d6/db/fe [0,4194304] 0 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:2/115: dwrite d5/d7/fe [0,4194304] 0 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:2/116: dread - d5/d7/d11/f20 zero size 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:2/117: write d5/d7/d17/f1d [4658166,5941] 0 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:2/118: readlink d5/l1a 0 2024-09-18T12:51:07.902 INFO:tasks.workunit.client.1.smithi136.stdout:2/119: readlink d5/d7/l16 0 2024-09-18T12:51:07.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/51: dwrite f2 [0,4194304] 0 2024-09-18T12:51:07.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/52: truncate f2 5205428 0 2024-09-18T12:51:07.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/53: chown d5/c6 9798 1 2024-09-18T12:51:07.904 INFO:tasks.workunit.client.1.smithi136.stdout:1/45: truncate d2/d5/fa 2081586 0 2024-09-18T12:51:07.904 INFO:tasks.workunit.client.1.smithi136.stdout:1/46: dread - d2/fb zero size 2024-09-18T12:51:07.907 INFO:tasks.workunit.client.1.smithi136.stdout:1/47: rename d2/fb to d2/d5/d9/f10 0 2024-09-18T12:51:07.908 INFO:tasks.workunit.client.1.smithi136.stdout:2/120: rmdir d5/d7/d11 39 2024-09-18T12:51:07.908 INFO:tasks.workunit.client.1.smithi136.stdout:2/121: creat d5/f22 x:0 0 0 2024-09-18T12:51:07.908 INFO:tasks.workunit.client.1.smithi136.stdout:2/122: chown d5/c13 27808 1 2024-09-18T12:51:07.909 INFO:tasks.workunit.client.1.smithi136.stdout:9/54: truncate d6/f7 5064395 0 2024-09-18T12:51:07.912 INFO:tasks.workunit.client.1.smithi136.stdout:2/123: creat d5/d7/f23 x:0 0 0 2024-09-18T12:51:07.912 INFO:tasks.workunit.client.1.smithi136.stdout:2/124: creat d5/d7/d17/f24 x:0 0 0 2024-09-18T12:51:07.916 INFO:tasks.workunit.client.1.smithi136.stdout:2/125: mkdir d5/d25 0 2024-09-18T12:51:07.918 INFO:tasks.workunit.client.1.smithi136.stdout:2/126: symlink d5/d25/l26 0 2024-09-18T12:51:07.920 INFO:tasks.workunit.client.1.smithi136.stdout:2/127: unlink d5/f19 0 2024-09-18T12:51:07.921 INFO:tasks.workunit.client.1.smithi136.stdout:5/54: dwrite f2 [0,4194304] 0 2024-09-18T12:51:07.921 INFO:tasks.workunit.client.1.smithi136.stdout:5/55: fsync d5/fa 0 2024-09-18T12:51:07.921 INFO:tasks.workunit.client.1.smithi136.stdout:9/55: unlink d6/db/fe 0 2024-09-18T12:51:07.923 INFO:tasks.workunit.client.1.smithi136.stdout:9/56: creat d6/d13/d15/f16 x:0 0 0 2024-09-18T12:51:07.924 INFO:tasks.workunit.client.1.smithi136.stdout:9/57: fsync d6/da/fd 0 2024-09-18T12:51:07.924 INFO:tasks.workunit.client.1.smithi136.stdout:9/58: chown l2 2956 1 2024-09-18T12:51:07.924 INFO:tasks.workunit.client.1.smithi136.stdout:9/59: dread - d6/d13/d15/f16 zero size 2024-09-18T12:51:07.925 INFO:tasks.workunit.client.1.smithi136.stdout:2/128: rename d5/d7/f23 to d5/d7/d17/f27 0 2024-09-18T12:51:07.926 INFO:tasks.workunit.client.1.smithi136.stdout:9/60: mknod d6/db/d12/c17 0 2024-09-18T12:51:07.926 INFO:tasks.workunit.client.1.smithi136.stdout:9/61: chown d6/df 89195 1 2024-09-18T12:51:07.931 INFO:tasks.workunit.client.1.smithi136.stdout:9/62: read d6/f7 [3473115,62379] 0 2024-09-18T12:51:07.932 INFO:tasks.workunit.client.1.smithi136.stdout:9/63: chown d6/db 19107966 1 2024-09-18T12:51:07.932 INFO:tasks.workunit.client.1.smithi136.stdout:9/64: fsync d6/d13/d15/f16 0 2024-09-18T12:51:07.932 INFO:tasks.workunit.client.1.smithi136.stdout:1/48: dwrite d2/d5/fd [0,4194304] 0 2024-09-18T12:51:07.932 INFO:tasks.workunit.client.1.smithi136.stdout:1/49: chown d2/f7 790 1 2024-09-18T12:51:07.932 INFO:tasks.workunit.client.1.smithi136.stdout:1/50: read d2/f4 [3664682,119450] 0 2024-09-18T12:51:07.934 INFO:tasks.workunit.client.1.smithi136.stdout:1/51: mkdir d2/d5/d11 0 2024-09-18T12:51:07.934 INFO:tasks.workunit.client.1.smithi136.stdout:1/52: chown d2/d5/d9/f10 1492 1 2024-09-18T12:51:07.934 INFO:tasks.workunit.client.1.smithi136.stdout:1/53: chown d2/d5/f6 14358 1 2024-09-18T12:51:07.943 INFO:tasks.workunit.client.1.smithi136.stdout:2/129: dwrite f4 [0,4194304] 0 2024-09-18T12:51:07.946 INFO:tasks.workunit.client.1.smithi136.stdout:2/130: unlink d5/f1f 0 2024-09-18T12:51:07.948 INFO:tasks.workunit.client.1.smithi136.stdout:2/131: creat d5/d25/f28 x:0 0 0 2024-09-18T12:51:07.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/132: getdents d5/d7 0 2024-09-18T12:51:07.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/133: fdatasync d5/d7/d17/f1d 0 2024-09-18T12:51:07.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/134: write d5/d7/f12 [734039,107524] 0 2024-09-18T12:51:07.952 INFO:tasks.workunit.client.1.smithi136.stdout:2/135: creat d5/d7/d11/f29 x:0 0 0 2024-09-18T12:51:07.952 INFO:tasks.workunit.client.1.smithi136.stdout:2/136: fdatasync d5/f9 0 2024-09-18T12:51:07.953 INFO:tasks.workunit.client.1.smithi136.stdout:2/137: stat d5/l1b 0 2024-09-18T12:51:07.954 INFO:tasks.workunit.client.1.smithi136.stdout:2/138: creat d5/d7/f2a x:0 0 0 2024-09-18T12:51:07.954 INFO:tasks.workunit.client.1.smithi136.stdout:2/139: stat d5/d7/fe 0 2024-09-18T12:51:07.965 INFO:tasks.workunit.client.1.smithi136.stdout:2/140: dwrite d5/d7/d17/f1d [4194304,4194304] 0 2024-09-18T12:51:07.965 INFO:tasks.workunit.client.1.smithi136.stdout:2/141: dread - d5/f22 zero size 2024-09-18T12:51:07.967 INFO:tasks.workunit.client.1.smithi136.stdout:2/142: link d5/ca d5/d25/c2b 0 2024-09-18T12:51:07.973 INFO:tasks.workunit.client.1.smithi136.stdout:2/143: read d5/d7/d17/f1d [6048667,66347] 0 2024-09-18T12:51:07.985 INFO:tasks.workunit.client.1.smithi136.stdout:2/144: dwrite d5/d7/d11/f20 [0,4194304] 0 2024-09-18T12:51:07.998 INFO:tasks.workunit.client.1.smithi136.stdout:2/145: dwrite d5/d7/f12 [0,4194304] 0 2024-09-18T12:51:07.998 INFO:tasks.workunit.client.1.smithi136.stdout:2/146: creat d5/d7/d17/f2c x:0 0 0 2024-09-18T12:51:08.001 INFO:tasks.workunit.client.1.smithi136.stdout:2/147: mkdir d5/d25/d2d 0 2024-09-18T12:51:08.002 INFO:tasks.workunit.client.1.smithi136.stdout:2/148: chown d5/l14 896 1 2024-09-18T12:51:08.005 INFO:tasks.workunit.client.1.smithi136.stdout:2/149: rename d5/d7/f2a to d5/d25/f2e 0 2024-09-18T12:51:08.006 INFO:tasks.workunit.client.1.smithi136.stdout:2/150: unlink d5/d7/d17/f2c 0 2024-09-18T12:51:08.008 INFO:tasks.workunit.client.1.smithi136.stdout:2/151: getdents d5 0 2024-09-18T12:51:08.008 INFO:tasks.workunit.client.1.smithi136.stdout:2/152: fsync d5/d7/f10 0 2024-09-18T12:51:08.008 INFO:tasks.workunit.client.1.smithi136.stdout:2/153: truncate d5/f22 932339 0 2024-09-18T12:51:08.024 INFO:tasks.workunit.client.1.smithi136.stdout:4/9: sync 2024-09-18T12:51:08.024 INFO:tasks.workunit.client.1.smithi136.stdout:0/33: sync 2024-09-18T12:51:08.024 INFO:tasks.workunit.client.1.smithi136.stdout:3/33: sync 2024-09-18T12:51:08.025 INFO:tasks.workunit.client.1.smithi136.stdout:3/34: unlink f2 0 2024-09-18T12:51:08.025 INFO:tasks.workunit.client.1.smithi136.stdout:4/10: mkdir d0 0 2024-09-18T12:51:08.027 INFO:tasks.workunit.client.1.smithi136.stdout:2/154: dwrite d5/d7/f1e [4194304,4194304] 0 2024-09-18T12:51:08.028 INFO:tasks.workunit.client.1.smithi136.stdout:3/35: creat d3/d5/f8 x:0 0 0 2024-09-18T12:51:08.028 INFO:tasks.workunit.client.1.smithi136.stdout:4/11: creat d0/f1 x:0 0 0 2024-09-18T12:51:08.029 INFO:tasks.workunit.client.1.smithi136.stdout:0/34: getdents d1/d3 0 2024-09-18T12:51:08.032 INFO:tasks.workunit.client.1.smithi136.stdout:4/12: mkdir d0/d2 0 2024-09-18T12:51:08.032 INFO:tasks.workunit.client.1.smithi136.stdout:4/13: readlink - no filename 2024-09-18T12:51:08.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/14: mkdir d0/d3 0 2024-09-18T12:51:08.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/15: chown d0 7780985 1 2024-09-18T12:51:08.034 INFO:tasks.workunit.client.1.smithi136.stdout:3/36: getdents d3/d5 0 2024-09-18T12:51:08.035 INFO:tasks.workunit.client.1.smithi136.stdout:3/37: write d3/d5/f8 [744156,130284] 0 2024-09-18T12:51:08.036 INFO:tasks.workunit.client.1.smithi136.stdout:3/38: getdents d3 0 2024-09-18T12:51:08.037 INFO:tasks.workunit.client.1.smithi136.stdout:4/16: link d0/f1 d0/d3/f4 0 2024-09-18T12:51:08.037 INFO:tasks.workunit.client.1.smithi136.stdout:4/17: dread - d0/f1 zero size 2024-09-18T12:51:08.037 INFO:tasks.workunit.client.1.smithi136.stdout:4/18: creat d0/f5 x:0 0 0 2024-09-18T12:51:08.037 INFO:tasks.workunit.client.1.smithi136.stdout:4/19: write d0/d3/f4 [1018700,23601] 0 2024-09-18T12:51:08.038 INFO:tasks.workunit.client.1.smithi136.stdout:4/20: readlink - no filename 2024-09-18T12:51:08.038 INFO:tasks.workunit.client.1.smithi136.stdout:4/21: write d0/f5 [277645,2259] 0 2024-09-18T12:51:08.038 INFO:tasks.workunit.client.1.smithi136.stdout:3/39: rmdir d3/d5 39 2024-09-18T12:51:08.039 INFO:tasks.workunit.client.1.smithi136.stdout:3/40: write d3/d5/f8 [1787945,111119] 0 2024-09-18T12:51:08.043 INFO:tasks.workunit.client.1.smithi136.stdout:2/155: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:51:08.043 INFO:tasks.workunit.client.1.smithi136.stdout:2/156: fsync d5/d7/fe 0 2024-09-18T12:51:08.043 INFO:tasks.workunit.client.1.smithi136.stdout:2/157: write d5/f15 [743003,83027] 0 2024-09-18T12:51:08.043 INFO:tasks.workunit.client.1.smithi136.stdout:3/41: fsync d3/d5/f8 0 2024-09-18T12:51:08.046 INFO:tasks.workunit.client.1.smithi136.stdout:0/35: dwrite d1/d3/f8 [0,4194304] 0 2024-09-18T12:51:08.050 INFO:tasks.workunit.client.1.smithi136.stdout:0/36: symlink d1/l9 0 2024-09-18T12:51:08.051 INFO:tasks.workunit.client.1.smithi136.stdout:0/37: creat d1/d3/fa x:0 0 0 2024-09-18T12:51:08.053 INFO:tasks.workunit.client.1.smithi136.stdout:0/38: mkdir d1/db 0 2024-09-18T12:51:08.055 INFO:tasks.workunit.client.1.smithi136.stdout:0/39: creat d1/fc x:0 0 0 2024-09-18T12:51:08.055 INFO:tasks.workunit.client.1.smithi136.stdout:0/40: dread - d1/d3/fa zero size 2024-09-18T12:51:08.055 INFO:tasks.workunit.client.1.smithi136.stdout:0/41: write d1/d3/f5 [5003501,30081] 0 2024-09-18T12:51:08.055 INFO:tasks.workunit.client.1.smithi136.stdout:0/42: read d1/d3/f5 [2461411,95858] 0 2024-09-18T12:51:08.056 INFO:tasks.workunit.client.1.smithi136.stdout:0/43: chown d1/d3 68 1 2024-09-18T12:51:08.056 INFO:tasks.workunit.client.1.smithi136.stdout:0/44: chown d1/l6 12968475 1 2024-09-18T12:51:08.056 INFO:tasks.workunit.client.1.smithi136.stdout:0/45: creat d1/db/fd x:0 0 0 2024-09-18T12:51:08.057 INFO:tasks.workunit.client.1.smithi136.stdout:0/46: link d1/d3/fa d1/fe 0 2024-09-18T12:51:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:07 smithi136 ceph-mon[35363]: pgmap v276: 65 pgs: 65 active+clean; 379 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 27 MiB/s wr, 513 op/s 2024-09-18T12:51:08.065 INFO:tasks.workunit.client.1.smithi136.stdout:2/158: dwrite d5/d7/d11/f20 [0,4194304] 0 2024-09-18T12:51:08.066 INFO:tasks.workunit.client.1.smithi136.stdout:2/159: truncate d5/d7/d17/f27 265572 0 2024-09-18T12:51:08.066 INFO:tasks.workunit.client.1.smithi136.stdout:3/42: dwrite d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.067 INFO:tasks.workunit.client.1.smithi136.stdout:4/22: dwrite d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:08.067 INFO:tasks.workunit.client.1.smithi136.stdout:2/160: mknod d5/d25/d2d/c2f 0 2024-09-18T12:51:08.073 INFO:tasks.workunit.client.1.smithi136.stdout:2/161: rename d5/d7/d17/f1d to d5/d25/d2d/f30 0 2024-09-18T12:51:08.073 INFO:tasks.workunit.client.1.smithi136.stdout:2/162: chown d5/d7 3413805 1 2024-09-18T12:51:08.074 INFO:tasks.workunit.client.1.smithi136.stdout:2/163: dread d5/f22 [0,4194304] 0 2024-09-18T12:51:08.075 INFO:tasks.workunit.client.1.smithi136.stdout:3/43: write d3/d5/f8 [1340303,55787] 0 2024-09-18T12:51:08.076 INFO:tasks.workunit.client.1.smithi136.stdout:3/44: creat d3/f9 x:0 0 0 2024-09-18T12:51:08.077 INFO:tasks.workunit.client.1.smithi136.stdout:4/23: write d0/d3/f4 [1667450,68995] 0 2024-09-18T12:51:08.077 INFO:tasks.workunit.client.1.smithi136.stdout:0/47: dwrite d1/d3/fa [0,4194304] 0 2024-09-18T12:51:08.077 INFO:tasks.workunit.client.1.smithi136.stdout:0/48: write d1/d3/f8 [4196366,13119] 0 2024-09-18T12:51:08.077 INFO:tasks.workunit.client.1.smithi136.stdout:0/49: creat d1/ff x:0 0 0 2024-09-18T12:51:08.077 INFO:tasks.workunit.client.1.smithi136.stdout:3/45: creat d3/fa x:0 0 0 2024-09-18T12:51:08.079 INFO:tasks.workunit.client.1.smithi136.stdout:4/24: fsync d0/f5 0 2024-09-18T12:51:08.082 INFO:tasks.workunit.client.1.smithi136.stdout:2/164: dread f3 [0,4194304] 0 2024-09-18T12:51:08.085 INFO:tasks.workunit.client.1.smithi136.stdout:3/46: mknod d3/d5/cb 0 2024-09-18T12:51:08.086 INFO:tasks.workunit.client.1.smithi136.stdout:3/47: creat d3/fc x:0 0 0 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/48: mknod d3/d5/cd 0 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/49: truncate d3/f9 529889 0 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/50: chown d3/fc 66 1 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/51: chown d3/d5/f8 388578165 1 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/52: chown d3/d5/f8 0 1 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/53: write d3/fc [1025187,20091] 0 2024-09-18T12:51:08.088 INFO:tasks.workunit.client.1.smithi136.stdout:4/25: dread d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:08.089 INFO:tasks.workunit.client.1.smithi136.stdout:3/54: creat d3/d5/fe x:0 0 0 2024-09-18T12:51:08.090 INFO:tasks.workunit.client.1.smithi136.stdout:4/26: mknod d0/d2/c6 0 2024-09-18T12:51:08.090 INFO:tasks.workunit.client.1.smithi136.stdout:4/27: creat d0/f7 x:0 0 0 2024-09-18T12:51:08.090 INFO:tasks.workunit.client.1.smithi136.stdout:4/28: truncate d0/f7 957817 0 2024-09-18T12:51:08.093 INFO:tasks.workunit.client.1.smithi136.stdout:4/29: mknod d0/d3/c8 0 2024-09-18T12:51:08.093 INFO:tasks.workunit.client.1.smithi136.stdout:4/30: read d0/d3/f4 [436713,51651] 0 2024-09-18T12:51:08.093 INFO:tasks.workunit.client.1.smithi136.stdout:4/31: creat d0/f9 x:0 0 0 2024-09-18T12:51:08.093 INFO:tasks.workunit.client.1.smithi136.stdout:2/165: dread d5/d7/fe [0,4194304] 0 2024-09-18T12:51:08.093 INFO:tasks.workunit.client.1.smithi136.stdout:4/32: write d0/f5 [122641,24393] 0 2024-09-18T12:51:08.094 INFO:tasks.workunit.client.1.smithi136.stdout:3/55: symlink d3/lf 0 2024-09-18T12:51:08.095 INFO:tasks.workunit.client.1.smithi136.stdout:2/166: unlink d5/cd 0 2024-09-18T12:51:08.095 INFO:tasks.workunit.client.1.smithi136.stdout:2/167: stat d5/d7/d11/f20 0 2024-09-18T12:51:08.097 INFO:tasks.workunit.client.1.smithi136.stdout:3/56: mkdir d3/d10 0 2024-09-18T12:51:08.099 INFO:tasks.workunit.client.1.smithi136.stdout:0/50: getdents d1 0 2024-09-18T12:51:08.099 INFO:tasks.workunit.client.1.smithi136.stdout:0/51: chown d1/d3/fa 8138 1 2024-09-18T12:51:08.099 INFO:tasks.workunit.client.1.smithi136.stdout:0/52: write d1/fc [303604,53801] 0 2024-09-18T12:51:08.101 INFO:tasks.workunit.client.1.smithi136.stdout:0/53: rename d1/l9 to d1/db/l10 0 2024-09-18T12:51:08.104 INFO:tasks.workunit.client.1.smithi136.stdout:2/168: write d5/d7/f12 [2001945,57964] 0 2024-09-18T12:51:08.104 INFO:tasks.workunit.client.1.smithi136.stdout:2/169: creat d5/d7/d11/f31 x:0 0 0 2024-09-18T12:51:08.104 INFO:tasks.workunit.client.1.smithi136.stdout:2/170: creat d5/d7/d11/f32 x:0 0 0 2024-09-18T12:51:08.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:07 smithi081 ceph-mon[27646]: pgmap v276: 65 pgs: 65 active+clean; 379 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 27 MiB/s wr, 513 op/s 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:6/81: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:7/189: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:1/54: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:5/56: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:8/76: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:8/77: dread - d9/f1e zero size 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:9/65: sync 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:9/66: read d6/da/fd [1403176,32259] 0 2024-09-18T12:51:08.110 INFO:tasks.workunit.client.1.smithi136.stdout:9/67: dread - d6/d13/d15/f16 zero size 2024-09-18T12:51:08.111 INFO:tasks.workunit.client.1.smithi136.stdout:7/190: mknod d0/d12/d2a/d3c/c44 0 2024-09-18T12:51:08.111 INFO:tasks.workunit.client.1.smithi136.stdout:3/57: rmdir d3 39 2024-09-18T12:51:08.111 INFO:tasks.workunit.client.1.smithi136.stdout:2/171: dread d5/d25/d2d/f30 [0,4194304] 0 2024-09-18T12:51:08.111 INFO:tasks.workunit.client.1.smithi136.stdout:1/55: mknod d2/d5/d11/c12 0 2024-09-18T12:51:08.112 INFO:tasks.workunit.client.1.smithi136.stdout:5/57: rename d5/c7 to d5/cb 0 2024-09-18T12:51:08.112 INFO:tasks.workunit.client.1.smithi136.stdout:8/78: symlink d9/d18/l24 0 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:9/68: getdents d6 0 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:9/69: chown d6/db/d12/c17 1927613 1 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:9/70: chown l5 0 1 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:3/58: stat d3/l4 0 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:3/59: dread - d3/fa zero size 2024-09-18T12:51:08.115 INFO:tasks.workunit.client.1.smithi136.stdout:2/172: truncate d5/d7/d11/f20 3306296 0 2024-09-18T12:51:08.116 INFO:tasks.workunit.client.1.smithi136.stdout:5/58: mkdir d5/dc 0 2024-09-18T12:51:08.118 INFO:tasks.workunit.client.1.smithi136.stdout:9/71: rename l1 to d6/l18 0 2024-09-18T12:51:08.119 INFO:tasks.workunit.client.1.smithi136.stdout:4/33: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-18T12:51:08.120 INFO:tasks.workunit.client.1.smithi136.stdout:3/60: unlink d3/d5/fe 0 2024-09-18T12:51:08.126 INFO:tasks.workunit.client.1.smithi136.stdout:4/34: mknod d0/d2/ca 0 2024-09-18T12:51:08.126 INFO:tasks.workunit.client.1.smithi136.stdout:3/61: write d3/fc [926944,87429] 0 2024-09-18T12:51:08.129 INFO:tasks.workunit.client.1.smithi136.stdout:5/59: write f2 [132949,6183] 0 2024-09-18T12:51:08.129 INFO:tasks.workunit.client.1.smithi136.stdout:5/60: stat d5 0 2024-09-18T12:51:08.129 INFO:tasks.workunit.client.1.smithi136.stdout:5/61: rename d5 to d5/dd 22 2024-09-18T12:51:08.130 INFO:tasks.workunit.client.1.smithi136.stdout:2/173: rmdir d5/d7/d17 39 2024-09-18T12:51:08.131 INFO:tasks.workunit.client.1.smithi136.stdout:2/174: read d5/f15 [654532,64863] 0 2024-09-18T12:51:08.131 INFO:tasks.workunit.client.1.smithi136.stdout:9/72: rmdir d6/d13/d15 39 2024-09-18T12:51:08.132 INFO:tasks.workunit.client.1.smithi136.stdout:9/73: rename d6 to d6/da/d19 22 2024-09-18T12:51:08.133 INFO:tasks.workunit.client.1.smithi136.stdout:4/35: mknod d0/cb 0 2024-09-18T12:51:08.134 INFO:tasks.workunit.client.1.smithi136.stdout:2/175: symlink d5/d7/l33 0 2024-09-18T12:51:08.134 INFO:tasks.workunit.client.1.smithi136.stdout:2/176: write d5/d7/f12 [4211021,47414] 0 2024-09-18T12:51:08.134 INFO:tasks.workunit.client.1.smithi136.stdout:2/177: chown d5/d25/c2b 20683680 1 2024-09-18T12:51:08.136 INFO:tasks.workunit.client.1.smithi136.stdout:9/74: rename l2 to d6/df/l1a 0 2024-09-18T12:51:08.138 INFO:tasks.workunit.client.1.smithi136.stdout:2/178: mkdir d5/d7/d11/d34 0 2024-09-18T12:51:08.138 INFO:tasks.workunit.client.1.smithi136.stdout:2/179: readlink d5/l14 0 2024-09-18T12:51:08.140 INFO:tasks.workunit.client.1.smithi136.stdout:1/56: dwrite d2/f4 [0,4194304] 0 2024-09-18T12:51:08.142 INFO:tasks.workunit.client.1.smithi136.stdout:1/57: getdents d2/d5 0 2024-09-18T12:51:08.142 INFO:tasks.workunit.client.1.smithi136.stdout:1/58: chown l0 105005295 1 2024-09-18T12:51:08.145 INFO:tasks.workunit.client.1.smithi136.stdout:3/62: dread d3/fc [0,4194304] 0 2024-09-18T12:51:08.147 INFO:tasks.workunit.client.1.smithi136.stdout:8/79: dwrite f3 [0,4194304] 0 2024-09-18T12:51:08.147 INFO:tasks.workunit.client.1.smithi136.stdout:6/82: dwrite f7 [0,4194304] 0 2024-09-18T12:51:08.147 INFO:tasks.workunit.client.1.smithi136.stdout:6/83: getdents d8/d9/de/d1c 0 2024-09-18T12:51:08.147 INFO:tasks.workunit.client.1.smithi136.stdout:6/84: fdatasync d8/f19 0 2024-09-18T12:51:08.147 INFO:tasks.workunit.client.1.smithi136.stdout:6/85: readlink d8/dc/l1b 0 2024-09-18T12:51:08.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/80: symlink d9/d14/d1a/l25 0 2024-09-18T12:51:08.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/81: creat d9/d14/f26 x:0 0 0 2024-09-18T12:51:08.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/82: read - d9/d14/f1f zero size 2024-09-18T12:51:08.148 INFO:tasks.workunit.client.1.smithi136.stdout:7/191: dwrite d0/d12/d1a/f3e [0,4194304] 0 2024-09-18T12:51:08.151 INFO:tasks.workunit.client.1.smithi136.stdout:7/192: dread d0/d2c/f2f [0,4194304] 0 2024-09-18T12:51:08.153 INFO:tasks.workunit.client.1.smithi136.stdout:3/63: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:08.155 INFO:tasks.workunit.client.1.smithi136.stdout:6/86: symlink d8/l1e 0 2024-09-18T12:51:08.155 INFO:tasks.workunit.client.1.smithi136.stdout:6/87: stat c4 0 2024-09-18T12:51:08.158 INFO:tasks.workunit.client.1.smithi136.stdout:5/62: dread f2 [4194304,4194304] 0 2024-09-18T12:51:08.158 INFO:tasks.workunit.client.1.smithi136.stdout:5/63: truncate d5/f9 453797 0 2024-09-18T12:51:08.158 INFO:tasks.workunit.client.1.smithi136.stdout:1/59: dwrite f1 [0,4194304] 0 2024-09-18T12:51:08.159 INFO:tasks.workunit.client.1.smithi136.stdout:7/193: creat d0/d2c/f45 x:0 0 0 2024-09-18T12:51:08.163 INFO:tasks.workunit.client.1.smithi136.stdout:3/64: mknod d3/d5/c11 0 2024-09-18T12:51:08.166 INFO:tasks.workunit.client.1.smithi136.stdout:3/65: rename d3/fc to d3/d5/f12 0 2024-09-18T12:51:08.166 INFO:tasks.workunit.client.1.smithi136.stdout:3/66: write d3/d5/f12 [988621,63551] 0 2024-09-18T12:51:08.174 INFO:tasks.workunit.client.1.smithi136.stdout:4/36: dwrite d0/f1 [4194304,4194304] 0 2024-09-18T12:51:08.176 INFO:tasks.workunit.client.1.smithi136.stdout:4/37: rmdir d0/d3 39 2024-09-18T12:51:08.191 INFO:tasks.workunit.client.1.smithi136.stdout:9/75: dwrite f3 [0,4194304] 0 2024-09-18T12:51:08.191 INFO:tasks.workunit.client.1.smithi136.stdout:8/83: dwrite d9/d14/f11 [0,4194304] 0 2024-09-18T12:51:08.192 INFO:tasks.workunit.client.1.smithi136.stdout:2/180: dwrite d5/d7/d17/f27 [0,4194304] 0 2024-09-18T12:51:08.193 INFO:tasks.workunit.client.1.smithi136.stdout:9/76: symlink d6/d13/l1b 0 2024-09-18T12:51:08.196 INFO:tasks.workunit.client.1.smithi136.stdout:8/84: creat d9/d14/d1a/f27 x:0 0 0 2024-09-18T12:51:08.201 INFO:tasks.workunit.client.1.smithi136.stdout:6/88: dwrite f1 [0,4194304] 0 2024-09-18T12:51:08.201 INFO:tasks.workunit.client.1.smithi136.stdout:6/89: fsync d8/dc/f15 0 2024-09-18T12:51:08.201 INFO:tasks.workunit.client.1.smithi136.stdout:9/77: symlink d6/db/l1c 0 2024-09-18T12:51:08.201 INFO:tasks.workunit.client.1.smithi136.stdout:9/78: stat c4 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/64: dwrite f2 [0,4194304] 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/65: truncate f2 5304239 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/66: creat d5/fe x:0 0 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/67: creat d5/ff x:0 0 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/68: chown d5/ff 262013 1 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:5/69: chown d5/cb 1 1 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:6/90: symlink d8/dc/l1f 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:7/194: dwrite d0/d2c/f2f [0,4194304] 0 2024-09-18T12:51:08.202 INFO:tasks.workunit.client.1.smithi136.stdout:7/195: write d0/d2c/d2e/f32 [4861825,48437] 0 2024-09-18T12:51:08.208 INFO:tasks.workunit.client.1.smithi136.stdout:6/91: creat d8/d9/de/d1c/f20 x:0 0 0 2024-09-18T12:51:08.211 INFO:tasks.workunit.client.1.smithi136.stdout:7/196: mkdir d0/d12/d1a/d46 0 2024-09-18T12:51:08.215 INFO:tasks.workunit.client.1.smithi136.stdout:6/92: read f1 [1620810,106899] 0 2024-09-18T12:51:08.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/93: write d8/dc/f1d [713236,113134] 0 2024-09-18T12:51:08.216 INFO:tasks.workunit.client.1.smithi136.stdout:1/60: dwrite d2/d5/f6 [0,4194304] 0 2024-09-18T12:51:08.219 INFO:tasks.workunit.client.1.smithi136.stdout:1/61: creat d2/d5/d11/f13 x:0 0 0 2024-09-18T12:51:08.219 INFO:tasks.workunit.client.1.smithi136.stdout:1/62: write d2/f7 [1016272,126729] 0 2024-09-18T12:51:08.220 INFO:tasks.workunit.client.1.smithi136.stdout:4/38: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-18T12:51:08.224 INFO:tasks.workunit.client.1.smithi136.stdout:1/63: rename d2/d5/d9/le to d2/d5/d11/l14 0 2024-09-18T12:51:08.225 INFO:tasks.workunit.client.1.smithi136.stdout:1/64: symlink d2/d5/d9/l15 0 2024-09-18T12:51:08.225 INFO:tasks.workunit.client.1.smithi136.stdout:1/65: creat d2/f16 x:0 0 0 2024-09-18T12:51:08.232 INFO:tasks.workunit.client.1.smithi136.stdout:3/67: dwrite d3/fa [0,4194304] 0 2024-09-18T12:51:08.233 INFO:tasks.workunit.client.1.smithi136.stdout:3/68: stat d3/d10 0 2024-09-18T12:51:08.233 INFO:tasks.workunit.client.1.smithi136.stdout:3/69: rename d3/d5 to d3/d5/d13 22 2024-09-18T12:51:08.233 INFO:tasks.workunit.client.1.smithi136.stdout:2/181: dwrite d5/d7/d17/f27 [0,4194304] 0 2024-09-18T12:51:08.233 INFO:tasks.workunit.client.1.smithi136.stdout:9/79: dwrite d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:08.234 INFO:tasks.workunit.client.1.smithi136.stdout:8/85: dwrite d9/f1e [0,4194304] 0 2024-09-18T12:51:08.234 INFO:tasks.workunit.client.1.smithi136.stdout:8/86: creat d9/d14/f28 x:0 0 0 2024-09-18T12:51:08.234 INFO:tasks.workunit.client.1.smithi136.stdout:8/87: write d9/d14/f1d [971407,43128] 0 2024-09-18T12:51:08.234 INFO:tasks.workunit.client.1.smithi136.stdout:8/88: chown d9/d18/l24 675567 1 2024-09-18T12:51:08.237 INFO:tasks.workunit.client.1.smithi136.stdout:2/182: mknod d5/d7/d11/d34/c35 0 2024-09-18T12:51:08.237 INFO:tasks.workunit.client.1.smithi136.stdout:2/183: fsync d5/d25/d2d/f30 0 2024-09-18T12:51:08.245 INFO:tasks.workunit.client.1.smithi136.stdout:3/70: unlink d3/c7 0 2024-09-18T12:51:08.247 INFO:tasks.workunit.client.1.smithi136.stdout:2/184: unlink d5/d7/d11/d34/c35 0 2024-09-18T12:51:08.249 INFO:tasks.workunit.client.1.smithi136.stdout:3/71: mkdir d3/d14 0 2024-09-18T12:51:08.250 INFO:tasks.workunit.client.1.smithi136.stdout:9/80: dread f3 [0,4194304] 0 2024-09-18T12:51:08.250 INFO:tasks.workunit.client.1.smithi136.stdout:3/72: mknod d3/c15 0 2024-09-18T12:51:08.251 INFO:tasks.workunit.client.1.smithi136.stdout:9/81: symlink d6/df/l1d 0 2024-09-18T12:51:08.252 INFO:tasks.workunit.client.1.smithi136.stdout:9/82: dread d6/f7 [4194304,4194304] 0 2024-09-18T12:51:08.252 INFO:tasks.workunit.client.1.smithi136.stdout:9/83: write d6/da/fd [2661329,80129] 0 2024-09-18T12:51:08.252 INFO:tasks.workunit.client.1.smithi136.stdout:9/84: stat d6/d13/l1b 0 2024-09-18T12:51:08.252 INFO:tasks.workunit.client.1.smithi136.stdout:3/73: creat d3/d10/f16 x:0 0 0 2024-09-18T12:51:08.253 INFO:tasks.workunit.client.1.smithi136.stdout:3/74: getdents d3/d14 0 2024-09-18T12:51:08.253 INFO:tasks.workunit.client.1.smithi136.stdout:5/70: rmdir d5 39 2024-09-18T12:51:08.254 INFO:tasks.workunit.client.1.smithi136.stdout:6/94: rmdir d8/d9/de 39 2024-09-18T12:51:08.254 INFO:tasks.workunit.client.1.smithi136.stdout:6/95: fdatasync f1 0 2024-09-18T12:51:08.254 INFO:tasks.workunit.client.1.smithi136.stdout:6/96: chown d8/dc/f1d 624154 1 2024-09-18T12:51:08.254 INFO:tasks.workunit.client.1.smithi136.stdout:6/97: fsync f7 0 2024-09-18T12:51:08.255 INFO:tasks.workunit.client.1.smithi136.stdout:5/71: getdents d5 0 2024-09-18T12:51:08.257 INFO:tasks.workunit.client.1.smithi136.stdout:8/89: dwrite d9/fa [0,4194304] 0 2024-09-18T12:51:08.257 INFO:tasks.workunit.client.1.smithi136.stdout:5/72: rename d5/c6 to d5/dc/c10 0 2024-09-18T12:51:08.260 INFO:tasks.workunit.client.1.smithi136.stdout:3/75: dread d3/fa [0,4194304] 0 2024-09-18T12:51:08.263 INFO:tasks.workunit.client.1.smithi136.stdout:8/90: rename d9/d14/l16 to d9/d18/l29 0 2024-09-18T12:51:08.264 INFO:tasks.workunit.client.1.smithi136.stdout:5/73: write d5/fa [441798,57759] 0 2024-09-18T12:51:08.265 INFO:tasks.workunit.client.1.smithi136.stdout:3/76: mkdir d3/d14/d17 0 2024-09-18T12:51:08.267 INFO:tasks.workunit.client.1.smithi136.stdout:5/74: creat d5/f11 x:0 0 0 2024-09-18T12:51:08.268 INFO:tasks.workunit.client.1.smithi136.stdout:8/91: rename d9/lf to d9/l2a 0 2024-09-18T12:51:08.268 INFO:tasks.workunit.client.1.smithi136.stdout:8/92: dread - d9/d14/f28 zero size 2024-09-18T12:51:08.269 INFO:tasks.workunit.client.1.smithi136.stdout:5/75: fdatasync d5/ff 0 2024-09-18T12:51:08.269 INFO:tasks.workunit.client.1.smithi136.stdout:5/76: write d5/f11 [275454,122844] 0 2024-09-18T12:51:08.270 INFO:tasks.workunit.client.1.smithi136.stdout:8/93: mkdir d9/d14/d1a/d2b 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:9/85: dwrite d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/77: dread d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:9/86: fdatasync d6/d13/d15/f16 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/78: fdatasync d3/fa 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:8/94: rename d9/d14/d1a/l22 to d9/d14/d1a/l2c 0 2024-09-18T12:51:08.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/79: write d3/f9 [738456,59474] 0 2024-09-18T12:51:08.273 INFO:tasks.workunit.client.1.smithi136.stdout:5/77: mknod d5/c12 0 2024-09-18T12:51:08.274 INFO:tasks.workunit.client.1.smithi136.stdout:9/87: getdents d6 0 2024-09-18T12:51:08.275 INFO:tasks.workunit.client.1.smithi136.stdout:3/80: mkdir d3/d14/d18 0 2024-09-18T12:51:08.275 INFO:tasks.workunit.client.1.smithi136.stdout:1/66: getdents d2 0 2024-09-18T12:51:08.278 INFO:tasks.workunit.client.1.smithi136.stdout:5/78: dread d5/f9 [0,4194304] 0 2024-09-18T12:51:08.278 INFO:tasks.workunit.client.1.smithi136.stdout:9/88: dread d6/da/fd [0,4194304] 0 2024-09-18T12:51:08.278 INFO:tasks.workunit.client.1.smithi136.stdout:1/67: creat d2/f17 x:0 0 0 2024-09-18T12:51:08.279 INFO:tasks.workunit.client.1.smithi136.stdout:3/81: truncate d3/fa 3140781 0 2024-09-18T12:51:08.279 INFO:tasks.workunit.client.1.smithi136.stdout:3/82: chown d3/d5 20 1 2024-09-18T12:51:08.280 INFO:tasks.workunit.client.1.smithi136.stdout:8/95: write f3 [646565,116440] 0 2024-09-18T12:51:08.281 INFO:tasks.workunit.client.1.smithi136.stdout:8/96: truncate d9/d14/f1f 572551 0 2024-09-18T12:51:08.281 INFO:tasks.workunit.client.1.smithi136.stdout:8/97: creat d9/d18/f2d x:0 0 0 2024-09-18T12:51:08.281 INFO:tasks.workunit.client.1.smithi136.stdout:9/89: mknod d6/d13/c1e 0 2024-09-18T12:51:08.281 INFO:tasks.workunit.client.1.smithi136.stdout:8/98: dread d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:08.281 INFO:tasks.workunit.client.1.smithi136.stdout:1/68: chown d2/f7 0 1 2024-09-18T12:51:08.282 INFO:tasks.workunit.client.1.smithi136.stdout:5/79: creat d5/dc/f13 x:0 0 0 2024-09-18T12:51:08.285 INFO:tasks.workunit.client.1.smithi136.stdout:9/90: rmdir d6/da 39 2024-09-18T12:51:08.286 INFO:tasks.workunit.client.1.smithi136.stdout:9/91: chown c4 450820 1 2024-09-18T12:51:08.287 INFO:tasks.workunit.client.1.smithi136.stdout:8/99: creat d9/d14/d1a/d2b/f2e x:0 0 0 2024-09-18T12:51:08.287 INFO:tasks.workunit.client.1.smithi136.stdout:8/100: write d9/d14/d1a/f27 [822087,86962] 0 2024-09-18T12:51:08.287 INFO:tasks.workunit.client.1.smithi136.stdout:8/101: chown l7 38143 1 2024-09-18T12:51:08.289 INFO:tasks.workunit.client.1.smithi136.stdout:3/83: mkdir d3/d19 0 2024-09-18T12:51:08.298 INFO:tasks.workunit.client.1.smithi136.stdout:1/69: unlink d2/d5/d11/l14 0 2024-09-18T12:51:08.299 INFO:tasks.workunit.client.1.smithi136.stdout:3/84: mkdir d3/d14/d17/d1a 0 2024-09-18T12:51:08.300 INFO:tasks.workunit.client.1.smithi136.stdout:5/80: symlink d5/l14 0 2024-09-18T12:51:08.300 INFO:tasks.workunit.client.1.smithi136.stdout:5/81: write d5/fa [628866,105963] 0 2024-09-18T12:51:08.301 INFO:tasks.workunit.client.1.smithi136.stdout:8/102: getdents d9/d14/d1a 0 2024-09-18T12:51:08.301 INFO:tasks.workunit.client.1.smithi136.stdout:8/103: write d9/d14/fe [177032,104065] 0 2024-09-18T12:51:08.302 INFO:tasks.workunit.client.1.smithi136.stdout:9/92: dwrite d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:08.302 INFO:tasks.workunit.client.1.smithi136.stdout:1/70: mknod d2/d5/d11/c18 0 2024-09-18T12:51:08.304 INFO:tasks.workunit.client.1.smithi136.stdout:3/85: mknod d3/d5/c1b 0 2024-09-18T12:51:08.305 INFO:tasks.workunit.client.1.smithi136.stdout:5/82: mknod d5/dc/c15 0 2024-09-18T12:51:08.305 INFO:tasks.workunit.client.1.smithi136.stdout:5/83: creat d5/dc/f16 x:0 0 0 2024-09-18T12:51:08.305 INFO:tasks.workunit.client.1.smithi136.stdout:5/84: fsync f2 0 2024-09-18T12:51:08.306 INFO:tasks.workunit.client.1.smithi136.stdout:3/86: write d3/f9 [404155,13124] 0 2024-09-18T12:51:08.311 INFO:tasks.workunit.client.1.smithi136.stdout:3/87: symlink d3/d19/l1c 0 2024-09-18T12:51:08.313 INFO:tasks.workunit.client.1.smithi136.stdout:3/88: creat d3/d14/d17/d1a/f1d x:0 0 0 2024-09-18T12:51:08.316 INFO:tasks.workunit.client.1.smithi136.stdout:3/89: link d3/l4 d3/d14/d17/l1e 0 2024-09-18T12:51:08.316 INFO:tasks.workunit.client.1.smithi136.stdout:3/90: dread - d3/d10/f16 zero size 2024-09-18T12:51:08.316 INFO:tasks.workunit.client.1.smithi136.stdout:3/91: fdatasync d3/d5/f12 0 2024-09-18T12:51:08.316 INFO:tasks.workunit.client.1.smithi136.stdout:8/104: truncate d9/d14/f11 3086406 0 2024-09-18T12:51:08.318 INFO:tasks.workunit.client.1.smithi136.stdout:8/105: symlink d9/d18/l2f 0 2024-09-18T12:51:08.318 INFO:tasks.workunit.client.1.smithi136.stdout:8/106: dread - d9/d14/d1a/d2b/f2e zero size 2024-09-18T12:51:08.319 INFO:tasks.workunit.client.1.smithi136.stdout:8/107: truncate d9/d14/f1d 843680 0 2024-09-18T12:51:08.321 INFO:tasks.workunit.client.1.smithi136.stdout:3/92: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:08.321 INFO:tasks.workunit.client.1.smithi136.stdout:3/93: write d3/d5/f8 [3938158,38575] 0 2024-09-18T12:51:08.321 INFO:tasks.workunit.client.1.smithi136.stdout:8/108: getdents d9/d14/d1a/d2b 0 2024-09-18T12:51:08.323 INFO:tasks.workunit.client.1.smithi136.stdout:1/71: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:08.323 INFO:tasks.workunit.client.1.smithi136.stdout:1/72: chown d2/d5/d9/f10 72264808 1 2024-09-18T12:51:08.323 INFO:tasks.workunit.client.1.smithi136.stdout:3/94: link d3/d5/f12 d3/d19/f1f 0 2024-09-18T12:51:08.324 INFO:tasks.workunit.client.1.smithi136.stdout:8/109: symlink d9/d14/d1a/d2b/l30 0 2024-09-18T12:51:08.324 INFO:tasks.workunit.client.1.smithi136.stdout:8/110: chown d9/d18/f1c 80617835 1 2024-09-18T12:51:08.324 INFO:tasks.workunit.client.1.smithi136.stdout:8/111: chown d9 211 1 2024-09-18T12:51:08.326 INFO:tasks.workunit.client.1.smithi136.stdout:8/112: mknod d9/c31 0 2024-09-18T12:51:08.326 INFO:tasks.workunit.client.1.smithi136.stdout:8/113: fdatasync d9/d18/f2d 0 2024-09-18T12:51:08.328 INFO:tasks.workunit.client.1.smithi136.stdout:3/95: dread d3/d19/f1f [0,4194304] 0 2024-09-18T12:51:08.328 INFO:tasks.workunit.client.1.smithi136.stdout:3/96: chown d3/d10 37682 1 2024-09-18T12:51:08.331 INFO:tasks.workunit.client.1.smithi136.stdout:3/97: dread d3/fa [0,4194304] 0 2024-09-18T12:51:08.331 INFO:tasks.workunit.client.1.smithi136.stdout:3/98: chown d3/d5/cb 0 1 2024-09-18T12:51:08.332 INFO:tasks.workunit.client.1.smithi136.stdout:3/99: symlink d3/d14/d18/l20 0 2024-09-18T12:51:08.332 INFO:tasks.workunit.client.1.smithi136.stdout:3/100: stat d3/d5 0 2024-09-18T12:51:08.333 INFO:tasks.workunit.client.1.smithi136.stdout:5/85: dwrite d5/f11 [0,4194304] 0 2024-09-18T12:51:08.335 INFO:tasks.workunit.client.1.smithi136.stdout:3/101: dread d3/d19/f1f [0,4194304] 0 2024-09-18T12:51:08.337 INFO:tasks.workunit.client.1.smithi136.stdout:3/102: symlink d3/d14/d17/d1a/l21 0 2024-09-18T12:51:08.337 INFO:tasks.workunit.client.1.smithi136.stdout:3/103: chown d3/d19/f1f 46243506 1 2024-09-18T12:51:08.337 INFO:tasks.workunit.client.1.smithi136.stdout:3/104: write d3/d14/d17/d1a/f1d [583470,1745] 0 2024-09-18T12:51:08.338 INFO:tasks.workunit.client.1.smithi136.stdout:8/114: write f5 [2109897,109560] 0 2024-09-18T12:51:08.339 INFO:tasks.workunit.client.1.smithi136.stdout:3/105: dread d3/d19/f1f [0,4194304] 0 2024-09-18T12:51:08.340 INFO:tasks.workunit.client.1.smithi136.stdout:8/115: mknod d9/d14/c32 0 2024-09-18T12:51:08.341 INFO:tasks.workunit.client.1.smithi136.stdout:3/106: rename d3/d19 to d3/d14/d22 0 2024-09-18T12:51:08.342 INFO:tasks.workunit.client.1.smithi136.stdout:1/73: dwrite d2/f4 [4194304,4194304] 0 2024-09-18T12:51:08.342 INFO:tasks.workunit.client.1.smithi136.stdout:1/74: creat d2/d5/d11/f19 x:0 0 0 2024-09-18T12:51:08.343 INFO:tasks.workunit.client.1.smithi136.stdout:8/116: dread d9/d14/d1a/f27 [0,4194304] 0 2024-09-18T12:51:08.343 INFO:tasks.workunit.client.1.smithi136.stdout:8/117: write d9/f20 [779450,74099] 0 2024-09-18T12:51:08.343 INFO:tasks.workunit.client.1.smithi136.stdout:8/118: write f5 [2047962,67165] 0 2024-09-18T12:51:08.343 INFO:tasks.workunit.client.1.smithi136.stdout:8/119: stat d9/d14/d1a 0 2024-09-18T12:51:08.344 INFO:tasks.workunit.client.1.smithi136.stdout:1/75: readlink d2/l3 0 2024-09-18T12:51:08.345 INFO:tasks.workunit.client.1.smithi136.stdout:1/76: truncate d2/f16 1028577 0 2024-09-18T12:51:08.345 INFO:tasks.workunit.client.1.smithi136.stdout:1/77: fdatasync d2/d5/d9/f10 0 2024-09-18T12:51:08.345 INFO:tasks.workunit.client.1.smithi136.stdout:3/107: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:08.347 INFO:tasks.workunit.client.1.smithi136.stdout:3/108: link d3/d5/f8 d3/d14/d22/f23 0 2024-09-18T12:51:08.349 INFO:tasks.workunit.client.1.smithi136.stdout:3/109: symlink d3/l24 0 2024-09-18T12:51:08.350 INFO:tasks.workunit.client.1.smithi136.stdout:3/110: mknod d3/d14/d22/c25 0 2024-09-18T12:51:08.350 INFO:tasks.workunit.client.1.smithi136.stdout:8/120: dread f3 [0,4194304] 0 2024-09-18T12:51:08.350 INFO:tasks.workunit.client.1.smithi136.stdout:8/121: fsync d9/d14/f1d 0 2024-09-18T12:51:08.351 INFO:tasks.workunit.client.1.smithi136.stdout:3/111: mknod d3/d14/d18/c26 0 2024-09-18T12:51:08.352 INFO:tasks.workunit.client.1.smithi136.stdout:1/78: rmdir d2 39 2024-09-18T12:51:08.352 INFO:tasks.workunit.client.1.smithi136.stdout:1/79: dread - d2/d5/d11/f19 zero size 2024-09-18T12:51:08.354 INFO:tasks.workunit.client.1.smithi136.stdout:3/112: dread d3/d5/f12 [0,4194304] 0 2024-09-18T12:51:08.355 INFO:tasks.workunit.client.1.smithi136.stdout:8/122: rename d9/d14/d1a/f27 to d9/d14/d1a/d2b/f33 0 2024-09-18T12:51:08.355 INFO:tasks.workunit.client.1.smithi136.stdout:8/123: dread - d9/d14/d1a/d2b/f2e zero size 2024-09-18T12:51:08.355 INFO:tasks.workunit.client.1.smithi136.stdout:8/124: write d9/f20 [1705983,126044] 0 2024-09-18T12:51:08.358 INFO:tasks.workunit.client.1.smithi136.stdout:8/125: truncate f3 1520016 0 2024-09-18T12:51:08.358 INFO:tasks.workunit.client.1.smithi136.stdout:5/86: dwrite d5/f11 [0,4194304] 0 2024-09-18T12:51:08.361 INFO:tasks.workunit.client.1.smithi136.stdout:5/87: mknod d5/dc/c17 0 2024-09-18T12:51:08.361 INFO:tasks.workunit.client.1.smithi136.stdout:5/88: chown l4 8293 1 2024-09-18T12:51:08.362 INFO:tasks.workunit.client.1.smithi136.stdout:5/89: creat d5/f18 x:0 0 0 2024-09-18T12:51:08.366 INFO:tasks.workunit.client.1.smithi136.stdout:5/90: symlink d5/l19 0 2024-09-18T12:51:08.366 INFO:tasks.workunit.client.1.smithi136.stdout:5/91: chown d5/f18 32776881 1 2024-09-18T12:51:08.367 INFO:tasks.workunit.client.1.smithi136.stdout:5/92: mkdir d5/d1a 0 2024-09-18T12:51:08.367 INFO:tasks.workunit.client.1.smithi136.stdout:5/93: chown d5/c12 4817570 1 2024-09-18T12:51:08.368 INFO:tasks.workunit.client.1.smithi136.stdout:5/94: creat d5/d1a/f1b x:0 0 0 2024-09-18T12:51:08.382 INFO:tasks.workunit.client.1.smithi136.stdout:0/54: sync 2024-09-18T12:51:08.382 INFO:tasks.workunit.client.1.smithi136.stdout:7/197: sync 2024-09-18T12:51:08.382 INFO:tasks.workunit.client.1.smithi136.stdout:7/198: stat d0/d12/c15 0 2024-09-18T12:51:08.382 INFO:tasks.workunit.client.1.smithi136.stdout:0/55: readlink d1/db/l10 0 2024-09-18T12:51:08.383 INFO:tasks.workunit.client.1.smithi136.stdout:7/199: truncate d0/d12/d2a/f42 918638 0 2024-09-18T12:51:08.383 INFO:tasks.workunit.client.1.smithi136.stdout:7/200: write d0/d12/d1a/f33 [89695,3539] 0 2024-09-18T12:51:08.383 INFO:tasks.workunit.client.1.smithi136.stdout:5/95: write f2 [2911077,64946] 0 2024-09-18T12:51:08.383 INFO:tasks.workunit.client.1.smithi136.stdout:5/96: truncate d5/f9 1296342 0 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:1/80: dwrite d2/f4 [0,4194304] 0 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/56: truncate d1/fe 443592 0 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/57: fdatasync d1/db/fd 0 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/58: write d1/d3/f5 [3925931,13650] 0 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/59: chown d1/l6 1551 1 2024-09-18T12:51:08.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/60: creat d1/d3/f11 x:0 0 0 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:0/61: chown d1/fc 321845 1 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:0/62: chown d1/d3/f11 1563 1 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:0/63: creat d1/db/f12 x:0 0 0 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:3/113: dwrite d3/f9 [0,4194304] 0 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:8/126: dwrite d9/f20 [0,4194304] 0 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:5/97: creat d5/f1c x:0 0 0 2024-09-18T12:51:08.385 INFO:tasks.workunit.client.1.smithi136.stdout:5/98: chown d5/d1a 4908517 1 2024-09-18T12:51:08.386 INFO:tasks.workunit.client.1.smithi136.stdout:5/99: chown d5/l19 3 1 2024-09-18T12:51:08.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/64: dread d1/d3/f8 [0,4194304] 0 2024-09-18T12:51:08.397 INFO:tasks.workunit.client.1.smithi136.stdout:3/114: mkdir d3/d14/d17/d27 0 2024-09-18T12:51:08.399 INFO:tasks.workunit.client.1.smithi136.stdout:5/100: rename d5/dc/c10 to d5/d1a/c1d 0 2024-09-18T12:51:08.400 INFO:tasks.workunit.client.1.smithi136.stdout:8/127: rmdir d9/d14 39 2024-09-18T12:51:08.401 INFO:tasks.workunit.client.1.smithi136.stdout:5/101: symlink d5/d1a/l1e 0 2024-09-18T12:51:08.401 INFO:tasks.workunit.client.1.smithi136.stdout:7/201: dwrite d0/d35/d36/f25 [4194304,4194304] 0 2024-09-18T12:51:08.402 INFO:tasks.workunit.client.1.smithi136.stdout:1/81: dwrite d2/d5/d9/f10 [0,4194304] 0 2024-09-18T12:51:08.402 INFO:tasks.workunit.client.1.smithi136.stdout:3/115: rename d3/l24 to d3/d14/d18/l28 0 2024-09-18T12:51:08.404 INFO:tasks.workunit.client.1.smithi136.stdout:0/65: rmdir d1/d3 39 2024-09-18T12:51:08.404 INFO:tasks.workunit.client.1.smithi136.stdout:0/66: dread - d1/ff zero size 2024-09-18T12:51:08.405 INFO:tasks.workunit.client.1.smithi136.stdout:8/128: mkdir d9/d18/d34 0 2024-09-18T12:51:08.407 INFO:tasks.workunit.client.1.smithi136.stdout:5/102: symlink d5/d1a/l1f 0 2024-09-18T12:51:08.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/67: write d1/d3/f8 [1333416,2084] 0 2024-09-18T12:51:08.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/68: chown d1/fe 2041 1 2024-09-18T12:51:08.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/69: write d1/d3/fa [706741,32939] 0 2024-09-18T12:51:08.413 INFO:tasks.workunit.client.1.smithi136.stdout:1/82: creat d2/d5/d9/f1a x:0 0 0 2024-09-18T12:51:08.413 INFO:tasks.workunit.client.1.smithi136.stdout:1/83: readlink d2/d5/d9/l15 0 2024-09-18T12:51:08.416 INFO:tasks.workunit.client.1.smithi136.stdout:7/202: rename d0/l2b to d0/d12/l47 0 2024-09-18T12:51:08.417 INFO:tasks.workunit.client.1.smithi136.stdout:2/185: sync 2024-09-18T12:51:08.417 INFO:tasks.workunit.client.1.smithi136.stdout:4/39: sync 2024-09-18T12:51:08.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/84: mkdir d2/d5/d11/d1b 0 2024-09-18T12:51:08.419 INFO:tasks.workunit.client.1.smithi136.stdout:7/203: dread d0/d35/d36/ff [0,4194304] 0 2024-09-18T12:51:08.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/85: chown d2/f4 11178 1 2024-09-18T12:51:08.420 INFO:tasks.workunit.client.1.smithi136.stdout:5/103: symlink d5/l20 0 2024-09-18T12:51:08.421 INFO:tasks.workunit.client.1.smithi136.stdout:4/40: truncate d0/f7 514587 0 2024-09-18T12:51:08.421 INFO:tasks.workunit.client.1.smithi136.stdout:4/41: creat d0/fc x:0 0 0 2024-09-18T12:51:08.421 INFO:tasks.workunit.client.1.smithi136.stdout:4/42: truncate d0/f5 446943 0 2024-09-18T12:51:08.423 INFO:tasks.workunit.client.1.smithi136.stdout:4/43: mknod d0/cd 0 2024-09-18T12:51:08.424 INFO:tasks.workunit.client.1.smithi136.stdout:4/44: chown d0 825 1 2024-09-18T12:51:08.432 INFO:tasks.workunit.client.1.smithi136.stdout:7/204: dread d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:08.432 INFO:tasks.workunit.client.1.smithi136.stdout:8/129: dwrite f3 [0,4194304] 0 2024-09-18T12:51:08.432 INFO:tasks.workunit.client.1.smithi136.stdout:3/116: dwrite d3/d5/f12 [0,4194304] 0 2024-09-18T12:51:08.432 INFO:tasks.workunit.client.1.smithi136.stdout:8/130: truncate d9/d14/f1d 1874596 0 2024-09-18T12:51:08.438 INFO:tasks.workunit.client.1.smithi136.stdout:8/131: creat d9/d18/d34/f35 x:0 0 0 2024-09-18T12:51:08.438 INFO:tasks.workunit.client.1.smithi136.stdout:8/132: stat d9/d18/d34/f35 0 2024-09-18T12:51:08.442 INFO:tasks.workunit.client.1.smithi136.stdout:7/205: write d0/d35/d36/f25 [262372,24113] 0 2024-09-18T12:51:08.444 INFO:tasks.workunit.client.1.smithi136.stdout:3/117: dread d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.444 INFO:tasks.workunit.client.1.smithi136.stdout:3/118: chown d3/d5/f8 2914974 1 2024-09-18T12:51:08.445 INFO:tasks.workunit.client.1.smithi136.stdout:1/86: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:08.446 INFO:tasks.workunit.client.1.smithi136.stdout:3/119: symlink d3/l29 0 2024-09-18T12:51:08.447 INFO:tasks.workunit.client.1.smithi136.stdout:1/87: truncate f1 1714833 0 2024-09-18T12:51:08.451 INFO:tasks.workunit.client.1.smithi136.stdout:7/206: write d0/d35/d36/f22 [3551777,63950] 0 2024-09-18T12:51:08.451 INFO:tasks.workunit.client.1.smithi136.stdout:7/207: creat d0/d2c/f48 x:0 0 0 2024-09-18T12:51:08.451 INFO:tasks.workunit.client.1.smithi136.stdout:9/93: sync 2024-09-18T12:51:08.451 INFO:tasks.workunit.client.1.smithi136.stdout:6/98: sync 2024-09-18T12:51:08.455 INFO:tasks.workunit.client.1.smithi136.stdout:7/208: rename d0/c6 to d0/d12/d2a/d3c/c49 0 2024-09-18T12:51:08.455 INFO:tasks.workunit.client.1.smithi136.stdout:7/209: chown d0/d12/d1a 516 1 2024-09-18T12:51:08.456 INFO:tasks.workunit.client.1.smithi136.stdout:7/210: write d0/d2c/f48 [169790,119051] 0 2024-09-18T12:51:08.456 INFO:tasks.workunit.client.1.smithi136.stdout:7/211: readlink d0/d35/d36/l23 0 2024-09-18T12:51:08.456 INFO:tasks.workunit.client.1.smithi136.stdout:7/212: write d0/d35/d36/ff [883669,113310] 0 2024-09-18T12:51:08.456 INFO:tasks.workunit.client.1.smithi136.stdout:9/94: unlink l0 0 2024-09-18T12:51:08.456 INFO:tasks.workunit.client.1.smithi136.stdout:9/95: readlink d6/d13/l14 0 2024-09-18T12:51:08.457 INFO:tasks.workunit.client.1.smithi136.stdout:6/99: creat d8/d9/f21 x:0 0 0 2024-09-18T12:51:08.457 INFO:tasks.workunit.client.1.smithi136.stdout:7/213: mknod d0/d12/d1a/d46/c4a 0 2024-09-18T12:51:08.457 INFO:tasks.workunit.client.1.smithi136.stdout:7/214: write d0/d35/d36/f22 [3918159,45461] 0 2024-09-18T12:51:08.458 INFO:tasks.workunit.client.1.smithi136.stdout:9/96: creat d6/df/f1f x:0 0 0 2024-09-18T12:51:08.458 INFO:tasks.workunit.client.1.smithi136.stdout:9/97: write d6/df/f1f [165555,10228] 0 2024-09-18T12:51:08.458 INFO:tasks.workunit.client.1.smithi136.stdout:1/88: dread d2/d5/fa [0,4194304] 0 2024-09-18T12:51:08.459 INFO:tasks.workunit.client.1.smithi136.stdout:7/215: creat d0/d12/d2a/d3c/f4b x:0 0 0 2024-09-18T12:51:08.460 INFO:tasks.workunit.client.1.smithi136.stdout:1/89: mkdir d2/d1c 0 2024-09-18T12:51:08.462 INFO:tasks.workunit.client.1.smithi136.stdout:4/45: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:08.462 INFO:tasks.workunit.client.1.smithi136.stdout:5/104: dwrite f2 [0,4194304] 0 2024-09-18T12:51:08.470 INFO:tasks.workunit.client.1.smithi136.stdout:4/46: dread d0/f1 [4194304,4194304] 0 2024-09-18T12:51:08.513 INFO:tasks.workunit.client.1.smithi136.stdout:0/70: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-18T12:51:08.513 INFO:tasks.workunit.client.1.smithi136.stdout:0/71: dread - d1/db/f12 zero size 2024-09-18T12:51:08.522 INFO:tasks.workunit.client.1.smithi136.stdout:0/72: dread d1/d3/f5 [0,4194304] 0 2024-09-18T12:51:08.522 INFO:tasks.workunit.client.1.smithi136.stdout:0/73: truncate d1/fe 1287175 0 2024-09-18T12:51:08.522 INFO:tasks.workunit.client.1.smithi136.stdout:4/47: truncate d0/f9 3405274 0 2024-09-18T12:51:08.522 INFO:tasks.workunit.client.1.smithi136.stdout:4/48: readlink - no filename 2024-09-18T12:51:08.523 INFO:tasks.workunit.client.1.smithi136.stdout:0/74: rmdir d1/d3 39 2024-09-18T12:51:08.524 INFO:tasks.workunit.client.1.smithi136.stdout:5/105: dwrite d5/dc/f13 [0,4194304] 0 2024-09-18T12:51:08.526 INFO:tasks.workunit.client.1.smithi136.stdout:4/49: symlink d0/le 0 2024-09-18T12:51:08.526 INFO:tasks.workunit.client.1.smithi136.stdout:8/133: dwrite d9/fa [0,4194304] 0 2024-09-18T12:51:08.526 INFO:tasks.workunit.client.1.smithi136.stdout:7/216: dread d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:08.526 INFO:tasks.workunit.client.1.smithi136.stdout:7/217: stat d0/d35/d36/l30 0 2024-09-18T12:51:08.527 INFO:tasks.workunit.client.1.smithi136.stdout:0/75: rename d1/l6 to d1/db/l13 0 2024-09-18T12:51:08.531 INFO:tasks.workunit.client.1.smithi136.stdout:7/218: truncate d0/d2c/f48 245595 0 2024-09-18T12:51:08.531 INFO:tasks.workunit.client.1.smithi136.stdout:7/219: fdatasync d0/d35/d36/f22 0 2024-09-18T12:51:08.532 INFO:tasks.workunit.client.1.smithi136.stdout:9/98: dwrite d6/df/f1f [0,4194304] 0 2024-09-18T12:51:08.534 INFO:tasks.workunit.client.1.smithi136.stdout:9/99: read f3 [4208237,93763] 0 2024-09-18T12:51:08.535 INFO:tasks.workunit.client.1.smithi136.stdout:0/76: symlink d1/d3/l14 0 2024-09-18T12:51:08.537 INFO:tasks.workunit.client.1.smithi136.stdout:5/106: dread d5/dc/f13 [0,4194304] 0 2024-09-18T12:51:08.537 INFO:tasks.workunit.client.1.smithi136.stdout:6/100: dwrite d8/f19 [0,4194304] 0 2024-09-18T12:51:08.537 INFO:tasks.workunit.client.1.smithi136.stdout:9/100: mknod d6/c20 0 2024-09-18T12:51:08.538 INFO:tasks.workunit.client.1.smithi136.stdout:5/107: write d5/dc/f13 [4306364,27333] 0 2024-09-18T12:51:08.539 INFO:tasks.workunit.client.1.smithi136.stdout:5/108: creat d5/d1a/f21 x:0 0 0 2024-09-18T12:51:08.541 INFO:tasks.workunit.client.1.smithi136.stdout:0/77: unlink d1/db/l10 0 2024-09-18T12:51:08.541 INFO:tasks.workunit.client.1.smithi136.stdout:0/78: dread - d1/db/f12 zero size 2024-09-18T12:51:08.542 INFO:tasks.workunit.client.1.smithi136.stdout:7/220: dread d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:51:08.546 INFO:tasks.workunit.client.1.smithi136.stdout:9/101: rename d6/db/l1c to d6/da/l21 0 2024-09-18T12:51:08.546 INFO:tasks.workunit.client.1.smithi136.stdout:4/50: write d0/f9 [1652159,129215] 0 2024-09-18T12:51:08.549 INFO:tasks.workunit.client.1.smithi136.stdout:5/109: truncate d5/f11 601118 0 2024-09-18T12:51:08.551 INFO:tasks.workunit.client.1.smithi136.stdout:0/79: unlink d1/fc 0 2024-09-18T12:51:08.551 INFO:tasks.workunit.client.1.smithi136.stdout:0/80: truncate d1/fe 1897552 0 2024-09-18T12:51:08.553 INFO:tasks.workunit.client.1.smithi136.stdout:7/221: link d0/c4 d0/c4c 0 2024-09-18T12:51:08.553 INFO:tasks.workunit.client.1.smithi136.stdout:7/222: dread - d0/d2c/f45 zero size 2024-09-18T12:51:08.554 INFO:tasks.workunit.client.1.smithi136.stdout:8/134: dwrite d9/fa [0,4194304] 0 2024-09-18T12:51:08.554 INFO:tasks.workunit.client.1.smithi136.stdout:9/102: truncate f3 2519515 0 2024-09-18T12:51:08.554 INFO:tasks.workunit.client.1.smithi136.stdout:9/103: chown d6/d13/c1e 6681 1 2024-09-18T12:51:08.559 INFO:tasks.workunit.client.1.smithi136.stdout:6/101: dwrite d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:08.560 INFO:tasks.workunit.client.1.smithi136.stdout:0/81: mknod d1/db/c15 0 2024-09-18T12:51:08.563 INFO:tasks.workunit.client.1.smithi136.stdout:8/135: creat d9/d14/d1a/f36 x:0 0 0 2024-09-18T12:51:08.563 INFO:tasks.workunit.client.1.smithi136.stdout:8/136: write f5 [132575,67580] 0 2024-09-18T12:51:08.563 INFO:tasks.workunit.client.1.smithi136.stdout:0/82: read d1/d3/fa [544194,39564] 0 2024-09-18T12:51:08.565 INFO:tasks.workunit.client.1.smithi136.stdout:6/102: getdents d8/d9/de 0 2024-09-18T12:51:08.565 INFO:tasks.workunit.client.1.smithi136.stdout:6/103: chown d8/d9/de/f16 555906 1 2024-09-18T12:51:08.567 INFO:tasks.workunit.client.1.smithi136.stdout:8/137: rename d9/d14/f28 to d9/d14/d1a/f37 0 2024-09-18T12:51:08.568 INFO:tasks.workunit.client.1.smithi136.stdout:6/104: symlink d8/d9/de/l22 0 2024-09-18T12:51:08.569 INFO:tasks.workunit.client.1.smithi136.stdout:4/51: dwrite d0/f7 [0,4194304] 0 2024-09-18T12:51:08.572 INFO:tasks.workunit.client.1.smithi136.stdout:7/223: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-18T12:51:08.572 INFO:tasks.workunit.client.1.smithi136.stdout:7/224: readlink d0/d35/d36/l23 0 2024-09-18T12:51:08.572 INFO:tasks.workunit.client.1.smithi136.stdout:6/105: creat d8/d9/de/f23 x:0 0 0 2024-09-18T12:51:08.572 INFO:tasks.workunit.client.1.smithi136.stdout:5/110: dwrite d5/ff [0,4194304] 0 2024-09-18T12:51:08.577 INFO:tasks.workunit.client.1.smithi136.stdout:8/138: symlink d9/l38 0 2024-09-18T12:51:08.577 INFO:tasks.workunit.client.1.smithi136.stdout:8/139: read f5 [3828551,74255] 0 2024-09-18T12:51:08.580 INFO:tasks.workunit.client.1.smithi136.stdout:7/225: mkdir d0/d39/d4d 0 2024-09-18T12:51:08.582 INFO:tasks.workunit.client.1.smithi136.stdout:5/111: dread f2 [0,4194304] 0 2024-09-18T12:51:08.582 INFO:tasks.workunit.client.1.smithi136.stdout:0/83: truncate d1/d3/f5 6147191 0 2024-09-18T12:51:08.582 INFO:tasks.workunit.client.1.smithi136.stdout:0/84: dread - d1/ff zero size 2024-09-18T12:51:08.590 INFO:tasks.workunit.client.1.smithi136.stdout:5/112: rename d5/d1a/l1f to d5/d1a/l22 0 2024-09-18T12:51:08.592 INFO:tasks.workunit.client.1.smithi136.stdout:0/85: creat d1/f16 x:0 0 0 2024-09-18T12:51:08.592 INFO:tasks.workunit.client.1.smithi136.stdout:0/86: truncate d1/d3/f11 886623 0 2024-09-18T12:51:08.592 INFO:tasks.workunit.client.1.smithi136.stdout:0/87: chown d1/db/c15 0 1 2024-09-18T12:51:08.593 INFO:tasks.workunit.client.1.smithi136.stdout:6/106: symlink d8/d9/de/d1c/l24 0 2024-09-18T12:51:08.597 INFO:tasks.workunit.client.1.smithi136.stdout:5/113: unlink l0 0 2024-09-18T12:51:08.598 INFO:tasks.workunit.client.1.smithi136.stdout:0/88: mkdir d1/d17 0 2024-09-18T12:51:08.599 INFO:tasks.workunit.client.1.smithi136.stdout:0/89: creat d1/f18 x:0 0 0 2024-09-18T12:51:08.599 INFO:tasks.workunit.client.1.smithi136.stdout:0/90: write d1/db/fd [827935,113522] 0 2024-09-18T12:51:08.602 INFO:tasks.workunit.client.1.smithi136.stdout:0/91: dread d1/d3/fa [0,4194304] 0 2024-09-18T12:51:08.602 INFO:tasks.workunit.client.1.smithi136.stdout:0/92: dread - d1/db/f12 zero size 2024-09-18T12:51:08.602 INFO:tasks.workunit.client.1.smithi136.stdout:0/93: fdatasync d1/fe 0 2024-09-18T12:51:08.603 INFO:tasks.workunit.client.1.smithi136.stdout:0/94: creat d1/d3/f19 x:0 0 0 2024-09-18T12:51:08.604 INFO:tasks.workunit.client.1.smithi136.stdout:7/226: rmdir d0/d39 39 2024-09-18T12:51:08.604 INFO:tasks.workunit.client.1.smithi136.stdout:7/227: truncate d0/f31 1235757 0 2024-09-18T12:51:08.604 INFO:tasks.workunit.client.1.smithi136.stdout:7/228: truncate d0/d39/f43 51508 0 2024-09-18T12:51:08.606 INFO:tasks.workunit.client.1.smithi136.stdout:0/95: mkdir d1/d3/d1a 0 2024-09-18T12:51:08.607 INFO:tasks.workunit.client.1.smithi136.stdout:0/96: fsync d1/d3/f11 0 2024-09-18T12:51:08.609 INFO:tasks.workunit.client.1.smithi136.stdout:4/52: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:08.609 INFO:tasks.workunit.client.1.smithi136.stdout:4/53: readlink d0/le 0 2024-09-18T12:51:08.609 INFO:tasks.workunit.client.1.smithi136.stdout:7/229: link d0/d12/c15 d0/d12/d1a/c4e 0 2024-09-18T12:51:08.609 INFO:tasks.workunit.client.1.smithi136.stdout:8/140: dwrite d9/d14/fe [0,4194304] 0 2024-09-18T12:51:08.610 INFO:tasks.workunit.client.1.smithi136.stdout:9/104: dwrite f3 [0,4194304] 0 2024-09-18T12:51:08.611 INFO:tasks.workunit.client.1.smithi136.stdout:4/54: mknod d0/d2/cf 0 2024-09-18T12:51:08.616 INFO:tasks.workunit.client.1.smithi136.stdout:7/230: mkdir d0/d35/d4f 0 2024-09-18T12:51:08.616 INFO:tasks.workunit.client.1.smithi136.stdout:7/231: chown d0/d35/d36/f25 6380 1 2024-09-18T12:51:08.617 INFO:tasks.workunit.client.1.smithi136.stdout:8/141: dread f5 [0,4194304] 0 2024-09-18T12:51:08.617 INFO:tasks.workunit.client.1.smithi136.stdout:8/142: chown d9/l38 242319 1 2024-09-18T12:51:08.624 INFO:tasks.workunit.client.1.smithi136.stdout:9/105: unlink d6/db/c10 0 2024-09-18T12:51:08.624 INFO:tasks.workunit.client.1.smithi136.stdout:4/55: dread d0/f5 [0,4194304] 0 2024-09-18T12:51:08.625 INFO:tasks.workunit.client.1.smithi136.stdout:7/232: mkdir d0/d35/d41/d50 0 2024-09-18T12:51:08.626 INFO:tasks.workunit.client.1.smithi136.stdout:8/143: symlink d9/d18/d34/l39 0 2024-09-18T12:51:08.627 INFO:tasks.workunit.client.1.smithi136.stdout:9/106: creat d6/d13/f22 x:0 0 0 2024-09-18T12:51:08.629 INFO:tasks.workunit.client.1.smithi136.stdout:4/56: creat d0/d3/f10 x:0 0 0 2024-09-18T12:51:08.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/233: creat d0/d12/d2a/d3b/f51 x:0 0 0 2024-09-18T12:51:08.630 INFO:tasks.workunit.client.1.smithi136.stdout:6/107: dwrite d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:08.630 INFO:tasks.workunit.client.1.smithi136.stdout:6/108: readlink d8/dc/l1f 0 2024-09-18T12:51:08.630 INFO:tasks.workunit.client.1.smithi136.stdout:0/97: dwrite d1/f16 [0,4194304] 0 2024-09-18T12:51:08.632 INFO:tasks.workunit.client.1.smithi136.stdout:7/234: symlink d0/d12/d1a/d46/l52 0 2024-09-18T12:51:08.632 INFO:tasks.workunit.client.1.smithi136.stdout:7/235: chown d0/d12/d2a/d3b/f51 91559 1 2024-09-18T12:51:08.632 INFO:tasks.workunit.client.1.smithi136.stdout:2/186: sync 2024-09-18T12:51:08.632 INFO:tasks.workunit.client.1.smithi136.stdout:2/187: dread d5/f22 [0,4194304] 0 2024-09-18T12:51:08.636 INFO:tasks.workunit.client.1.smithi136.stdout:7/236: link d0/d35/d36/l23 d0/d2c/l53 0 2024-09-18T12:51:08.636 INFO:tasks.workunit.client.1.smithi136.stdout:4/57: dread d0/f7 [0,4194304] 0 2024-09-18T12:51:08.636 INFO:tasks.workunit.client.1.smithi136.stdout:7/237: chown d0/d12/d2a/d3b 415 1 2024-09-18T12:51:08.636 INFO:tasks.workunit.client.1.smithi136.stdout:7/238: write d0/d39/f43 [322394,124159] 0 2024-09-18T12:51:08.637 INFO:tasks.workunit.client.1.smithi136.stdout:6/109: rmdir d8/d9/de 39 2024-09-18T12:51:08.640 INFO:tasks.workunit.client.1.smithi136.stdout:7/239: symlink d0/d39/d4d/l54 0 2024-09-18T12:51:08.641 INFO:tasks.workunit.client.1.smithi136.stdout:7/240: write d0/d12/d2a/f42 [377701,18885] 0 2024-09-18T12:51:08.641 INFO:tasks.workunit.client.1.smithi136.stdout:7/241: fsync d0/d35/d36/ff 0 2024-09-18T12:51:08.641 INFO:tasks.workunit.client.1.smithi136.stdout:7/242: readlink d0/d12/d1a/d46/l52 0 2024-09-18T12:51:08.642 INFO:tasks.workunit.client.1.smithi136.stdout:7/243: mkdir d0/d39/d4d/d55 0 2024-09-18T12:51:08.642 INFO:tasks.workunit.client.1.smithi136.stdout:7/244: stat d0/d35/d36/l40 0 2024-09-18T12:51:08.643 INFO:tasks.workunit.client.1.smithi136.stdout:0/98: dread d1/f16 [0,4194304] 0 2024-09-18T12:51:08.644 INFO:tasks.workunit.client.1.smithi136.stdout:7/245: link d0/d12/l16 d0/d35/l56 0 2024-09-18T12:51:08.645 INFO:tasks.workunit.client.1.smithi136.stdout:0/99: mknod d1/c1b 0 2024-09-18T12:51:08.646 INFO:tasks.workunit.client.1.smithi136.stdout:8/144: dwrite d9/d14/d1a/f37 [0,4194304] 0 2024-09-18T12:51:08.646 INFO:tasks.workunit.client.1.smithi136.stdout:8/145: chown d9/c31 3 1 2024-09-18T12:51:08.646 INFO:tasks.workunit.client.1.smithi136.stdout:8/146: stat d9/f1e 0 2024-09-18T12:51:08.646 INFO:tasks.workunit.client.1.smithi136.stdout:8/147: fsync d9/f1e 0 2024-09-18T12:51:08.646 INFO:tasks.workunit.client.1.smithi136.stdout:0/100: rename d1/db/f12 to d1/d3/f1c 0 2024-09-18T12:51:08.647 INFO:tasks.workunit.client.1.smithi136.stdout:0/101: chown d1/f16 668918113 1 2024-09-18T12:51:08.647 INFO:tasks.workunit.client.1.smithi136.stdout:7/246: write d0/fa [7972760,103584] 0 2024-09-18T12:51:08.649 INFO:tasks.workunit.client.1.smithi136.stdout:8/148: creat d9/d14/f3a x:0 0 0 2024-09-18T12:51:08.651 INFO:tasks.workunit.client.1.smithi136.stdout:8/149: mknod d9/d18/d34/c3b 0 2024-09-18T12:51:08.651 INFO:tasks.workunit.client.1.smithi136.stdout:8/150: readlink d9/l2a 0 2024-09-18T12:51:08.653 INFO:tasks.workunit.client.1.smithi136.stdout:0/102: getdents d1 0 2024-09-18T12:51:08.654 INFO:tasks.workunit.client.1.smithi136.stdout:7/247: rmdir d0/d12/d2a 39 2024-09-18T12:51:08.655 INFO:tasks.workunit.client.1.smithi136.stdout:8/151: mkdir d9/d14/d3c 0 2024-09-18T12:51:08.656 INFO:tasks.workunit.client.1.smithi136.stdout:0/103: mknod d1/d17/c1d 0 2024-09-18T12:51:08.658 INFO:tasks.workunit.client.1.smithi136.stdout:7/248: rename d0/d12/l26 to d0/d12/d1a/d46/l57 0 2024-09-18T12:51:08.658 INFO:tasks.workunit.client.1.smithi136.stdout:7/249: readlink d0/d35/d36/l40 0 2024-09-18T12:51:08.659 INFO:tasks.workunit.client.1.smithi136.stdout:7/250: write d0/d12/d2a/d3b/f51 [635433,30292] 0 2024-09-18T12:51:08.659 INFO:tasks.workunit.client.1.smithi136.stdout:7/251: chown d0/d35/d36/ff 180247 1 2024-09-18T12:51:08.659 INFO:tasks.workunit.client.1.smithi136.stdout:8/152: mkdir d9/d18/d34/d3d 0 2024-09-18T12:51:08.661 INFO:tasks.workunit.client.1.smithi136.stdout:7/252: mkdir d0/d35/d41/d58 0 2024-09-18T12:51:08.663 INFO:tasks.workunit.client.1.smithi136.stdout:8/153: unlink d9/d14/c32 0 2024-09-18T12:51:08.663 INFO:tasks.workunit.client.1.smithi136.stdout:8/154: fsync d9/d14/f1f 0 2024-09-18T12:51:08.663 INFO:tasks.workunit.client.1.smithi136.stdout:0/104: rmdir d1/d3 39 2024-09-18T12:51:08.663 INFO:tasks.workunit.client.1.smithi136.stdout:0/105: dread - d1/f18 zero size 2024-09-18T12:51:08.665 INFO:tasks.workunit.client.1.smithi136.stdout:7/253: truncate d0/d12/d1a/f3e 1611594 0 2024-09-18T12:51:08.665 INFO:tasks.workunit.client.1.smithi136.stdout:7/254: write d0/d12/d1a/f20 [4037231,60689] 0 2024-09-18T12:51:08.673 INFO:tasks.workunit.client.1.smithi136.stdout:8/155: rename d9/d14/f3a to d9/d18/d34/f3e 0 2024-09-18T12:51:08.674 INFO:tasks.workunit.client.1.smithi136.stdout:0/106: creat d1/d3/f1e x:0 0 0 2024-09-18T12:51:08.678 INFO:tasks.workunit.client.1.smithi136.stdout:0/107: creat d1/f1f x:0 0 0 2024-09-18T12:51:08.678 INFO:tasks.workunit.client.1.smithi136.stdout:3/120: sync 2024-09-18T12:51:08.678 INFO:tasks.workunit.client.1.smithi136.stdout:1/90: sync 2024-09-18T12:51:08.678 INFO:tasks.workunit.client.1.smithi136.stdout:1/91: chown d2/d5/fa 491260 1 2024-09-18T12:51:08.680 INFO:tasks.workunit.client.1.smithi136.stdout:0/108: dread d1/fe [0,4194304] 0 2024-09-18T12:51:08.680 INFO:tasks.workunit.client.1.smithi136.stdout:0/109: dread - d1/d3/f19 zero size 2024-09-18T12:51:08.680 INFO:tasks.workunit.client.1.smithi136.stdout:8/156: rmdir d9/d18/d34 39 2024-09-18T12:51:08.682 INFO:tasks.workunit.client.1.smithi136.stdout:0/110: creat d1/d3/d1a/f20 x:0 0 0 2024-09-18T12:51:08.682 INFO:tasks.workunit.client.1.smithi136.stdout:0/111: chown d1/d3/f5 21637 1 2024-09-18T12:51:08.682 INFO:tasks.workunit.client.1.smithi136.stdout:0/112: fdatasync d1/fe 0 2024-09-18T12:51:08.683 INFO:tasks.workunit.client.1.smithi136.stdout:3/121: mknod d3/c2a 0 2024-09-18T12:51:08.685 INFO:tasks.workunit.client.1.smithi136.stdout:1/92: symlink d2/l1d 0 2024-09-18T12:51:08.687 INFO:tasks.workunit.client.1.smithi136.stdout:0/113: rename d1/d3/fa to d1/d3/f21 0 2024-09-18T12:51:08.687 INFO:tasks.workunit.client.1.smithi136.stdout:0/114: chown d1/f16 1095436 1 2024-09-18T12:51:08.687 INFO:tasks.workunit.client.1.smithi136.stdout:8/157: symlink d9/d14/d1a/d2b/l3f 0 2024-09-18T12:51:08.689 INFO:tasks.workunit.client.1.smithi136.stdout:8/158: unlink d9/d18/d34/f35 0 2024-09-18T12:51:08.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/159: rename d9/d18/l24 to d9/d18/d34/d3d/l40 0 2024-09-18T12:51:08.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/160: creat d9/d18/f41 x:0 0 0 2024-09-18T12:51:08.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/161: fsync f3 0 2024-09-18T12:51:08.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/162: write d9/d14/f1f [595258,9984] 0 2024-09-18T12:51:08.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/163: write f5 [5091363,37487] 0 2024-09-18T12:51:08.693 INFO:tasks.workunit.client.1.smithi136.stdout:3/122: read d3/d5/f12 [1007977,88284] 0 2024-09-18T12:51:08.696 INFO:tasks.workunit.client.1.smithi136.stdout:3/123: mkdir d3/d2b 0 2024-09-18T12:51:08.698 INFO:tasks.workunit.client.1.smithi136.stdout:3/124: mkdir d3/d14/d22/d2c 0 2024-09-18T12:51:08.701 INFO:tasks.workunit.client.1.smithi136.stdout:3/125: rename d3/d5/c11 to d3/d14/d17/d1a/c2d 0 2024-09-18T12:51:08.701 INFO:tasks.workunit.client.1.smithi136.stdout:1/93: dread d2/d5/fd [0,4194304] 0 2024-09-18T12:51:08.701 INFO:tasks.workunit.client.1.smithi136.stdout:1/94: chown d2/d5/l8 327986 1 2024-09-18T12:51:08.702 INFO:tasks.workunit.client.1.smithi136.stdout:1/95: creat d2/d5/f1e x:0 0 0 2024-09-18T12:51:08.702 INFO:tasks.workunit.client.1.smithi136.stdout:1/96: chown d2/d5/f1e 630 1 2024-09-18T12:51:08.703 INFO:tasks.workunit.client.1.smithi136.stdout:3/126: mknod d3/c2e 0 2024-09-18T12:51:08.704 INFO:tasks.workunit.client.1.smithi136.stdout:1/97: creat d2/d1c/f1f x:0 0 0 2024-09-18T12:51:08.704 INFO:tasks.workunit.client.1.smithi136.stdout:1/98: truncate d2/d5/f6 3778593 0 2024-09-18T12:51:08.705 INFO:tasks.workunit.client.1.smithi136.stdout:1/99: readlink l0 0 2024-09-18T12:51:08.705 INFO:tasks.workunit.client.1.smithi136.stdout:1/100: symlink d2/d1c/l20 0 2024-09-18T12:51:08.707 INFO:tasks.workunit.client.1.smithi136.stdout:1/101: symlink d2/d5/d11/d1b/l21 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:1/102: creat d2/d5/d11/d1b/f22 x:0 0 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:1/103: write d2/f7 [1393835,93729] 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:0/115: dwrite d1/d3/f1e [0,4194304] 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:0/116: write d1/d3/f5 [2502311,82556] 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:0/117: creat d1/d3/f22 x:0 0 0 2024-09-18T12:51:08.709 INFO:tasks.workunit.client.1.smithi136.stdout:0/118: chown d1/d3/d1a 1964414 1 2024-09-18T12:51:08.711 INFO:tasks.workunit.client.1.smithi136.stdout:8/164: dwrite d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:08.716 INFO:tasks.workunit.client.1.smithi136.stdout:0/119: rename d1/db/l13 to d1/d3/l23 0 2024-09-18T12:51:08.721 INFO:tasks.workunit.client.1.smithi136.stdout:8/165: mkdir d9/d14/d1a/d2b/d42 0 2024-09-18T12:51:08.723 INFO:tasks.workunit.client.1.smithi136.stdout:8/166: creat d9/d14/d1a/d2b/d42/f43 x:0 0 0 2024-09-18T12:51:08.723 INFO:tasks.workunit.client.1.smithi136.stdout:8/167: creat d9/d18/f44 x:0 0 0 2024-09-18T12:51:08.727 INFO:tasks.workunit.client.1.smithi136.stdout:8/168: rmdir d9/d18/d34 39 2024-09-18T12:51:08.729 INFO:tasks.workunit.client.1.smithi136.stdout:8/169: mknod d9/d18/d34/d3d/c45 0 2024-09-18T12:51:08.729 INFO:tasks.workunit.client.1.smithi136.stdout:8/170: dread - d9/d18/f44 zero size 2024-09-18T12:51:08.729 INFO:tasks.workunit.client.1.smithi136.stdout:8/171: write d9/d18/f41 [640269,120821] 0 2024-09-18T12:51:08.729 INFO:tasks.workunit.client.1.smithi136.stdout:8/172: creat d9/d14/d1a/f46 x:0 0 0 2024-09-18T12:51:08.729 INFO:tasks.workunit.client.1.smithi136.stdout:8/173: chown d9/d14/c21 12154 1 2024-09-18T12:51:08.731 INFO:tasks.workunit.client.1.smithi136.stdout:8/174: mkdir d9/d18/d34/d3d/d47 0 2024-09-18T12:51:08.732 INFO:tasks.workunit.client.1.smithi136.stdout:3/127: dwrite d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.733 INFO:tasks.workunit.client.1.smithi136.stdout:8/175: rmdir d9/d14/d3c 0 2024-09-18T12:51:08.733 INFO:tasks.workunit.client.1.smithi136.stdout:8/176: readlink d9/d14/d1a/d2b/l30 0 2024-09-18T12:51:08.733 INFO:tasks.workunit.client.1.smithi136.stdout:8/177: chown d9/d18/d34/c3b 186390 1 2024-09-18T12:51:08.733 INFO:tasks.workunit.client.1.smithi136.stdout:8/178: creat d9/d18/f48 x:0 0 0 2024-09-18T12:51:08.734 INFO:tasks.workunit.client.1.smithi136.stdout:1/104: dwrite d2/f7 [0,4194304] 0 2024-09-18T12:51:08.735 INFO:tasks.workunit.client.1.smithi136.stdout:3/128: link d3/d14/d22/c25 d3/d5/c2f 0 2024-09-18T12:51:08.737 INFO:tasks.workunit.client.1.smithi136.stdout:0/120: dwrite d1/d3/f1e [0,4194304] 0 2024-09-18T12:51:08.738 INFO:tasks.workunit.client.1.smithi136.stdout:8/179: getdents d9/d18/d34 0 2024-09-18T12:51:08.738 INFO:tasks.workunit.client.1.smithi136.stdout:8/180: creat d9/d14/d1a/d2b/d42/f49 x:0 0 0 2024-09-18T12:51:08.738 INFO:tasks.workunit.client.1.smithi136.stdout:8/181: creat d9/d14/d1a/f4a x:0 0 0 2024-09-18T12:51:08.739 INFO:tasks.workunit.client.1.smithi136.stdout:3/129: dread d3/fa [0,4194304] 0 2024-09-18T12:51:08.747 INFO:tasks.workunit.client.1.smithi136.stdout:8/182: creat d9/d18/d34/d3d/f4b x:0 0 0 2024-09-18T12:51:08.747 INFO:tasks.workunit.client.1.smithi136.stdout:8/183: truncate d9/d14/d1a/d2b/d42/f43 890193 0 2024-09-18T12:51:08.747 INFO:tasks.workunit.client.1.smithi136.stdout:8/184: write d9/d14/f26 [907917,95777] 0 2024-09-18T12:51:08.748 INFO:tasks.workunit.client.1.smithi136.stdout:8/185: dread d9/d14/d1a/d2b/d42/f43 [0,4194304] 0 2024-09-18T12:51:08.762 INFO:tasks.workunit.client.1.smithi136.stdout:0/121: dwrite d1/ff [0,4194304] 0 2024-09-18T12:51:08.762 INFO:tasks.workunit.client.1.smithi136.stdout:0/122: creat d1/d3/d1a/f24 x:0 0 0 2024-09-18T12:51:08.762 INFO:tasks.workunit.client.1.smithi136.stdout:3/130: dwrite d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:08.763 INFO:tasks.workunit.client.1.smithi136.stdout:3/131: truncate d3/d14/d22/f23 5143360 0 2024-09-18T12:51:08.766 INFO:tasks.workunit.client.1.smithi136.stdout:0/123: rename d1/d3/f11 to d1/d17/f25 0 2024-09-18T12:51:08.771 INFO:tasks.workunit.client.1.smithi136.stdout:0/124: mknod d1/db/c26 0 2024-09-18T12:51:08.772 INFO:tasks.workunit.client.1.smithi136.stdout:0/125: symlink d1/db/l27 0 2024-09-18T12:51:08.772 INFO:tasks.workunit.client.1.smithi136.stdout:0/126: read - d1/f1f zero size 2024-09-18T12:51:08.775 INFO:tasks.workunit.client.1.smithi136.stdout:3/132: dread d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.775 INFO:tasks.workunit.client.1.smithi136.stdout:3/133: chown d3/d14/d22/f23 432 1 2024-09-18T12:51:08.777 INFO:tasks.workunit.client.1.smithi136.stdout:3/134: dread d3/d5/f8 [4194304,4194304] 0 2024-09-18T12:51:08.778 INFO:tasks.workunit.client.1.smithi136.stdout:3/135: read d3/d14/d17/d1a/f1d [323596,50857] 0 2024-09-18T12:51:08.779 INFO:tasks.workunit.client.1.smithi136.stdout:3/136: mknod d3/d5/c30 0 2024-09-18T12:51:08.780 INFO:tasks.workunit.client.1.smithi136.stdout:3/137: mkdir d3/d5/d31 0 2024-09-18T12:51:08.780 INFO:tasks.workunit.client.1.smithi136.stdout:3/138: readlink d3/d14/d17/l1e 0 2024-09-18T12:51:08.781 INFO:tasks.workunit.client.1.smithi136.stdout:3/139: mknod d3/c32 0 2024-09-18T12:51:08.786 INFO:tasks.workunit.client.1.smithi136.stdout:0/127: dwrite d1/d3/d1a/f24 [0,4194304] 0 2024-09-18T12:51:08.786 INFO:tasks.workunit.client.1.smithi136.stdout:0/128: chown d1/db/l27 1224619 1 2024-09-18T12:51:08.787 INFO:tasks.workunit.client.1.smithi136.stdout:0/129: truncate d1/ff 4168325 0 2024-09-18T12:51:08.788 INFO:tasks.workunit.client.1.smithi136.stdout:0/130: rename d1/db/l27 to d1/d17/l28 0 2024-09-18T12:51:08.789 INFO:tasks.workunit.client.1.smithi136.stdout:0/131: truncate d1/f1f 891957 0 2024-09-18T12:51:08.789 INFO:tasks.workunit.client.1.smithi136.stdout:0/132: mknod d1/d17/c29 0 2024-09-18T12:51:08.795 INFO:tasks.workunit.client.1.smithi136.stdout:3/140: dwrite d3/f9 [0,4194304] 0 2024-09-18T12:51:08.800 INFO:tasks.workunit.client.1.smithi136.stdout:3/141: dread d3/d5/f8 [0,4194304] 0 2024-09-18T12:51:08.802 INFO:tasks.workunit.client.1.smithi136.stdout:3/142: rename d3/d14/d22/f23 to d3/d14/d17/d1a/f33 0 2024-09-18T12:51:08.802 INFO:tasks.workunit.client.1.smithi136.stdout:3/143: write d3/d10/f16 [283758,121398] 0 2024-09-18T12:51:08.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/133: dwrite d1/d17/f25 [0,4194304] 0 2024-09-18T12:51:08.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/134: truncate d1/d3/f19 295528 0 2024-09-18T12:51:08.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/135: creat d1/d3/d1a/f2a x:0 0 0 2024-09-18T12:51:08.808 INFO:tasks.workunit.client.1.smithi136.stdout:3/144: unlink d3/d14/d17/d1a/f33 0 2024-09-18T12:51:08.818 INFO:tasks.workunit.client.1.smithi136.stdout:3/145: rename d3/d5/f8 to d3/f34 0 2024-09-18T12:51:08.821 INFO:tasks.workunit.client.1.smithi136.stdout:3/146: dread d3/d14/d17/d1a/f1d [0,4194304] 0 2024-09-18T12:51:08.829 INFO:tasks.workunit.client.1.smithi136.stdout:0/136: dwrite d1/d3/f21 [0,4194304] 0 2024-09-18T12:51:08.838 INFO:tasks.workunit.client.1.smithi136.stdout:3/147: dwrite d3/d14/d22/f1f [4194304,4194304] 0 2024-09-18T12:51:08.843 INFO:tasks.workunit.client.1.smithi136.stdout:0/137: write d1/d3/f1e [3317515,79111] 0 2024-09-18T12:51:08.843 INFO:tasks.workunit.client.1.smithi136.stdout:3/148: truncate d3/d14/d22/f1f 1064369 0 2024-09-18T12:51:08.845 INFO:tasks.workunit.client.1.smithi136.stdout:0/138: creat d1/d17/f2b x:0 0 0 2024-09-18T12:51:08.848 INFO:tasks.workunit.client.1.smithi136.stdout:3/149: rename d3/d5/f12 to d3/d5/f35 0 2024-09-18T12:51:08.848 INFO:tasks.workunit.client.1.smithi136.stdout:3/150: write d3/d5/f35 [1265991,25621] 0 2024-09-18T12:51:08.853 INFO:tasks.workunit.client.1.smithi136.stdout:0/139: dread d1/f16 [0,4194304] 0 2024-09-18T12:51:08.855 INFO:tasks.workunit.client.1.smithi136.stdout:0/140: link d1/d3/f1c d1/f2c 0 2024-09-18T12:51:08.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/141: mkdir d1/d17/d2d 0 2024-09-18T12:51:08.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/142: write d1/d3/f1e [3119975,78201] 0 2024-09-18T12:51:08.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/143: write d1/d3/d1a/f24 [5126952,26464] 0 2024-09-18T12:51:08.857 INFO:tasks.workunit.client.1.smithi136.stdout:0/144: mknod d1/db/c2e 0 2024-09-18T12:51:08.857 INFO:tasks.workunit.client.1.smithi136.stdout:0/145: creat d1/f2f x:0 0 0 2024-09-18T12:51:08.857 INFO:tasks.workunit.client.1.smithi136.stdout:3/151: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:08.857 INFO:tasks.workunit.client.1.smithi136.stdout:3/152: write d3/d14/d17/d1a/f1d [893793,22751] 0 2024-09-18T12:51:08.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/146: mknod d1/c30 0 2024-09-18T12:51:08.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/147: dread - d1/f2c zero size 2024-09-18T12:51:08.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/148: fsync d1/d17/f2b 0 2024-09-18T12:51:08.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/149: creat d1/f31 x:0 0 0 2024-09-18T12:51:08.876 INFO:tasks.workunit.client.1.smithi136.stdout:5/114: sync 2024-09-18T12:51:08.879 INFO:tasks.workunit.client.1.smithi136.stdout:5/115: write d5/dc/f13 [401664,10374] 0 2024-09-18T12:51:08.879 INFO:tasks.workunit.client.1.smithi136.stdout:3/153: dwrite d3/fa [0,4194304] 0 2024-09-18T12:51:08.881 INFO:tasks.workunit.client.1.smithi136.stdout:5/116: link d5/ff d5/f23 0 2024-09-18T12:51:08.881 INFO:tasks.workunit.client.1.smithi136.stdout:5/117: readlink d5/l19 0 2024-09-18T12:51:08.881 INFO:tasks.workunit.client.1.smithi136.stdout:5/118: fsync d5/f9 0 2024-09-18T12:51:08.882 INFO:tasks.workunit.client.1.smithi136.stdout:5/119: truncate d5/fe 225507 0 2024-09-18T12:51:08.883 INFO:tasks.workunit.client.1.smithi136.stdout:5/120: mknod d5/c24 0 2024-09-18T12:51:08.884 INFO:tasks.workunit.client.1.smithi136.stdout:5/121: stat d5/dc/f16 0 2024-09-18T12:51:08.885 INFO:tasks.workunit.client.1.smithi136.stdout:5/122: mknod d5/dc/c25 0 2024-09-18T12:51:08.885 INFO:tasks.workunit.client.1.smithi136.stdout:5/123: dread - d5/d1a/f21 zero size 2024-09-18T12:51:08.885 INFO:tasks.workunit.client.1.smithi136.stdout:5/124: fsync d5/fe 0 2024-09-18T12:51:08.885 INFO:tasks.workunit.client.1.smithi136.stdout:5/125: truncate d5/d1a/f21 453827 0 2024-09-18T12:51:08.885 INFO:tasks.workunit.client.1.smithi136.stdout:5/126: fdatasync d5/f9 0 2024-09-18T12:51:08.886 INFO:tasks.workunit.client.1.smithi136.stdout:3/154: read d3/fa [295741,123997] 0 2024-09-18T12:51:08.888 INFO:tasks.workunit.client.1.smithi136.stdout:5/127: dread d5/fa [0,4194304] 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/128: truncate d5/f23 4807101 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/129: stat d5/d1a 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/130: chown d5/d1a/f1b 7815309 1 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/131: stat f2 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/150: dwrite d1/ff [4194304,4194304] 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/151: fdatasync d1/f1f 0 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/152: chown d1/d3/f1e 5214 1 2024-09-18T12:51:08.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/153: write d1/f31 [434349,3479] 0 2024-09-18T12:51:08.893 INFO:tasks.workunit.client.1.smithi136.stdout:3/155: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:08.900 INFO:tasks.workunit.client.1.smithi136.stdout:0/154: symlink d1/d17/l32 0 2024-09-18T12:51:08.902 INFO:tasks.workunit.client.1.smithi136.stdout:5/132: symlink d5/l26 0 2024-09-18T12:51:08.904 INFO:tasks.workunit.client.1.smithi136.stdout:3/156: getdents d3/d10 0 2024-09-18T12:51:08.911 INFO:tasks.workunit.client.1.smithi136.stdout:9/107: sync 2024-09-18T12:51:08.911 INFO:tasks.workunit.client.1.smithi136.stdout:2/188: sync 2024-09-18T12:51:08.911 INFO:tasks.workunit.client.1.smithi136.stdout:9/108: chown d6/df/l1d 1 1 2024-09-18T12:51:08.911 INFO:tasks.workunit.client.1.smithi136.stdout:9/109: readlink d6/d13/l1b 0 2024-09-18T12:51:08.912 INFO:tasks.workunit.client.1.smithi136.stdout:2/189: write d5/f22 [931932,42920] 0 2024-09-18T12:51:08.912 INFO:tasks.workunit.client.1.smithi136.stdout:2/190: creat d5/d25/f36 x:0 0 0 2024-09-18T12:51:08.912 INFO:tasks.workunit.client.1.smithi136.stdout:9/110: truncate f3 2543898 0 2024-09-18T12:51:08.913 INFO:tasks.workunit.client.1.smithi136.stdout:0/155: dwrite d1/d17/f25 [0,4194304] 0 2024-09-18T12:51:08.913 INFO:tasks.workunit.client.1.smithi136.stdout:2/191: link d5/cb d5/d25/c37 0 2024-09-18T12:51:08.917 INFO:tasks.workunit.client.1.smithi136.stdout:0/156: rename d1/ff to d1/d3/d1a/f33 0 2024-09-18T12:51:08.917 INFO:tasks.workunit.client.1.smithi136.stdout:0/157: creat d1/d17/f34 x:0 0 0 2024-09-18T12:51:08.918 INFO:tasks.workunit.client.1.smithi136.stdout:9/111: rmdir d6/d13 39 2024-09-18T12:51:08.918 INFO:tasks.workunit.client.1.smithi136.stdout:9/112: chown d6/df/l1a 59 1 2024-09-18T12:51:08.920 INFO:tasks.workunit.client.1.smithi136.stdout:9/113: dread d6/da/fd [0,4194304] 0 2024-09-18T12:51:08.920 INFO:tasks.workunit.client.1.smithi136.stdout:9/114: fdatasync f3 0 2024-09-18T12:51:08.924 INFO:tasks.workunit.client.1.smithi136.stdout:0/158: mkdir d1/d17/d2d/d35 0 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/115: mkdir d6/df/d23 0 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/116: write d6/df/f1f [4416756,119741] 0 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/117: chown d6/d13/d15 30237 1 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/118: fsync d6/d13/f22 0 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/119: dread - d6/d13/f22 zero size 2024-09-18T12:51:08.925 INFO:tasks.workunit.client.1.smithi136.stdout:2/192: write d5/ff [2978628,124171] 0 2024-09-18T12:51:08.926 INFO:tasks.workunit.client.1.smithi136.stdout:2/193: dread - d5/d7/d17/f24 zero size 2024-09-18T12:51:08.926 INFO:tasks.workunit.client.1.smithi136.stdout:2/194: chown d5/f15 1211 1 2024-09-18T12:51:08.926 INFO:tasks.workunit.client.1.smithi136.stdout:2/195: fsync f3 0 2024-09-18T12:51:08.926 INFO:tasks.workunit.client.1.smithi136.stdout:2/196: fdatasync d5/f15 0 2024-09-18T12:51:08.926 INFO:tasks.workunit.client.1.smithi136.stdout:2/197: fdatasync d5/d7/d11/f31 0 2024-09-18T12:51:08.928 INFO:tasks.workunit.client.1.smithi136.stdout:9/120: symlink d6/d13/d15/l24 0 2024-09-18T12:51:08.930 INFO:tasks.workunit.client.1.smithi136.stdout:2/198: rename d5/ff to d5/d7/d11/d34/f38 0 2024-09-18T12:51:08.930 INFO:tasks.workunit.client.1.smithi136.stdout:2/199: fsync d5/f22 0 2024-09-18T12:51:08.931 INFO:tasks.workunit.client.1.smithi136.stdout:9/121: mkdir d6/d13/d15/d25 0 2024-09-18T12:51:08.933 INFO:tasks.workunit.client.1.smithi136.stdout:0/159: getdents d1/d17 0 2024-09-18T12:51:08.933 INFO:tasks.workunit.client.1.smithi136.stdout:0/160: write d1/d17/f2b [395856,73055] 0 2024-09-18T12:51:08.934 INFO:tasks.workunit.client.1.smithi136.stdout:0/161: rmdir d1/d17/d2d 39 2024-09-18T12:51:08.934 INFO:tasks.workunit.client.1.smithi136.stdout:0/162: write d1/d3/d1a/f2a [614787,112133] 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/122: write d6/d13/d15/f16 [3854559,126852] 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/123: stat d6/df 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/124: creat d6/df/f26 x:0 0 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/125: readlink d6/d13/l14 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/126: fsync d6/da/fd 0 2024-09-18T12:51:08.943 INFO:tasks.workunit.client.1.smithi136.stdout:9/127: write d6/d13/d15/f16 [4016352,31699] 0 2024-09-18T12:51:08.945 INFO:tasks.workunit.client.1.smithi136.stdout:2/200: dwrite d5/d7/d11/f20 [0,4194304] 0 2024-09-18T12:51:08.954 INFO:tasks.workunit.client.1.smithi136.stdout:0/163: dwrite d1/fe [0,4194304] 0 2024-09-18T12:51:08.954 INFO:tasks.workunit.client.1.smithi136.stdout:0/164: creat d1/f36 x:0 0 0 2024-09-18T12:51:08.954 INFO:tasks.workunit.client.1.smithi136.stdout:9/128: dread d6/df/f1f [0,4194304] 0 2024-09-18T12:51:08.959 INFO:tasks.workunit.client.1.smithi136.stdout:2/201: dwrite d5/f1c [8388608,4194304] 0 2024-09-18T12:51:08.970 INFO:tasks.workunit.client.1.smithi136.stdout:0/165: dread d1/d3/d1a/f33 [0,4194304] 0 2024-09-18T12:51:08.970 INFO:tasks.workunit.client.1.smithi136.stdout:0/166: chown d1/d17/d2d 694869 1 2024-09-18T12:51:08.970 INFO:tasks.workunit.client.1.smithi136.stdout:0/167: write d1/f2f [280998,17787] 0 2024-09-18T12:51:08.977 INFO:tasks.workunit.client.1.smithi136.stdout:0/168: getdents d1 0 2024-09-18T12:51:08.979 INFO:tasks.workunit.client.1.smithi136.stdout:0/169: rename d1/d3/f5 to d1/d17/f37 0 2024-09-18T12:51:08.979 INFO:tasks.workunit.client.1.smithi136.stdout:0/170: read - d1/d17/f34 zero size 2024-09-18T12:51:08.979 INFO:tasks.workunit.client.1.smithi136.stdout:0/171: symlink d1/d17/d2d/l38 0 2024-09-18T12:51:08.979 INFO:tasks.workunit.client.1.smithi136.stdout:0/172: truncate d1/f2c 783117 0 2024-09-18T12:51:08.980 INFO:tasks.workunit.client.1.smithi136.stdout:0/173: mknod d1/d17/d2d/c39 0 2024-09-18T12:51:08.984 INFO:tasks.workunit.client.1.smithi136.stdout:9/129: dwrite d6/df/f26 [0,4194304] 0 2024-09-18T12:51:08.984 INFO:tasks.workunit.client.1.smithi136.stdout:2/202: dwrite d5/d7/d11/f31 [0,4194304] 0 2024-09-18T12:51:08.984 INFO:tasks.workunit.client.1.smithi136.stdout:9/130: truncate d6/d13/f22 683370 0 2024-09-18T12:51:08.984 INFO:tasks.workunit.client.1.smithi136.stdout:9/131: write d6/d13/d15/f16 [338526,75433] 0 2024-09-18T12:51:08.985 INFO:tasks.workunit.client.1.smithi136.stdout:9/132: write d6/f7 [5261854,5576] 0 2024-09-18T12:51:08.985 INFO:tasks.workunit.client.1.smithi136.stdout:9/133: write d6/d13/d15/f16 [5236898,25935] 0 2024-09-18T12:51:08.988 INFO:tasks.workunit.client.1.smithi136.stdout:0/174: dread d1/d3/d1a/f24 [0,4194304] 0 2024-09-18T12:51:08.992 INFO:tasks.workunit.client.1.smithi136.stdout:2/203: symlink d5/d7/d17/l39 0 2024-09-18T12:51:08.993 INFO:tasks.workunit.client.1.smithi136.stdout:9/134: creat d6/d13/d15/d25/f27 x:0 0 0 2024-09-18T12:51:08.994 INFO:tasks.workunit.client.1.smithi136.stdout:0/175: rename d1/c1b to d1/d17/d2d/c3a 0 2024-09-18T12:51:08.994 INFO:tasks.workunit.client.1.smithi136.stdout:0/176: fsync d1/d3/f22 0 2024-09-18T12:51:08.996 INFO:tasks.workunit.client.1.smithi136.stdout:2/204: symlink d5/d25/d2d/l3a 0 2024-09-18T12:51:08.997 INFO:tasks.workunit.client.1.smithi136.stdout:9/135: mknod d6/d13/d15/d25/c28 0 2024-09-18T12:51:08.997 INFO:tasks.workunit.client.1.smithi136.stdout:0/177: rmdir d1/d17 39 2024-09-18T12:51:08.997 INFO:tasks.workunit.client.1.smithi136.stdout:0/178: fdatasync d1/d3/d1a/f33 0 2024-09-18T12:51:08.998 INFO:tasks.workunit.client.1.smithi136.stdout:0/179: read d1/d3/f1c [115458,34053] 0 2024-09-18T12:51:08.998 INFO:tasks.workunit.client.1.smithi136.stdout:2/205: mkdir d5/d7/d3b 0 2024-09-18T12:51:08.998 INFO:tasks.workunit.client.1.smithi136.stdout:2/206: chown d5/d7/f10 15918377 1 2024-09-18T12:51:08.999 INFO:tasks.workunit.client.1.smithi136.stdout:0/180: symlink d1/d3/d1a/l3b 0 2024-09-18T12:51:08.999 INFO:tasks.workunit.client.1.smithi136.stdout:0/181: dread - d1/d3/f22 zero size 2024-09-18T12:51:08.999 INFO:tasks.workunit.client.1.smithi136.stdout:0/182: stat d1/d17/f34 0 2024-09-18T12:51:09.001 INFO:tasks.workunit.client.1.smithi136.stdout:2/207: creat d5/d7/d17/f3c x:0 0 0 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:7/255: sync 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:6/110: sync 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:4/58: sync 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:1/105: sync 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:8/186: sync 2024-09-18T12:51:09.002 INFO:tasks.workunit.client.1.smithi136.stdout:8/187: write d9/d18/f1c [683946,121038] 0 2024-09-18T12:51:09.003 INFO:tasks.workunit.client.1.smithi136.stdout:2/208: mknod d5/d7/d17/c3d 0 2024-09-18T12:51:09.003 INFO:tasks.workunit.client.1.smithi136.stdout:2/209: creat d5/d7/f3e x:0 0 0 2024-09-18T12:51:09.003 INFO:tasks.workunit.client.1.smithi136.stdout:5/133: sync 2024-09-18T12:51:09.003 INFO:tasks.workunit.client.1.smithi136.stdout:5/134: dread - d5/f18 zero size 2024-09-18T12:51:09.006 INFO:tasks.workunit.client.1.smithi136.stdout:4/59: unlink d0/d2/cf 0 2024-09-18T12:51:09.007 INFO:tasks.workunit.client.1.smithi136.stdout:6/111: link d8/f19 d8/d9/de/f25 0 2024-09-18T12:51:09.016 INFO:tasks.workunit.client.1.smithi136.stdout:7/256: dread d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:09.018 INFO:tasks.workunit.client.1.smithi136.stdout:7/257: mkdir d0/d2c/d59 0 2024-09-18T12:51:09.021 INFO:tasks.workunit.client.1.smithi136.stdout:7/258: mkdir d0/d35/d41/d50/d5a 0 2024-09-18T12:51:09.021 INFO:tasks.workunit.client.1.smithi136.stdout:7/259: chown d0/l8 0 1 2024-09-18T12:51:09.022 INFO:tasks.workunit.client.1.smithi136.stdout:9/136: dwrite d6/da/fd [0,4194304] 0 2024-09-18T12:51:09.025 INFO:tasks.workunit.client.1.smithi136.stdout:2/210: getdents d5/d7 0 2024-09-18T12:51:09.025 INFO:tasks.workunit.client.1.smithi136.stdout:7/260: mknod d0/d35/d36/c5b 0 2024-09-18T12:51:09.025 INFO:tasks.workunit.client.1.smithi136.stdout:7/261: dread - d0/d12/d2a/f37 zero size 2024-09-18T12:51:09.025 INFO:tasks.workunit.client.1.smithi136.stdout:7/262: getdents d0/d2c/d2e 0 2024-09-18T12:51:09.026 INFO:tasks.workunit.client.1.smithi136.stdout:7/263: creat d0/d35/d41/f5c x:0 0 0 2024-09-18T12:51:09.028 INFO:tasks.workunit.client.1.smithi136.stdout:5/135: dread d5/ff [0,4194304] 0 2024-09-18T12:51:09.029 INFO:tasks.workunit.client.1.smithi136.stdout:7/264: creat d0/d35/d41/d50/f5d x:0 0 0 2024-09-18T12:51:09.030 INFO:tasks.workunit.client.1.smithi136.stdout:6/112: dread d8/dc/f1d [0,4194304] 0 2024-09-18T12:51:09.039 INFO:tasks.workunit.client.1.smithi136.stdout:0/183: dwrite d1/d3/d1a/f24 [0,4194304] 0 2024-09-18T12:51:09.039 INFO:tasks.workunit.client.1.smithi136.stdout:9/137: read d6/df/f26 [3213938,100166] 0 2024-09-18T12:51:09.040 INFO:tasks.workunit.client.1.smithi136.stdout:0/184: symlink d1/d17/d2d/l3c 0 2024-09-18T12:51:09.042 INFO:tasks.workunit.client.1.smithi136.stdout:9/138: mkdir d6/d13/d15/d25/d29 0 2024-09-18T12:51:09.042 INFO:tasks.workunit.client.1.smithi136.stdout:2/211: dwrite d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:09.045 INFO:tasks.workunit.client.1.smithi136.stdout:6/113: dread d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:09.045 INFO:tasks.workunit.client.1.smithi136.stdout:1/106: dwrite d2/d5/f6 [0,4194304] 0 2024-09-18T12:51:09.045 INFO:tasks.workunit.client.1.smithi136.stdout:1/107: chown d2/d1c/l20 195 1 2024-09-18T12:51:09.046 INFO:tasks.workunit.client.1.smithi136.stdout:2/212: rename f4 to d5/d7/f3f 0 2024-09-18T12:51:09.046 INFO:tasks.workunit.client.1.smithi136.stdout:2/213: creat d5/d25/f40 x:0 0 0 2024-09-18T12:51:09.047 INFO:tasks.workunit.client.1.smithi136.stdout:6/114: truncate d8/d9/de/f18 617331 0 2024-09-18T12:51:09.047 INFO:tasks.workunit.client.1.smithi136.stdout:6/115: truncate d8/d9/fa 1653270 0 2024-09-18T12:51:09.050 INFO:tasks.workunit.client.1.smithi136.stdout:8/188: dwrite d9/d14/d1a/f37 [0,4194304] 0 2024-09-18T12:51:09.050 INFO:tasks.workunit.client.1.smithi136.stdout:8/189: truncate d9/d14/d1a/f36 1000796 0 2024-09-18T12:51:09.051 INFO:tasks.workunit.client.1.smithi136.stdout:2/214: mkdir d5/d7/d41 0 2024-09-18T12:51:09.051 INFO:tasks.workunit.client.1.smithi136.stdout:2/215: read - d5/d25/f28 zero size 2024-09-18T12:51:09.051 INFO:tasks.workunit.client.1.smithi136.stdout:2/216: chown d5/d7 112 1 2024-09-18T12:51:09.051 INFO:tasks.workunit.client.1.smithi136.stdout:2/217: dread - d5/d7/d11/f32 zero size 2024-09-18T12:51:09.052 INFO:tasks.workunit.client.1.smithi136.stdout:6/116: truncate d8/f19 1030457 0 2024-09-18T12:51:09.052 INFO:tasks.workunit.client.1.smithi136.stdout:1/108: getdents d2/d5/d9 0 2024-09-18T12:51:09.053 INFO:tasks.workunit.client.1.smithi136.stdout:8/190: symlink d9/d18/l4c 0 2024-09-18T12:51:09.054 INFO:tasks.workunit.client.1.smithi136.stdout:2/218: rename d5/l1a to d5/l42 0 2024-09-18T12:51:09.055 INFO:tasks.workunit.client.1.smithi136.stdout:6/117: creat d8/f26 x:0 0 0 2024-09-18T12:51:09.055 INFO:tasks.workunit.client.1.smithi136.stdout:9/139: fdatasync d6/f7 0 2024-09-18T12:51:09.055 INFO:tasks.workunit.client.1.smithi136.stdout:8/191: read d9/d14/d1a/d2b/f33 [537249,120295] 0 2024-09-18T12:51:09.055 INFO:tasks.workunit.client.1.smithi136.stdout:9/140: write d6/d13/f22 [493664,11597] 0 2024-09-18T12:51:09.056 INFO:tasks.workunit.client.1.smithi136.stdout:9/141: stat d6/db/c11 0 2024-09-18T12:51:09.056 INFO:tasks.workunit.client.1.smithi136.stdout:9/142: chown d6/df/d23 50 1 2024-09-18T12:51:09.056 INFO:tasks.workunit.client.1.smithi136.stdout:1/109: mkdir d2/d5/d9/d23 0 2024-09-18T12:51:09.056 INFO:tasks.workunit.client.1.smithi136.stdout:2/219: mkdir d5/d25/d43 0 2024-09-18T12:51:09.057 INFO:tasks.workunit.client.1.smithi136.stdout:4/60: dwrite d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:09.057 INFO:tasks.workunit.client.1.smithi136.stdout:5/136: dwrite d5/fe [0,4194304] 0 2024-09-18T12:51:09.058 INFO:tasks.workunit.client.1.smithi136.stdout:8/192: creat d9/d14/d1a/d2b/f4d x:0 0 0 2024-09-18T12:51:09.061 INFO:tasks.workunit.client.1.smithi136.stdout:7/265: dwrite d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:51:09.061 INFO:tasks.workunit.client.1.smithi136.stdout:7/266: fsync d0/d12/d1a/f3e 0 2024-09-18T12:51:09.061 INFO:tasks.workunit.client.1.smithi136.stdout:9/143: unlink d6/da/l21 0 2024-09-18T12:51:09.062 INFO:tasks.workunit.client.1.smithi136.stdout:0/185: dwrite d1/d17/f37 [0,4194304] 0 2024-09-18T12:51:09.063 INFO:tasks.workunit.client.1.smithi136.stdout:2/220: symlink d5/d25/d2d/l44 0 2024-09-18T12:51:09.063 INFO:tasks.workunit.client.1.smithi136.stdout:2/221: creat d5/d25/f45 x:0 0 0 2024-09-18T12:51:09.063 INFO:tasks.workunit.client.1.smithi136.stdout:2/222: chown d5/l42 26907 1 2024-09-18T12:51:09.069 INFO:tasks.workunit.client.1.smithi136.stdout:4/61: unlink d0/f9 0 2024-09-18T12:51:09.069 INFO:tasks.workunit.client.1.smithi136.stdout:4/62: fsync d0/d3/f10 0 2024-09-18T12:51:09.069 INFO:tasks.workunit.client.1.smithi136.stdout:4/63: write d0/fc [482415,108710] 0 2024-09-18T12:51:09.071 INFO:tasks.workunit.client.1.smithi136.stdout:7/267: mkdir d0/d12/d5e 0 2024-09-18T12:51:09.074 INFO:tasks.workunit.client.1.smithi136.stdout:4/64: dread d0/f5 [0,4194304] 0 2024-09-18T12:51:09.074 INFO:tasks.workunit.client.1.smithi136.stdout:9/144: creat d6/d13/d15/d25/d29/f2a x:0 0 0 2024-09-18T12:51:09.076 INFO:tasks.workunit.client.1.smithi136.stdout:1/110: link d2/d5/d11/c18 d2/c24 0 2024-09-18T12:51:09.076 INFO:tasks.workunit.client.1.smithi136.stdout:1/111: creat d2/d5/d11/d1b/f25 x:0 0 0 2024-09-18T12:51:09.076 INFO:tasks.workunit.client.1.smithi136.stdout:7/268: dread d0/fa [0,4194304] 0 2024-09-18T12:51:09.078 INFO:tasks.workunit.client.1.smithi136.stdout:6/118: dread d8/d9/de/f25 [0,4194304] 0 2024-09-18T12:51:09.079 INFO:tasks.workunit.client.1.smithi136.stdout:4/65: dread d0/d3/f4 [4194304,4194304] 0 2024-09-18T12:51:09.089 INFO:tasks.workunit.client.1.smithi136.stdout:0/186: rename d1/d17/l32 to d1/d17/d2d/d35/l3d 0 2024-09-18T12:51:09.089 INFO:tasks.workunit.client.1.smithi136.stdout:0/187: write d1/f36 [478631,111050] 0 2024-09-18T12:51:09.089 INFO:tasks.workunit.client.1.smithi136.stdout:0/188: chown d1/c30 6 1 2024-09-18T12:51:09.089 INFO:tasks.workunit.client.1.smithi136.stdout:0/189: creat d1/db/f3e x:0 0 0 2024-09-18T12:51:09.091 INFO:tasks.workunit.client.1.smithi136.stdout:2/223: link d5/d25/l26 d5/d7/d41/l46 0 2024-09-18T12:51:09.091 INFO:tasks.workunit.client.1.smithi136.stdout:2/224: chown d5/ca 260554479 1 2024-09-18T12:51:09.095 INFO:tasks.workunit.client.1.smithi136.stdout:7/269: mknod d0/d12/d5e/c5f 0 2024-09-18T12:51:09.095 INFO:tasks.workunit.client.1.smithi136.stdout:7/270: write d0/d12/d2a/f37 [401057,96348] 0 2024-09-18T12:51:09.095 INFO:tasks.workunit.client.1.smithi136.stdout:7/271: chown d0/d39 2879142 1 2024-09-18T12:51:09.097 INFO:tasks.workunit.client.1.smithi136.stdout:6/119: truncate f5 4942462 0 2024-09-18T12:51:09.097 INFO:tasks.workunit.client.1.smithi136.stdout:6/120: fsync d8/d9/fb 0 2024-09-18T12:51:09.100 INFO:tasks.workunit.client.1.smithi136.stdout:4/66: rename d0/le to d0/d3/l11 0 2024-09-18T12:51:09.102 INFO:tasks.workunit.client.1.smithi136.stdout:0/190: link d1/db/c2e d1/db/c3f 0 2024-09-18T12:51:09.104 INFO:tasks.workunit.client.1.smithi136.stdout:2/225: truncate d5/d7/d17/f27 3395430 0 2024-09-18T12:51:09.104 INFO:tasks.workunit.client.1.smithi136.stdout:2/226: fsync d5/d7/d11/f31 0 2024-09-18T12:51:09.107 INFO:tasks.workunit.client.1.smithi136.stdout:7/272: link d0/d2c/d2e/f3f d0/d12/f60 0 2024-09-18T12:51:09.108 INFO:tasks.workunit.client.1.smithi136.stdout:6/121: creat d8/d9/de/d1c/f27 x:0 0 0 2024-09-18T12:51:09.108 INFO:tasks.workunit.client.1.smithi136.stdout:6/122: chown d8/dc/l1b 0 1 2024-09-18T12:51:09.108 INFO:tasks.workunit.client.1.smithi136.stdout:6/123: readlink d8/dc/l1f 0 2024-09-18T12:51:09.108 INFO:tasks.workunit.client.1.smithi136.stdout:3/157: sync 2024-09-18T12:51:09.109 INFO:tasks.workunit.client.1.smithi136.stdout:3/158: truncate d3/d14/d22/f1f 1362030 0 2024-09-18T12:51:09.110 INFO:tasks.workunit.client.1.smithi136.stdout:2/227: rename d5/d7/d11/d34/f38 to d5/d7/d17/f47 0 2024-09-18T12:51:09.113 INFO:tasks.workunit.client.1.smithi136.stdout:7/273: link d0/d12/d2a/l1d d0/d12/l61 0 2024-09-18T12:51:09.114 INFO:tasks.workunit.client.1.smithi136.stdout:6/124: creat d8/d9/de/f28 x:0 0 0 2024-09-18T12:51:09.115 INFO:tasks.workunit.client.1.smithi136.stdout:4/67: getdents d0/d2 0 2024-09-18T12:51:09.117 INFO:tasks.workunit.client.1.smithi136.stdout:3/159: creat d3/d10/f36 x:0 0 0 2024-09-18T12:51:09.117 INFO:tasks.workunit.client.1.smithi136.stdout:0/191: dwrite d1/d3/d1a/f24 [0,4194304] 0 2024-09-18T12:51:09.118 INFO:tasks.workunit.client.1.smithi136.stdout:2/228: mkdir d5/d7/d17/d48 0 2024-09-18T12:51:09.119 INFO:tasks.workunit.client.1.smithi136.stdout:3/160: dread d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:09.119 INFO:tasks.workunit.client.1.smithi136.stdout:3/161: stat d3/d10/f36 0 2024-09-18T12:51:09.119 INFO:tasks.workunit.client.1.smithi136.stdout:7/274: link d0/d2c/d2e/f32 d0/f62 0 2024-09-18T12:51:09.120 INFO:tasks.workunit.client.1.smithi136.stdout:7/275: readlink d0/d12/l47 0 2024-09-18T12:51:09.124 INFO:tasks.workunit.client.1.smithi136.stdout:7/276: dread d0/d12/d2a/f37 [0,4194304] 0 2024-09-18T12:51:09.128 INFO:tasks.workunit.client.1.smithi136.stdout:7/277: dread d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:51:09.139 INFO:tasks.workunit.client.1.smithi136.stdout:3/162: dwrite d3/f34 [0,4194304] 0 2024-09-18T12:51:09.169 INFO:tasks.workunit.client.1.smithi136.stdout:9/145: dwrite d6/da/fd [4194304,4194304] 0 2024-09-18T12:51:09.169 INFO:tasks.workunit.client.1.smithi136.stdout:6/125: mknod d8/d9/de/d1c/c29 0 2024-09-18T12:51:09.171 INFO:tasks.workunit.client.1.smithi136.stdout:4/68: unlink d0/d3/l11 0 2024-09-18T12:51:09.172 INFO:tasks.workunit.client.1.smithi136.stdout:0/192: stat d1/d17/d2d/c3a 0 2024-09-18T12:51:09.173 INFO:tasks.workunit.client.1.smithi136.stdout:0/193: write d1/d3/d1a/f20 [185005,36763] 0 2024-09-18T12:51:09.174 INFO:tasks.workunit.client.1.smithi136.stdout:2/229: symlink d5/d7/d3b/l49 0 2024-09-18T12:51:09.174 INFO:tasks.workunit.client.1.smithi136.stdout:1/112: dwrite d2/d5/d11/d1b/f25 [0,4194304] 0 2024-09-18T12:51:09.178 INFO:tasks.workunit.client.1.smithi136.stdout:7/278: symlink d0/d2c/d2e/l63 0 2024-09-18T12:51:09.180 INFO:tasks.workunit.client.1.smithi136.stdout:7/279: dread d0/d12/d2a/f42 [0,4194304] 0 2024-09-18T12:51:09.180 INFO:tasks.workunit.client.1.smithi136.stdout:9/146: mkdir d6/df/d23/d2b 0 2024-09-18T12:51:09.180 INFO:tasks.workunit.client.1.smithi136.stdout:7/280: write d0/d12/d1a/f33 [585927,125020] 0 2024-09-18T12:51:09.182 INFO:tasks.workunit.client.1.smithi136.stdout:6/126: rename d8/d9/de/d1c/l24 to d8/d9/de/d1c/l2a 0 2024-09-18T12:51:09.182 INFO:tasks.workunit.client.1.smithi136.stdout:6/127: creat d8/d9/de/d1c/f2b x:0 0 0 2024-09-18T12:51:09.189 INFO:tasks.workunit.client.1.smithi136.stdout:4/69: unlink d0/f5 0 2024-09-18T12:51:09.189 INFO:tasks.workunit.client.1.smithi136.stdout:4/70: stat d0 0 2024-09-18T12:51:09.189 INFO:tasks.workunit.client.1.smithi136.stdout:4/71: write d0/f1 [297778,5293] 0 2024-09-18T12:51:09.191 INFO:tasks.workunit.client.1.smithi136.stdout:2/230: dwrite d5/d7/d17/f47 [4194304,4194304] 0 2024-09-18T12:51:09.191 INFO:tasks.workunit.client.1.smithi136.stdout:2/231: fdatasync d5/d25/f40 0 2024-09-18T12:51:09.191 INFO:tasks.workunit.client.1.smithi136.stdout:2/232: chown d5/d25/l26 916376 1 2024-09-18T12:51:09.191 INFO:tasks.workunit.client.1.smithi136.stdout:0/194: creat d1/d17/d2d/d35/f40 x:0 0 0 2024-09-18T12:51:09.194 INFO:tasks.workunit.client.1.smithi136.stdout:1/113: readlink d2/d5/d9/l15 0 2024-09-18T12:51:09.196 INFO:tasks.workunit.client.1.smithi136.stdout:3/163: getdents d3 0 2024-09-18T12:51:09.199 INFO:tasks.workunit.client.1.smithi136.stdout:9/147: creat d6/db/f2c x:0 0 0 2024-09-18T12:51:09.199 INFO:tasks.workunit.client.1.smithi136.stdout:0/195: write d1/d17/f37 [1464250,111352] 0 2024-09-18T12:51:09.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/114: write d2/d5/fa [335631,54887] 0 2024-09-18T12:51:09.201 INFO:tasks.workunit.client.1.smithi136.stdout:7/281: mkdir d0/d35/d36/d64 0 2024-09-18T12:51:09.204 INFO:tasks.workunit.client.1.smithi136.stdout:6/128: mknod d8/dc/c2c 0 2024-09-18T12:51:09.204 INFO:tasks.workunit.client.1.smithi136.stdout:6/129: creat d8/d9/de/d1c/f2d x:0 0 0 2024-09-18T12:51:09.205 INFO:tasks.workunit.client.1.smithi136.stdout:9/148: dread d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:09.205 INFO:tasks.workunit.client.1.smithi136.stdout:9/149: truncate d6/d13/d15/d25/d29/f2a 945328 0 2024-09-18T12:51:09.207 INFO:tasks.workunit.client.1.smithi136.stdout:4/72: creat d0/d2/f12 x:0 0 0 2024-09-18T12:51:09.208 INFO:tasks.workunit.client.1.smithi136.stdout:6/130: write d8/d9/de/f16 [518285,86397] 0 2024-09-18T12:51:09.211 INFO:tasks.workunit.client.1.smithi136.stdout:3/164: dread d3/f34 [0,4194304] 0 2024-09-18T12:51:09.213 INFO:tasks.workunit.client.1.smithi136.stdout:2/233: mkdir d5/d4a 0 2024-09-18T12:51:09.215 INFO:tasks.workunit.client.1.smithi136.stdout:5/137: sync 2024-09-18T12:51:09.216 INFO:tasks.workunit.client.1.smithi136.stdout:1/115: unlink d2/d5/d11/d1b/f22 0 2024-09-18T12:51:09.222 INFO:tasks.workunit.client.1.smithi136.stdout:3/165: creat d3/d14/d22/f37 x:0 0 0 2024-09-18T12:51:09.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/234: mknod d5/d7/d3b/c4b 0 2024-09-18T12:51:09.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/235: readlink d5/d7/lc 0 2024-09-18T12:51:09.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/236: stat d5/d4a 0 2024-09-18T12:51:09.226 INFO:tasks.workunit.client.1.smithi136.stdout:5/138: read d5/ff [3266702,111686] 0 2024-09-18T12:51:09.226 INFO:tasks.workunit.client.1.smithi136.stdout:1/116: unlink d2/f7 0 2024-09-18T12:51:09.226 INFO:tasks.workunit.client.1.smithi136.stdout:5/139: truncate d5/f11 1598876 0 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:8/193: sync 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:5/140: write d5/fa [22251,6621] 0 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:8/194: creat d9/d14/d1a/f4e x:0 0 0 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:8/195: truncate f5 6086948 0 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:8/196: fdatasync d9/f20 0 2024-09-18T12:51:09.227 INFO:tasks.workunit.client.1.smithi136.stdout:8/197: write d9/d14/f1d [1925953,409] 0 2024-09-18T12:51:09.228 INFO:tasks.workunit.client.1.smithi136.stdout:7/282: rmdir d0/d35/d41 39 2024-09-18T12:51:09.228 INFO:tasks.workunit.client.1.smithi136.stdout:0/196: dwrite d1/d3/f1e [0,4194304] 0 2024-09-18T12:51:09.229 INFO:tasks.workunit.client.1.smithi136.stdout:0/197: write d1/db/fd [99692,4311] 0 2024-09-18T12:51:09.229 INFO:tasks.workunit.client.1.smithi136.stdout:0/198: chown d1/d17/f37 1 1 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:9/150: dwrite d6/d13/d15/d25/d29/f2a [0,4194304] 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:9/151: fsync f3 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:4/73: dwrite d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:6/131: link d8/d9/de/d1c/f20 d8/f2e 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:5/141: dread d5/dc/f13 [4194304,4194304] 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:6/132: read d8/d9/fa [1331817,88560] 0 2024-09-18T12:51:09.230 INFO:tasks.workunit.client.1.smithi136.stdout:5/142: readlink d5/d1a/l1e 0 2024-09-18T12:51:09.231 INFO:tasks.workunit.client.1.smithi136.stdout:3/166: mknod d3/d2b/c38 0 2024-09-18T12:51:09.231 INFO:tasks.workunit.client.1.smithi136.stdout:1/117: dread d2/f4 [0,4194304] 0 2024-09-18T12:51:09.232 INFO:tasks.workunit.client.1.smithi136.stdout:2/237: truncate f3 1430555 0 2024-09-18T12:51:09.232 INFO:tasks.workunit.client.1.smithi136.stdout:2/238: fsync d5/d7/d11/f32 0 2024-09-18T12:51:09.234 INFO:tasks.workunit.client.1.smithi136.stdout:8/198: symlink d9/d18/l4f 0 2024-09-18T12:51:09.238 INFO:tasks.workunit.client.1.smithi136.stdout:4/74: dread d0/f7 [0,4194304] 0 2024-09-18T12:51:09.240 INFO:tasks.workunit.client.1.smithi136.stdout:9/152: rmdir d6 39 2024-09-18T12:51:09.243 INFO:tasks.workunit.client.1.smithi136.stdout:0/199: write d1/d3/d1a/f33 [1640717,114899] 0 2024-09-18T12:51:09.243 INFO:tasks.workunit.client.1.smithi136.stdout:6/133: rename d8/d9/de/d1c/f27 to d8/d9/de/d1c/f2f 0 2024-09-18T12:51:09.245 INFO:tasks.workunit.client.1.smithi136.stdout:5/143: rename d5/dc/f16 to d5/d1a/f27 0 2024-09-18T12:51:09.246 INFO:tasks.workunit.client.1.smithi136.stdout:1/118: mknod d2/d5/c26 0 2024-09-18T12:51:09.248 INFO:tasks.workunit.client.1.smithi136.stdout:2/239: symlink d5/d7/d17/d48/l4c 0 2024-09-18T12:51:09.248 INFO:tasks.workunit.client.1.smithi136.stdout:2/240: dread - d5/d7/d11/f29 zero size 2024-09-18T12:51:09.250 INFO:tasks.workunit.client.1.smithi136.stdout:3/167: dwrite d3/d14/d17/d1a/f1d [0,4194304] 0 2024-09-18T12:51:09.250 INFO:tasks.workunit.client.1.smithi136.stdout:3/168: chown d3/d14/d17/d27 2385 1 2024-09-18T12:51:09.250 INFO:tasks.workunit.client.1.smithi136.stdout:8/199: link d9/d14/d1a/d2b/d42/f43 d9/d18/d34/d3d/f50 0 2024-09-18T12:51:09.252 INFO:tasks.workunit.client.1.smithi136.stdout:8/200: dread d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:09.253 INFO:tasks.workunit.client.1.smithi136.stdout:4/75: mkdir d0/d13 0 2024-09-18T12:51:09.253 INFO:tasks.workunit.client.1.smithi136.stdout:3/169: read d3/f9 [3301199,129708] 0 2024-09-18T12:51:09.253 INFO:tasks.workunit.client.1.smithi136.stdout:3/170: fsync d3/d10/f16 0 2024-09-18T12:51:09.254 INFO:tasks.workunit.client.1.smithi136.stdout:3/171: fdatasync d3/d14/d22/f1f 0 2024-09-18T12:51:09.255 INFO:tasks.workunit.client.1.smithi136.stdout:6/134: write d8/dc/f15 [2306036,38467] 0 2024-09-18T12:51:09.256 INFO:tasks.workunit.client.1.smithi136.stdout:9/153: creat d6/f2d x:0 0 0 2024-09-18T12:51:09.256 INFO:tasks.workunit.client.1.smithi136.stdout:9/154: write d6/f2d [11,106280] 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:0/200: mkdir d1/d17/d41 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:5/144: write d5/fe [994968,69775] 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:1/119: creat d2/d5/d9/d23/f27 x:0 0 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:2/241: mknod d5/d7/d11/c4d 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:1/120: stat d2/d5/d11/f13 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:0/201: creat d1/d17/d2d/d35/f42 x:0 0 0 2024-09-18T12:51:09.260 INFO:tasks.workunit.client.1.smithi136.stdout:0/202: dread - d1/d17/f34 zero size 2024-09-18T12:51:09.267 INFO:tasks.workunit.client.1.smithi136.stdout:5/145: write d5/f11 [435975,33471] 0 2024-09-18T12:51:09.267 INFO:tasks.workunit.client.1.smithi136.stdout:5/146: truncate d5/f18 379849 0 2024-09-18T12:51:09.269 INFO:tasks.workunit.client.1.smithi136.stdout:4/76: link d0/cd d0/d2/c14 0 2024-09-18T12:51:09.270 INFO:tasks.workunit.client.1.smithi136.stdout:9/155: dread f3 [0,4194304] 0 2024-09-18T12:51:09.270 INFO:tasks.workunit.client.1.smithi136.stdout:9/156: fsync d6/da/fd 0 2024-09-18T12:51:09.270 INFO:tasks.workunit.client.1.smithi136.stdout:3/172: creat d3/d14/d22/d2c/f39 x:0 0 0 2024-09-18T12:51:09.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/173: dread d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:09.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/174: fsync d3/f9 0 2024-09-18T12:51:09.276 INFO:tasks.workunit.client.1.smithi136.stdout:7/283: dwrite d0/f29 [0,4194304] 0 2024-09-18T12:51:09.276 INFO:tasks.workunit.client.1.smithi136.stdout:0/203: rename d1/d3/f21 to d1/f43 0 2024-09-18T12:51:09.277 INFO:tasks.workunit.client.1.smithi136.stdout:6/135: dwrite f1 [0,4194304] 0 2024-09-18T12:51:09.277 INFO:tasks.workunit.client.1.smithi136.stdout:6/136: write d8/f26 [429633,47810] 0 2024-09-18T12:51:09.277 INFO:tasks.workunit.client.1.smithi136.stdout:6/137: fsync d8/f2e 0 2024-09-18T12:51:09.278 INFO:tasks.workunit.client.1.smithi136.stdout:8/201: link d9/d18/d34/f3e d9/d14/d1a/d2b/f51 0 2024-09-18T12:51:09.281 INFO:tasks.workunit.client.1.smithi136.stdout:5/147: mknod d5/dc/c28 0 2024-09-18T12:51:09.281 INFO:tasks.workunit.client.1.smithi136.stdout:4/77: link d0/d3/f4 d0/f15 0 2024-09-18T12:51:09.281 INFO:tasks.workunit.client.1.smithi136.stdout:1/121: symlink d2/l28 0 2024-09-18T12:51:09.285 INFO:tasks.workunit.client.1.smithi136.stdout:9/157: rename d6/df/f26 to d6/d13/d15/d25/f2e 0 2024-09-18T12:51:09.285 INFO:tasks.workunit.client.1.smithi136.stdout:9/158: write d6/d13/d15/d25/f2e [4804833,88942] 0 2024-09-18T12:51:09.287 INFO:tasks.workunit.client.1.smithi136.stdout:0/204: rmdir d1/d17/d41 0 2024-09-18T12:51:09.292 INFO:tasks.workunit.client.1.smithi136.stdout:1/122: mknod d2/d1c/c29 0 2024-09-18T12:51:09.292 INFO:tasks.workunit.client.1.smithi136.stdout:8/202: dread d9/d14/fe [0,4194304] 0 2024-09-18T12:51:09.292 INFO:tasks.workunit.client.1.smithi136.stdout:9/159: rename c4 to d6/d13/d15/c2f 0 2024-09-18T12:51:09.294 INFO:tasks.workunit.client.1.smithi136.stdout:8/203: symlink d9/d14/l52 0 2024-09-18T12:51:09.296 INFO:tasks.workunit.client.1.smithi136.stdout:3/175: rename d3/fa to d3/d14/f3a 0 2024-09-18T12:51:09.297 INFO:tasks.workunit.client.1.smithi136.stdout:9/160: link d6/df/f1f d6/d13/d15/d25/d29/f30 0 2024-09-18T12:51:09.297 INFO:tasks.workunit.client.1.smithi136.stdout:0/205: getdents d1/d3/d1a 0 2024-09-18T12:51:09.298 INFO:tasks.workunit.client.1.smithi136.stdout:1/123: dread d2/d5/fd [0,4194304] 0 2024-09-18T12:51:09.299 INFO:tasks.workunit.client.1.smithi136.stdout:0/206: link d1/db/fd d1/d17/d2d/f44 0 2024-09-18T12:51:09.299 INFO:tasks.workunit.client.1.smithi136.stdout:1/124: truncate d2/d5/d9/f1a 114811 0 2024-09-18T12:51:09.300 INFO:tasks.workunit.client.1.smithi136.stdout:8/204: mknod d9/c53 0 2024-09-18T12:51:09.303 INFO:tasks.workunit.client.1.smithi136.stdout:8/205: unlink d9/d18/f2d 0 2024-09-18T12:51:09.303 INFO:tasks.workunit.client.1.smithi136.stdout:8/206: creat d9/d18/d34/d3d/f54 x:0 0 0 2024-09-18T12:51:09.303 INFO:tasks.workunit.client.1.smithi136.stdout:7/284: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-18T12:51:09.305 INFO:tasks.workunit.client.1.smithi136.stdout:5/148: dwrite d5/d1a/f21 [0,4194304] 0 2024-09-18T12:51:09.306 INFO:tasks.workunit.client.1.smithi136.stdout:4/78: dwrite d0/fc [0,4194304] 0 2024-09-18T12:51:09.306 INFO:tasks.workunit.client.1.smithi136.stdout:0/207: rmdir d1/d17/d2d/d35 39 2024-09-18T12:51:09.307 INFO:tasks.workunit.client.1.smithi136.stdout:0/208: fsync d1/d17/f34 0 2024-09-18T12:51:09.307 INFO:tasks.workunit.client.1.smithi136.stdout:0/209: write d1/f36 [1364377,7915] 0 2024-09-18T12:51:09.308 INFO:tasks.workunit.client.1.smithi136.stdout:8/207: symlink d9/d14/d1a/d2b/d42/l55 0 2024-09-18T12:51:09.311 INFO:tasks.workunit.client.1.smithi136.stdout:4/79: write d0/d3/f4 [4478924,83230] 0 2024-09-18T12:51:09.314 INFO:tasks.workunit.client.1.smithi136.stdout:5/149: dread d5/dc/f13 [0,4194304] 0 2024-09-18T12:51:09.314 INFO:tasks.workunit.client.1.smithi136.stdout:7/285: creat d0/d12/d2a/d3c/f65 x:0 0 0 2024-09-18T12:51:09.315 INFO:tasks.workunit.client.1.smithi136.stdout:9/161: write d6/d13/d15/d25/d29/f2a [2147839,57553] 0 2024-09-18T12:51:09.315 INFO:tasks.workunit.client.1.smithi136.stdout:9/162: creat d6/d13/d15/d25/f31 x:0 0 0 2024-09-18T12:51:09.315 INFO:tasks.workunit.client.1.smithi136.stdout:9/163: rename d6/d13/d15/d25 to d6/d13/d15/d25/d29/d32 22 2024-09-18T12:51:09.315 INFO:tasks.workunit.client.1.smithi136.stdout:8/208: dread f5 [0,4194304] 0 2024-09-18T12:51:09.315 INFO:tasks.workunit.client.1.smithi136.stdout:8/209: chown d9/d14/c13 21280706 1 2024-09-18T12:51:09.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/210: creat d1/d17/f45 x:0 0 0 2024-09-18T12:51:09.318 INFO:tasks.workunit.client.1.smithi136.stdout:9/164: write d6/d13/d15/d25/d29/f30 [4362684,14171] 0 2024-09-18T12:51:09.318 INFO:tasks.workunit.client.1.smithi136.stdout:9/165: dread - d6/d13/d15/d25/f27 zero size 2024-09-18T12:51:09.318 INFO:tasks.workunit.client.1.smithi136.stdout:7/286: mkdir d0/d35/d4f/d66 0 2024-09-18T12:51:09.322 INFO:tasks.workunit.client.1.smithi136.stdout:9/166: creat d6/db/d12/f33 x:0 0 0 2024-09-18T12:51:09.322 INFO:tasks.workunit.client.1.smithi136.stdout:7/287: mkdir d0/d12/d5e/d67 0 2024-09-18T12:51:09.323 INFO:tasks.workunit.client.1.smithi136.stdout:7/288: chown d0/d2c/d2e/f3f 65540674 1 2024-09-18T12:51:09.323 INFO:tasks.workunit.client.1.smithi136.stdout:9/167: mknod d6/df/d23/d2b/c34 0 2024-09-18T12:51:09.323 INFO:tasks.workunit.client.1.smithi136.stdout:9/168: fdatasync d6/db/f2c 0 2024-09-18T12:51:09.323 INFO:tasks.workunit.client.1.smithi136.stdout:9/169: dread - d6/db/d12/f33 zero size 2024-09-18T12:51:09.324 INFO:tasks.workunit.client.1.smithi136.stdout:7/289: dread d0/d12/d2a/d3b/f51 [0,4194304] 0 2024-09-18T12:51:09.324 INFO:tasks.workunit.client.1.smithi136.stdout:7/290: chown d0/d39/d4d/d55 1456293 1 2024-09-18T12:51:09.326 INFO:tasks.workunit.client.1.smithi136.stdout:1/125: dwrite d2/d1c/f1f [0,4194304] 0 2024-09-18T12:51:09.326 INFO:tasks.workunit.client.1.smithi136.stdout:3/176: dwrite d3/d14/d22/d2c/f39 [0,4194304] 0 2024-09-18T12:51:09.327 INFO:tasks.workunit.client.1.smithi136.stdout:9/170: dread d6/d13/f22 [0,4194304] 0 2024-09-18T12:51:09.327 INFO:tasks.workunit.client.1.smithi136.stdout:9/171: creat d6/d13/d15/d25/d29/f35 x:0 0 0 2024-09-18T12:51:09.332 INFO:tasks.workunit.client.1.smithi136.stdout:1/126: unlink d2/d5/f6 0 2024-09-18T12:51:09.332 INFO:tasks.workunit.client.1.smithi136.stdout:1/127: fdatasync d2/d5/d11/f19 0 2024-09-18T12:51:09.333 INFO:tasks.workunit.client.1.smithi136.stdout:5/150: read d5/d1a/f21 [2336660,46985] 0 2024-09-18T12:51:09.333 INFO:tasks.workunit.client.1.smithi136.stdout:5/151: chown d5/d1a/l1e 79404862 1 2024-09-18T12:51:09.338 INFO:tasks.workunit.client.1.smithi136.stdout:0/211: read d1/f43 [737067,47039] 0 2024-09-18T12:51:09.339 INFO:tasks.workunit.client.1.smithi136.stdout:8/210: write d9/d14/f11 [1561211,58979] 0 2024-09-18T12:51:09.341 INFO:tasks.workunit.client.1.smithi136.stdout:1/128: truncate d2/f16 1020753 0 2024-09-18T12:51:09.341 INFO:tasks.workunit.client.1.smithi136.stdout:1/129: fdatasync d2/d5/d11/d1b/f25 0 2024-09-18T12:51:09.343 INFO:tasks.workunit.client.1.smithi136.stdout:5/152: mknod d5/dc/c29 0 2024-09-18T12:51:09.343 INFO:tasks.workunit.client.1.smithi136.stdout:5/153: write d5/d1a/f21 [3284736,91178] 0 2024-09-18T12:51:09.346 INFO:tasks.workunit.client.1.smithi136.stdout:1/130: getdents d2/d5/d11/d1b 0 2024-09-18T12:51:09.354 INFO:tasks.workunit.client.1.smithi136.stdout:7/291: dwrite d0/d2c/f48 [0,4194304] 0 2024-09-18T12:51:09.354 INFO:tasks.workunit.client.1.smithi136.stdout:6/138: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:09.355 INFO:tasks.workunit.client.1.smithi136.stdout:6/139: chown d8/d9/de/f25 27620526 1 2024-09-18T12:51:09.355 INFO:tasks.workunit.client.1.smithi136.stdout:6/140: chown d8/d9/de/f18 6 1 2024-09-18T12:51:09.355 INFO:tasks.workunit.client.1.smithi136.stdout:8/211: dread d9/d14/d1a/f37 [0,4194304] 0 2024-09-18T12:51:09.355 INFO:tasks.workunit.client.1.smithi136.stdout:8/212: dread - d9/d14/d1a/f46 zero size 2024-09-18T12:51:09.355 INFO:tasks.workunit.client.1.smithi136.stdout:9/172: dwrite d6/db/f2c [0,4194304] 0 2024-09-18T12:51:09.356 INFO:tasks.workunit.client.1.smithi136.stdout:3/177: dwrite d3/d10/f36 [0,4194304] 0 2024-09-18T12:51:09.358 INFO:tasks.workunit.client.1.smithi136.stdout:3/178: dread d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:09.358 INFO:tasks.workunit.client.1.smithi136.stdout:3/179: stat d3/c2a 0 2024-09-18T12:51:09.358 INFO:tasks.workunit.client.1.smithi136.stdout:3/180: write d3/d5/f35 [1553122,79576] 0 2024-09-18T12:51:09.359 INFO:tasks.workunit.client.1.smithi136.stdout:6/141: creat d8/f30 x:0 0 0 2024-09-18T12:51:09.360 INFO:tasks.workunit.client.1.smithi136.stdout:8/213: rename d9/c53 to d9/d18/d34/d3d/c56 0 2024-09-18T12:51:09.360 INFO:tasks.workunit.client.1.smithi136.stdout:6/142: dread d8/d9/de/f25 [0,4194304] 0 2024-09-18T12:51:09.362 INFO:tasks.workunit.client.1.smithi136.stdout:8/214: dread d9/d14/d1a/d2b/f33 [0,4194304] 0 2024-09-18T12:51:09.363 INFO:tasks.workunit.client.1.smithi136.stdout:9/173: symlink d6/db/l36 0 2024-09-18T12:51:09.363 INFO:tasks.workunit.client.1.smithi136.stdout:9/174: creat d6/db/d12/f37 x:0 0 0 2024-09-18T12:51:09.365 INFO:tasks.workunit.client.1.smithi136.stdout:3/181: symlink d3/d10/l3b 0 2024-09-18T12:51:09.366 INFO:tasks.workunit.client.1.smithi136.stdout:1/131: dwrite d2/d5/d9/fc [0,4194304] 0 2024-09-18T12:51:09.367 INFO:tasks.workunit.client.1.smithi136.stdout:8/215: rename d9/c31 to d9/d18/d34/d3d/c57 0 2024-09-18T12:51:09.367 INFO:tasks.workunit.client.1.smithi136.stdout:8/216: write d9/d14/d1a/d2b/f33 [652963,105059] 0 2024-09-18T12:51:09.368 INFO:tasks.workunit.client.1.smithi136.stdout:7/292: dread d0/f62 [0,4194304] 0 2024-09-18T12:51:09.368 INFO:tasks.workunit.client.1.smithi136.stdout:7/293: truncate d0/d12/d2a/d3c/f4b 301351 0 2024-09-18T12:51:09.368 INFO:tasks.workunit.client.1.smithi136.stdout:7/294: chown d0/d12/d2a/c38 74 1 2024-09-18T12:51:09.368 INFO:tasks.workunit.client.1.smithi136.stdout:9/175: mkdir d6/d13/d15/d38 0 2024-09-18T12:51:09.369 INFO:tasks.workunit.client.1.smithi136.stdout:9/176: readlink d6/l18 0 2024-09-18T12:51:09.369 INFO:tasks.workunit.client.1.smithi136.stdout:9/177: chown d6/l18 0 1 2024-09-18T12:51:09.369 INFO:tasks.workunit.client.1.smithi136.stdout:9/178: creat d6/d13/d15/d25/f39 x:0 0 0 2024-09-18T12:51:09.369 INFO:tasks.workunit.client.1.smithi136.stdout:9/179: creat d6/d13/d15/d25/f3a x:0 0 0 2024-09-18T12:51:09.369 INFO:tasks.workunit.client.1.smithi136.stdout:3/182: mkdir d3/d5/d3c 0 2024-09-18T12:51:09.372 INFO:tasks.workunit.client.1.smithi136.stdout:1/132: truncate d2/d5/fd 2860617 0 2024-09-18T12:51:09.372 INFO:tasks.workunit.client.1.smithi136.stdout:1/133: chown d2/d5/d11/f19 18693 1 2024-09-18T12:51:09.373 INFO:tasks.workunit.client.1.smithi136.stdout:1/134: write d2/f16 [633544,107082] 0 2024-09-18T12:51:09.373 INFO:tasks.workunit.client.1.smithi136.stdout:8/217: creat d9/d14/d1a/d2b/f58 x:0 0 0 2024-09-18T12:51:09.375 INFO:tasks.workunit.client.1.smithi136.stdout:7/295: creat d0/d12/d5e/d67/f68 x:0 0 0 2024-09-18T12:51:09.375 INFO:tasks.workunit.client.1.smithi136.stdout:7/296: readlink d0/d12/l16 0 2024-09-18T12:51:09.377 INFO:tasks.workunit.client.1.smithi136.stdout:9/180: rename d6/d13/d15/d25/d29/f30 to d6/df/f3b 0 2024-09-18T12:51:09.378 INFO:tasks.workunit.client.1.smithi136.stdout:3/183: truncate d3/d14/f3a 4137743 0 2024-09-18T12:51:09.379 INFO:tasks.workunit.client.1.smithi136.stdout:1/135: mknod d2/d5/c2a 0 2024-09-18T12:51:09.381 INFO:tasks.workunit.client.1.smithi136.stdout:7/297: mkdir d0/d39/d4d/d69 0 2024-09-18T12:51:09.382 INFO:tasks.workunit.client.1.smithi136.stdout:9/181: symlink d6/d13/l3c 0 2024-09-18T12:51:09.385 INFO:tasks.workunit.client.1.smithi136.stdout:9/182: dread d6/d13/d15/f16 [4194304,4194304] 0 2024-09-18T12:51:09.385 INFO:tasks.workunit.client.1.smithi136.stdout:7/298: link d0/d39/f43 d0/d35/d41/d50/d5a/f6a 0 2024-09-18T12:51:09.388 INFO:tasks.workunit.client.1.smithi136.stdout:3/184: dread d3/d10/f36 [0,4194304] 0 2024-09-18T12:51:09.390 INFO:tasks.workunit.client.1.smithi136.stdout:3/185: mkdir d3/d14/d22/d2c/d3d 0 2024-09-18T12:51:09.391 INFO:tasks.workunit.client.1.smithi136.stdout:1/136: write d2/d1c/f1f [1216694,118790] 0 2024-09-18T12:51:09.391 INFO:tasks.workunit.client.1.smithi136.stdout:7/299: dread d0/d12/d2a/f42 [0,4194304] 0 2024-09-18T12:51:09.392 INFO:tasks.workunit.client.1.smithi136.stdout:7/300: dread - d0/d12/f60 zero size 2024-09-18T12:51:09.392 INFO:tasks.workunit.client.1.smithi136.stdout:3/186: creat d3/d5/f3e x:0 0 0 2024-09-18T12:51:09.392 INFO:tasks.workunit.client.1.smithi136.stdout:2/242: sync 2024-09-18T12:51:09.394 INFO:tasks.workunit.client.1.smithi136.stdout:8/218: dwrite d9/d14/d1a/d2b/f58 [0,4194304] 0 2024-09-18T12:51:09.394 INFO:tasks.workunit.client.1.smithi136.stdout:8/219: chown d9/d18/f41 1 1 2024-09-18T12:51:09.396 INFO:tasks.workunit.client.1.smithi136.stdout:3/187: unlink d3/d14/d22/d2c/f39 0 2024-09-18T12:51:09.398 INFO:tasks.workunit.client.1.smithi136.stdout:2/243: creat d5/d7/d17/d48/f4e x:0 0 0 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/220: symlink d9/d18/d34/l59 0 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/221: chown d9/f1e 41320 1 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/222: truncate d9/d18/d34/d3d/f4b 542514 0 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/223: dread - d9/d14/d1a/f4a zero size 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/224: dread - d9/d18/d34/d3d/f54 zero size 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:8/225: creat d9/d18/f5a x:0 0 0 2024-09-18T12:51:09.401 INFO:tasks.workunit.client.1.smithi136.stdout:7/301: rmdir d0/d12/d5e/d67 39 2024-09-18T12:51:09.405 INFO:tasks.workunit.client.1.smithi136.stdout:3/188: creat d3/d14/d22/d2c/d3d/f3f x:0 0 0 2024-09-18T12:51:09.405 INFO:tasks.workunit.client.1.smithi136.stdout:3/189: truncate d3/d10/f36 4714071 0 2024-09-18T12:51:09.405 INFO:tasks.workunit.client.1.smithi136.stdout:3/190: getdents d3/d5/d3c 0 2024-09-18T12:51:09.407 INFO:tasks.workunit.client.1.smithi136.stdout:8/226: symlink d9/d18/d34/d3d/d47/l5b 0 2024-09-18T12:51:09.408 INFO:tasks.workunit.client.1.smithi136.stdout:8/227: write d9/d14/d1a/f36 [112658,45944] 0 2024-09-18T12:51:09.408 INFO:tasks.workunit.client.1.smithi136.stdout:8/228: creat d9/d18/f5c x:0 0 0 2024-09-18T12:51:09.408 INFO:tasks.workunit.client.1.smithi136.stdout:7/302: mkdir d0/d12/d2a/d6b 0 2024-09-18T12:51:09.408 INFO:tasks.workunit.client.1.smithi136.stdout:7/303: write d0/d2c/d2e/f3f [34487,41623] 0 2024-09-18T12:51:09.409 INFO:tasks.workunit.client.1.smithi136.stdout:3/191: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:09.411 INFO:tasks.workunit.client.1.smithi136.stdout:3/192: creat d3/d14/f40 x:0 0 0 2024-09-18T12:51:09.412 INFO:tasks.workunit.client.1.smithi136.stdout:3/193: chown d3/d10 98 1 2024-09-18T12:51:09.414 INFO:tasks.workunit.client.1.smithi136.stdout:3/194: unlink d3/d14/d17/d1a/f1d 0 2024-09-18T12:51:09.417 INFO:tasks.workunit.client.1.smithi136.stdout:1/137: dwrite d2/d5/d9/fc [4194304,4194304] 0 2024-09-18T12:51:09.418 INFO:tasks.workunit.client.1.smithi136.stdout:7/304: dread d0/d2c/f45 [0,4194304] 0 2024-09-18T12:51:09.418 INFO:tasks.workunit.client.1.smithi136.stdout:7/305: chown d0/d12/d1a/f33 1121704 1 2024-09-18T12:51:09.421 INFO:tasks.workunit.client.1.smithi136.stdout:8/229: dread d9/d14/d1a/d2b/f58 [0,4194304] 0 2024-09-18T12:51:09.423 INFO:tasks.workunit.client.1.smithi136.stdout:8/230: symlink d9/d14/d1a/d2b/d42/l5d 0 2024-09-18T12:51:09.423 INFO:tasks.workunit.client.1.smithi136.stdout:8/231: chown d9/d18/d34/d3d/l40 0 1 2024-09-18T12:51:09.423 INFO:tasks.workunit.client.1.smithi136.stdout:8/232: dread - d9/d14/d1a/f4e zero size 2024-09-18T12:51:09.423 INFO:tasks.workunit.client.1.smithi136.stdout:8/233: chown l7 409 1 2024-09-18T12:51:09.424 INFO:tasks.workunit.client.1.smithi136.stdout:8/234: getdents d9/d18/d34 0 2024-09-18T12:51:09.424 INFO:tasks.workunit.client.1.smithi136.stdout:8/235: stat d9/fa 0 2024-09-18T12:51:09.445 INFO:tasks.workunit.client.1.smithi136.stdout:7/306: dwrite d0/d12/d2a/f42 [0,4194304] 0 2024-09-18T12:51:09.445 INFO:tasks.workunit.client.1.smithi136.stdout:3/195: dwrite d3/d5/f3e [0,4194304] 0 2024-09-18T12:51:09.445 INFO:tasks.workunit.client.1.smithi136.stdout:8/236: dwrite d9/f1e [0,4194304] 0 2024-09-18T12:51:09.445 INFO:tasks.workunit.client.1.smithi136.stdout:8/237: chown d9/d14/d1a/d2b/f4d 12936199 1 2024-09-18T12:51:09.446 INFO:tasks.workunit.client.1.smithi136.stdout:3/196: write d3/d5/f35 [1327462,82567] 0 2024-09-18T12:51:09.447 INFO:tasks.workunit.client.1.smithi136.stdout:7/307: creat d0/d35/f6c x:0 0 0 2024-09-18T12:51:09.449 INFO:tasks.workunit.client.1.smithi136.stdout:3/197: creat d3/d14/d18/f41 x:0 0 0 2024-09-18T12:51:09.450 INFO:tasks.workunit.client.1.smithi136.stdout:7/308: creat d0/d12/d2a/d3b/f6d x:0 0 0 2024-09-18T12:51:09.450 INFO:tasks.workunit.client.1.smithi136.stdout:8/238: link d9/d18/d34/l39 d9/d14/d1a/d2b/l5e 0 2024-09-18T12:51:09.451 INFO:tasks.workunit.client.1.smithi136.stdout:7/309: read d0/f62 [4805173,89131] 0 2024-09-18T12:51:09.451 INFO:tasks.workunit.client.1.smithi136.stdout:7/310: write d0/d35/d41/f5c [206566,112789] 0 2024-09-18T12:51:09.452 INFO:tasks.workunit.client.1.smithi136.stdout:8/239: creat d9/f5f x:0 0 0 2024-09-18T12:51:09.453 INFO:tasks.workunit.client.1.smithi136.stdout:7/311: rename d0/d12/d2a/d3b/f6d to d0/d39/d4d/d69/f6e 0 2024-09-18T12:51:09.453 INFO:tasks.workunit.client.1.smithi136.stdout:7/312: read - d0/d12/d5e/d67/f68 zero size 2024-09-18T12:51:09.453 INFO:tasks.workunit.client.1.smithi136.stdout:7/313: write d0/d35/d36/ff [1787946,104809] 0 2024-09-18T12:51:09.454 INFO:tasks.workunit.client.1.smithi136.stdout:4/80: sync 2024-09-18T12:51:09.455 INFO:tasks.workunit.client.1.smithi136.stdout:7/314: creat d0/d35/d41/d58/f6f x:0 0 0 2024-09-18T12:51:09.455 INFO:tasks.workunit.client.1.smithi136.stdout:7/315: dread - d0/d12/d5e/d67/f68 zero size 2024-09-18T12:51:09.456 INFO:tasks.workunit.client.1.smithi136.stdout:7/316: write d0/f62 [5363711,47743] 0 2024-09-18T12:51:09.456 INFO:tasks.workunit.client.1.smithi136.stdout:8/240: mknod d9/d14/d1a/d2b/c60 0 2024-09-18T12:51:09.458 INFO:tasks.workunit.client.1.smithi136.stdout:4/81: truncate d0/f15 4804518 0 2024-09-18T12:51:09.458 INFO:tasks.workunit.client.1.smithi136.stdout:4/82: creat d0/d2/f16 x:0 0 0 2024-09-18T12:51:09.458 INFO:tasks.workunit.client.1.smithi136.stdout:4/83: chown d0/f7 1 1 2024-09-18T12:51:09.458 INFO:tasks.workunit.client.1.smithi136.stdout:4/84: chown d0/cd 11150 1 2024-09-18T12:51:09.459 INFO:tasks.workunit.client.1.smithi136.stdout:7/317: symlink d0/d39/d4d/d69/l70 0 2024-09-18T12:51:09.459 INFO:tasks.workunit.client.1.smithi136.stdout:7/318: stat d0/d12/d1a/c1f 0 2024-09-18T12:51:09.466 INFO:tasks.workunit.client.1.smithi136.stdout:8/241: getdents d9/d14/d1a/d2b 0 2024-09-18T12:51:09.466 INFO:tasks.workunit.client.1.smithi136.stdout:8/242: dread - d9/d14/d1a/f4e zero size 2024-09-18T12:51:09.466 INFO:tasks.workunit.client.1.smithi136.stdout:8/243: write d9/d14/d1a/f36 [1944335,50611] 0 2024-09-18T12:51:09.466 INFO:tasks.workunit.client.1.smithi136.stdout:8/244: truncate d9/f5f 159489 0 2024-09-18T12:51:09.467 INFO:tasks.workunit.client.1.smithi136.stdout:8/245: symlink d9/d18/d34/d3d/d47/l61 0 2024-09-18T12:51:09.468 INFO:tasks.workunit.client.1.smithi136.stdout:3/198: dwrite d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:09.468 INFO:tasks.workunit.client.1.smithi136.stdout:3/199: creat d3/d14/d22/f42 x:0 0 0 2024-09-18T12:51:09.468 INFO:tasks.workunit.client.1.smithi136.stdout:3/200: creat d3/d10/f43 x:0 0 0 2024-09-18T12:51:09.470 INFO:tasks.workunit.client.1.smithi136.stdout:4/85: rmdir d0 39 2024-09-18T12:51:09.473 INFO:tasks.workunit.client.1.smithi136.stdout:3/201: symlink d3/d14/d18/l44 0 2024-09-18T12:51:09.476 INFO:tasks.workunit.client.1.smithi136.stdout:4/86: rmdir d0/d2 39 2024-09-18T12:51:09.477 INFO:tasks.workunit.client.1.smithi136.stdout:3/202: symlink d3/d14/d22/d2c/d3d/l45 0 2024-09-18T12:51:09.478 INFO:tasks.workunit.client.1.smithi136.stdout:4/87: creat d0/d2/f17 x:0 0 0 2024-09-18T12:51:09.478 INFO:tasks.workunit.client.1.smithi136.stdout:4/88: write d0/d2/f12 [116480,38970] 0 2024-09-18T12:51:09.479 INFO:tasks.workunit.client.1.smithi136.stdout:3/203: rename d3/d14/d17/d1a/l21 to d3/d14/d17/l46 0 2024-09-18T12:51:09.479 INFO:tasks.workunit.client.1.smithi136.stdout:4/89: truncate d0/fc 1287540 0 2024-09-18T12:51:09.481 INFO:tasks.workunit.client.1.smithi136.stdout:3/204: link d3/c2e d3/d5/c47 0 2024-09-18T12:51:09.481 INFO:tasks.workunit.client.1.smithi136.stdout:3/205: truncate d3/d14/d22/f37 449781 0 2024-09-18T12:51:09.481 INFO:tasks.workunit.client.1.smithi136.stdout:3/206: truncate d3/d14/d22/f37 812523 0 2024-09-18T12:51:09.482 INFO:tasks.workunit.client.1.smithi136.stdout:3/207: dread d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:09.482 INFO:tasks.workunit.client.1.smithi136.stdout:3/208: fdatasync d3/d5/f35 0 2024-09-18T12:51:09.482 INFO:tasks.workunit.client.1.smithi136.stdout:4/90: creat d0/d13/f18 x:0 0 0 2024-09-18T12:51:09.482 INFO:tasks.workunit.client.1.smithi136.stdout:4/91: fdatasync d0/d3/f10 0 2024-09-18T12:51:09.483 INFO:tasks.workunit.client.1.smithi136.stdout:3/209: mknod d3/d14/d17/c48 0 2024-09-18T12:51:09.483 INFO:tasks.workunit.client.1.smithi136.stdout:3/210: readlink d3/d5/l6 0 2024-09-18T12:51:09.483 INFO:tasks.workunit.client.1.smithi136.stdout:3/211: read d3/f9 [2899198,21229] 0 2024-09-18T12:51:09.484 INFO:tasks.workunit.client.1.smithi136.stdout:4/92: mkdir d0/d2/d19 0 2024-09-18T12:51:09.486 INFO:tasks.workunit.client.1.smithi136.stdout:8/246: dwrite d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:09.486 INFO:tasks.workunit.client.1.smithi136.stdout:8/247: truncate d9/d14/f15 923454 0 2024-09-18T12:51:09.487 INFO:tasks.workunit.client.1.smithi136.stdout:7/319: dwrite d0/d35/d41/f5c [0,4194304] 0 2024-09-18T12:51:09.490 INFO:tasks.workunit.client.1.smithi136.stdout:3/212: link d3/d14/d17/l46 d3/d14/d17/d27/l49 0 2024-09-18T12:51:09.496 INFO:tasks.workunit.client.1.smithi136.stdout:8/248: mknod d9/c62 0 2024-09-18T12:51:09.496 INFO:tasks.workunit.client.1.smithi136.stdout:8/249: creat d9/d14/f63 x:0 0 0 2024-09-18T12:51:09.497 INFO:tasks.workunit.client.1.smithi136.stdout:3/213: mkdir d3/d10/d4a 0 2024-09-18T12:51:09.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/250: getdents d9/d18/d34/d3d 0 2024-09-18T12:51:09.506 INFO:tasks.workunit.client.1.smithi136.stdout:7/320: dwrite d0/fa [0,4194304] 0 2024-09-18T12:51:09.508 INFO:tasks.workunit.client.1.smithi136.stdout:7/321: mknod d0/d2c/c71 0 2024-09-18T12:51:09.513 INFO:tasks.workunit.client.1.smithi136.stdout:3/214: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:09.515 INFO:tasks.workunit.client.1.smithi136.stdout:3/215: dread d3/f34 [4194304,4194304] 0 2024-09-18T12:51:09.516 INFO:tasks.workunit.client.1.smithi136.stdout:3/216: creat d3/d2b/f4b x:0 0 0 2024-09-18T12:51:09.516 INFO:tasks.workunit.client.1.smithi136.stdout:3/217: write d3/d14/f3a [1479163,66868] 0 2024-09-18T12:51:09.518 INFO:tasks.workunit.client.1.smithi136.stdout:3/218: creat d3/d5/d3c/f4c x:0 0 0 2024-09-18T12:51:09.518 INFO:tasks.workunit.client.1.smithi136.stdout:3/219: chown d3/d14/d17/d1a/c2d 1405104 1 2024-09-18T12:51:09.518 INFO:tasks.workunit.client.1.smithi136.stdout:3/220: creat d3/d14/d17/f4d x:0 0 0 2024-09-18T12:51:09.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/221: unlink d3/d5/c30 0 2024-09-18T12:51:09.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/222: mkdir d3/d2b/d4e 0 2024-09-18T12:51:09.522 INFO:tasks.workunit.client.1.smithi136.stdout:3/223: unlink d3/d5/f3e 0 2024-09-18T12:51:09.529 INFO:tasks.workunit.client.1.smithi136.stdout:8/251: dwrite d9/d14/d1a/d2b/d42/f49 [0,4194304] 0 2024-09-18T12:51:09.529 INFO:tasks.workunit.client.1.smithi136.stdout:8/252: fdatasync f3 0 2024-09-18T12:51:09.531 INFO:tasks.workunit.client.1.smithi136.stdout:8/253: link d9/d14/c21 d9/d14/d1a/c64 0 2024-09-18T12:51:09.532 INFO:tasks.workunit.client.1.smithi136.stdout:8/254: mkdir d9/d18/d34/d3d/d47/d65 0 2024-09-18T12:51:09.534 INFO:tasks.workunit.client.1.smithi136.stdout:8/255: unlink d9/d18/d34/d3d/d47/l61 0 2024-09-18T12:51:09.535 INFO:tasks.workunit.client.1.smithi136.stdout:8/256: read d9/d14/f15 [632039,21949] 0 2024-09-18T12:51:09.544 INFO:tasks.workunit.client.1.smithi136.stdout:3/224: dwrite d3/d2b/f4b [0,4194304] 0 2024-09-18T12:51:09.544 INFO:tasks.workunit.client.1.smithi136.stdout:5/154: sync 2024-09-18T12:51:09.544 INFO:tasks.workunit.client.1.smithi136.stdout:0/212: sync 2024-09-18T12:51:09.545 INFO:tasks.workunit.client.1.smithi136.stdout:5/155: dread d5/f9 [0,4194304] 0 2024-09-18T12:51:09.545 INFO:tasks.workunit.client.1.smithi136.stdout:5/156: stat d5/f9 0 2024-09-18T12:51:09.547 INFO:tasks.workunit.client.1.smithi136.stdout:5/157: dread d5/f9 [0,4194304] 0 2024-09-18T12:51:09.548 INFO:tasks.workunit.client.1.smithi136.stdout:0/213: unlink d1/d3/d1a/f2a 0 2024-09-18T12:51:09.549 INFO:tasks.workunit.client.1.smithi136.stdout:5/158: creat d5/f2a x:0 0 0 2024-09-18T12:51:09.549 INFO:tasks.workunit.client.1.smithi136.stdout:5/159: fdatasync d5/d1a/f21 0 2024-09-18T12:51:09.549 INFO:tasks.workunit.client.1.smithi136.stdout:5/160: creat d5/d1a/f2b x:0 0 0 2024-09-18T12:51:09.551 INFO:tasks.workunit.client.1.smithi136.stdout:8/257: dread f3 [0,4194304] 0 2024-09-18T12:51:09.551 INFO:tasks.workunit.client.1.smithi136.stdout:5/161: creat d5/f2c x:0 0 0 2024-09-18T12:51:09.555 INFO:tasks.workunit.client.1.smithi136.stdout:8/258: rename d9/f5f to d9/d18/d34/d3d/d47/d65/f66 0 2024-09-18T12:51:09.556 INFO:tasks.workunit.client.1.smithi136.stdout:8/259: truncate d9/d14/f15 876521 0 2024-09-18T12:51:09.556 INFO:tasks.workunit.client.1.smithi136.stdout:8/260: stat d9/d18/d34/d3d/d47/l5b 0 2024-09-18T12:51:09.557 INFO:tasks.workunit.client.1.smithi136.stdout:8/261: chown d9/d14/d1a/d2b/d42/f43 3864378 1 2024-09-18T12:51:09.557 INFO:tasks.workunit.client.1.smithi136.stdout:8/262: creat d9/d18/d34/f67 x:0 0 0 2024-09-18T12:51:09.566 INFO:tasks.workunit.client.1.smithi136.stdout:3/225: dwrite d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:09.569 INFO:tasks.workunit.client.1.smithi136.stdout:3/226: mknod d3/d14/d17/d1a/c4f 0 2024-09-18T12:51:09.569 INFO:tasks.workunit.client.1.smithi136.stdout:3/227: readlink d3/l29 0 2024-09-18T12:51:09.574 INFO:tasks.workunit.client.1.smithi136.stdout:3/228: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:09.574 INFO:tasks.workunit.client.1.smithi136.stdout:3/229: creat d3/d14/d18/f50 x:0 0 0 2024-09-18T12:51:09.574 INFO:tasks.workunit.client.1.smithi136.stdout:3/230: dread - d3/d14/d22/f42 zero size 2024-09-18T12:51:09.579 INFO:tasks.workunit.client.1.smithi136.stdout:5/162: dwrite d5/d1a/f2b [0,4194304] 0 2024-09-18T12:51:09.579 INFO:tasks.workunit.client.1.smithi136.stdout:0/214: dwrite d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:09.579 INFO:tasks.workunit.client.1.smithi136.stdout:8/263: dwrite d9/d18/d34/f67 [0,4194304] 0 2024-09-18T12:51:09.583 INFO:tasks.workunit.client.1.smithi136.stdout:5/163: mkdir d5/d1a/d2d 0 2024-09-18T12:51:09.585 INFO:tasks.workunit.client.1.smithi136.stdout:8/264: write d9/d14/d1a/d2b/f58 [591028,66867] 0 2024-09-18T12:51:09.586 INFO:tasks.workunit.client.1.smithi136.stdout:0/215: mkdir d1/d46 0 2024-09-18T12:51:09.586 INFO:tasks.workunit.client.1.smithi136.stdout:0/216: chown d1/fe 228860 1 2024-09-18T12:51:09.587 INFO:tasks.workunit.client.1.smithi136.stdout:5/164: dread f2 [0,4194304] 0 2024-09-18T12:51:09.587 INFO:tasks.workunit.client.1.smithi136.stdout:5/165: chown d5/d1a/f27 4139416 1 2024-09-18T12:51:09.587 INFO:tasks.workunit.client.1.smithi136.stdout:5/166: chown d5/l14 2643 1 2024-09-18T12:51:09.587 INFO:tasks.workunit.client.1.smithi136.stdout:5/167: chown d5/fe 104320 1 2024-09-18T12:51:09.587 INFO:tasks.workunit.client.1.smithi136.stdout:8/265: mknod d9/d18/d34/d3d/d47/d65/c68 0 2024-09-18T12:51:09.588 INFO:tasks.workunit.client.1.smithi136.stdout:0/217: rename d1/d3/d1a/f24 to d1/d17/f47 0 2024-09-18T12:51:09.589 INFO:tasks.workunit.client.1.smithi136.stdout:5/168: link f2 d5/dc/f2e 0 2024-09-18T12:51:09.593 INFO:tasks.workunit.client.1.smithi136.stdout:0/218: getdents d1 0 2024-09-18T12:51:09.594 INFO:tasks.workunit.client.1.smithi136.stdout:0/219: unlink d1/d3/f19 0 2024-09-18T12:51:09.594 INFO:tasks.workunit.client.1.smithi136.stdout:0/220: write d1/f31 [676788,48221] 0 2024-09-18T12:51:09.595 INFO:tasks.workunit.client.1.smithi136.stdout:3/231: dwrite d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:09.595 INFO:tasks.workunit.client.1.smithi136.stdout:8/266: dread d9/d18/d34/f67 [0,4194304] 0 2024-09-18T12:51:09.596 INFO:tasks.workunit.client.1.smithi136.stdout:0/221: mknod d1/d17/c48 0 2024-09-18T12:51:09.602 INFO:tasks.workunit.client.1.smithi136.stdout:8/267: mknod d9/d14/d1a/d2b/d42/c69 0 2024-09-18T12:51:09.604 INFO:tasks.workunit.client.1.smithi136.stdout:0/222: unlink d1/d17/c48 0 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:8/268: creat d9/f6a x:0 0 0 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:9/183: sync 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:6/143: sync 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:2/244: sync 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:2/245: fdatasync d5/d7/d17/f24 0 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:2/246: chown d5/cb 402020 1 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:6/144: creat d8/dc/f31 x:0 0 0 2024-09-18T12:51:09.605 INFO:tasks.workunit.client.1.smithi136.stdout:6/145: chown d8/f19 297534072 1 2024-09-18T12:51:09.606 INFO:tasks.workunit.client.1.smithi136.stdout:8/269: mkdir d9/d18/d34/d3d/d47/d65/d6b 0 2024-09-18T12:51:09.606 INFO:tasks.workunit.client.1.smithi136.stdout:1/138: sync 2024-09-18T12:51:09.606 INFO:tasks.workunit.client.1.smithi136.stdout:1/139: write d2/d5/d11/f13 [285653,121659] 0 2024-09-18T12:51:09.607 INFO:tasks.workunit.client.1.smithi136.stdout:9/184: mkdir d6/da/d3d 0 2024-09-18T12:51:09.607 INFO:tasks.workunit.client.1.smithi136.stdout:5/169: dwrite d5/fa [0,4194304] 0 2024-09-18T12:51:09.608 INFO:tasks.workunit.client.1.smithi136.stdout:5/170: dread - d5/f1c zero size 2024-09-18T12:51:09.611 INFO:tasks.workunit.client.1.smithi136.stdout:2/247: unlink d5/d7/d11/f20 0 2024-09-18T12:51:09.611 INFO:tasks.workunit.client.1.smithi136.stdout:2/248: write d5/d7/d17/f47 [3267748,28643] 0 2024-09-18T12:51:09.612 INFO:tasks.workunit.client.1.smithi136.stdout:6/146: mknod d8/d9/c32 0 2024-09-18T12:51:09.613 INFO:tasks.workunit.client.1.smithi136.stdout:8/270: link d9/d18/d34/d3d/d47/l5b d9/d14/d1a/l6c 0 2024-09-18T12:51:09.615 INFO:tasks.workunit.client.1.smithi136.stdout:1/140: mkdir d2/d5/d2b 0 2024-09-18T12:51:09.615 INFO:tasks.workunit.client.1.smithi136.stdout:1/141: creat d2/d5/d9/d23/f2c x:0 0 0 2024-09-18T12:51:09.615 INFO:tasks.workunit.client.1.smithi136.stdout:1/142: truncate d2/f16 1383315 0 2024-09-18T12:51:09.615 INFO:tasks.workunit.client.1.smithi136.stdout:1/143: dread - d2/d5/d11/f19 zero size 2024-09-18T12:51:09.616 INFO:tasks.workunit.client.1.smithi136.stdout:9/185: symlink d6/db/l3e 0 2024-09-18T12:51:09.616 INFO:tasks.workunit.client.1.smithi136.stdout:9/186: truncate d6/d13/f22 1002421 0 2024-09-18T12:51:09.616 INFO:tasks.workunit.client.1.smithi136.stdout:9/187: truncate d6/db/d12/f37 503684 0 2024-09-18T12:51:09.618 INFO:tasks.workunit.client.1.smithi136.stdout:6/147: mknod d8/dc/c33 0 2024-09-18T12:51:09.619 INFO:tasks.workunit.client.1.smithi136.stdout:1/144: mknod d2/d5/d11/c2d 0 2024-09-18T12:51:09.621 INFO:tasks.workunit.client.1.smithi136.stdout:9/188: symlink d6/d13/l3f 0 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.1.smithi136.stdout:1/145: truncate d2/d5/d9/f10 4197093 0 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.1.smithi136.stdout:1/146: dread - d2/f17 zero size 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.0.smithi081.stdout:0/1: sync 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.0.smithi081.stdout:0/2: stat f0 0 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.0.smithi081.stdout:0/3: fsync f0 0 2024-09-18T12:51:09.622 INFO:tasks.workunit.client.0.smithi081.stdout:0/4: symlink l1 0 2024-09-18T12:51:09.623 INFO:tasks.workunit.client.1.smithi136.stdout:9/189: rename f3 to d6/f40 0 2024-09-18T12:51:09.624 INFO:tasks.workunit.client.0.smithi081.stdout:0/5: symlink l2 0 2024-09-18T12:51:09.624 INFO:tasks.workunit.client.1.smithi136.stdout:3/232: dwrite d3/d2b/f4b [0,4194304] 0 2024-09-18T12:51:09.624 INFO:tasks.workunit.client.1.smithi136.stdout:2/249: dread d5/d7/f1e [4194304,4194304] 0 2024-09-18T12:51:09.625 INFO:tasks.workunit.client.0.smithi081.stdout:0/6: mknod c3 0 2024-09-18T12:51:09.625 INFO:tasks.workunit.client.0.smithi081.stdout:0/7: write f0 [975857,8923] 0 2024-09-18T12:51:09.625 INFO:tasks.workunit.client.1.smithi136.stdout:9/190: rmdir d6/d13/d15 39 2024-09-18T12:51:09.625 INFO:tasks.workunit.client.1.smithi136.stdout:6/148: dread d8/d9/fa [0,4194304] 0 2024-09-18T12:51:09.625 INFO:tasks.workunit.client.1.smithi136.stdout:6/149: creat d8/d9/f34 x:0 0 0 2024-09-18T12:51:09.626 INFO:tasks.workunit.client.1.smithi136.stdout:0/223: dwrite d1/f36 [0,4194304] 0 2024-09-18T12:51:09.626 INFO:tasks.workunit.client.1.smithi136.stdout:0/224: read d1/f43 [3579446,43897] 0 2024-09-18T12:51:09.626 INFO:tasks.workunit.client.1.smithi136.stdout:1/147: mkdir d2/d5/d11/d2e 0 2024-09-18T12:51:09.629 INFO:tasks.workunit.client.1.smithi136.stdout:1/148: read f1 [1421057,70278] 0 2024-09-18T12:51:09.632 INFO:tasks.workunit.client.1.smithi136.stdout:8/271: dwrite d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:09.632 INFO:tasks.workunit.client.1.smithi136.stdout:8/272: creat d9/d14/d1a/d2b/d42/f6d x:0 0 0 2024-09-18T12:51:09.633 INFO:tasks.workunit.client.1.smithi136.stdout:5/171: dwrite d5/f2a [0,4194304] 0 2024-09-18T12:51:09.633 INFO:tasks.workunit.client.1.smithi136.stdout:0/225: truncate d1/d3/f1e 783512 0 2024-09-18T12:51:09.636 INFO:tasks.workunit.client.0.smithi081.stdout:0/8: dread f0 [0,4194304] 0 2024-09-18T12:51:09.637 INFO:tasks.workunit.client.1.smithi136.stdout:1/149: truncate d2/f4 746754 0 2024-09-18T12:51:09.637 INFO:tasks.workunit.client.1.smithi136.stdout:1/150: stat d2/d5/d11/d1b/l21 0 2024-09-18T12:51:09.648 INFO:tasks.workunit.client.1.smithi136.stdout:2/250: dwrite d5/d7/d17/f27 [0,4194304] 0 2024-09-18T12:51:09.648 INFO:tasks.workunit.client.1.smithi136.stdout:2/251: chown d5/d7/d11/c4d 30 1 2024-09-18T12:51:09.648 INFO:tasks.workunit.client.1.smithi136.stdout:5/172: rename d5/d1a/c1d to d5/d1a/c2f 0 2024-09-18T12:51:09.649 INFO:tasks.workunit.client.1.smithi136.stdout:4/93: sync 2024-09-18T12:51:09.649 INFO:tasks.workunit.client.1.smithi136.stdout:7/322: sync 2024-09-18T12:51:09.650 INFO:tasks.workunit.client.1.smithi136.stdout:0/226: creat d1/d17/d2d/d35/f49 x:0 0 0 2024-09-18T12:51:09.650 INFO:tasks.workunit.client.1.smithi136.stdout:0/227: write d1/f1f [1327563,58541] 0 2024-09-18T12:51:09.651 INFO:tasks.workunit.client.1.smithi136.stdout:6/150: dwrite d8/d9/de/f25 [0,4194304] 0 2024-09-18T12:51:09.651 INFO:tasks.workunit.client.1.smithi136.stdout:0/228: dread d1/f2c [0,4194304] 0 2024-09-18T12:51:09.651 INFO:tasks.workunit.client.1.smithi136.stdout:0/229: creat d1/d17/d2d/d35/f4a x:0 0 0 2024-09-18T12:51:09.651 INFO:tasks.workunit.client.1.smithi136.stdout:0/230: chown d1 1260237490 1 2024-09-18T12:51:09.657 INFO:tasks.workunit.client.0.smithi081.stdout:0/9: rename c3 to c4 0 2024-09-18T12:51:09.659 INFO:tasks.workunit.client.1.smithi136.stdout:1/151: rmdir d2/d5/d11 39 2024-09-18T12:51:09.663 INFO:tasks.workunit.client.1.smithi136.stdout:2/252: rename d5/d25/f45 to d5/d7/d41/f4f 0 2024-09-18T12:51:09.664 INFO:tasks.workunit.client.1.smithi136.stdout:2/253: fsync d5/d7/d11/f29 0 2024-09-18T12:51:09.667 INFO:tasks.workunit.client.1.smithi136.stdout:4/94: mknod d0/d2/c1a 0 2024-09-18T12:51:09.668 INFO:tasks.workunit.client.1.smithi136.stdout:7/323: symlink d0/d35/d4f/d66/l72 0 2024-09-18T12:51:09.672 INFO:tasks.workunit.client.1.smithi136.stdout:1/152: read d2/d5/d11/d1b/f25 [2782591,104466] 0 2024-09-18T12:51:09.672 INFO:tasks.workunit.client.1.smithi136.stdout:1/153: creat d2/d1c/f2f x:0 0 0 2024-09-18T12:51:09.672 INFO:tasks.workunit.client.1.smithi136.stdout:0/231: symlink d1/db/l4b 0 2024-09-18T12:51:09.677 INFO:tasks.workunit.client.0.smithi081.stdout:0/10: dwrite f0 [0,4194304] 0 2024-09-18T12:51:09.677 INFO:tasks.workunit.client.0.smithi081.stdout:0/11: fdatasync f0 0 2024-09-18T12:51:09.677 INFO:tasks.workunit.client.0.smithi081.stdout:0/12: stat l2 0 2024-09-18T12:51:09.677 INFO:tasks.workunit.client.0.smithi081.stdout:0/13: creat f5 x:0 0 0 2024-09-18T12:51:09.677 INFO:tasks.workunit.client.0.smithi081.stdout:0/14: creat f6 x:0 0 0 2024-09-18T12:51:09.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/173: rmdir d5 39 2024-09-18T12:51:09.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/174: chown d5/d1a/f2b 7 1 2024-09-18T12:51:09.680 INFO:tasks.workunit.client.1.smithi136.stdout:4/95: mknod d0/c1b 0 2024-09-18T12:51:09.682 INFO:tasks.workunit.client.1.smithi136.stdout:7/324: mknod d0/d35/d4f/c73 0 2024-09-18T12:51:09.683 INFO:tasks.workunit.client.1.smithi136.stdout:6/151: mknod d8/c35 0 2024-09-18T12:51:09.688 INFO:tasks.workunit.client.1.smithi136.stdout:2/254: rmdir d5/d7/d17 39 2024-09-18T12:51:09.688 INFO:tasks.workunit.client.1.smithi136.stdout:2/255: chown d5/f15 3332013 1 2024-09-18T12:51:09.688 INFO:tasks.workunit.client.1.smithi136.stdout:2/256: truncate d5/d7/d17/f24 22484 0 2024-09-18T12:51:09.688 INFO:tasks.workunit.client.1.smithi136.stdout:2/257: dread - d5/d25/f36 zero size 2024-09-18T12:51:09.689 INFO:tasks.workunit.client.0.smithi081.stdout:0/15: write f0 [3463701,6269] 0 2024-09-18T12:51:09.689 INFO:tasks.workunit.client.0.smithi081.stdout:0/16: chown f6 125220 1 2024-09-18T12:51:09.691 INFO:tasks.workunit.client.1.smithi136.stdout:5/175: mkdir d5/d1a/d30 0 2024-09-18T12:51:09.691 INFO:tasks.workunit.client.1.smithi136.stdout:4/96: rmdir d0 39 2024-09-18T12:51:09.693 INFO:tasks.workunit.client.1.smithi136.stdout:6/152: symlink d8/d9/de/d1c/l36 0 2024-09-18T12:51:09.693 INFO:tasks.workunit.client.1.smithi136.stdout:6/153: truncate d8/d9/f21 330859 0 2024-09-18T12:51:09.693 INFO:tasks.workunit.client.1.smithi136.stdout:1/154: mknod d2/d5/d9/c30 0 2024-09-18T12:51:09.694 INFO:tasks.workunit.client.1.smithi136.stdout:2/258: creat d5/d7/d11/d34/f50 x:0 0 0 2024-09-18T12:51:09.696 INFO:tasks.workunit.client.1.smithi136.stdout:7/325: dwrite d0/d12/d2a/d3b/f51 [0,4194304] 0 2024-09-18T12:51:09.699 INFO:tasks.workunit.client.1.smithi136.stdout:6/154: symlink d8/d9/de/d1c/l37 0 2024-09-18T12:51:09.699 INFO:tasks.workunit.client.1.smithi136.stdout:5/176: truncate d5/d1a/f21 3274576 0 2024-09-18T12:51:09.700 INFO:tasks.workunit.client.1.smithi136.stdout:5/177: fdatasync d5/fa 0 2024-09-18T12:51:09.700 INFO:tasks.workunit.client.1.smithi136.stdout:4/97: rmdir d0/d2/d19 0 2024-09-18T12:51:09.700 INFO:tasks.workunit.client.1.smithi136.stdout:1/155: link d2/d5/d9/f10 d2/d5/d11/d2e/f31 0 2024-09-18T12:51:09.704 INFO:tasks.workunit.client.1.smithi136.stdout:4/98: symlink d0/d2/l1c 0 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/155: dread f1 [0,4194304] 0 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/156: read d8/dc/f14 [224000,54492] 0 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/157: read - d8/f30 zero size 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/158: chown d8/d9/de/d1c/f20 32681 1 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/159: chown d8/dc/f31 668450 1 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:1/156: creat d2/d5/d9/f32 x:0 0 0 2024-09-18T12:51:09.708 INFO:tasks.workunit.client.1.smithi136.stdout:6/160: creat d8/d9/de/d1c/f38 x:0 0 0 2024-09-18T12:51:09.712 INFO:tasks.workunit.client.1.smithi136.stdout:4/99: mknod d0/d3/c1d 0 2024-09-18T12:51:09.715 INFO:tasks.workunit.client.0.smithi081.stdout:0/17: getdents . 0 2024-09-18T12:51:09.717 INFO:tasks.workunit.client.1.smithi136.stdout:6/161: mknod d8/d9/c39 0 2024-09-18T12:51:09.717 INFO:tasks.workunit.client.0.smithi081.stdout:0/18: mkdir d7 0 2024-09-18T12:51:09.719 INFO:tasks.workunit.client.1.smithi136.stdout:5/178: rename d5/d1a/f21 to d5/f31 0 2024-09-18T12:51:09.719 INFO:tasks.workunit.client.0.smithi081.stdout:0/19: symlink d7/l8 0 2024-09-18T12:51:09.719 INFO:tasks.workunit.client.0.smithi081.stdout:0/20: truncate f6 212064 0 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.1.smithi136.stdout:2/259: dwrite d5/d25/d2d/f30 [4194304,4194304] 0 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.1.smithi136.stdout:2/260: read - d5/d7/d41/f4f zero size 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.1.smithi136.stdout:2/261: write d5/d7/d17/f24 [230962,113795] 0 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.1.smithi136.stdout:2/262: stat d5/d25/d43 0 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.0.smithi081.stdout:0/21: mkdir d7/d9 0 2024-09-18T12:51:09.720 INFO:tasks.workunit.client.0.smithi081.stdout:0/22: readlink l1 0 2024-09-18T12:51:09.721 INFO:tasks.workunit.client.0.smithi081.stdout:0/23: truncate f6 227914 0 2024-09-18T12:51:09.721 INFO:tasks.workunit.client.0.smithi081.stdout:0/24: mknod d7/d9/ca 0 2024-09-18T12:51:09.721 INFO:tasks.workunit.client.1.smithi136.stdout:6/162: symlink d8/d9/l3a 0 2024-09-18T12:51:09.722 INFO:tasks.workunit.client.0.smithi081.stdout:0/25: creat d7/fb x:0 0 0 2024-09-18T12:51:09.722 INFO:tasks.workunit.client.0.smithi081.stdout:0/26: dread - d7/fb zero size 2024-09-18T12:51:09.722 INFO:tasks.workunit.client.1.smithi136.stdout:2/263: truncate d5/d7/d17/f27 3513936 0 2024-09-18T12:51:09.723 INFO:tasks.workunit.client.1.smithi136.stdout:2/264: chown d5/d25/d2d/f30 54245021 1 2024-09-18T12:51:09.723 INFO:tasks.workunit.client.0.smithi081.stdout:0/27: mknod d7/d9/cc 0 2024-09-18T12:51:09.724 INFO:tasks.workunit.client.1.smithi136.stdout:6/163: creat d8/f3b x:0 0 0 2024-09-18T12:51:09.724 INFO:tasks.workunit.client.1.smithi136.stdout:6/164: dread - d8/dc/f31 zero size 2024-09-18T12:51:09.726 INFO:tasks.workunit.client.1.smithi136.stdout:6/165: write d8/d9/fa [2784,7209] 0 2024-09-18T12:51:09.730 INFO:tasks.workunit.client.1.smithi136.stdout:7/326: dwrite d0/d12/d2a/f42 [0,4194304] 0 2024-09-18T12:51:09.731 INFO:tasks.workunit.client.1.smithi136.stdout:7/327: dread d0/d12/d2a/d3c/f4b [0,4194304] 0 2024-09-18T12:51:09.733 INFO:tasks.workunit.client.1.smithi136.stdout:7/328: creat d0/d35/d4f/d66/f74 x:0 0 0 2024-09-18T12:51:09.734 INFO:tasks.workunit.client.1.smithi136.stdout:7/329: dread - d0/d39/d4d/d69/f6e zero size 2024-09-18T12:51:09.734 INFO:tasks.workunit.client.1.smithi136.stdout:4/100: dwrite d0/f7 [0,4194304] 0 2024-09-18T12:51:09.735 INFO:tasks.workunit.client.1.smithi136.stdout:7/330: unlink d0/d35/d36/c19 0 2024-09-18T12:51:09.737 INFO:tasks.workunit.client.1.smithi136.stdout:4/101: link d0/cd d0/d3/c1e 0 2024-09-18T12:51:09.737 INFO:tasks.workunit.client.1.smithi136.stdout:1/157: dwrite d2/d5/d9/d23/f2c [0,4194304] 0 2024-09-18T12:51:09.738 INFO:tasks.workunit.client.1.smithi136.stdout:7/331: unlink d0/d12/d2a/f37 0 2024-09-18T12:51:09.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/265: dwrite d5/d7/d41/f4f [0,4194304] 0 2024-09-18T12:51:09.741 INFO:tasks.workunit.client.0.smithi081.stdout:0/28: dwrite f5 [0,4194304] 0 2024-09-18T12:51:09.741 INFO:tasks.workunit.client.0.smithi081.stdout:0/29: stat c4 0 2024-09-18T12:51:09.741 INFO:tasks.workunit.client.0.smithi081.stdout:0/30: write f6 [318807,80276] 0 2024-09-18T12:51:09.741 INFO:tasks.workunit.client.1.smithi136.stdout:6/166: dread d8/d9/fa [0,4194304] 0 2024-09-18T12:51:09.742 INFO:tasks.workunit.client.1.smithi136.stdout:6/167: dread - d8/d9/de/d1c/f38 zero size 2024-09-18T12:51:09.742 INFO:tasks.workunit.client.1.smithi136.stdout:4/102: dread d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:09.742 INFO:tasks.workunit.client.1.smithi136.stdout:1/158: rmdir d2/d5/d11/d2e 39 2024-09-18T12:51:09.745 INFO:tasks.workunit.client.1.smithi136.stdout:4/103: write d0/d2/f12 [35437,40967] 0 2024-09-18T12:51:09.748 INFO:tasks.workunit.client.0.smithi081.stdout:0/31: dread f6 [0,4194304] 0 2024-09-18T12:51:09.749 INFO:tasks.workunit.client.0.smithi081.stdout:0/32: mknod d7/d9/cd 0 2024-09-18T12:51:09.750 INFO:tasks.workunit.client.1.smithi136.stdout:2/266: rmdir d5/d7/d3b 39 2024-09-18T12:51:09.750 INFO:tasks.workunit.client.1.smithi136.stdout:2/267: fdatasync d5/f9 0 2024-09-18T12:51:09.751 INFO:tasks.workunit.client.1.smithi136.stdout:1/159: creat d2/d5/d11/d2e/f33 x:0 0 0 2024-09-18T12:51:09.752 INFO:tasks.workunit.client.1.smithi136.stdout:7/332: getdents d0/d35 0 2024-09-18T12:51:09.753 INFO:tasks.workunit.client.1.smithi136.stdout:4/104: symlink d0/d13/l1f 0 2024-09-18T12:51:09.754 INFO:tasks.workunit.client.1.smithi136.stdout:2/268: creat d5/d7/d3b/f51 x:0 0 0 2024-09-18T12:51:09.755 INFO:tasks.workunit.client.1.smithi136.stdout:7/333: rename d0/d12/d2a/d3c/f4b to d0/d12/d2a/d6b/f75 0 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/269: link d5/d7/f10 d5/d25/d43/f52 0 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/270: chown d5/f9 98216 1 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/271: truncate d5/d25/f2e 608424 0 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:1/160: dread d2/d5/d11/d1b/f25 [0,4194304] 0 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:1/161: fsync d2/d5/d9/f1a 0 2024-09-18T12:51:09.757 INFO:tasks.workunit.client.1.smithi136.stdout:1/162: write d2/f4 [396291,34081] 0 2024-09-18T12:51:09.758 INFO:tasks.workunit.client.1.smithi136.stdout:7/334: symlink d0/d35/d36/d64/l76 0 2024-09-18T12:51:09.758 INFO:tasks.workunit.client.1.smithi136.stdout:7/335: truncate d0/d35/d4f/d66/f74 632047 0 2024-09-18T12:51:09.759 INFO:tasks.workunit.client.1.smithi136.stdout:2/272: rmdir d5/d7/d17/d48 39 2024-09-18T12:51:09.759 INFO:tasks.workunit.client.1.smithi136.stdout:2/273: fdatasync d5/d7/d17/f24 0 2024-09-18T12:51:09.759 INFO:tasks.workunit.client.1.smithi136.stdout:7/336: rmdir d0/d12/d1a 39 2024-09-18T12:51:09.759 INFO:tasks.workunit.client.0.smithi081.stdout:0/33: write f5 [3624431,21068] 0 2024-09-18T12:51:09.761 INFO:tasks.workunit.client.1.smithi136.stdout:4/105: dread d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:09.761 INFO:tasks.workunit.client.1.smithi136.stdout:6/168: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:09.761 INFO:tasks.workunit.client.1.smithi136.stdout:2/274: unlink d5/cb 0 2024-09-18T12:51:09.764 INFO:tasks.workunit.client.1.smithi136.stdout:6/169: mkdir d8/d9/d3c 0 2024-09-18T12:51:09.765 INFO:tasks.workunit.client.1.smithi136.stdout:2/275: mkdir d5/d7/d41/d53 0 2024-09-18T12:51:09.765 INFO:tasks.workunit.client.1.smithi136.stdout:6/170: creat d8/d9/de/f3d x:0 0 0 2024-09-18T12:51:09.766 INFO:tasks.workunit.client.1.smithi136.stdout:2/276: mknod d5/d25/d2d/c54 0 2024-09-18T12:51:09.766 INFO:tasks.workunit.client.1.smithi136.stdout:2/277: stat d5/d7/d17/d48/l4c 0 2024-09-18T12:51:09.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/34: dread f5 [0,4194304] 0 2024-09-18T12:51:09.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/35: chown f0 352 1 2024-09-18T12:51:09.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/36: stat f5 0 2024-09-18T12:51:09.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/37: fsync f6 0 2024-09-18T12:51:09.768 INFO:tasks.workunit.client.1.smithi136.stdout:2/278: creat d5/d7/f55 x:0 0 0 2024-09-18T12:51:09.769 INFO:tasks.workunit.client.1.smithi136.stdout:2/279: symlink d5/d4a/l56 0 2024-09-18T12:51:09.770 INFO:tasks.workunit.client.1.smithi136.stdout:2/280: fdatasync d5/d7/d11/f29 0 2024-09-18T12:51:09.770 INFO:tasks.workunit.client.1.smithi136.stdout:2/281: chown d5/f15 22 1 2024-09-18T12:51:09.771 INFO:tasks.workunit.client.1.smithi136.stdout:6/171: dread d8/d9/fb [0,4194304] 0 2024-09-18T12:51:09.772 INFO:tasks.workunit.client.1.smithi136.stdout:2/282: rename d5/d25/d2d/l3a to d5/d7/d17/l57 0 2024-09-18T12:51:09.773 INFO:tasks.workunit.client.1.smithi136.stdout:6/172: symlink d8/d9/de/d1c/l3e 0 2024-09-18T12:51:09.773 INFO:tasks.workunit.client.1.smithi136.stdout:7/337: getdents d0/d35/d36/d64 0 2024-09-18T12:51:09.773 INFO:tasks.workunit.client.1.smithi136.stdout:7/338: getdents d0/d39/d4d/d55 0 2024-09-18T12:51:09.775 INFO:tasks.workunit.client.1.smithi136.stdout:6/173: rename d8/d9/de/d1c/f2f to d8/d9/d3c/f3f 0 2024-09-18T12:51:09.776 INFO:tasks.workunit.client.1.smithi136.stdout:7/339: getdents d0 0 2024-09-18T12:51:09.776 INFO:tasks.workunit.client.1.smithi136.stdout:7/340: fsync d0/d35/d41/f5c 0 2024-09-18T12:51:09.776 INFO:tasks.workunit.client.1.smithi136.stdout:7/341: chown d0/d35/d36/l30 54092 1 2024-09-18T12:51:09.777 INFO:tasks.workunit.client.1.smithi136.stdout:6/174: creat d8/d9/de/f40 x:0 0 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:9/191: sync 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:8/273: sync 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:0/232: sync 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:7/342: dread d0/f31 [0,4194304] 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:8/274: chown d9/d14/d1a/d2b/c60 672249482 1 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:7/343: chown d0/d35/d36/c9 4193 1 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:9/192: read d6/f7 [11457,35750] 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:3/233: sync 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:8/275: stat d9/d18/d34/d3d/d47/d65/d6b 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:7/344: read d0/d2c/d2e/f3f [65982,56046] 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:3/234: write d3/d14/d18/f41 [710831,46283] 0 2024-09-18T12:51:09.779 INFO:tasks.workunit.client.1.smithi136.stdout:3/235: write d3/d2b/f4b [4355738,43020] 0 2024-09-18T12:51:09.780 INFO:tasks.workunit.client.1.smithi136.stdout:6/175: rename d8/f2e to d8/dc/f41 0 2024-09-18T12:51:09.780 INFO:tasks.workunit.client.1.smithi136.stdout:6/176: truncate d8/f19 4425873 0 2024-09-18T12:51:09.783 INFO:tasks.workunit.client.1.smithi136.stdout:9/193: unlink l5 0 2024-09-18T12:51:09.784 INFO:tasks.workunit.client.1.smithi136.stdout:3/236: truncate d3/f9 2083492 0 2024-09-18T12:51:09.784 INFO:tasks.workunit.client.1.smithi136.stdout:3/237: fsync d3/d14/f40 0 2024-09-18T12:51:09.786 INFO:tasks.workunit.client.1.smithi136.stdout:0/233: getdents d1/db 0 2024-09-18T12:51:09.788 INFO:tasks.workunit.client.1.smithi136.stdout:6/177: truncate f5 2234431 0 2024-09-18T12:51:09.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/234: getdents d1/d17 0 2024-09-18T12:51:09.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/345: read d0/d12/d2a/d3b/f51 [4079254,25374] 0 2024-09-18T12:51:09.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/346: stat d0/d12/d2a/d3b/f51 0 2024-09-18T12:51:09.796 INFO:tasks.workunit.client.1.smithi136.stdout:0/235: creat d1/d17/f4c x:0 0 0 2024-09-18T12:51:09.797 INFO:tasks.workunit.client.1.smithi136.stdout:0/236: creat d1/d17/d2d/d35/f4d x:0 0 0 2024-09-18T12:51:09.797 INFO:tasks.workunit.client.1.smithi136.stdout:0/237: readlink d1/d3/l14 0 2024-09-18T12:51:09.800 INFO:tasks.workunit.client.1.smithi136.stdout:0/238: symlink d1/d3/d1a/l4e 0 2024-09-18T12:51:09.800 INFO:tasks.workunit.client.1.smithi136.stdout:0/239: write d1/d17/d2d/d35/f4a [791916,124138] 0 2024-09-18T12:51:09.802 INFO:tasks.workunit.client.1.smithi136.stdout:0/240: symlink d1/d17/d2d/d35/l4f 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/178: write d8/d9/de/f18 [1213583,62381] 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/179: write f7 [5056099,94871] 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/180: fdatasync d8/d9/fb 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/181: read - d8/d9/de/d1c/f20 zero size 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/182: read - d8/d9/de/d1c/f38 zero size 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/183: chown d8/c35 30594 1 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:6/184: truncate d8/d9/de/d1c/f38 177188 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:9/194: dwrite d6/db/f2c [0,4194304] 0 2024-09-18T12:51:09.803 INFO:tasks.workunit.client.1.smithi136.stdout:8/276: dwrite d9/f6a [0,4194304] 0 2024-09-18T12:51:09.804 INFO:tasks.workunit.client.1.smithi136.stdout:0/241: creat d1/d3/d1a/f50 x:0 0 0 2024-09-18T12:51:09.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/38: dwrite f0 [4194304,4194304] 0 2024-09-18T12:51:09.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/39: chown d7/d9 104727721 1 2024-09-18T12:51:09.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/40: truncate d7/fb 106530 0 2024-09-18T12:51:09.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/41: mknod d7/ce 0 2024-09-18T12:51:09.805 INFO:tasks.workunit.client.1.smithi136.stdout:6/185: truncate d8/dc/f15 2200887 0 2024-09-18T12:51:09.805 INFO:tasks.workunit.client.1.smithi136.stdout:6/186: creat d8/d9/de/d1c/f42 x:0 0 0 2024-09-18T12:51:09.806 INFO:tasks.workunit.client.1.smithi136.stdout:6/187: chown d8/dc/f15 26048 1 2024-09-18T12:51:09.811 INFO:tasks.workunit.client.1.smithi136.stdout:8/277: mkdir d9/d14/d1a/d2b/d42/d6e 0 2024-09-18T12:51:09.812 INFO:tasks.workunit.client.1.smithi136.stdout:7/347: dwrite d0/d12/d1a/f3e [0,4194304] 0 2024-09-18T12:51:09.813 INFO:tasks.workunit.client.0.smithi081.stdout:0/42: truncate d7/fb 22616 0 2024-09-18T12:51:09.813 INFO:tasks.workunit.client.1.smithi136.stdout:9/195: dread d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:09.814 INFO:tasks.workunit.client.0.smithi081.stdout:0/43: write f6 [63991,82387] 0 2024-09-18T12:51:09.814 INFO:tasks.workunit.client.0.smithi081.stdout:0/44: rename d7/d9 to d7/d9/df 22 2024-09-18T12:51:09.816 INFO:tasks.workunit.client.1.smithi136.stdout:0/242: mkdir d1/d17/d2d/d51 0 2024-09-18T12:51:09.816 INFO:tasks.workunit.client.1.smithi136.stdout:0/243: write d1/d17/d2d/d35/f42 [943036,117306] 0 2024-09-18T12:51:09.816 INFO:tasks.workunit.client.1.smithi136.stdout:6/188: write f1 [6804056,130157] 0 2024-09-18T12:51:09.816 INFO:tasks.workunit.client.1.smithi136.stdout:6/189: creat d8/dc/f43 x:0 0 0 2024-09-18T12:51:09.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/278: unlink d9/d14/d1a/f36 0 2024-09-18T12:51:09.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/279: chown d9/f6a 392138888 1 2024-09-18T12:51:09.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/280: creat d9/d18/d34/f6f x:0 0 0 2024-09-18T12:51:09.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/281: stat d9/d18/d34/l59 0 2024-09-18T12:51:09.821 INFO:tasks.workunit.client.1.smithi136.stdout:7/348: getdents d0/d39/d4d 0 2024-09-18T12:51:09.821 INFO:tasks.workunit.client.1.smithi136.stdout:7/349: truncate d0/d12/d2a/d6b/f75 1324683 0 2024-09-18T12:51:09.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/196: truncate d6/f7 2932246 0 2024-09-18T12:51:09.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/197: write d6/d13/d15/d25/f27 [487311,75159] 0 2024-09-18T12:51:09.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/198: truncate d6/f40 2551076 0 2024-09-18T12:51:09.824 INFO:tasks.workunit.client.1.smithi136.stdout:0/244: rename d1/db/l4b to d1/d3/d1a/l52 0 2024-09-18T12:51:09.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/282: symlink d9/d18/d34/d3d/l70 0 2024-09-18T12:51:09.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/283: write d9/d18/f5c [651439,84075] 0 2024-09-18T12:51:09.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/284: chown d9/d14/d1a/d2b/d42/l55 244 1 2024-09-18T12:51:09.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/285: readlink d9/d14/l17 0 2024-09-18T12:51:09.829 INFO:tasks.workunit.client.1.smithi136.stdout:7/350: truncate d0/d35/d36/f25 6275070 0 2024-09-18T12:51:09.831 INFO:tasks.workunit.client.1.smithi136.stdout:8/286: write d9/d14/f26 [265418,53355] 0 2024-09-18T12:51:09.831 INFO:tasks.workunit.client.1.smithi136.stdout:8/287: creat d9/d14/f71 x:0 0 0 2024-09-18T12:51:09.831 INFO:tasks.workunit.client.1.smithi136.stdout:8/288: stat d9/d18/f41 0 2024-09-18T12:51:09.831 INFO:tasks.workunit.client.1.smithi136.stdout:9/199: truncate d6/da/fd 5217751 0 2024-09-18T12:51:09.831 INFO:tasks.workunit.client.1.smithi136.stdout:6/190: getdents d8 0 2024-09-18T12:51:09.832 INFO:tasks.workunit.client.1.smithi136.stdout:7/351: rmdir d0/d35/d41 39 2024-09-18T12:51:09.834 INFO:tasks.workunit.client.1.smithi136.stdout:6/191: dread d8/dc/f1d [0,4194304] 0 2024-09-18T12:51:09.834 INFO:tasks.workunit.client.1.smithi136.stdout:6/192: dread - d8/d9/de/d1c/f2d zero size 2024-09-18T12:51:09.835 INFO:tasks.workunit.client.1.smithi136.stdout:8/289: truncate d9/fa 3628227 0 2024-09-18T12:51:09.835 INFO:tasks.workunit.client.1.smithi136.stdout:9/200: mkdir d6/da/d3d/d41 0 2024-09-18T12:51:09.837 INFO:tasks.workunit.client.0.smithi081.stdout:0/45: dwrite f6 [0,4194304] 0 2024-09-18T12:51:09.838 INFO:tasks.workunit.client.1.smithi136.stdout:7/352: symlink d0/d35/d41/d50/l77 0 2024-09-18T12:51:09.840 INFO:tasks.workunit.client.0.smithi081.stdout:0/46: rename d7/fb to d7/d9/f10 0 2024-09-18T12:51:09.845 INFO:tasks.workunit.client.1.smithi136.stdout:6/193: symlink d8/d9/d3c/l44 0 2024-09-18T12:51:09.847 INFO:tasks.workunit.client.1.smithi136.stdout:8/290: unlink c8 0 2024-09-18T12:51:09.849 INFO:tasks.workunit.client.1.smithi136.stdout:7/353: creat d0/d35/d4f/f78 x:0 0 0 2024-09-18T12:51:09.849 INFO:tasks.workunit.client.1.smithi136.stdout:7/354: write d0/d35/d36/f22 [4460857,77498] 0 2024-09-18T12:51:09.851 INFO:tasks.workunit.client.1.smithi136.stdout:6/194: mkdir d8/d9/d3c/d45 0 2024-09-18T12:51:09.851 INFO:tasks.workunit.client.1.smithi136.stdout:6/195: dread - d8/dc/f41 zero size 2024-09-18T12:51:09.851 INFO:tasks.workunit.client.1.smithi136.stdout:6/196: chown d8/d9/de/l22 0 1 2024-09-18T12:51:09.853 INFO:tasks.workunit.client.1.smithi136.stdout:6/197: rename f1 to d8/d9/de/d1c/f46 0 2024-09-18T12:51:09.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/198: mknod d8/dc/c47 0 2024-09-18T12:51:09.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/199: rename d8 to d8/dc/d48 22 2024-09-18T12:51:09.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/200: stat d8/dc/f14 0 2024-09-18T12:51:09.855 INFO:tasks.workunit.client.1.smithi136.stdout:5/179: sync 2024-09-18T12:51:09.855 INFO:tasks.workunit.client.1.smithi136.stdout:5/180: getdents d5/d1a/d30 0 2024-09-18T12:51:09.857 INFO:tasks.workunit.client.1.smithi136.stdout:9/201: write d6/da/fd [3900950,19793] 0 2024-09-18T12:51:09.857 INFO:tasks.workunit.client.1.smithi136.stdout:9/202: creat d6/f42 x:0 0 0 2024-09-18T12:51:09.857 INFO:tasks.workunit.client.1.smithi136.stdout:9/203: read - d6/d13/d15/d25/f39 zero size 2024-09-18T12:51:09.857 INFO:tasks.workunit.client.1.smithi136.stdout:9/204: write d6/d13/f22 [1971319,67601] 0 2024-09-18T12:51:09.857 INFO:tasks.workunit.client.1.smithi136.stdout:6/201: getdents d8/d9 0 2024-09-18T12:51:09.859 INFO:tasks.workunit.client.0.smithi081.stdout:0/47: dwrite f0 [8388608,4194304] 0 2024-09-18T12:51:09.859 INFO:tasks.workunit.client.1.smithi136.stdout:5/181: dread d5/dc/f2e [0,4194304] 0 2024-09-18T12:51:09.860 INFO:tasks.workunit.client.0.smithi081.stdout:0/48: creat d7/d9/f11 x:0 0 0 2024-09-18T12:51:09.861 INFO:tasks.workunit.client.1.smithi136.stdout:9/205: creat d6/df/d23/d2b/f43 x:0 0 0 2024-09-18T12:51:09.862 INFO:tasks.workunit.client.1.smithi136.stdout:5/182: mknod d5/d1a/c32 0 2024-09-18T12:51:09.862 INFO:tasks.workunit.client.0.smithi081.stdout:0/49: unlink f5 0 2024-09-18T12:51:09.863 INFO:tasks.workunit.client.1.smithi136.stdout:5/183: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:09.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/206: rename d6/df/l1d to d6/db/l44 0 2024-09-18T12:51:09.867 INFO:tasks.workunit.client.1.smithi136.stdout:7/355: write d0/d2c/f48 [3248343,98361] 0 2024-09-18T12:51:09.869 INFO:tasks.workunit.client.1.smithi136.stdout:9/207: dread d6/df/f1f [0,4194304] 0 2024-09-18T12:51:09.869 INFO:tasks.workunit.client.1.smithi136.stdout:8/291: dwrite f5 [0,4194304] 0 2024-09-18T12:51:09.869 INFO:tasks.workunit.client.1.smithi136.stdout:7/356: truncate d0/d12/d1a/f3e 3820115 0 2024-09-18T12:51:09.871 INFO:tasks.workunit.client.1.smithi136.stdout:9/208: mknod d6/db/c45 0 2024-09-18T12:51:09.872 INFO:tasks.workunit.client.1.smithi136.stdout:8/292: symlink d9/d14/d1a/d2b/d42/d6e/l72 0 2024-09-18T12:51:09.875 INFO:tasks.workunit.client.1.smithi136.stdout:9/209: symlink d6/db/d12/l46 0 2024-09-18T12:51:09.875 INFO:tasks.workunit.client.1.smithi136.stdout:9/210: chown d6/da 143774929 1 2024-09-18T12:51:09.875 INFO:tasks.workunit.client.1.smithi136.stdout:9/211: write d6/d13/d15/d25/d29/f2a [2160877,97776] 0 2024-09-18T12:51:09.875 INFO:tasks.workunit.client.1.smithi136.stdout:9/212: write d6/d13/d15/d25/f27 [1452879,127939] 0 2024-09-18T12:51:09.878 INFO:tasks.workunit.client.1.smithi136.stdout:5/184: dread d5/ff [0,4194304] 0 2024-09-18T12:51:09.881 INFO:tasks.workunit.client.1.smithi136.stdout:5/185: rename d5/d1a/f2b to d5/dc/f33 0 2024-09-18T12:51:09.881 INFO:tasks.workunit.client.1.smithi136.stdout:5/186: chown d5/d1a/l1e 2015648 1 2024-09-18T12:51:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:0/50: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:51:09.884 INFO:tasks.workunit.client.1.smithi136.stdout:8/293: dread d9/d14/fe [0,4194304] 0 2024-09-18T12:51:09.885 INFO:tasks.workunit.client.1.smithi136.stdout:6/202: dwrite d8/d9/de/d1c/f38 [0,4194304] 0 2024-09-18T12:51:09.886 INFO:tasks.workunit.client.1.smithi136.stdout:8/294: mknod d9/d14/d1a/d2b/d42/c73 0 2024-09-18T12:51:09.887 INFO:tasks.workunit.client.1.smithi136.stdout:9/213: dread d6/f40 [0,4194304] 0 2024-09-18T12:51:09.888 INFO:tasks.workunit.client.1.smithi136.stdout:6/203: mknod d8/d9/d3c/c49 0 2024-09-18T12:51:09.888 INFO:tasks.workunit.client.1.smithi136.stdout:6/204: chown d8/d9/de/d1c/f20 378048 1 2024-09-18T12:51:09.889 INFO:tasks.workunit.client.1.smithi136.stdout:8/295: link d9/d14/f11 d9/d18/d34/f74 0 2024-09-18T12:51:09.889 INFO:tasks.workunit.client.1.smithi136.stdout:8/296: chown d9/d14/d1a/d2b/f33 1446936 1 2024-09-18T12:51:09.890 INFO:tasks.workunit.client.1.smithi136.stdout:6/205: mkdir d8/d9/d3c/d4a 0 2024-09-18T12:51:09.892 INFO:tasks.workunit.client.1.smithi136.stdout:7/357: dwrite d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:51:09.893 INFO:tasks.workunit.client.1.smithi136.stdout:8/297: mkdir d9/d14/d1a/d2b/d42/d6e/d75 0 2024-09-18T12:51:09.896 INFO:tasks.workunit.client.1.smithi136.stdout:5/187: getdents d5/dc 0 2024-09-18T12:51:09.898 INFO:tasks.workunit.client.1.smithi136.stdout:6/206: symlink d8/d9/d3c/d4a/l4b 0 2024-09-18T12:51:09.898 INFO:tasks.workunit.client.1.smithi136.stdout:6/207: fdatasync d8/d9/de/d1c/f2b 0 2024-09-18T12:51:09.904 INFO:tasks.workunit.client.1.smithi136.stdout:7/358: mknod d0/c79 0 2024-09-18T12:51:09.905 INFO:tasks.workunit.client.1.smithi136.stdout:5/188: getdents d5/d1a 0 2024-09-18T12:51:09.906 INFO:tasks.workunit.client.1.smithi136.stdout:6/208: creat d8/d9/de/f4c x:0 0 0 2024-09-18T12:51:09.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/189: rmdir d5 39 2024-09-18T12:51:09.910 INFO:tasks.workunit.client.1.smithi136.stdout:5/190: dread d5/ff [4194304,4194304] 0 2024-09-18T12:51:09.912 INFO:tasks.workunit.client.1.smithi136.stdout:5/191: rename d5/dc to d5/d1a/d2d/d34 0 2024-09-18T12:51:09.912 INFO:tasks.workunit.client.1.smithi136.stdout:5/192: read d5/f11 [470862,318] 0 2024-09-18T12:51:09.915 INFO:tasks.workunit.client.1.smithi136.stdout:7/359: truncate d0/d2c/d2e/f32 1164559 0 2024-09-18T12:51:09.916 INFO:tasks.workunit.client.1.smithi136.stdout:7/360: mknod d0/d35/c7a 0 2024-09-18T12:51:09.916 INFO:tasks.workunit.client.1.smithi136.stdout:7/361: readlink d0/d35/d36/l30 0 2024-09-18T12:51:09.917 INFO:tasks.workunit.client.1.smithi136.stdout:7/362: mkdir d0/d35/d41/d50/d7b 0 2024-09-18T12:51:09.919 INFO:tasks.workunit.client.1.smithi136.stdout:7/363: mkdir d0/d35/d36/d7c 0 2024-09-18T12:51:09.919 INFO:tasks.workunit.client.1.smithi136.stdout:7/364: chown d0/d35/d36/d7c 69377 1 2024-09-18T12:51:09.920 INFO:tasks.workunit.client.1.smithi136.stdout:7/365: creat d0/d35/d36/d7c/f7d x:0 0 0 2024-09-18T12:51:09.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/366: creat d0/d39/f7e x:0 0 0 2024-09-18T12:51:09.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/367: dread - d0/d35/d4f/f78 zero size 2024-09-18T12:51:09.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/368: dread - d0/d35/d4f/f78 zero size 2024-09-18T12:51:09.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/369: write d0/d39/f43 [1255839,101709] 0 2024-09-18T12:51:09.925 INFO:tasks.workunit.client.1.smithi136.stdout:8/298: dwrite d9/d14/d1a/f4a [0,4194304] 0 2024-09-18T12:51:09.926 INFO:tasks.workunit.client.1.smithi136.stdout:8/299: write d9/d18/d34/d3d/d47/d65/f66 [1203688,9129] 0 2024-09-18T12:51:09.929 INFO:tasks.workunit.client.1.smithi136.stdout:6/209: dwrite d8/d9/f34 [0,4194304] 0 2024-09-18T12:51:09.930 INFO:tasks.workunit.client.0.smithi081.stdout:0/51: dwrite f0 [12582912,4194304] 0 2024-09-18T12:51:09.930 INFO:tasks.workunit.client.1.smithi136.stdout:7/370: rename d0/d12/d2a to d0/d35/d41/d50/d7f 0 2024-09-18T12:51:09.932 INFO:tasks.workunit.client.1.smithi136.stdout:5/193: dwrite d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:09.933 INFO:tasks.workunit.client.0.smithi081.stdout:0/52: mkdir d7/d9/d12 0 2024-09-18T12:51:09.933 INFO:tasks.workunit.client.0.smithi081.stdout:0/53: chown d7/d9/cd 0 1 2024-09-18T12:51:09.933 INFO:tasks.workunit.client.0.smithi081.stdout:0/54: chown d7/l8 0 1 2024-09-18T12:51:09.934 INFO:tasks.workunit.client.1.smithi136.stdout:6/210: symlink d8/d9/de/d1c/l4d 0 2024-09-18T12:51:09.934 INFO:tasks.workunit.client.1.smithi136.stdout:6/211: chown f5 5 1 2024-09-18T12:51:09.936 INFO:tasks.workunit.client.1.smithi136.stdout:7/371: mknod d0/d35/d36/d64/c80 0 2024-09-18T12:51:09.938 INFO:tasks.workunit.client.1.smithi136.stdout:7/372: symlink d0/d39/d4d/l81 0 2024-09-18T12:51:09.938 INFO:tasks.workunit.client.1.smithi136.stdout:7/373: creat d0/d35/d4f/f82 x:0 0 0 2024-09-18T12:51:09.938 INFO:tasks.workunit.client.1.smithi136.stdout:7/374: chown d0/d35/d41 0 1 2024-09-18T12:51:09.940 INFO:tasks.workunit.client.1.smithi136.stdout:7/375: mkdir d0/d35/d36/d83 0 2024-09-18T12:51:09.943 INFO:tasks.workunit.client.1.smithi136.stdout:5/194: dread d5/f2a [0,4194304] 0 2024-09-18T12:51:09.943 INFO:tasks.workunit.client.1.smithi136.stdout:7/376: rmdir d0/d39/d4d 39 2024-09-18T12:51:09.943 INFO:tasks.workunit.client.1.smithi136.stdout:5/195: write d5/d1a/f1b [382572,30423] 0 2024-09-18T12:51:09.952 INFO:tasks.workunit.client.1.smithi136.stdout:7/377: dread d0/fa [4194304,4194304] 0 2024-09-18T12:51:09.952 INFO:tasks.workunit.client.1.smithi136.stdout:6/212: dwrite d8/dc/f1d [0,4194304] 0 2024-09-18T12:51:09.953 INFO:tasks.workunit.client.1.smithi136.stdout:8/300: dwrite d9/fa [0,4194304] 0 2024-09-18T12:51:09.955 INFO:tasks.workunit.client.1.smithi136.stdout:8/301: creat d9/d18/d34/d3d/d47/d65/f76 x:0 0 0 2024-09-18T12:51:09.955 INFO:tasks.workunit.client.1.smithi136.stdout:1/163: sync 2024-09-18T12:51:09.956 INFO:tasks.workunit.client.1.smithi136.stdout:4/106: sync 2024-09-18T12:51:09.958 INFO:tasks.workunit.client.1.smithi136.stdout:8/302: rename f3 to d9/d18/d34/d3d/d47/d65/d6b/f77 0 2024-09-18T12:51:09.958 INFO:tasks.workunit.client.1.smithi136.stdout:5/196: dwrite d5/ff [4194304,4194304] 0 2024-09-18T12:51:09.958 INFO:tasks.workunit.client.1.smithi136.stdout:5/197: readlink d5/d1a/l22 0 2024-09-18T12:51:09.960 INFO:tasks.workunit.client.1.smithi136.stdout:1/164: mkdir d2/d5/d2b/d34 0 2024-09-18T12:51:09.960 INFO:tasks.workunit.client.1.smithi136.stdout:7/378: write d0/f62 [871660,123862] 0 2024-09-18T12:51:09.960 INFO:tasks.workunit.client.1.smithi136.stdout:7/379: write d0/d12/d1a/f20 [4304268,17437] 0 2024-09-18T12:51:09.960 INFO:tasks.workunit.client.1.smithi136.stdout:7/380: dread - d0/d35/d41/d50/d7f/d3c/f65 zero size 2024-09-18T12:51:09.961 INFO:tasks.workunit.client.1.smithi136.stdout:4/107: mknod d0/d2/c20 0 2024-09-18T12:51:09.962 INFO:tasks.workunit.client.1.smithi136.stdout:5/198: link d5/f9 d5/d1a/d2d/d34/f35 0 2024-09-18T12:51:09.963 INFO:tasks.workunit.client.1.smithi136.stdout:1/165: truncate d2/d5/d11/d1b/f25 26142 0 2024-09-18T12:51:09.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/108: symlink d0/d2/l21 0 2024-09-18T12:51:09.964 INFO:tasks.workunit.client.1.smithi136.stdout:1/166: creat d2/d5/d2b/d34/f35 x:0 0 0 2024-09-18T12:51:09.966 INFO:tasks.workunit.client.1.smithi136.stdout:4/109: symlink d0/l22 0 2024-09-18T12:51:09.966 INFO:tasks.workunit.client.1.smithi136.stdout:7/381: read d0/d2c/f45 [2028666,56152] 0 2024-09-18T12:51:09.968 INFO:tasks.workunit.client.1.smithi136.stdout:4/110: dread d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:09.969 INFO:tasks.workunit.client.1.smithi136.stdout:7/382: symlink d0/d35/d41/d50/d5a/l84 0 2024-09-18T12:51:09.969 INFO:tasks.workunit.client.1.smithi136.stdout:7/383: read d0/d35/d41/d50/d5a/f6a [584219,27925] 0 2024-09-18T12:51:09.970 INFO:tasks.workunit.client.1.smithi136.stdout:8/303: dread d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:09.970 INFO:tasks.workunit.client.1.smithi136.stdout:6/213: dwrite d8/d9/de/d1c/f42 [0,4194304] 0 2024-09-18T12:51:09.971 INFO:tasks.workunit.client.1.smithi136.stdout:7/384: mkdir d0/d2c/d85 0 2024-09-18T12:51:09.974 INFO:tasks.workunit.client.1.smithi136.stdout:8/304: creat d9/d18/d34/d3d/f78 x:0 0 0 2024-09-18T12:51:09.975 INFO:tasks.workunit.client.1.smithi136.stdout:6/214: mkdir d8/d9/de/d1c/d4e 0 2024-09-18T12:51:09.975 INFO:tasks.workunit.client.1.smithi136.stdout:6/215: creat d8/dc/f4f x:0 0 0 2024-09-18T12:51:09.977 INFO:tasks.workunit.client.1.smithi136.stdout:7/385: rmdir d0/d35/d36/d83 0 2024-09-18T12:51:09.977 INFO:tasks.workunit.client.1.smithi136.stdout:7/386: dread - d0/d35/d4f/f82 zero size 2024-09-18T12:51:09.978 INFO:tasks.workunit.client.1.smithi136.stdout:4/111: write d0/d3/f4 [1638359,81335] 0 2024-09-18T12:51:09.978 INFO:tasks.workunit.client.1.smithi136.stdout:4/112: creat d0/d2/f23 x:0 0 0 2024-09-18T12:51:09.979 INFO:tasks.workunit.client.1.smithi136.stdout:8/305: rename d9/d14/f15 to d9/d14/f79 0 2024-09-18T12:51:09.979 INFO:tasks.workunit.client.1.smithi136.stdout:8/306: readlink d9/d14/d1a/d2b/d42/d6e/l72 0 2024-09-18T12:51:09.979 INFO:tasks.workunit.client.1.smithi136.stdout:8/307: creat d9/d18/f7a x:0 0 0 2024-09-18T12:51:09.979 INFO:tasks.workunit.client.1.smithi136.stdout:8/308: stat d9/d18/d34/f3e 0 2024-09-18T12:51:09.980 INFO:tasks.workunit.client.1.smithi136.stdout:6/216: mkdir d8/d9/de/d1c/d50 0 2024-09-18T12:51:09.981 INFO:tasks.workunit.client.1.smithi136.stdout:7/387: creat d0/d35/d41/d50/d5a/f86 x:0 0 0 2024-09-18T12:51:09.986 INFO:tasks.workunit.client.1.smithi136.stdout:6/217: rename d8/c35 to d8/c51 0 2024-09-18T12:51:09.986 INFO:tasks.workunit.client.1.smithi136.stdout:6/218: chown d8/d9/c32 222601 1 2024-09-18T12:51:09.986 INFO:tasks.workunit.client.1.smithi136.stdout:6/219: readlink d8/d9/d3c/l44 0 2024-09-18T12:51:09.986 INFO:tasks.workunit.client.1.smithi136.stdout:6/220: write d8/d9/de/f23 [427447,97700] 0 2024-09-18T12:51:09.988 INFO:tasks.workunit.client.1.smithi136.stdout:6/221: symlink d8/d9/d3c/l52 0 2024-09-18T12:51:09.988 INFO:tasks.workunit.client.1.smithi136.stdout:1/167: dwrite d2/f17 [0,4194304] 0 2024-09-18T12:51:09.988 INFO:tasks.workunit.client.1.smithi136.stdout:1/168: fsync d2/d5/d9/fc 0 2024-09-18T12:51:09.988 INFO:tasks.workunit.client.1.smithi136.stdout:1/169: truncate d2/d5/d9/f1a 493904 0 2024-09-18T12:51:09.989 INFO:tasks.workunit.client.1.smithi136.stdout:5/199: dwrite d5/d1a/f27 [0,4194304] 0 2024-09-18T12:51:09.993 INFO:tasks.workunit.client.1.smithi136.stdout:1/170: creat d2/f36 x:0 0 0 2024-09-18T12:51:09.993 INFO:tasks.workunit.client.1.smithi136.stdout:1/171: stat d2/l1d 0 2024-09-18T12:51:10.004 INFO:tasks.workunit.client.1.smithi136.stdout:5/200: dread d5/fe [0,4194304] 0 2024-09-18T12:51:10.004 INFO:tasks.workunit.client.1.smithi136.stdout:5/201: truncate d5/d1a/f1b 544340 0 2024-09-18T12:51:10.005 INFO:tasks.workunit.client.1.smithi136.stdout:5/202: truncate d5/fa 1977100 0 2024-09-18T12:51:10.006 INFO:tasks.workunit.client.1.smithi136.stdout:5/203: mknod d5/d1a/d2d/d34/c36 0 2024-09-18T12:51:10.006 INFO:tasks.workunit.client.1.smithi136.stdout:5/204: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:10.007 INFO:tasks.workunit.client.1.smithi136.stdout:5/205: creat d5/d1a/f37 x:0 0 0 2024-09-18T12:51:10.009 INFO:tasks.workunit.client.1.smithi136.stdout:5/206: rename d5/d1a/d2d/d34/c28 to d5/c38 0 2024-09-18T12:51:10.011 INFO:tasks.workunit.client.1.smithi136.stdout:5/207: fsync d5/d1a/f37 0 2024-09-18T12:51:10.013 INFO:tasks.workunit.client.1.smithi136.stdout:5/208: creat d5/d1a/d2d/f39 x:0 0 0 2024-09-18T12:51:10.013 INFO:tasks.workunit.client.1.smithi136.stdout:4/113: dwrite d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:10.014 INFO:tasks.workunit.client.1.smithi136.stdout:5/209: unlink d5/f2c 0 2024-09-18T12:51:10.014 INFO:tasks.workunit.client.1.smithi136.stdout:5/210: chown d5/d1a/f27 476 1 2024-09-18T12:51:10.016 INFO:tasks.workunit.client.1.smithi136.stdout:4/114: mknod d0/d2/c24 0 2024-09-18T12:51:10.017 INFO:tasks.workunit.client.1.smithi136.stdout:5/211: link d5/ff d5/d1a/f3a 0 2024-09-18T12:51:10.018 INFO:tasks.workunit.client.1.smithi136.stdout:4/115: mkdir d0/d25 0 2024-09-18T12:51:10.018 INFO:tasks.workunit.client.1.smithi136.stdout:4/116: truncate d0/d13/f18 489762 0 2024-09-18T12:51:10.018 INFO:tasks.workunit.client.1.smithi136.stdout:6/222: dwrite d8/dc/f15 [0,4194304] 0 2024-09-18T12:51:10.019 INFO:tasks.workunit.client.1.smithi136.stdout:7/388: dwrite d0/d35/d41/d50/f5d [0,4194304] 0 2024-09-18T12:51:10.019 INFO:tasks.workunit.client.1.smithi136.stdout:8/309: dwrite d9/d14/d1a/d2b/d42/f49 [4194304,4194304] 0 2024-09-18T12:51:10.019 INFO:tasks.workunit.client.1.smithi136.stdout:1/172: dwrite d2/d5/d2b/d34/f35 [0,4194304] 0 2024-09-18T12:51:10.020 INFO:tasks.workunit.client.1.smithi136.stdout:4/117: symlink d0/d2/l26 0 2024-09-18T12:51:10.024 INFO:tasks.workunit.client.1.smithi136.stdout:6/223: write d8/d9/fb [1720256,95545] 0 2024-09-18T12:51:10.028 INFO:tasks.workunit.client.1.smithi136.stdout:1/173: symlink d2/d5/d9/d23/l37 0 2024-09-18T12:51:10.029 INFO:tasks.workunit.client.1.smithi136.stdout:7/389: dread d0/d2c/f48 [0,4194304] 0 2024-09-18T12:51:10.030 INFO:tasks.workunit.client.1.smithi136.stdout:5/212: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:10.031 INFO:tasks.workunit.client.1.smithi136.stdout:7/390: symlink d0/d39/d4d/l87 0 2024-09-18T12:51:10.031 INFO:tasks.workunit.client.1.smithi136.stdout:7/391: write d0/d35/d4f/d66/f74 [1392606,73304] 0 2024-09-18T12:51:10.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/118: dread d0/f15 [4194304,4194304] 0 2024-09-18T12:51:10.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/119: write d0/f15 [4175780,55] 0 2024-09-18T12:51:10.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/120: fsync d0/d2/f23 0 2024-09-18T12:51:10.035 INFO:tasks.workunit.client.1.smithi136.stdout:7/392: rmdir d0/d2c/d59 0 2024-09-18T12:51:10.037 INFO:tasks.workunit.client.1.smithi136.stdout:7/393: creat d0/d39/d4d/d69/f88 x:0 0 0 2024-09-18T12:51:10.039 INFO:tasks.workunit.client.1.smithi136.stdout:4/121: dread d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:10.043 INFO:tasks.workunit.client.1.smithi136.stdout:4/122: symlink d0/l27 0 2024-09-18T12:51:10.048 INFO:tasks.workunit.client.1.smithi136.stdout:5/213: read d5/f2a [270130,19896] 0 2024-09-18T12:51:10.058 INFO:tasks.workunit.client.1.smithi136.stdout:8/310: dwrite d9/d14/d1a/f37 [4194304,4194304] 0 2024-09-18T12:51:10.058 INFO:tasks.workunit.client.1.smithi136.stdout:8/311: readlink d9/d18/l2f 0 2024-09-18T12:51:10.058 INFO:tasks.workunit.client.1.smithi136.stdout:8/312: creat d9/d18/d34/d3d/d47/d65/f7b x:0 0 0 2024-09-18T12:51:10.060 INFO:tasks.workunit.client.1.smithi136.stdout:8/313: rename d9/c62 to d9/d14/d1a/d2b/d42/d6e/d75/c7c 0 2024-09-18T12:51:10.061 INFO:tasks.workunit.client.1.smithi136.stdout:8/314: symlink d9/d18/d34/d3d/d47/l7d 0 2024-09-18T12:51:10.074 INFO:tasks.workunit.client.1.smithi136.stdout:3/238: sync 2024-09-18T12:51:10.074 INFO:tasks.workunit.client.1.smithi136.stdout:0/245: sync 2024-09-18T12:51:10.074 INFO:tasks.workunit.client.1.smithi136.stdout:2/283: sync 2024-09-18T12:51:10.074 INFO:tasks.workunit.client.1.smithi136.stdout:0/246: fdatasync d1/f18 0 2024-09-18T12:51:10.076 INFO:tasks.workunit.client.1.smithi136.stdout:3/239: rmdir d3/d2b/d4e 0 2024-09-18T12:51:10.076 INFO:tasks.workunit.client.1.smithi136.stdout:2/284: creat d5/d7/d41/f58 x:0 0 0 2024-09-18T12:51:10.077 INFO:tasks.workunit.client.1.smithi136.stdout:7/394: dwrite d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:5/214: dwrite d5/d1a/d2d/d34/f33 [0,4194304] 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:7/395: chown d0/d2c/f2f 191 1 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:5/215: chown d5/d1a/f3a 3864148 1 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:7/396: dread - d0/d35/d41/d50/d5a/f86 zero size 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:8/315: read d9/d14/d1a/f37 [6463867,63995] 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:8/316: fdatasync d9/d14/d1a/d2b/f51 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:4/123: dwrite d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:1/174: dwrite d2/f36 [0,4194304] 0 2024-09-18T12:51:10.078 INFO:tasks.workunit.client.1.smithi136.stdout:4/124: creat d0/d2/f28 x:0 0 0 2024-09-18T12:51:10.079 INFO:tasks.workunit.client.1.smithi136.stdout:5/216: rename d5/fe to d5/d1a/d30/f3b 0 2024-09-18T12:51:10.081 INFO:tasks.workunit.client.1.smithi136.stdout:7/397: mknod d0/d35/d36/d64/c89 0 2024-09-18T12:51:10.081 INFO:tasks.workunit.client.1.smithi136.stdout:7/398: stat d0/d35/d41/d50/d7f/d3c 0 2024-09-18T12:51:10.082 INFO:tasks.workunit.client.1.smithi136.stdout:2/285: mknod d5/d25/d2d/c59 0 2024-09-18T12:51:10.082 INFO:tasks.workunit.client.1.smithi136.stdout:2/286: creat d5/d7/f5a x:0 0 0 2024-09-18T12:51:10.086 INFO:tasks.workunit.client.1.smithi136.stdout:5/217: dread d5/f23 [0,4194304] 0 2024-09-18T12:51:10.086 INFO:tasks.workunit.client.1.smithi136.stdout:5/218: chown d5/d1a/f1b 203348 1 2024-09-18T12:51:10.086 INFO:tasks.workunit.client.1.smithi136.stdout:5/219: chown d5/c38 154 1 2024-09-18T12:51:10.086 INFO:tasks.workunit.client.1.smithi136.stdout:5/220: fdatasync d5/fa 0 2024-09-18T12:51:10.090 INFO:tasks.workunit.client.1.smithi136.stdout:4/125: rename d0/f7 to d0/d3/f29 0 2024-09-18T12:51:10.090 INFO:tasks.workunit.client.1.smithi136.stdout:4/126: truncate d0/d13/f18 1274655 0 2024-09-18T12:51:10.090 INFO:tasks.workunit.client.1.smithi136.stdout:6/224: dwrite d8/d9/de/f3d [0,4194304] 0 2024-09-18T12:51:10.090 INFO:tasks.workunit.client.1.smithi136.stdout:3/240: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:10.090 INFO:tasks.workunit.client.1.smithi136.stdout:6/225: write d8/dc/f43 [229371,20267] 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:6/226: stat d8/d9/de/f16 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:6/227: chown d8 223304782 1 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:6/228: truncate d8/d9/de/f28 895835 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:3/241: write d3/d14/d22/f42 [102264,49878] 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:6/229: truncate d8/dc/f41 613858 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:7/399: mkdir d0/d35/d36/d7c/d8a 0 2024-09-18T12:51:10.091 INFO:tasks.workunit.client.1.smithi136.stdout:7/400: rename d0/d35 to d0/d35/d41/d50/d7f/d8b 22 2024-09-18T12:51:10.092 INFO:tasks.workunit.client.1.smithi136.stdout:0/247: dwrite d1/d17/d2d/d35/f42 [0,4194304] 0 2024-09-18T12:51:10.094 INFO:tasks.workunit.client.1.smithi136.stdout:1/175: write d2/f17 [655373,68163] 0 2024-09-18T12:51:10.096 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:09 smithi136 ceph-mon[35363]: pgmap v277: 65 pgs: 65 active+clean; 436 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 36 MiB/s wr, 509 op/s 2024-09-18T12:51:10.096 INFO:tasks.workunit.client.1.smithi136.stdout:5/221: creat d5/d1a/d30/f3c x:0 0 0 2024-09-18T12:51:10.100 INFO:tasks.workunit.client.1.smithi136.stdout:4/127: symlink d0/l2a 0 2024-09-18T12:51:10.100 INFO:tasks.workunit.client.1.smithi136.stdout:4/128: chown d0/d2 48038646 1 2024-09-18T12:51:10.100 INFO:tasks.workunit.client.1.smithi136.stdout:4/129: readlink d0/d13/l1f 0 2024-09-18T12:51:10.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:09 smithi081 ceph-mon[27646]: pgmap v277: 65 pgs: 65 active+clean; 436 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 36 MiB/s wr, 509 op/s 2024-09-18T12:51:10.109 INFO:tasks.workunit.client.1.smithi136.stdout:6/230: creat d8/d9/d3c/d4a/f53 x:0 0 0 2024-09-18T12:51:10.110 INFO:tasks.workunit.client.1.smithi136.stdout:7/401: mkdir d0/d39/d4d/d69/d8c 0 2024-09-18T12:51:10.114 INFO:tasks.workunit.client.1.smithi136.stdout:1/176: mknod d2/d5/d11/d2e/c38 0 2024-09-18T12:51:10.114 INFO:tasks.workunit.client.1.smithi136.stdout:1/177: write d2/d1c/f1f [3382400,69691] 0 2024-09-18T12:51:10.118 INFO:tasks.workunit.client.1.smithi136.stdout:4/130: getdents d0 0 2024-09-18T12:51:10.118 INFO:tasks.workunit.client.1.smithi136.stdout:4/131: chown d0/d2/c24 415707773 1 2024-09-18T12:51:10.118 INFO:tasks.workunit.client.1.smithi136.stdout:4/132: dread - d0/d2/f28 zero size 2024-09-18T12:51:10.119 INFO:tasks.workunit.client.1.smithi136.stdout:1/178: truncate d2/d5/fa 3666499 0 2024-09-18T12:51:10.121 INFO:tasks.workunit.client.1.smithi136.stdout:4/133: symlink d0/l2b 0 2024-09-18T12:51:10.122 INFO:tasks.workunit.client.1.smithi136.stdout:1/179: symlink d2/d1c/l39 0 2024-09-18T12:51:10.122 INFO:tasks.workunit.client.1.smithi136.stdout:4/134: readlink d0/l22 0 2024-09-18T12:51:10.123 INFO:tasks.workunit.client.1.smithi136.stdout:1/180: creat d2/d5/d11/f3a x:0 0 0 2024-09-18T12:51:10.123 INFO:tasks.workunit.client.1.smithi136.stdout:1/181: readlink d2/d5/l8 0 2024-09-18T12:51:10.124 INFO:tasks.workunit.client.1.smithi136.stdout:4/135: chown d0/fc 0 1 2024-09-18T12:51:10.125 INFO:tasks.workunit.client.1.smithi136.stdout:4/136: write d0/d13/f18 [1486637,35177] 0 2024-09-18T12:51:10.125 INFO:tasks.workunit.client.1.smithi136.stdout:4/137: truncate d0/d3/f29 4771925 0 2024-09-18T12:51:10.127 INFO:tasks.workunit.client.1.smithi136.stdout:4/138: symlink d0/d3/l2c 0 2024-09-18T12:51:10.130 INFO:tasks.workunit.client.1.smithi136.stdout:4/139: creat d0/d25/f2d x:0 0 0 2024-09-18T12:51:10.130 INFO:tasks.workunit.client.1.smithi136.stdout:4/140: chown d0/d3/l2c 79 1 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:6/231: truncate d8/d9/de/d1c/f20 101504 0 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:6/232: dread - d8/d9/d3c/d4a/f53 zero size 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:6/233: write d8/d9/fa [1390183,28864] 0 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:9/214: sync 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:9/215: chown d6/da/fd 30 1 2024-09-18T12:51:10.134 INFO:tasks.workunit.client.1.smithi136.stdout:6/234: creat d8/d9/d3c/d4a/f54 x:0 0 0 2024-09-18T12:51:10.135 INFO:tasks.workunit.client.1.smithi136.stdout:9/216: symlink d6/d13/l47 0 2024-09-18T12:51:10.137 INFO:tasks.workunit.client.0.smithi081.stdout:2/14: sync 2024-09-18T12:51:10.139 INFO:tasks.workunit.client.1.smithi136.stdout:9/217: mknod d6/df/d23/d2b/c48 0 2024-09-18T12:51:10.139 INFO:tasks.workunit.client.0.smithi081.stdout:2/15: rename l0 to l1 0 2024-09-18T12:51:10.140 INFO:tasks.workunit.client.1.smithi136.stdout:9/218: mkdir d6/db/d49 0 2024-09-18T12:51:10.140 INFO:tasks.workunit.client.1.smithi136.stdout:9/219: fsync d6/df/d23/d2b/f43 0 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:2/16: symlink l2 0 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:2/17: rmdir - no directory 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:2/18: dwrite - no filename 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:2/19: truncate - no filename 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:8/35: sync 2024-09-18T12:51:10.141 INFO:tasks.workunit.client.0.smithi081.stdout:8/36: chown d3/ca 6618356 1 2024-09-18T12:51:10.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/220: mknod d6/d13/d15/c4a 0 2024-09-18T12:51:10.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/221: write d6/d13/d15/d25/d29/f2a [3979815,113074] 0 2024-09-18T12:51:10.142 INFO:tasks.workunit.client.0.smithi081.stdout:2/20: mknod c3 0 2024-09-18T12:51:10.143 INFO:tasks.workunit.client.0.smithi081.stdout:2/21: symlink l4 0 2024-09-18T12:51:10.144 INFO:tasks.workunit.client.0.smithi081.stdout:2/22: dwrite - no filename 2024-09-18T12:51:10.144 INFO:tasks.workunit.client.0.smithi081.stdout:2/23: dwrite - no filename 2024-09-18T12:51:10.144 INFO:tasks.workunit.client.0.smithi081.stdout:2/24: readlink l1 0 2024-09-18T12:51:10.144 INFO:tasks.workunit.client.0.smithi081.stdout:2/25: readlink l1 0 2024-09-18T12:51:10.144 INFO:tasks.workunit.client.1.smithi136.stdout:9/222: mknod d6/d13/d15/c4b 0 2024-09-18T12:51:10.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/26: link l2 l5 0 2024-09-18T12:51:10.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/27: write - no filename 2024-09-18T12:51:10.146 INFO:tasks.workunit.client.1.smithi136.stdout:9/223: mkdir d6/d13/d4c 0 2024-09-18T12:51:10.146 INFO:tasks.workunit.client.1.smithi136.stdout:9/224: dread - d6/d13/d15/d25/f31 zero size 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:7/20: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:7/21: fdatasync d2/f3 0 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/53: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:6/21: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/54: truncate d0/d6/fe 393841 0 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:9/25: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:3/9: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:4/35: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:5/82: sync 2024-09-18T12:51:10.147 INFO:tasks.workunit.client.0.smithi081.stdout:0/55: sync 2024-09-18T12:51:10.148 INFO:tasks.workunit.client.0.smithi081.stdout:0/56: stat l2 0 2024-09-18T12:51:10.148 INFO:tasks.workunit.client.0.smithi081.stdout:3/10: fdatasync f1 0 2024-09-18T12:51:10.148 INFO:tasks.workunit.client.1.smithi136.stdout:9/225: mkdir d6/da/d3d/d4d 0 2024-09-18T12:51:10.148 INFO:tasks.workunit.client.0.smithi081.stdout:6/22: mknod d4/d6/c8 0 2024-09-18T12:51:10.150 INFO:tasks.workunit.client.1.smithi136.stdout:9/226: rename d6/d13/d15/l24 to d6/db/l4e 0 2024-09-18T12:51:10.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/55: creat d0/d6/d7/d8/f11 x:0 0 0 2024-09-18T12:51:10.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/56: chown d0/ff 87707778 1 2024-09-18T12:51:10.151 INFO:tasks.workunit.client.0.smithi081.stdout:4/36: mkdir d3/db 0 2024-09-18T12:51:10.152 INFO:tasks.workunit.client.1.smithi136.stdout:8/317: dwrite d9/d14/d1a/d2b/f58 [0,4194304] 0 2024-09-18T12:51:10.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/26: mknod c9 0 2024-09-18T12:51:10.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/27: creat fa x:0 0 0 2024-09-18T12:51:10.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/28: rmdir - no directory 2024-09-18T12:51:10.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/29: creat fb x:0 0 0 2024-09-18T12:51:10.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/30: truncate fb 270223 0 2024-09-18T12:51:10.154 INFO:tasks.workunit.client.1.smithi136.stdout:3/242: dwrite d3/d14/d17/f4d [0,4194304] 0 2024-09-18T12:51:10.154 INFO:tasks.workunit.client.1.smithi136.stdout:2/287: dwrite d5/d7/d17/d48/f4e [0,4194304] 0 2024-09-18T12:51:10.154 INFO:tasks.workunit.client.0.smithi081.stdout:5/83: mkdir d2/d1f 0 2024-09-18T12:51:10.154 INFO:tasks.workunit.client.1.smithi136.stdout:3/243: read d3/d14/d18/f41 [570140,103601] 0 2024-09-18T12:51:10.155 INFO:tasks.workunit.client.0.smithi081.stdout:0/57: mkdir d7/d13 0 2024-09-18T12:51:10.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/11: rename c0 to d3/c5 0 2024-09-18T12:51:10.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/12: chown d3/c4 120327396 1 2024-09-18T12:51:10.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/13: read - f2 zero size 2024-09-18T12:51:10.157 INFO:tasks.workunit.client.0.smithi081.stdout:7/22: read f0 [1400612,73269] 0 2024-09-18T12:51:10.158 INFO:tasks.workunit.client.0.smithi081.stdout:1/57: mkdir d0/db/d12 0 2024-09-18T12:51:10.159 INFO:tasks.workunit.client.1.smithi136.stdout:1/182: dwrite d2/f36 [0,4194304] 0 2024-09-18T12:51:10.160 INFO:tasks.workunit.client.0.smithi081.stdout:4/37: creat d3/db/fc x:0 0 0 2024-09-18T12:51:10.161 INFO:tasks.workunit.client.0.smithi081.stdout:1/58: dread d0/d6/fd [0,4194304] 0 2024-09-18T12:51:10.161 INFO:tasks.workunit.client.0.smithi081.stdout:1/59: chown d0/ff 484189347 1 2024-09-18T12:51:10.163 INFO:tasks.workunit.client.0.smithi081.stdout:7/23: dread f0 [0,4194304] 0 2024-09-18T12:51:10.163 INFO:tasks.workunit.client.0.smithi081.stdout:9/31: mknod cc 0 2024-09-18T12:51:10.164 INFO:tasks.workunit.client.0.smithi081.stdout:9/32: fdatasync f6 0 2024-09-18T12:51:10.167 INFO:tasks.workunit.client.1.smithi136.stdout:8/318: dread d9/d14/f11 [0,4194304] 0 2024-09-18T12:51:10.167 INFO:tasks.workunit.client.1.smithi136.stdout:4/141: dwrite d0/d25/f2d [0,4194304] 0 2024-09-18T12:51:10.167 INFO:tasks.workunit.client.1.smithi136.stdout:1/183: truncate d2/d1c/f1f 671559 0 2024-09-18T12:51:10.169 INFO:tasks.workunit.client.0.smithi081.stdout:8/37: dwrite d3/f9 [0,4194304] 0 2024-09-18T12:51:10.170 INFO:tasks.workunit.client.1.smithi136.stdout:0/248: dwrite d1/f16 [0,4194304] 0 2024-09-18T12:51:10.170 INFO:tasks.workunit.client.0.smithi081.stdout:0/58: link d7/ce d7/c14 0 2024-09-18T12:51:10.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/14: symlink d3/l6 0 2024-09-18T12:51:10.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/15: dread - f2 zero size 2024-09-18T12:51:10.172 INFO:tasks.workunit.client.1.smithi136.stdout:5/222: dwrite d5/d1a/d2d/d34/f33 [4194304,4194304] 0 2024-09-18T12:51:10.173 INFO:tasks.workunit.client.0.smithi081.stdout:6/23: getdents d4 0 2024-09-18T12:51:10.174 INFO:tasks.workunit.client.0.smithi081.stdout:2/28: getdents . 0 2024-09-18T12:51:10.175 INFO:tasks.workunit.client.1.smithi136.stdout:7/402: dwrite d0/d35/d36/f25 [4194304,4194304] 0 2024-09-18T12:51:10.176 INFO:tasks.workunit.client.1.smithi136.stdout:8/319: mknod d9/d18/d34/c7e 0 2024-09-18T12:51:10.179 INFO:tasks.workunit.client.0.smithi081.stdout:8/38: creat d3/fd x:0 0 0 2024-09-18T12:51:10.181 INFO:tasks.workunit.client.1.smithi136.stdout:9/227: rmdir d6 39 2024-09-18T12:51:10.181 INFO:tasks.workunit.client.0.smithi081.stdout:5/84: rmdir d2/dd 39 2024-09-18T12:51:10.184 INFO:tasks.workunit.client.0.smithi081.stdout:3/16: rename f2 to d3/f7 0 2024-09-18T12:51:10.184 INFO:tasks.workunit.client.1.smithi136.stdout:0/249: creat d1/d17/d2d/f53 x:0 0 0 2024-09-18T12:51:10.185 INFO:tasks.workunit.client.0.smithi081.stdout:3/17: write f1 [525765,92211] 0 2024-09-18T12:51:10.185 INFO:tasks.workunit.client.0.smithi081.stdout:3/18: dread - d3/f7 zero size 2024-09-18T12:51:10.186 INFO:tasks.workunit.client.0.smithi081.stdout:3/19: stat f1 0 2024-09-18T12:51:10.186 INFO:tasks.workunit.client.0.smithi081.stdout:3/20: read f1 [85074,12291] 0 2024-09-18T12:51:10.186 INFO:tasks.workunit.client.0.smithi081.stdout:6/24: mknod d4/c9 0 2024-09-18T12:51:10.186 INFO:tasks.workunit.client.1.smithi136.stdout:5/223: truncate f2 5269155 0 2024-09-18T12:51:10.187 INFO:tasks.workunit.client.1.smithi136.stdout:7/403: mknod d0/d12/d5e/c8d 0 2024-09-18T12:51:10.189 INFO:tasks.workunit.client.0.smithi081.stdout:2/29: rename c3 to c6 0 2024-09-18T12:51:10.190 INFO:tasks.workunit.client.1.smithi136.stdout:8/320: mkdir d9/d14/d1a/d7f 0 2024-09-18T12:51:10.191 INFO:tasks.workunit.client.0.smithi081.stdout:8/39: creat d3/fe x:0 0 0 2024-09-18T12:51:10.192 INFO:tasks.workunit.client.1.smithi136.stdout:1/184: link d2/d5/d9/f32 d2/d5/d9/f3b 0 2024-09-18T12:51:10.192 INFO:tasks.workunit.client.1.smithi136.stdout:1/185: fdatasync d2/d5/d9/f3b 0 2024-09-18T12:51:10.192 INFO:tasks.workunit.client.1.smithi136.stdout:1/186: write d2/f4 [1642665,43010] 0 2024-09-18T12:51:10.193 INFO:tasks.workunit.client.1.smithi136.stdout:9/228: creat d6/db/d49/f4f x:0 0 0 2024-09-18T12:51:10.195 INFO:tasks.workunit.client.1.smithi136.stdout:0/250: mkdir d1/d17/d2d/d35/d54 0 2024-09-18T12:51:10.195 INFO:tasks.workunit.client.1.smithi136.stdout:0/251: fdatasync d1/d17/d2d/d35/f40 0 2024-09-18T12:51:10.198 INFO:tasks.workunit.client.1.smithi136.stdout:8/321: symlink d9/d14/l80 0 2024-09-18T12:51:10.199 INFO:tasks.workunit.client.1.smithi136.stdout:8/322: chown d9/f1e 0 1 2024-09-18T12:51:10.199 INFO:tasks.workunit.client.1.smithi136.stdout:8/323: chown d9/d18/l4c 3 1 2024-09-18T12:51:10.199 INFO:tasks.workunit.client.1.smithi136.stdout:8/324: write d9/d14/d1a/d2b/f51 [533398,67128] 0 2024-09-18T12:51:10.199 INFO:tasks.workunit.client.1.smithi136.stdout:8/325: fsync d9/d14/d1a/d2b/d42/f6d 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/85: dread d2/d4/f8 [0,4194304] 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/86: fdatasync d2/d4/f13 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.0.smithi081.stdout:6/25: creat d4/fa x:0 0 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.0.smithi081.stdout:6/26: fdatasync f3 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/187: creat d2/f3c x:0 0 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/188: truncate d2/d5/d2b/d34/f35 4529154 0 2024-09-18T12:51:10.200 INFO:tasks.workunit.client.1.smithi136.stdout:5/224: write d5/d1a/f3a [6449600,59795] 0 2024-09-18T12:51:10.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/30: creat f7 x:0 0 0 2024-09-18T12:51:10.201 INFO:tasks.workunit.client.1.smithi136.stdout:9/229: creat d6/d13/d4c/f50 x:0 0 0 2024-09-18T12:51:10.201 INFO:tasks.workunit.client.1.smithi136.stdout:9/230: write d6/f42 [858211,125809] 0 2024-09-18T12:51:10.203 INFO:tasks.workunit.client.0.smithi081.stdout:7/24: dwrite d2/f3 [0,4194304] 0 2024-09-18T12:51:10.203 INFO:tasks.workunit.client.0.smithi081.stdout:7/25: chown f0 17899463 1 2024-09-18T12:51:10.203 INFO:tasks.workunit.client.1.smithi136.stdout:0/252: unlink d1/d3/f1c 0 2024-09-18T12:51:10.203 INFO:tasks.workunit.client.1.smithi136.stdout:0/253: dread - d1/db/f3e zero size 2024-09-18T12:51:10.204 INFO:tasks.workunit.client.1.smithi136.stdout:0/254: creat d1/d17/d2d/f55 x:0 0 0 2024-09-18T12:51:10.204 INFO:tasks.workunit.client.0.smithi081.stdout:5/87: unlink d2/d14/l1c 0 2024-09-18T12:51:10.206 INFO:tasks.workunit.client.1.smithi136.stdout:9/231: mknod d6/df/d23/d2b/c51 0 2024-09-18T12:51:10.206 INFO:tasks.workunit.client.1.smithi136.stdout:9/232: read d6/d13/f22 [199915,11615] 0 2024-09-18T12:51:10.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/40: symlink d3/lf 0 2024-09-18T12:51:10.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/41: chown d3/ca 23140105 1 2024-09-18T12:51:10.207 INFO:tasks.workunit.client.0.smithi081.stdout:7/26: dread f0 [0,4194304] 0 2024-09-18T12:51:10.207 INFO:tasks.workunit.client.0.smithi081.stdout:7/27: creat d2/f6 x:0 0 0 2024-09-18T12:51:10.207 INFO:tasks.workunit.client.0.smithi081.stdout:7/28: readlink d2/l5 0 2024-09-18T12:51:10.208 INFO:tasks.workunit.client.1.smithi136.stdout:3/244: dwrite d3/d14/d18/f50 [0,4194304] 0 2024-09-18T12:51:10.208 INFO:tasks.workunit.client.1.smithi136.stdout:3/245: readlink d3/l4 0 2024-09-18T12:51:10.212 INFO:tasks.workunit.client.1.smithi136.stdout:0/255: mknod d1/d17/d2d/c56 0 2024-09-18T12:51:10.213 INFO:tasks.workunit.client.0.smithi081.stdout:8/42: symlink d3/l10 0 2024-09-18T12:51:10.213 INFO:tasks.workunit.client.0.smithi081.stdout:8/43: readlink d3/lc 0 2024-09-18T12:51:10.215 INFO:tasks.workunit.client.1.smithi136.stdout:2/288: dwrite d5/d25/f36 [0,4194304] 0 2024-09-18T12:51:10.215 INFO:tasks.workunit.client.1.smithi136.stdout:2/289: stat d5/d7/d11/f32 0 2024-09-18T12:51:10.215 INFO:tasks.workunit.client.0.smithi081.stdout:8/44: creat d3/f11 x:0 0 0 2024-09-18T12:51:10.215 INFO:tasks.workunit.client.0.smithi081.stdout:9/33: dwrite f7 [0,4194304] 0 2024-09-18T12:51:10.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/59: dwrite f6 [0,4194304] 0 2024-09-18T12:51:10.217 INFO:tasks.workunit.client.1.smithi136.stdout:3/246: dread d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:10.217 INFO:tasks.workunit.client.1.smithi136.stdout:4/142: dwrite d0/d13/f18 [0,4194304] 0 2024-09-18T12:51:10.218 INFO:tasks.workunit.client.1.smithi136.stdout:0/256: creat d1/d17/d2d/d51/f57 x:0 0 0 2024-09-18T12:51:10.221 INFO:tasks.workunit.client.0.smithi081.stdout:4/38: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:10.221 INFO:tasks.workunit.client.0.smithi081.stdout:4/39: chown l1 231 1 2024-09-18T12:51:10.221 INFO:tasks.workunit.client.0.smithi081.stdout:4/40: dread - d3/db/fc zero size 2024-09-18T12:51:10.224 INFO:tasks.workunit.client.0.smithi081.stdout:8/45: creat d3/f12 x:0 0 0 2024-09-18T12:51:10.224 INFO:tasks.workunit.client.0.smithi081.stdout:8/46: dread - d3/f11 zero size 2024-09-18T12:51:10.227 INFO:tasks.workunit.client.1.smithi136.stdout:4/143: mknod d0/c2e 0 2024-09-18T12:51:10.228 INFO:tasks.workunit.client.0.smithi081.stdout:8/47: unlink d3/fe 0 2024-09-18T12:51:10.228 INFO:tasks.workunit.client.0.smithi081.stdout:8/48: write d3/fd [571728,9244] 0 2024-09-18T12:51:10.228 INFO:tasks.workunit.client.0.smithi081.stdout:8/49: write d3/fb [4828961,73609] 0 2024-09-18T12:51:10.228 INFO:tasks.workunit.client.1.smithi136.stdout:8/326: dwrite d9/d18/d34/d3d/d47/d65/f66 [0,4194304] 0 2024-09-18T12:51:10.228 INFO:tasks.workunit.client.0.smithi081.stdout:4/41: rmdir d3/db 39 2024-09-18T12:51:10.231 INFO:tasks.workunit.client.0.smithi081.stdout:5/88: write d2/d4/f8 [2601741,39374] 0 2024-09-18T12:51:10.231 INFO:tasks.workunit.client.0.smithi081.stdout:5/89: write d2/fe [2325384,107942] 0 2024-09-18T12:51:10.232 INFO:tasks.workunit.client.1.smithi136.stdout:8/327: symlink d9/d18/l81 0 2024-09-18T12:51:10.234 INFO:tasks.workunit.client.0.smithi081.stdout:5/90: mkdir d2/d4/d18/d20 0 2024-09-18T12:51:10.235 INFO:tasks.workunit.client.0.smithi081.stdout:5/91: truncate d2/d4/f13 581262 0 2024-09-18T12:51:10.235 INFO:tasks.workunit.client.1.smithi136.stdout:8/328: unlink d9/d14/d1a/f46 0 2024-09-18T12:51:10.235 INFO:tasks.workunit.client.1.smithi136.stdout:8/329: chown d9/d14/d1a/l2c 917 1 2024-09-18T12:51:10.236 INFO:tasks.workunit.client.1.smithi136.stdout:8/330: chown d9/d14/d1a/l25 7 1 2024-09-18T12:51:10.236 INFO:tasks.workunit.client.1.smithi136.stdout:8/331: stat d9/d14/d1a/l25 0 2024-09-18T12:51:10.239 INFO:tasks.workunit.client.0.smithi081.stdout:5/92: rename d2/d4/f8 to d2/dd/f21 0 2024-09-18T12:51:10.239 INFO:tasks.workunit.client.1.smithi136.stdout:5/225: dwrite d5/fa [0,4194304] 0 2024-09-18T12:51:10.239 INFO:tasks.workunit.client.1.smithi136.stdout:2/290: write d5/d25/d43/f52 [1529933,1629] 0 2024-09-18T12:51:10.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/21: getdents d3 0 2024-09-18T12:51:10.240 INFO:tasks.workunit.client.0.smithi081.stdout:3/22: stat d3 0 2024-09-18T12:51:10.240 INFO:tasks.workunit.client.0.smithi081.stdout:3/23: read - d3/f7 zero size 2024-09-18T12:51:10.242 INFO:tasks.workunit.client.0.smithi081.stdout:5/93: creat d2/d4/d18/d20/f22 x:0 0 0 2024-09-18T12:51:10.243 INFO:tasks.workunit.client.1.smithi136.stdout:5/226: symlink d5/d1a/d2d/d34/l3d 0 2024-09-18T12:51:10.245 INFO:tasks.workunit.client.0.smithi081.stdout:3/24: symlink d3/l8 0 2024-09-18T12:51:10.248 INFO:tasks.workunit.client.1.smithi136.stdout:0/257: getdents d1/d17/d2d 0 2024-09-18T12:51:10.249 INFO:tasks.workunit.client.0.smithi081.stdout:2/31: link c6 c8 0 2024-09-18T12:51:10.249 INFO:tasks.workunit.client.0.smithi081.stdout:3/25: dread - d3/f7 zero size 2024-09-18T12:51:10.249 INFO:tasks.workunit.client.0.smithi081.stdout:3/26: write d3/f7 [143458,73246] 0 2024-09-18T12:51:10.249 INFO:tasks.workunit.client.0.smithi081.stdout:2/32: creat f9 x:0 0 0 2024-09-18T12:51:10.250 INFO:tasks.workunit.client.0.smithi081.stdout:3/27: readlink d3/l6 0 2024-09-18T12:51:10.252 INFO:tasks.workunit.client.0.smithi081.stdout:7/29: write f0 [1682117,54951] 0 2024-09-18T12:51:10.252 INFO:tasks.workunit.client.0.smithi081.stdout:7/30: dread - d2/f6 zero size 2024-09-18T12:51:10.253 INFO:tasks.workunit.client.1.smithi136.stdout:5/227: dread d5/d1a/f27 [0,4194304] 0 2024-09-18T12:51:10.253 INFO:tasks.workunit.client.0.smithi081.stdout:7/31: rename d2/f3 to d2/f7 0 2024-09-18T12:51:10.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/291: mknod d5/d25/c5b 0 2024-09-18T12:51:10.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/292: chown f3 9270 1 2024-09-18T12:51:10.257 INFO:tasks.workunit.client.1.smithi136.stdout:5/228: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:10.259 INFO:tasks.workunit.client.1.smithi136.stdout:2/293: stat d5/d7/d17/l57 0 2024-09-18T12:51:10.260 INFO:tasks.workunit.client.1.smithi136.stdout:0/258: rmdir d1/d17/d2d/d51 39 2024-09-18T12:51:10.261 INFO:tasks.workunit.client.1.smithi136.stdout:0/259: creat d1/d3/f58 x:0 0 0 2024-09-18T12:51:10.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/260: stat d1/d17/f37 0 2024-09-18T12:51:10.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/261: truncate d1/d3/f8 4535482 0 2024-09-18T12:51:10.268 INFO:tasks.workunit.client.1.smithi136.stdout:0/262: rename d1/f2f to d1/d3/d1a/f59 0 2024-09-18T12:51:10.270 INFO:tasks.workunit.client.1.smithi136.stdout:0/263: mknod d1/d17/c5a 0 2024-09-18T12:51:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/34: dwrite fb [0,4194304] 0 2024-09-18T12:51:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/35: stat c9 0 2024-09-18T12:51:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/36: fsync f0 0 2024-09-18T12:51:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:0/60: dwrite f0 [0,4194304] 0 2024-09-18T12:51:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:6/27: dwrite d4/fa [0,4194304] 0 2024-09-18T12:51:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:0/61: chown d7/d9/cc 337 1 2024-09-18T12:51:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:8/50: fdatasync d3/fd 0 2024-09-18T12:51:10.274 INFO:tasks.workunit.client.1.smithi136.stdout:2/294: write d5/d7/d11/f31 [1869076,6167] 0 2024-09-18T12:51:10.276 INFO:tasks.workunit.client.0.smithi081.stdout:9/37: mkdir dd 0 2024-09-18T12:51:10.276 INFO:tasks.workunit.client.1.smithi136.stdout:2/295: mkdir d5/d25/d43/d5c 0 2024-09-18T12:51:10.277 INFO:tasks.workunit.client.1.smithi136.stdout:2/296: write d5/d7/d11/f32 [982009,57886] 0 2024-09-18T12:51:10.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/28: chown d4/f7 16049 1 2024-09-18T12:51:10.278 INFO:tasks.workunit.client.1.smithi136.stdout:0/264: read d1/d17/f34 [150348,76093] 0 2024-09-18T12:51:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:0/62: unlink f6 0 2024-09-18T12:51:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:0/63: write d7/d9/f11 [127049,108516] 0 2024-09-18T12:51:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:9/38: mkdir dd/de 0 2024-09-18T12:51:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/29: creat d4/d6/fb x:0 0 0 2024-09-18T12:51:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/30: fdatasync f3 0 2024-09-18T12:51:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:9/39: dread f0 [0,4194304] 0 2024-09-18T12:51:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/40: rename c5 to dd/cf 0 2024-09-18T12:51:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/41: readlink - no filename 2024-09-18T12:51:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:5/94: dwrite d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:10.288 INFO:tasks.workunit.client.1.smithi136.stdout:9/233: dwrite d6/df/f3b [0,4194304] 0 2024-09-18T12:51:10.288 INFO:tasks.workunit.client.1.smithi136.stdout:1/189: dwrite d2/d5/d9/fc [4194304,4194304] 0 2024-09-18T12:51:10.288 INFO:tasks.workunit.client.1.smithi136.stdout:5/229: dwrite d5/d1a/d2d/f39 [0,4194304] 0 2024-09-18T12:51:10.289 INFO:tasks.workunit.client.1.smithi136.stdout:2/297: write d5/d7/fe [915962,93705] 0 2024-09-18T12:51:10.289 INFO:tasks.workunit.client.1.smithi136.stdout:8/332: dwrite d9/d14/d1a/d2b/d42/f49 [0,4194304] 0 2024-09-18T12:51:10.289 INFO:tasks.workunit.client.1.smithi136.stdout:3/247: dwrite d3/d14/d18/f41 [0,4194304] 0 2024-09-18T12:51:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:9/42: mknod dd/c10 0 2024-09-18T12:51:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:9/43: read f0 [451501,97618] 0 2024-09-18T12:51:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:0/64: write d7/d9/f10 [3259563,44415] 0 2024-09-18T12:51:10.290 INFO:tasks.workunit.client.1.smithi136.stdout:9/234: symlink d6/d13/d15/d25/d29/l52 0 2024-09-18T12:51:10.291 INFO:tasks.workunit.client.1.smithi136.stdout:1/190: mknod d2/d5/d2b/c3d 0 2024-09-18T12:51:10.291 INFO:tasks.workunit.client.1.smithi136.stdout:1/191: stat d2/d5/d9/c30 0 2024-09-18T12:51:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/28: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:10.293 INFO:tasks.workunit.client.1.smithi136.stdout:5/230: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:10.293 INFO:tasks.workunit.client.1.smithi136.stdout:5/231: read d5/d1a/d30/f3b [2430094,88934] 0 2024-09-18T12:51:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:8/51: rmdir d3 39 2024-09-18T12:51:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:8/52: chown d3/fb 6 1 2024-09-18T12:51:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:8/53: dread - d3/f11 zero size 2024-09-18T12:51:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:8/54: dread - d3/f11 zero size 2024-09-18T12:51:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:4/42: truncate d3/f7 3740772 0 2024-09-18T12:51:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:4/43: chown d3/f9 83 1 2024-09-18T12:51:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:5/95: dread d2/fe [0,4194304] 0 2024-09-18T12:51:10.297 INFO:tasks.workunit.client.1.smithi136.stdout:1/192: rename d2/d5/d11/f3a to d2/d5/d9/d23/f3e 0 2024-09-18T12:51:10.297 INFO:tasks.workunit.client.1.smithi136.stdout:5/232: symlink d5/d1a/d2d/d34/l3e 0 2024-09-18T12:51:10.297 INFO:tasks.workunit.client.1.smithi136.stdout:2/298: symlink d5/d25/l5d 0 2024-09-18T12:51:10.298 INFO:tasks.workunit.client.1.smithi136.stdout:5/233: mkdir d5/d1a/d2d/d3f 0 2024-09-18T12:51:10.300 INFO:tasks.workunit.client.1.smithi136.stdout:2/299: symlink d5/d7/d3b/l5e 0 2024-09-18T12:51:10.300 INFO:tasks.workunit.client.1.smithi136.stdout:2/300: chown d5/d25/d2d/f30 1217 1 2024-09-18T12:51:10.300 INFO:tasks.workunit.client.1.smithi136.stdout:2/301: truncate d5/d25/f28 403498 0 2024-09-18T12:51:10.302 INFO:tasks.workunit.client.1.smithi136.stdout:2/302: mknod d5/d7/d11/d34/c5f 0 2024-09-18T12:51:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:9/44: symlink dd/de/l11 0 2024-09-18T12:51:10.308 INFO:tasks.workunit.client.0.smithi081.stdout:4/44: mkdir d3/dd 0 2024-09-18T12:51:10.309 INFO:tasks.workunit.client.0.smithi081.stdout:7/32: getdents d2 0 2024-09-18T12:51:10.310 INFO:tasks.workunit.client.0.smithi081.stdout:0/65: dread d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:10.311 INFO:tasks.workunit.client.1.smithi136.stdout:0/265: dwrite d1/d17/f4c [0,4194304] 0 2024-09-18T12:51:10.311 INFO:tasks.workunit.client.1.smithi136.stdout:8/333: write d9/d14/d1a/f4e [1575856,118191] 0 2024-09-18T12:51:10.311 INFO:tasks.workunit.client.1.smithi136.stdout:8/334: write d9/d14/d1a/d2b/d42/f43 [1567603,109018] 0 2024-09-18T12:51:10.312 INFO:tasks.workunit.client.0.smithi081.stdout:3/29: symlink d3/l9 0 2024-09-18T12:51:10.314 INFO:tasks.workunit.client.0.smithi081.stdout:8/55: rename d3/f9 to d3/f13 0 2024-09-18T12:51:10.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/30: creat d3/fa x:0 0 0 2024-09-18T12:51:10.316 INFO:tasks.workunit.client.1.smithi136.stdout:0/266: dread d1/f2c [0,4194304] 0 2024-09-18T12:51:10.316 INFO:tasks.workunit.client.1.smithi136.stdout:5/234: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:10.317 INFO:tasks.workunit.client.1.smithi136.stdout:5/235: getdents d5/d1a/d2d/d3f 0 2024-09-18T12:51:10.318 INFO:tasks.workunit.client.1.smithi136.stdout:8/335: getdents d9/d18/d34 0 2024-09-18T12:51:10.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/33: dread f0 [0,4194304] 0 2024-09-18T12:51:10.320 INFO:tasks.workunit.client.0.smithi081.stdout:6/31: rmdir d4 39 2024-09-18T12:51:10.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/34: mknod d2/c8 0 2024-09-18T12:51:10.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/35: write d2/f7 [4903219,69652] 0 2024-09-18T12:51:10.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/36: write d2/f7 [4491278,44310] 0 2024-09-18T12:51:10.323 INFO:tasks.workunit.client.0.smithi081.stdout:6/32: creat d4/d6/fc x:0 0 0 2024-09-18T12:51:10.324 INFO:tasks.workunit.client.0.smithi081.stdout:6/33: write d4/d6/fb [450085,90029] 0 2024-09-18T12:51:10.325 INFO:tasks.workunit.client.1.smithi136.stdout:1/193: dwrite d2/d5/d9/f32 [0,4194304] 0 2024-09-18T12:51:10.328 INFO:tasks.workunit.client.1.smithi136.stdout:9/235: dwrite d6/db/f2c [0,4194304] 0 2024-09-18T12:51:10.328 INFO:tasks.workunit.client.1.smithi136.stdout:3/248: dwrite d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:10.328 INFO:tasks.workunit.client.0.smithi081.stdout:7/37: creat d2/f9 x:0 0 0 2024-09-18T12:51:10.329 INFO:tasks.workunit.client.1.smithi136.stdout:9/236: dread d6/db/d12/f37 [0,4194304] 0 2024-09-18T12:51:10.329 INFO:tasks.workunit.client.1.smithi136.stdout:9/237: stat d6/f2d 0 2024-09-18T12:51:10.330 INFO:tasks.workunit.client.1.smithi136.stdout:1/194: creat d2/f3f x:0 0 0 2024-09-18T12:51:10.330 INFO:tasks.workunit.client.1.smithi136.stdout:1/195: fsync d2/d5/fa 0 2024-09-18T12:51:10.330 INFO:tasks.workunit.client.1.smithi136.stdout:3/249: mkdir d3/d10/d4a/d51 0 2024-09-18T12:51:10.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/38: rename d2/c4 to d2/ca 0 2024-09-18T12:51:10.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/39: rename d2 to d2/db 22 2024-09-18T12:51:10.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/40: write f0 [1874894,114585] 0 2024-09-18T12:51:10.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/41: creat d2/fc x:0 0 0 2024-09-18T12:51:10.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/42: creat d2/fd x:0 0 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:2/303: dwrite d5/f1c [8388608,4194304] 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:1/196: dread f1 [0,4194304] 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:1/197: chown d2/d5/d2b/c3d 1285722 1 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:2/304: truncate d5/d7/d41/f58 856962 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:2/305: readlink d5/d4a/l56 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:1/198: dread - d2/d5/d9/d23/f3e zero size 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:1/199: fsync d2/d1c/f1f 0 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:1/200: read - d2/d1c/f2f zero size 2024-09-18T12:51:10.334 INFO:tasks.workunit.client.1.smithi136.stdout:2/306: read d5/d25/d43/f52 [152399,121533] 0 2024-09-18T12:51:10.335 INFO:tasks.workunit.client.1.smithi136.stdout:1/201: write d2/f16 [45047,124764] 0 2024-09-18T12:51:10.335 INFO:tasks.workunit.client.0.smithi081.stdout:9/45: getdents dd/de 0 2024-09-18T12:51:10.344 INFO:tasks.workunit.client.1.smithi136.stdout:5/236: rmdir d5/d1a 39 2024-09-18T12:51:10.344 INFO:tasks.workunit.client.1.smithi136.stdout:5/237: stat d5/d1a/d2d/d34/c17 0 2024-09-18T12:51:10.351 INFO:tasks.workunit.client.0.smithi081.stdout:8/56: getdents d3 0 2024-09-18T12:51:10.351 INFO:tasks.workunit.client.0.smithi081.stdout:8/57: dread - d3/f11 zero size 2024-09-18T12:51:10.351 INFO:tasks.workunit.client.0.smithi081.stdout:6/34: dwrite f3 [0,4194304] 0 2024-09-18T12:51:10.351 INFO:tasks.workunit.client.0.smithi081.stdout:6/35: creat d4/d6/fd x:0 0 0 2024-09-18T12:51:10.352 INFO:tasks.workunit.client.0.smithi081.stdout:6/36: dread - d4/d6/fc zero size 2024-09-18T12:51:10.353 INFO:tasks.workunit.client.0.smithi081.stdout:9/46: dread f6 [0,4194304] 0 2024-09-18T12:51:10.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/58: creat d3/f14 x:0 0 0 2024-09-18T12:51:10.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/59: creat d3/f15 x:0 0 0 2024-09-18T12:51:10.356 INFO:tasks.workunit.client.0.smithi081.stdout:9/47: link f6 dd/de/f12 0 2024-09-18T12:51:10.358 INFO:tasks.workunit.client.0.smithi081.stdout:6/37: link d4/d6/fd d4/fe 0 2024-09-18T12:51:10.359 INFO:tasks.workunit.client.1.smithi136.stdout:9/238: mkdir d6/db/d49/d53 0 2024-09-18T12:51:10.360 INFO:tasks.workunit.client.0.smithi081.stdout:9/48: creat dd/de/f13 x:0 0 0 2024-09-18T12:51:10.361 INFO:tasks.workunit.client.1.smithi136.stdout:1/202: truncate d2/d5/fd 1713301 0 2024-09-18T12:51:10.362 INFO:tasks.workunit.client.1.smithi136.stdout:2/307: truncate d5/d7/d11/f32 329250 0 2024-09-18T12:51:10.363 INFO:tasks.workunit.client.1.smithi136.stdout:1/203: dread d2/d5/d11/d1b/f25 [0,4194304] 0 2024-09-18T12:51:10.363 INFO:tasks.workunit.client.1.smithi136.stdout:1/204: readlink d2/d1c/l20 0 2024-09-18T12:51:10.363 INFO:tasks.workunit.client.1.smithi136.stdout:1/205: write d2/d5/d9/d23/f3e [798959,122851] 0 2024-09-18T12:51:10.363 INFO:tasks.workunit.client.1.smithi136.stdout:2/308: symlink d5/d25/d2d/l60 0 2024-09-18T12:51:10.363 INFO:tasks.workunit.client.1.smithi136.stdout:1/206: mknod d2/d5/d2b/c40 0 2024-09-18T12:51:10.370 INFO:tasks.workunit.client.0.smithi081.stdout:3/31: dwrite d3/fa [0,4194304] 0 2024-09-18T12:51:10.372 INFO:tasks.workunit.client.0.smithi081.stdout:3/32: mkdir d3/db 0 2024-09-18T12:51:10.373 INFO:tasks.workunit.client.0.smithi081.stdout:3/33: mkdir d3/db/dc 0 2024-09-18T12:51:10.373 INFO:tasks.workunit.client.0.smithi081.stdout:3/34: creat d3/fd x:0 0 0 2024-09-18T12:51:10.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/35: dread - d3/fd zero size 2024-09-18T12:51:10.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/36: stat d3/db 0 2024-09-18T12:51:10.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/37: mkdir d3/db/dc/de 0 2024-09-18T12:51:10.382 INFO:tasks.workunit.client.0.smithi081.stdout:3/38: dread d3/fa [0,4194304] 0 2024-09-18T12:51:10.382 INFO:tasks.workunit.client.0.smithi081.stdout:3/39: chown d3/fd 140855 1 2024-09-18T12:51:10.384 INFO:tasks.workunit.client.0.smithi081.stdout:6/38: dread f3 [0,4194304] 0 2024-09-18T12:51:10.384 INFO:tasks.workunit.client.0.smithi081.stdout:6/39: readlink - no filename 2024-09-18T12:51:10.387 INFO:tasks.workunit.client.0.smithi081.stdout:9/49: read f7 [2848054,37362] 0 2024-09-18T12:51:10.388 INFO:tasks.workunit.client.0.smithi081.stdout:9/50: truncate f7 4557159 0 2024-09-18T12:51:10.388 INFO:tasks.workunit.client.0.smithi081.stdout:9/51: fdatasync dd/de/f12 0 2024-09-18T12:51:10.388 INFO:tasks.workunit.client.0.smithi081.stdout:9/52: fsync fa 0 2024-09-18T12:51:10.389 INFO:tasks.workunit.client.1.smithi136.stdout:8/336: dwrite d9/d14/d1a/d2b/d42/f49 [0,4194304] 0 2024-09-18T12:51:10.390 INFO:tasks.workunit.client.1.smithi136.stdout:8/337: truncate d9/d14/d1a/d2b/f33 1445005 0 2024-09-18T12:51:10.390 INFO:tasks.workunit.client.1.smithi136.stdout:8/338: write d9/d18/f48 [132769,124469] 0 2024-09-18T12:51:10.390 INFO:tasks.workunit.client.0.smithi081.stdout:7/43: dwrite d2/f9 [0,4194304] 0 2024-09-18T12:51:10.390 INFO:tasks.workunit.client.0.smithi081.stdout:0/66: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:5/96: dwrite d2/ff [0,4194304] 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:7/44: write f0 [1335099,67488] 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:7/45: creat d2/fe x:0 0 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:7/46: dread - d2/f6 zero size 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:7/47: stat d2/fd 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.0.smithi081.stdout:7/48: creat d2/ff x:0 0 0 2024-09-18T12:51:10.391 INFO:tasks.workunit.client.1.smithi136.stdout:3/250: dwrite d3/d10/f16 [0,4194304] 0 2024-09-18T12:51:10.396 INFO:tasks.workunit.client.1.smithi136.stdout:8/339: dread d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:10.396 INFO:tasks.workunit.client.1.smithi136.stdout:3/251: rename d3/lf to d3/d5/d31/l52 0 2024-09-18T12:51:10.398 INFO:tasks.workunit.client.1.smithi136.stdout:5/238: dwrite d5/d1a/d30/f3c [0,4194304] 0 2024-09-18T12:51:10.398 INFO:tasks.workunit.client.1.smithi136.stdout:3/252: mkdir d3/d14/d17/d53 0 2024-09-18T12:51:10.401 INFO:tasks.workunit.client.1.smithi136.stdout:3/253: unlink d3/l4 0 2024-09-18T12:51:10.401 INFO:tasks.workunit.client.1.smithi136.stdout:3/254: creat d3/d14/f54 x:0 0 0 2024-09-18T12:51:10.401 INFO:tasks.workunit.client.1.smithi136.stdout:3/255: write d3/d14/f54 [663573,5315] 0 2024-09-18T12:51:10.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/40: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:10.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/41: fsync d3/fa 0 2024-09-18T12:51:10.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/42: stat d3/l6 0 2024-09-18T12:51:10.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/43: dread - d3/fd zero size 2024-09-18T12:51:10.403 INFO:tasks.workunit.client.0.smithi081.stdout:6/40: write d4/fa [2744774,15950] 0 2024-09-18T12:51:10.405 INFO:tasks.workunit.client.0.smithi081.stdout:7/49: link d2/ff d2/f10 0 2024-09-18T12:51:10.410 INFO:tasks.workunit.client.0.smithi081.stdout:3/44: mkdir d3/db/df 0 2024-09-18T12:51:10.410 INFO:tasks.workunit.client.0.smithi081.stdout:3/45: write d3/fd [155640,107883] 0 2024-09-18T12:51:10.412 INFO:tasks.workunit.client.0.smithi081.stdout:5/97: write d2/ff [110761,39779] 0 2024-09-18T12:51:10.412 INFO:tasks.workunit.client.0.smithi081.stdout:5/98: rename d2 to d2/d14/d1d/d23 22 2024-09-18T12:51:10.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/41: symlink d4/d6/lf 0 2024-09-18T12:51:10.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/42: write d4/f7 [929392,67726] 0 2024-09-18T12:51:10.414 INFO:tasks.workunit.client.0.smithi081.stdout:7/50: link d2/f9 d2/f11 0 2024-09-18T12:51:10.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/99: mknod d2/d4/d16/c24 0 2024-09-18T12:51:10.418 INFO:tasks.workunit.client.0.smithi081.stdout:6/43: mkdir d4/d6/d10 0 2024-09-18T12:51:10.419 INFO:tasks.workunit.client.1.smithi136.stdout:3/256: write d3/d14/d18/f41 [467025,41194] 0 2024-09-18T12:51:10.419 INFO:tasks.workunit.client.1.smithi136.stdout:3/257: readlink d3/d14/d17/l46 0 2024-09-18T12:51:10.419 INFO:tasks.workunit.client.1.smithi136.stdout:3/258: read d3/d14/f3a [1638722,10276] 0 2024-09-18T12:51:10.420 INFO:tasks.workunit.client.0.smithi081.stdout:5/100: creat d2/d4/d18/f25 x:0 0 0 2024-09-18T12:51:10.421 INFO:tasks.workunit.client.1.smithi136.stdout:1/207: dwrite d2/f16 [0,4194304] 0 2024-09-18T12:51:10.421 INFO:tasks.workunit.client.0.smithi081.stdout:0/67: dwrite d7/d9/f10 [4194304,4194304] 0 2024-09-18T12:51:10.422 INFO:tasks.workunit.client.0.smithi081.stdout:3/46: read d3/f7 [2737664,7614] 0 2024-09-18T12:51:10.422 INFO:tasks.workunit.client.0.smithi081.stdout:6/44: rename d4/d6/c8 to d4/d6/c11 0 2024-09-18T12:51:10.422 INFO:tasks.workunit.client.0.smithi081.stdout:6/45: chown f3 97065658 1 2024-09-18T12:51:10.423 INFO:tasks.workunit.client.0.smithi081.stdout:5/101: mknod d2/d4/d18/d20/c26 0 2024-09-18T12:51:10.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/102: creat d2/d14/f27 x:0 0 0 2024-09-18T12:51:10.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/103: write d2/dd/f21 [118251,35201] 0 2024-09-18T12:51:10.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/104: dread - d2/d4/d18/f25 zero size 2024-09-18T12:51:10.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/105: write d2/d4/d18/d20/f22 [803856,7537] 0 2024-09-18T12:51:10.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/106: write d2/fe [3155280,66292] 0 2024-09-18T12:51:10.426 INFO:tasks.workunit.client.0.smithi081.stdout:5/107: symlink d2/d4/d18/l28 0 2024-09-18T12:51:10.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/340: dwrite d9/d18/f7a [0,4194304] 0 2024-09-18T12:51:10.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/341: readlink d9/d18/d34/d3d/d47/l7d 0 2024-09-18T12:51:10.427 INFO:tasks.workunit.client.0.smithi081.stdout:5/108: creat d2/dd/f29 x:0 0 0 2024-09-18T12:51:10.431 INFO:tasks.workunit.client.0.smithi081.stdout:3/47: write d3/fa [72734,35663] 0 2024-09-18T12:51:10.431 INFO:tasks.workunit.client.0.smithi081.stdout:6/46: dread f0 [0,4194304] 0 2024-09-18T12:51:10.431 INFO:tasks.workunit.client.0.smithi081.stdout:6/47: fdatasync f3 0 2024-09-18T12:51:10.431 INFO:tasks.workunit.client.1.smithi136.stdout:8/342: getdents d9 0 2024-09-18T12:51:10.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/48: symlink d3/db/dc/l10 0 2024-09-18T12:51:10.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/49: truncate d3/fd 1264281 0 2024-09-18T12:51:10.433 INFO:tasks.workunit.client.1.smithi136.stdout:1/208: dread d2/d5/d9/f3b [0,4194304] 0 2024-09-18T12:51:10.434 INFO:tasks.workunit.client.0.smithi081.stdout:3/50: symlink d3/db/l11 0 2024-09-18T12:51:10.435 INFO:tasks.workunit.client.1.smithi136.stdout:8/343: mknod d9/d14/d1a/d2b/d42/d6e/c82 0 2024-09-18T12:51:10.435 INFO:tasks.workunit.client.0.smithi081.stdout:7/51: dwrite d2/fe [0,4194304] 0 2024-09-18T12:51:10.436 INFO:tasks.workunit.client.0.smithi081.stdout:3/51: mkdir d3/db/dc/de/d12 0 2024-09-18T12:51:10.439 INFO:tasks.workunit.client.0.smithi081.stdout:7/52: unlink d2/c8 0 2024-09-18T12:51:10.439 INFO:tasks.workunit.client.1.smithi136.stdout:8/344: mknod d9/d18/d34/d3d/d47/c83 0 2024-09-18T12:51:10.440 INFO:tasks.workunit.client.0.smithi081.stdout:3/52: mkdir d3/db/dc/de/d13 0 2024-09-18T12:51:10.441 INFO:tasks.workunit.client.0.smithi081.stdout:3/53: creat d3/db/dc/de/d13/f14 x:0 0 0 2024-09-18T12:51:10.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/54: creat d3/db/dc/f15 x:0 0 0 2024-09-18T12:51:10.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/55: read d3/f7 [2293518,112802] 0 2024-09-18T12:51:10.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/56: chown d3/db/dc/de 1037918 1 2024-09-18T12:51:10.452 INFO:tasks.workunit.client.1.smithi136.stdout:8/345: rmdir d9/d18/d34/d3d 39 2024-09-18T12:51:10.452 INFO:tasks.workunit.client.0.smithi081.stdout:3/57: link d3/c5 d3/c16 0 2024-09-18T12:51:10.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/58: fdatasync d3/f7 0 2024-09-18T12:51:10.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/59: write d3/db/dc/f15 [122584,112850] 0 2024-09-18T12:51:10.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/60: write d3/fd [586057,68890] 0 2024-09-18T12:51:10.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/61: dread - d3/db/dc/de/d13/f14 zero size 2024-09-18T12:51:10.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/62: read d3/f7 [28772,74436] 0 2024-09-18T12:51:10.454 INFO:tasks.workunit.client.1.smithi136.stdout:8/346: creat d9/d14/d1a/d2b/d42/d6e/f84 x:0 0 0 2024-09-18T12:51:10.455 INFO:tasks.workunit.client.0.smithi081.stdout:3/63: mkdir d3/db/dc/de/d13/d17 0 2024-09-18T12:51:10.455 INFO:tasks.workunit.client.0.smithi081.stdout:3/64: stat d3/fd 0 2024-09-18T12:51:10.455 INFO:tasks.workunit.client.1.smithi136.stdout:8/347: truncate d9/f6a 528511 0 2024-09-18T12:51:10.455 INFO:tasks.workunit.client.1.smithi136.stdout:8/348: stat d9/d14/d1a/d7f 0 2024-09-18T12:51:10.456 INFO:tasks.workunit.client.0.smithi081.stdout:3/65: creat d3/db/dc/de/d13/d17/f18 x:0 0 0 2024-09-18T12:51:10.457 INFO:tasks.workunit.client.0.smithi081.stdout:3/66: creat d3/db/dc/de/f19 x:0 0 0 2024-09-18T12:51:10.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/67: mkdir d3/db/dc/d1a 0 2024-09-18T12:51:10.461 INFO:tasks.workunit.client.0.smithi081.stdout:3/68: mkdir d3/db/d1b 0 2024-09-18T12:51:10.461 INFO:tasks.workunit.client.0.smithi081.stdout:3/69: stat d3/db/dc/de/d13/f14 0 2024-09-18T12:51:10.462 INFO:tasks.workunit.client.0.smithi081.stdout:3/70: mknod d3/db/dc/de/d13/d17/c1c 0 2024-09-18T12:51:10.464 INFO:tasks.workunit.client.0.smithi081.stdout:3/71: rename d3/c16 to d3/db/df/c1d 0 2024-09-18T12:51:10.475 INFO:tasks.workunit.client.0.smithi081.stdout:7/53: dwrite d2/f7 [0,4194304] 0 2024-09-18T12:51:10.475 INFO:tasks.workunit.client.0.smithi081.stdout:6/48: truncate d4/f7 912660 0 2024-09-18T12:51:10.475 INFO:tasks.workunit.client.1.smithi136.stdout:6/235: sync 2024-09-18T12:51:10.475 INFO:tasks.workunit.client.1.smithi136.stdout:1/209: dwrite d2/d1c/f2f [0,4194304] 0 2024-09-18T12:51:10.476 INFO:tasks.workunit.client.0.smithi081.stdout:6/49: dread - d4/f5 zero size 2024-09-18T12:51:10.478 INFO:tasks.workunit.client.1.smithi136.stdout:8/349: dwrite d9/f1e [0,4194304] 0 2024-09-18T12:51:10.478 INFO:tasks.workunit.client.1.smithi136.stdout:6/236: mknod d8/d9/d3c/d4a/c55 0 2024-09-18T12:51:10.478 INFO:tasks.workunit.client.1.smithi136.stdout:6/237: chown d8/d9/d3c/d4a/f53 51210 1 2024-09-18T12:51:10.479 INFO:tasks.workunit.client.0.smithi081.stdout:0/68: dwrite f0 [4194304,4194304] 0 2024-09-18T12:51:10.479 INFO:tasks.workunit.client.1.smithi136.stdout:8/350: mknod d9/d18/c85 0 2024-09-18T12:51:10.479 INFO:tasks.workunit.client.1.smithi136.stdout:8/351: write d9/d18/f48 [850352,63928] 0 2024-09-18T12:51:10.479 INFO:tasks.workunit.client.1.smithi136.stdout:8/352: truncate d9/d18/d34/d3d/f4b 850008 0 2024-09-18T12:51:10.480 INFO:tasks.workunit.client.1.smithi136.stdout:6/238: mkdir d8/d9/d56 0 2024-09-18T12:51:10.482 INFO:tasks.workunit.client.1.smithi136.stdout:6/239: mknod d8/d9/de/d1c/d50/c57 0 2024-09-18T12:51:10.483 INFO:tasks.workunit.client.1.smithi136.stdout:6/240: chown d8/d9/de/d1c/l4d 334626324 1 2024-09-18T12:51:10.483 INFO:tasks.workunit.client.1.smithi136.stdout:6/241: readlink d8/d9/de/d1c/l2a 0 2024-09-18T12:51:10.484 INFO:tasks.workunit.client.0.smithi081.stdout:0/69: rename c4 to d7/c15 0 2024-09-18T12:51:10.485 INFO:tasks.workunit.client.1.smithi136.stdout:6/242: link d8/d9/de/f23 d8/d9/d3c/f58 0 2024-09-18T12:51:10.485 INFO:tasks.workunit.client.1.smithi136.stdout:6/243: dread - d8/dc/f4f zero size 2024-09-18T12:51:10.492 INFO:tasks.workunit.client.0.smithi081.stdout:0/70: creat d7/d13/f16 x:0 0 0 2024-09-18T12:51:10.495 INFO:tasks.workunit.client.1.smithi136.stdout:8/353: dread d9/d18/d34/f74 [0,4194304] 0 2024-09-18T12:51:10.495 INFO:tasks.workunit.client.1.smithi136.stdout:8/354: chown d9/d18/d34/d3d/d47/l7d 3357 1 2024-09-18T12:51:10.495 INFO:tasks.workunit.client.1.smithi136.stdout:8/355: readlink d9/lc 0 2024-09-18T12:51:10.497 INFO:tasks.workunit.client.1.smithi136.stdout:8/356: mknod d9/d14/d1a/d2b/d42/c86 0 2024-09-18T12:51:10.499 INFO:tasks.workunit.client.1.smithi136.stdout:8/357: mknod d9/d14/d1a/d2b/c87 0 2024-09-18T12:51:10.499 INFO:tasks.workunit.client.1.smithi136.stdout:8/358: fdatasync d9/d14/f1f 0 2024-09-18T12:51:10.499 INFO:tasks.workunit.client.1.smithi136.stdout:8/359: stat d9/d14/d1a/d2b/d42/f49 0 2024-09-18T12:51:10.500 INFO:tasks.workunit.client.1.smithi136.stdout:8/360: mkdir d9/d18/d34/d88 0 2024-09-18T12:51:10.501 INFO:tasks.workunit.client.0.smithi081.stdout:7/54: dwrite d2/fe [0,4194304] 0 2024-09-18T12:51:10.501 INFO:tasks.workunit.client.0.smithi081.stdout:1/60: sync 2024-09-18T12:51:10.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/361: mknod d9/c89 0 2024-09-18T12:51:10.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/362: readlink d9/d14/l52 0 2024-09-18T12:51:10.504 INFO:tasks.workunit.client.0.smithi081.stdout:1/61: symlink d0/db/l13 0 2024-09-18T12:51:10.505 INFO:tasks.workunit.client.1.smithi136.stdout:6/244: dwrite d8/dc/f14 [0,4194304] 0 2024-09-18T12:51:10.507 INFO:tasks.workunit.client.0.smithi081.stdout:1/62: dread d0/d6/d7/d8/fc [0,4194304] 0 2024-09-18T12:51:10.507 INFO:tasks.workunit.client.0.smithi081.stdout:1/63: read - d0/ff zero size 2024-09-18T12:51:10.511 INFO:tasks.workunit.client.1.smithi136.stdout:6/245: unlink d8/l1e 0 2024-09-18T12:51:10.512 INFO:tasks.workunit.client.1.smithi136.stdout:6/246: creat d8/d9/d3c/f59 x:0 0 0 2024-09-18T12:51:10.512 INFO:tasks.workunit.client.1.smithi136.stdout:1/210: dwrite d2/f36 [0,4194304] 0 2024-09-18T12:51:10.512 INFO:tasks.workunit.client.1.smithi136.stdout:1/211: write d2/d5/d9/f10 [4422255,119959] 0 2024-09-18T12:51:10.514 INFO:tasks.workunit.client.1.smithi136.stdout:6/247: creat d8/f5a x:0 0 0 2024-09-18T12:51:10.514 INFO:tasks.workunit.client.1.smithi136.stdout:6/248: chown d8/d9/de/f40 88423 1 2024-09-18T12:51:10.516 INFO:tasks.workunit.client.0.smithi081.stdout:3/72: dwrite d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:10.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/71: dwrite d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:10.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/72: getdents d7/d9/d12 0 2024-09-18T12:51:10.527 INFO:tasks.workunit.client.0.smithi081.stdout:7/55: dwrite d2/fc [0,4194304] 0 2024-09-18T12:51:10.527 INFO:tasks.workunit.client.0.smithi081.stdout:7/56: fsync d2/fd 0 2024-09-18T12:51:10.527 INFO:tasks.workunit.client.0.smithi081.stdout:7/57: creat d2/f12 x:0 0 0 2024-09-18T12:51:10.530 INFO:tasks.workunit.client.1.smithi136.stdout:6/249: dread d8/d9/de/d1c/f38 [0,4194304] 0 2024-09-18T12:51:10.530 INFO:tasks.workunit.client.1.smithi136.stdout:6/250: chown d8/d9/c17 69 1 2024-09-18T12:51:10.531 INFO:tasks.workunit.client.1.smithi136.stdout:6/251: read d8/d9/d3c/f58 [99130,11407] 0 2024-09-18T12:51:10.531 INFO:tasks.workunit.client.1.smithi136.stdout:6/252: fdatasync d8/dc/f14 0 2024-09-18T12:51:10.553 INFO:tasks.workunit.client.0.smithi081.stdout:5/109: dwrite d2/ff [0,4194304] 0 2024-09-18T12:51:10.554 INFO:tasks.workunit.client.0.smithi081.stdout:5/110: write d2/dd/f10 [5233276,44635] 0 2024-09-18T12:51:10.555 INFO:tasks.workunit.client.0.smithi081.stdout:5/111: mkdir d2/d4/d2a 0 2024-09-18T12:51:10.555 INFO:tasks.workunit.client.1.smithi136.stdout:8/363: dwrite d9/d18/f5c [0,4194304] 0 2024-09-18T12:51:10.555 INFO:tasks.workunit.client.1.smithi136.stdout:8/364: write d9/d18/d34/d3d/d47/d65/d6b/f77 [2533197,28389] 0 2024-09-18T12:51:10.558 INFO:tasks.workunit.client.1.smithi136.stdout:8/365: stat d9/d18/l29 0 2024-09-18T12:51:10.558 INFO:tasks.workunit.client.1.smithi136.stdout:8/366: dread - d9/d14/f71 zero size 2024-09-18T12:51:10.558 INFO:tasks.workunit.client.1.smithi136.stdout:8/367: rename d9/d14/d1a to d9/d14/d1a/d7f/d8a 22 2024-09-18T12:51:10.563 INFO:tasks.workunit.client.0.smithi081.stdout:5/112: write d2/dd/f10 [2450782,106929] 0 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.0.smithi081.stdout:5/113: chown d2/d4/ca 214820289 1 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.0.smithi081.stdout:5/114: chown d2/d4/f13 253760968 1 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.0.smithi081.stdout:5/115: dread - d2/dd/f29 zero size 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.0.smithi081.stdout:5/116: stat d2/d4/d2a 0 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.1.smithi136.stdout:1/212: dwrite d2/d5/d11/d1b/f25 [0,4194304] 0 2024-09-18T12:51:10.564 INFO:tasks.workunit.client.1.smithi136.stdout:6/253: dwrite d8/f3b [0,4194304] 0 2024-09-18T12:51:10.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/64: dwrite d0/d6/fe [0,4194304] 0 2024-09-18T12:51:10.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/65: readlink d0/db/l13 0 2024-09-18T12:51:10.565 INFO:tasks.workunit.client.0.smithi081.stdout:5/117: creat d2/d14/d1d/d1a/f2b x:0 0 0 2024-09-18T12:51:10.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/66: creat d0/db/f14 x:0 0 0 2024-09-18T12:51:10.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/67: truncate d0/db/f14 668782 0 2024-09-18T12:51:10.570 INFO:tasks.workunit.client.1.smithi136.stdout:1/213: rename d2/d5/d11/f13 to d2/f41 0 2024-09-18T12:51:10.570 INFO:tasks.workunit.client.0.smithi081.stdout:1/68: creat d0/f15 x:0 0 0 2024-09-18T12:51:10.571 INFO:tasks.workunit.client.0.smithi081.stdout:1/69: truncate d0/ff 147851 0 2024-09-18T12:51:10.571 INFO:tasks.workunit.client.0.smithi081.stdout:7/58: rmdir d2 39 2024-09-18T12:51:10.571 INFO:tasks.workunit.client.1.smithi136.stdout:8/368: dread d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:10.571 INFO:tasks.workunit.client.1.smithi136.stdout:6/254: rename d8/d9/de/d1c/d50/c57 to d8/d9/d3c/d45/c5b 0 2024-09-18T12:51:10.572 INFO:tasks.workunit.client.1.smithi136.stdout:6/255: chown d8/f26 4096 1 2024-09-18T12:51:10.572 INFO:tasks.workunit.client.0.smithi081.stdout:1/70: symlink d0/db/d12/l16 0 2024-09-18T12:51:10.572 INFO:tasks.workunit.client.1.smithi136.stdout:1/214: creat d2/f42 x:0 0 0 2024-09-18T12:51:10.573 INFO:tasks.workunit.client.0.smithi081.stdout:7/59: creat d2/f13 x:0 0 0 2024-09-18T12:51:10.573 INFO:tasks.workunit.client.0.smithi081.stdout:7/60: write d2/f6 [180508,103931] 0 2024-09-18T12:51:10.574 INFO:tasks.workunit.client.1.smithi136.stdout:8/369: mkdir d9/d18/d34/d3d/d8b 0 2024-09-18T12:51:10.575 INFO:tasks.workunit.client.1.smithi136.stdout:8/370: stat d9/d14/fe 0 2024-09-18T12:51:10.579 INFO:tasks.workunit.client.1.smithi136.stdout:8/371: mkdir d9/d14/d1a/d7f/d8c 0 2024-09-18T12:51:10.581 INFO:tasks.workunit.client.1.smithi136.stdout:8/372: dread d9/d14/d1a/d2b/f51 [0,4194304] 0 2024-09-18T12:51:10.581 INFO:tasks.workunit.client.1.smithi136.stdout:8/373: fsync d9/fa 0 2024-09-18T12:51:10.582 INFO:tasks.workunit.client.1.smithi136.stdout:6/256: rmdir d8/d9/de/d1c 39 2024-09-18T12:51:10.583 INFO:tasks.workunit.client.1.smithi136.stdout:1/215: rmdir d2/d5/d9 39 2024-09-18T12:51:10.584 INFO:tasks.workunit.client.1.smithi136.stdout:8/374: mknod d9/d18/d34/d88/c8d 0 2024-09-18T12:51:10.585 INFO:tasks.workunit.client.1.smithi136.stdout:6/257: mknod d8/d9/d56/c5c 0 2024-09-18T12:51:10.586 INFO:tasks.workunit.client.1.smithi136.stdout:1/216: link d2/d1c/l39 d2/d5/l43 0 2024-09-18T12:51:10.587 INFO:tasks.workunit.client.1.smithi136.stdout:8/375: mknod d9/d18/d34/d3d/d47/d65/c8e 0 2024-09-18T12:51:10.587 INFO:tasks.workunit.client.1.smithi136.stdout:8/376: fdatasync d9/d14/d1a/d2b/d42/d6e/f84 0 2024-09-18T12:51:10.588 INFO:tasks.workunit.client.1.smithi136.stdout:1/217: rename d2/d5/d11/d2e/c38 to d2/d5/d2b/c44 0 2024-09-18T12:51:10.588 INFO:tasks.workunit.client.0.smithi081.stdout:7/61: dread f0 [0,4194304] 0 2024-09-18T12:51:10.591 INFO:tasks.workunit.client.0.smithi081.stdout:7/62: unlink d2/fd 0 2024-09-18T12:51:10.591 INFO:tasks.workunit.client.1.smithi136.stdout:1/218: dread d2/d5/d9/d23/f3e [0,4194304] 0 2024-09-18T12:51:10.591 INFO:tasks.workunit.client.1.smithi136.stdout:1/219: truncate d2/d5/d9/d23/f27 381036 0 2024-09-18T12:51:10.592 INFO:tasks.workunit.client.0.smithi081.stdout:7/63: mkdir d2/d14 0 2024-09-18T12:51:10.592 INFO:tasks.workunit.client.1.smithi136.stdout:4/144: sync 2024-09-18T12:51:10.592 INFO:tasks.workunit.client.1.smithi136.stdout:7/404: sync 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.1.smithi136.stdout:5/239: sync 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.1.smithi136.stdout:7/405: readlink d0/d35/d36/d64/l76 0 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/309: sync 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.1.smithi136.stdout:0/267: sync 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.1.smithi136.stdout:9/239: sync 2024-09-18T12:51:10.593 INFO:tasks.workunit.client.0.smithi081.stdout:1/71: dwrite d0/db/f14 [0,4194304] 0 2024-09-18T12:51:10.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/64: symlink d2/d14/l15 0 2024-09-18T12:51:10.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/65: dread - d2/f12 zero size 2024-09-18T12:51:10.594 INFO:tasks.workunit.client.0.smithi081.stdout:0/73: dwrite d7/d9/f11 [4194304,4194304] 0 2024-09-18T12:51:10.595 INFO:tasks.workunit.client.1.smithi136.stdout:5/240: link d5/f31 d5/d1a/d30/f40 0 2024-09-18T12:51:10.595 INFO:tasks.workunit.client.1.smithi136.stdout:5/241: chown d5/d1a/d2d/d34/f2e 79 1 2024-09-18T12:51:10.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/72: rmdir d0/db/d12 39 2024-09-18T12:51:10.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/73: chown d0/db/l13 3 1 2024-09-18T12:51:10.597 INFO:tasks.workunit.client.0.smithi081.stdout:7/66: link d2/ff d2/d14/f16 0 2024-09-18T12:51:10.597 INFO:tasks.workunit.client.1.smithi136.stdout:7/406: unlink d0/d35/d41/d58/f6f 0 2024-09-18T12:51:10.597 INFO:tasks.workunit.client.1.smithi136.stdout:7/407: write d0/d35/f6c [370081,117866] 0 2024-09-18T12:51:10.599 INFO:tasks.workunit.client.0.smithi081.stdout:1/74: dread d0/d6/fd [0,4194304] 0 2024-09-18T12:51:10.600 INFO:tasks.workunit.client.1.smithi136.stdout:0/268: rename d1/d3/d1a/l4e to d1/d17/d2d/l5b 0 2024-09-18T12:51:10.600 INFO:tasks.workunit.client.1.smithi136.stdout:6/258: write d8/f19 [261470,12085] 0 2024-09-18T12:51:10.600 INFO:tasks.workunit.client.1.smithi136.stdout:6/259: truncate d8/dc/f4f 371885 0 2024-09-18T12:51:10.600 INFO:tasks.workunit.client.1.smithi136.stdout:9/240: getdents d6/df/d23/d2b 0 2024-09-18T12:51:10.601 INFO:tasks.workunit.client.1.smithi136.stdout:0/269: creat d1/d3/f5c x:0 0 0 2024-09-18T12:51:10.601 INFO:tasks.workunit.client.1.smithi136.stdout:4/145: mknod d0/c2f 0 2024-09-18T12:51:10.603 INFO:tasks.workunit.client.1.smithi136.stdout:5/242: symlink d5/d1a/d2d/d34/l41 0 2024-09-18T12:51:10.605 INFO:tasks.workunit.client.1.smithi136.stdout:7/408: link d0/d2c/c71 d0/d39/d4d/c8e 0 2024-09-18T12:51:10.605 INFO:tasks.workunit.client.0.smithi081.stdout:0/74: read f0 [2959845,103070] 0 2024-09-18T12:51:10.606 INFO:tasks.workunit.client.0.smithi081.stdout:0/75: mknod d7/d13/c17 0 2024-09-18T12:51:10.608 INFO:tasks.workunit.client.1.smithi136.stdout:9/241: creat d6/db/d49/d53/f54 x:0 0 0 2024-09-18T12:51:10.608 INFO:tasks.workunit.client.1.smithi136.stdout:9/242: write d6/db/d49/d53/f54 [737517,18508] 0 2024-09-18T12:51:10.608 INFO:tasks.workunit.client.1.smithi136.stdout:9/243: write d6/d13/d15/f16 [171900,36533] 0 2024-09-18T12:51:10.608 INFO:tasks.workunit.client.1.smithi136.stdout:0/270: symlink d1/d17/d2d/d35/l5d 0 2024-09-18T12:51:10.609 INFO:tasks.workunit.client.0.smithi081.stdout:0/76: symlink d7/d9/d12/l18 0 2024-09-18T12:51:10.609 INFO:tasks.workunit.client.0.smithi081.stdout:0/77: mknod d7/c19 0 2024-09-18T12:51:10.609 INFO:tasks.workunit.client.0.smithi081.stdout:0/78: creat d7/d13/f1a x:0 0 0 2024-09-18T12:51:10.609 INFO:tasks.workunit.client.0.smithi081.stdout:0/79: creat d7/d13/f1b x:0 0 0 2024-09-18T12:51:10.612 INFO:tasks.workunit.client.1.smithi136.stdout:4/146: symlink d0/d25/l30 0 2024-09-18T12:51:10.613 INFO:tasks.workunit.client.0.smithi081.stdout:0/80: link d7/c14 d7/d13/c1c 0 2024-09-18T12:51:10.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/81: mknod d7/d13/c1d 0 2024-09-18T12:51:10.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/82: readlink d7/d9/d12/l18 0 2024-09-18T12:51:10.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/83: creat d7/d13/f1e x:0 0 0 2024-09-18T12:51:10.614 INFO:tasks.workunit.client.1.smithi136.stdout:7/409: rename d0/d39/d4d/l54 to d0/d35/d41/d50/d7f/d3c/l8f 0 2024-09-18T12:51:10.616 INFO:tasks.workunit.client.0.smithi081.stdout:0/84: symlink d7/d9/d12/l1f 0 2024-09-18T12:51:10.616 INFO:tasks.workunit.client.1.smithi136.stdout:5/243: dread d5/d1a/f3a [4194304,4194304] 0 2024-09-18T12:51:10.616 INFO:tasks.workunit.client.1.smithi136.stdout:6/260: rmdir d8/d9/de 39 2024-09-18T12:51:10.616 INFO:tasks.workunit.client.1.smithi136.stdout:6/261: stat d8/d9/d3c/f58 0 2024-09-18T12:51:10.617 INFO:tasks.workunit.client.1.smithi136.stdout:6/262: readlink d8/d9/d3c/l44 0 2024-09-18T12:51:10.617 INFO:tasks.workunit.client.1.smithi136.stdout:6/263: chown d8/d9/de/f16 437 1 2024-09-18T12:51:10.617 INFO:tasks.workunit.client.1.smithi136.stdout:0/271: fdatasync d1/fe 0 2024-09-18T12:51:10.617 INFO:tasks.workunit.client.0.smithi081.stdout:0/85: link d7/ce d7/c20 0 2024-09-18T12:51:10.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/86: creat d7/f21 x:0 0 0 2024-09-18T12:51:10.620 INFO:tasks.workunit.client.1.smithi136.stdout:2/310: dwrite d5/d25/f36 [0,4194304] 0 2024-09-18T12:51:10.620 INFO:tasks.workunit.client.1.smithi136.stdout:7/410: unlink d0/d35/d36/f25 0 2024-09-18T12:51:10.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/87: unlink d7/d13/c1d 0 2024-09-18T12:51:10.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/88: creat d7/f22 x:0 0 0 2024-09-18T12:51:10.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/89: creat d7/d9/f23 x:0 0 0 2024-09-18T12:51:10.623 INFO:tasks.workunit.client.1.smithi136.stdout:6/264: mknod d8/d9/d3c/d45/c5d 0 2024-09-18T12:51:10.624 INFO:tasks.workunit.client.1.smithi136.stdout:0/272: write d1/f31 [1768615,75609] 0 2024-09-18T12:51:10.628 INFO:tasks.workunit.client.1.smithi136.stdout:2/311: symlink d5/d7/d17/l61 0 2024-09-18T12:51:10.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/411: creat d0/d35/d41/d50/d7b/f90 x:0 0 0 2024-09-18T12:51:10.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/412: fdatasync d0/d35/d41/f5c 0 2024-09-18T12:51:10.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/413: chown d0/d12/d1a/d46/l52 84297753 1 2024-09-18T12:51:10.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/414: read - d0/d35/d41/d50/d7b/f90 zero size 2024-09-18T12:51:10.632 INFO:tasks.workunit.client.1.smithi136.stdout:6/265: creat d8/d9/de/d1c/f5e x:0 0 0 2024-09-18T12:51:10.632 INFO:tasks.workunit.client.1.smithi136.stdout:6/266: creat d8/d9/de/d1c/f5f x:0 0 0 2024-09-18T12:51:10.633 INFO:tasks.workunit.client.1.smithi136.stdout:0/273: stat d1/db 0 2024-09-18T12:51:10.635 INFO:tasks.workunit.client.1.smithi136.stdout:7/415: mkdir d0/d35/d4f/d91 0 2024-09-18T12:51:10.635 INFO:tasks.workunit.client.1.smithi136.stdout:7/416: chown d0/d39/d4d/d69/f6e 3 1 2024-09-18T12:51:10.637 INFO:tasks.workunit.client.1.smithi136.stdout:0/274: link d1/d17/f45 d1/d17/d2d/d35/d54/f5e 0 2024-09-18T12:51:10.637 INFO:tasks.workunit.client.1.smithi136.stdout:1/220: dwrite d2/d5/d9/d23/f2c [0,4194304] 0 2024-09-18T12:51:10.638 INFO:tasks.workunit.client.1.smithi136.stdout:9/244: dread d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:10.640 INFO:tasks.workunit.client.0.smithi081.stdout:0/90: write d7/d9/f11 [3491414,108888] 0 2024-09-18T12:51:10.641 INFO:tasks.workunit.client.0.smithi081.stdout:1/75: dwrite d0/ff [0,4194304] 0 2024-09-18T12:51:10.641 INFO:tasks.workunit.client.0.smithi081.stdout:0/91: write d7/d9/f23 [555369,89392] 0 2024-09-18T12:51:10.644 INFO:tasks.workunit.client.1.smithi136.stdout:6/267: mkdir d8/d9/de/d60 0 2024-09-18T12:51:10.646 INFO:tasks.workunit.client.1.smithi136.stdout:4/147: dwrite d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:10.646 INFO:tasks.workunit.client.1.smithi136.stdout:0/275: creat d1/d17/d2d/d35/d54/f5f x:0 0 0 2024-09-18T12:51:10.646 INFO:tasks.workunit.client.1.smithi136.stdout:0/276: chown d1/d3/d1a/f20 73 1 2024-09-18T12:51:10.647 INFO:tasks.workunit.client.1.smithi136.stdout:5/244: dwrite d5/d1a/f3a [4194304,4194304] 0 2024-09-18T12:51:10.647 INFO:tasks.workunit.client.1.smithi136.stdout:2/312: rmdir d5/d7 39 2024-09-18T12:51:10.651 INFO:tasks.workunit.client.1.smithi136.stdout:5/245: creat d5/d1a/d2d/d34/f42 x:0 0 0 2024-09-18T12:51:10.652 INFO:tasks.workunit.client.1.smithi136.stdout:1/221: getdents d2/d5/d11/d2e 0 2024-09-18T12:51:10.652 INFO:tasks.workunit.client.1.smithi136.stdout:1/222: write d2/d5/d9/f1a [1352806,38812] 0 2024-09-18T12:51:10.652 INFO:tasks.workunit.client.1.smithi136.stdout:1/223: fsync d2/f41 0 2024-09-18T12:51:10.656 INFO:tasks.workunit.client.0.smithi081.stdout:0/92: getdents d7 0 2024-09-18T12:51:10.657 INFO:tasks.workunit.client.1.smithi136.stdout:7/417: dread d0/d35/d41/d50/d7f/f42 [0,4194304] 0 2024-09-18T12:51:10.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/93: link d7/d9/f10 d7/d13/f24 0 2024-09-18T12:51:10.659 INFO:tasks.workunit.client.0.smithi081.stdout:1/76: dread d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:10.659 INFO:tasks.workunit.client.1.smithi136.stdout:7/418: creat d0/d39/d4d/f92 x:0 0 0 2024-09-18T12:51:10.660 INFO:tasks.workunit.client.1.smithi136.stdout:7/419: chown d0/d35/d36/cd 0 1 2024-09-18T12:51:10.661 INFO:tasks.workunit.client.0.smithi081.stdout:1/77: link d0/ff d0/d6/f17 0 2024-09-18T12:51:10.661 INFO:tasks.workunit.client.0.smithi081.stdout:1/78: truncate d0/d6/d7/d8/f11 123815 0 2024-09-18T12:51:10.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/79: mkdir d0/d18 0 2024-09-18T12:51:10.663 INFO:tasks.workunit.client.0.smithi081.stdout:7/67: dwrite d2/f13 [0,4194304] 0 2024-09-18T12:51:10.663 INFO:tasks.workunit.client.1.smithi136.stdout:4/148: dread d0/d25/f2d [0,4194304] 0 2024-09-18T12:51:10.667 INFO:tasks.workunit.client.0.smithi081.stdout:1/80: getdents d0/d6/d7 0 2024-09-18T12:51:10.668 INFO:tasks.workunit.client.1.smithi136.stdout:4/149: link d0/l27 d0/d13/l31 0 2024-09-18T12:51:10.669 INFO:tasks.workunit.client.0.smithi081.stdout:7/68: getdents d2 0 2024-09-18T12:51:10.670 INFO:tasks.workunit.client.1.smithi136.stdout:4/150: truncate d0/d25/f2d 2204261 0 2024-09-18T12:51:10.670 INFO:tasks.workunit.client.0.smithi081.stdout:1/81: symlink d0/d6/d7/l19 0 2024-09-18T12:51:10.671 INFO:tasks.workunit.client.1.smithi136.stdout:5/246: read d5/d1a/f3a [4876410,56468] 0 2024-09-18T12:51:10.671 INFO:tasks.workunit.client.0.smithi081.stdout:7/69: symlink d2/l17 0 2024-09-18T12:51:10.671 INFO:tasks.workunit.client.1.smithi136.stdout:7/420: dread d0/d12/d1a/f3e [0,4194304] 0 2024-09-18T12:51:10.672 INFO:tasks.workunit.client.0.smithi081.stdout:1/82: mkdir d0/d18/d1a 0 2024-09-18T12:51:10.672 INFO:tasks.workunit.client.0.smithi081.stdout:1/83: chown d0/d6/d7/l19 5716735 1 2024-09-18T12:51:10.674 INFO:tasks.workunit.client.0.smithi081.stdout:1/84: creat d0/d6/f1b x:0 0 0 2024-09-18T12:51:10.674 INFO:tasks.workunit.client.0.smithi081.stdout:1/85: chown d0/d6/d7/l19 251851217 1 2024-09-18T12:51:10.675 INFO:tasks.workunit.client.1.smithi136.stdout:5/247: rename d5/fa to d5/d1a/f43 0 2024-09-18T12:51:10.675 INFO:tasks.workunit.client.1.smithi136.stdout:5/248: chown d5/d1a/f27 49113102 1 2024-09-18T12:51:10.675 INFO:tasks.workunit.client.1.smithi136.stdout:5/249: truncate d5/f23 8928984 0 2024-09-18T12:51:10.676 INFO:tasks.workunit.client.0.smithi081.stdout:7/70: unlink d2/f7 0 2024-09-18T12:51:10.677 INFO:tasks.workunit.client.1.smithi136.stdout:7/421: mknod d0/d35/d41/d50/d7b/c93 0 2024-09-18T12:51:10.677 INFO:tasks.workunit.client.1.smithi136.stdout:7/422: chown d0/d35/d4f/d91 72977 1 2024-09-18T12:51:10.677 INFO:tasks.workunit.client.1.smithi136.stdout:9/245: dwrite d6/d13/d4c/f50 [0,4194304] 0 2024-09-18T12:51:10.678 INFO:tasks.workunit.client.0.smithi081.stdout:1/86: creat d0/d18/f1c x:0 0 0 2024-09-18T12:51:10.678 INFO:tasks.workunit.client.0.smithi081.stdout:1/87: truncate d0/f15 273990 0 2024-09-18T12:51:10.678 INFO:tasks.workunit.client.0.smithi081.stdout:1/88: fdatasync d0/db/f14 0 2024-09-18T12:51:10.678 INFO:tasks.workunit.client.0.smithi081.stdout:1/89: write d0/d6/f17 [5092269,48621] 0 2024-09-18T12:51:10.679 INFO:tasks.workunit.client.0.smithi081.stdout:1/90: mknod d0/d18/c1d 0 2024-09-18T12:51:10.679 INFO:tasks.workunit.client.1.smithi136.stdout:5/250: mknod d5/d1a/c44 0 2024-09-18T12:51:10.679 INFO:tasks.workunit.client.1.smithi136.stdout:5/251: write d5/d1a/f27 [4442747,39788] 0 2024-09-18T12:51:10.679 INFO:tasks.workunit.client.1.smithi136.stdout:5/252: chown d5/d1a/d2d/d34/c36 30273468 1 2024-09-18T12:51:10.680 INFO:tasks.workunit.client.1.smithi136.stdout:7/423: mkdir d0/d35/d41/d50/d7f/d3c/d94 0 2024-09-18T12:51:10.680 INFO:tasks.workunit.client.0.smithi081.stdout:7/71: mkdir d2/d18 0 2024-09-18T12:51:10.680 INFO:tasks.workunit.client.0.smithi081.stdout:7/72: readlink d2/l17 0 2024-09-18T12:51:10.680 INFO:tasks.workunit.client.1.smithi136.stdout:6/268: dwrite d8/d9/de/f4c [0,4194304] 0 2024-09-18T12:51:10.681 INFO:tasks.workunit.client.0.smithi081.stdout:1/91: rename d0/db/d12/l16 to d0/db/d12/l1e 0 2024-09-18T12:51:10.682 INFO:tasks.workunit.client.0.smithi081.stdout:7/73: chown d2/d14/f16 379454018 1 2024-09-18T12:51:10.683 INFO:tasks.workunit.client.1.smithi136.stdout:7/424: getdents d0/d12/d1a/d46 0 2024-09-18T12:51:10.684 INFO:tasks.workunit.client.0.smithi081.stdout:1/92: mkdir d0/d18/d1a/d1f 0 2024-09-18T12:51:10.684 INFO:tasks.workunit.client.0.smithi081.stdout:1/93: read - d0/d6/f1b zero size 2024-09-18T12:51:10.686 INFO:tasks.workunit.client.1.smithi136.stdout:6/269: symlink d8/d9/d3c/l61 0 2024-09-18T12:51:10.687 INFO:tasks.workunit.client.1.smithi136.stdout:6/270: creat d8/d9/d3c/f62 x:0 0 0 2024-09-18T12:51:10.687 INFO:tasks.workunit.client.1.smithi136.stdout:6/271: readlink d8/d9/d3c/d4a/l4b 0 2024-09-18T12:51:10.688 INFO:tasks.workunit.client.1.smithi136.stdout:7/425: mkdir d0/d35/d36/d7c/d8a/d95 0 2024-09-18T12:51:10.688 INFO:tasks.workunit.client.1.smithi136.stdout:7/426: chown d0/d2c 895 1 2024-09-18T12:51:10.690 INFO:tasks.workunit.client.0.smithi081.stdout:0/94: dwrite d7/d13/f16 [0,4194304] 0 2024-09-18T12:51:10.690 INFO:tasks.workunit.client.0.smithi081.stdout:0/95: stat l1 0 2024-09-18T12:51:10.691 INFO:tasks.workunit.client.1.smithi136.stdout:9/246: dread d6/df/f3b [0,4194304] 0 2024-09-18T12:51:10.691 INFO:tasks.workunit.client.1.smithi136.stdout:9/247: read - d6/d13/d15/d25/f39 zero size 2024-09-18T12:51:10.692 INFO:tasks.workunit.client.1.smithi136.stdout:6/272: unlink d8/d9/de/f4c 0 2024-09-18T12:51:10.692 INFO:tasks.workunit.client.1.smithi136.stdout:6/273: stat d8/d9/c32 0 2024-09-18T12:51:10.694 INFO:tasks.workunit.client.1.smithi136.stdout:9/248: mkdir d6/d13/d15/d25/d55 0 2024-09-18T12:51:10.694 INFO:tasks.workunit.client.1.smithi136.stdout:9/249: dread - d6/df/d23/d2b/f43 zero size 2024-09-18T12:51:10.695 INFO:tasks.workunit.client.1.smithi136.stdout:9/250: getdents d6/d13/d15/d25/d55 0 2024-09-18T12:51:10.695 INFO:tasks.workunit.client.1.smithi136.stdout:9/251: fdatasync d6/d13/d15/d25/f39 0 2024-09-18T12:51:10.695 INFO:tasks.workunit.client.1.smithi136.stdout:6/274: symlink d8/d9/d3c/d4a/l63 0 2024-09-18T12:51:10.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/33: sync 2024-09-18T12:51:10.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/34: truncate f9 335240 0 2024-09-18T12:51:10.696 INFO:tasks.workunit.client.1.smithi136.stdout:4/151: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:51:10.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/35: readlink l1 0 2024-09-18T12:51:10.697 INFO:tasks.workunit.client.1.smithi136.stdout:2/313: dwrite d5/d7/d17/f24 [0,4194304] 0 2024-09-18T12:51:10.697 INFO:tasks.workunit.client.1.smithi136.stdout:0/277: dwrite d1/f2c [0,4194304] 0 2024-09-18T12:51:10.697 INFO:tasks.workunit.client.0.smithi081.stdout:2/36: creat fa x:0 0 0 2024-09-18T12:51:10.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/37: readlink l2 0 2024-09-18T12:51:10.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/38: chown f9 1 1 2024-09-18T12:51:10.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/39: dread - f7 zero size 2024-09-18T12:51:10.699 INFO:tasks.workunit.client.0.smithi081.stdout:2/40: dread f9 [0,4194304] 0 2024-09-18T12:51:10.700 INFO:tasks.workunit.client.0.smithi081.stdout:2/41: rmdir - no directory 2024-09-18T12:51:10.700 INFO:tasks.workunit.client.0.smithi081.stdout:2/42: stat l1 0 2024-09-18T12:51:10.703 INFO:tasks.workunit.client.0.smithi081.stdout:2/43: unlink l5 0 2024-09-18T12:51:10.703 INFO:tasks.workunit.client.0.smithi081.stdout:2/44: chown f7 61071835 1 2024-09-18T12:51:10.704 INFO:tasks.workunit.client.1.smithi136.stdout:2/314: creat d5/d25/f62 x:0 0 0 2024-09-18T12:51:10.704 INFO:tasks.workunit.client.1.smithi136.stdout:2/315: truncate d5/d7/f55 856 0 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/96: write d7/d9/f11 [7121585,93150] 0 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/97: creat d7/d9/f25 x:0 0 0 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/98: write d7/d9/f23 [1449598,103020] 0 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/99: dread - d7/f21 zero size 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/100: chown d7/l8 18 1 2024-09-18T12:51:10.705 INFO:tasks.workunit.client.1.smithi136.stdout:9/252: dread d6/d13/d15/f16 [0,4194304] 0 2024-09-18T12:51:10.709 INFO:tasks.workunit.client.0.smithi081.stdout:0/101: unlink d7/d9/ca 0 2024-09-18T12:51:10.709 INFO:tasks.workunit.client.1.smithi136.stdout:4/152: dread d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:10.709 INFO:tasks.workunit.client.1.smithi136.stdout:4/153: fdatasync d0/d2/f23 0 2024-09-18T12:51:10.711 INFO:tasks.workunit.client.1.smithi136.stdout:7/427: rename d0/d35/d36/d7c/d8a to d0/d35/d41/d58/d96 0 2024-09-18T12:51:10.711 INFO:tasks.workunit.client.0.smithi081.stdout:1/94: truncate d0/ff 1508292 0 2024-09-18T12:51:10.711 INFO:tasks.workunit.client.0.smithi081.stdout:1/95: write d0/f2 [1925096,62501] 0 2024-09-18T12:51:10.711 INFO:tasks.workunit.client.0.smithi081.stdout:1/96: creat d0/f20 x:0 0 0 2024-09-18T12:51:10.714 INFO:tasks.workunit.client.1.smithi136.stdout:0/278: mkdir d1/d60 0 2024-09-18T12:51:10.714 INFO:tasks.workunit.client.1.smithi136.stdout:0/279: dread - d1/d17/d2d/d35/f49 zero size 2024-09-18T12:51:10.715 INFO:tasks.workunit.client.1.smithi136.stdout:9/253: mkdir d6/db/d12/d56 0 2024-09-18T12:51:10.716 INFO:tasks.workunit.client.1.smithi136.stdout:9/254: write d6/f2d [29888,26137] 0 2024-09-18T12:51:10.716 INFO:tasks.workunit.client.1.smithi136.stdout:9/255: truncate d6/da/fd 5786484 0 2024-09-18T12:51:10.716 INFO:tasks.workunit.client.1.smithi136.stdout:9/256: dread - d6/d13/d15/d25/d29/f35 zero size 2024-09-18T12:51:10.717 INFO:tasks.workunit.client.1.smithi136.stdout:4/154: link d0/d2/c6 d0/d13/c32 0 2024-09-18T12:51:10.717 INFO:tasks.workunit.client.1.smithi136.stdout:4/155: write d0/d2/f28 [377170,50104] 0 2024-09-18T12:51:10.718 INFO:tasks.workunit.client.1.smithi136.stdout:7/428: mknod d0/d35/d41/c97 0 2024-09-18T12:51:10.718 INFO:tasks.workunit.client.1.smithi136.stdout:5/253: dwrite d5/f2a [0,4194304] 0 2024-09-18T12:51:10.719 INFO:tasks.workunit.client.1.smithi136.stdout:9/257: creat d6/d13/d15/d25/f57 x:0 0 0 2024-09-18T12:51:10.720 INFO:tasks.workunit.client.0.smithi081.stdout:2/45: fsync fa 0 2024-09-18T12:51:10.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/46: write f7 [807496,87136] 0 2024-09-18T12:51:10.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/47: write f9 [467599,63655] 0 2024-09-18T12:51:10.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/48: fdatasync fa 0 2024-09-18T12:51:10.722 INFO:tasks.workunit.client.0.smithi081.stdout:0/102: dread f0 [8388608,4194304] 0 2024-09-18T12:51:10.723 INFO:tasks.workunit.client.0.smithi081.stdout:7/74: dwrite d2/f12 [0,4194304] 0 2024-09-18T12:51:10.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/49: unlink c6 0 2024-09-18T12:51:10.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/50: chown l1 0 1 2024-09-18T12:51:10.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/51: dread - fa zero size 2024-09-18T12:51:10.724 INFO:tasks.workunit.client.1.smithi136.stdout:4/156: write d0/d25/f2d [772840,36228] 0 2024-09-18T12:51:10.725 INFO:tasks.workunit.client.1.smithi136.stdout:2/316: dread d5/d7/f3f [0,4194304] 0 2024-09-18T12:51:10.729 INFO:tasks.workunit.client.0.smithi081.stdout:7/75: mknod d2/d14/c19 0 2024-09-18T12:51:10.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/52: chown l4 216867103 1 2024-09-18T12:51:10.730 INFO:tasks.workunit.client.1.smithi136.stdout:7/429: write d0/f29 [1082712,119295] 0 2024-09-18T12:51:10.730 INFO:tasks.workunit.client.1.smithi136.stdout:3/259: sync 2024-09-18T12:51:10.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/103: rmdir d7/d9 39 2024-09-18T12:51:10.731 INFO:tasks.workunit.client.0.smithi081.stdout:0/104: chown d7/c19 7743 1 2024-09-18T12:51:10.733 INFO:tasks.workunit.client.0.smithi081.stdout:2/53: creat fb x:0 0 0 2024-09-18T12:51:10.733 INFO:tasks.workunit.client.0.smithi081.stdout:2/54: dread - fb zero size 2024-09-18T12:51:10.734 INFO:tasks.workunit.client.0.smithi081.stdout:0/105: creat d7/d9/d12/f26 x:0 0 0 2024-09-18T12:51:10.737 INFO:tasks.workunit.client.1.smithi136.stdout:0/280: dwrite d1/d17/d2d/d51/f57 [0,4194304] 0 2024-09-18T12:51:10.737 INFO:tasks.workunit.client.1.smithi136.stdout:0/281: fsync d1/d17/d2d/d35/f40 0 2024-09-18T12:51:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:2/55: creat fc x:0 0 0 2024-09-18T12:51:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:2/56: stat l1 0 2024-09-18T12:51:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:0/106: mknod d7/d9/c27 0 2024-09-18T12:51:10.741 INFO:tasks.workunit.client.1.smithi136.stdout:7/430: dread d0/d35/d36/f22 [0,4194304] 0 2024-09-18T12:51:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/57: unlink fa 0 2024-09-18T12:51:10.744 INFO:tasks.workunit.client.1.smithi136.stdout:5/254: dwrite f2 [0,4194304] 0 2024-09-18T12:51:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:7/76: getdents d2/d14 0 2024-09-18T12:51:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:7/77: chown f0 65406044 1 2024-09-18T12:51:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:0/107: write f0 [10323935,32449] 0 2024-09-18T12:51:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:0/108: read - d7/d13/f1b zero size 2024-09-18T12:51:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:7/78: readlink d2/l5 0 2024-09-18T12:51:10.746 INFO:tasks.workunit.client.1.smithi136.stdout:5/255: truncate d5/d1a/f27 2721925 0 2024-09-18T12:51:10.746 INFO:tasks.workunit.client.1.smithi136.stdout:5/256: chown d5/l19 335442086 1 2024-09-18T12:51:10.746 INFO:tasks.workunit.client.1.smithi136.stdout:5/257: dread - d5/f1c zero size 2024-09-18T12:51:10.746 INFO:tasks.workunit.client.1.smithi136.stdout:5/258: creat d5/d1a/d2d/d34/f45 x:0 0 0 2024-09-18T12:51:10.746 INFO:tasks.workunit.client.1.smithi136.stdout:5/259: chown d5/ff 342756 1 2024-09-18T12:51:10.747 INFO:tasks.workunit.client.1.smithi136.stdout:5/260: fsync d5/d1a/d2d/d34/f33 0 2024-09-18T12:51:10.747 INFO:tasks.workunit.client.1.smithi136.stdout:3/260: write d3/d14/d22/f37 [3512512,29405] 0 2024-09-18T12:51:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:7/79: symlink d2/l1a 0 2024-09-18T12:51:10.750 INFO:tasks.workunit.client.1.smithi136.stdout:3/261: mknod d3/d10/d4a/c55 0 2024-09-18T12:51:10.751 INFO:tasks.workunit.client.0.smithi081.stdout:7/80: mkdir d2/d1b 0 2024-09-18T12:51:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:7/81: creat d2/d18/f1c x:0 0 0 2024-09-18T12:51:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:7/82: chown d2/d1b 578 1 2024-09-18T12:51:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:7/83: dread - d2/d14/f16 zero size 2024-09-18T12:51:10.754 INFO:tasks.workunit.client.1.smithi136.stdout:5/261: dread d5/f11 [0,4194304] 0 2024-09-18T12:51:10.754 INFO:tasks.workunit.client.1.smithi136.stdout:0/282: dwrite d1/d17/d2d/d35/d54/f5e [0,4194304] 0 2024-09-18T12:51:10.754 INFO:tasks.workunit.client.1.smithi136.stdout:3/262: link d3/d10/f43 d3/d14/d17/d1a/f56 0 2024-09-18T12:51:10.754 INFO:tasks.workunit.client.1.smithi136.stdout:9/258: dwrite d6/d13/d4c/f50 [0,4194304] 0 2024-09-18T12:51:10.755 INFO:tasks.workunit.client.1.smithi136.stdout:5/262: mknod d5/d1a/d2d/d3f/c46 0 2024-09-18T12:51:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:0/109: dread d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:0/110: chown d7/d9/f25 62945999 1 2024-09-18T12:51:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:0/111: symlink d7/d13/l28 0 2024-09-18T12:51:10.758 INFO:tasks.workunit.client.1.smithi136.stdout:0/283: mkdir d1/d60/d61 0 2024-09-18T12:51:10.761 INFO:tasks.workunit.client.1.smithi136.stdout:9/259: mknod d6/d13/d4c/c58 0 2024-09-18T12:51:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/58: write f9 [1415393,50614] 0 2024-09-18T12:51:10.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/284: unlink d1/f2c 0 2024-09-18T12:51:10.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/285: fdatasync d1/d3/f58 0 2024-09-18T12:51:10.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/286: fdatasync d1/d17/f2b 0 2024-09-18T12:51:10.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/287: readlink d1/d17/d2d/d35/l5d 0 2024-09-18T12:51:10.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/288: write d1/d17/d2d/d35/f4a [923639,26530] 0 2024-09-18T12:51:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:0/112: getdents d7/d9/d12 0 2024-09-18T12:51:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:0/113: creat d7/d13/f29 x:0 0 0 2024-09-18T12:51:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:2/59: write fb [821811,91391] 0 2024-09-18T12:51:10.766 INFO:tasks.workunit.client.1.smithi136.stdout:5/263: dread f2 [0,4194304] 0 2024-09-18T12:51:10.768 INFO:tasks.workunit.client.1.smithi136.stdout:5/264: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:10.768 INFO:tasks.workunit.client.1.smithi136.stdout:9/260: rename d6/d13/d15/d25/d29 to d6/d59 0 2024-09-18T12:51:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/114: mknod d7/d9/c2a 0 2024-09-18T12:51:10.772 INFO:tasks.workunit.client.1.smithi136.stdout:7/431: dwrite d0/d35/d41/d50/d5a/f86 [0,4194304] 0 2024-09-18T12:51:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:0/115: rmdir d7 39 2024-09-18T12:51:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:0/116: dread - d7/d13/f1b zero size 2024-09-18T12:51:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:7/84: read d2/f13 [2630264,76865] 0 2024-09-18T12:51:10.774 INFO:tasks.workunit.client.1.smithi136.stdout:9/261: creat d6/da/d3d/d4d/f5a x:0 0 0 2024-09-18T12:51:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/60: creat fd x:0 0 0 2024-09-18T12:51:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:0/117: mkdir d7/d9/d12/d2b 0 2024-09-18T12:51:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:0/118: stat d7/d9/c2a 0 2024-09-18T12:51:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:0/119: dread - d7/d13/f1a zero size 2024-09-18T12:51:10.779 INFO:tasks.workunit.client.1.smithi136.stdout:7/432: mkdir d0/d35/d41/d50/d5a/d98 0 2024-09-18T12:51:10.779 INFO:tasks.workunit.client.1.smithi136.stdout:7/433: write d0/d35/d4f/f82 [574983,62338] 0 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/61: creat fe x:0 0 0 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/62: chown fe 52569878 1 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.1.smithi136.stdout:3/263: dwrite d3/d14/f3a [4194304,4194304] 0 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.1.smithi136.stdout:4/157: dwrite d0/d25/f2d [0,4194304] 0 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.1.smithi136.stdout:0/289: getdents d1/d17/d2d/d35/d54 0 2024-09-18T12:51:10.780 INFO:tasks.workunit.client.1.smithi136.stdout:0/290: readlink d1/d3/d1a/l52 0 2024-09-18T12:51:10.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/120: symlink d7/l2c 0 2024-09-18T12:51:10.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/121: stat d7/d9/f11 0 2024-09-18T12:51:10.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/122: truncate d7/d13/f1e 851212 0 2024-09-18T12:51:10.783 INFO:tasks.workunit.client.1.smithi136.stdout:3/264: mknod d3/d10/d4a/d51/c57 0 2024-09-18T12:51:10.783 INFO:tasks.workunit.client.0.smithi081.stdout:7/85: mkdir d2/d1d 0 2024-09-18T12:51:10.785 INFO:tasks.workunit.client.1.smithi136.stdout:4/158: chown d0/l2a 14558436 1 2024-09-18T12:51:10.785 INFO:tasks.workunit.client.1.smithi136.stdout:0/291: rmdir d1/d17/d2d/d51 39 2024-09-18T12:51:10.786 INFO:tasks.workunit.client.0.smithi081.stdout:7/86: rename d2/ff to d2/d18/f1e 0 2024-09-18T12:51:10.786 INFO:tasks.workunit.client.0.smithi081.stdout:7/87: creat d2/d18/f1f x:0 0 0 2024-09-18T12:51:10.787 INFO:tasks.workunit.client.1.smithi136.stdout:3/265: dread d3/d14/d22/f42 [0,4194304] 0 2024-09-18T12:51:10.788 INFO:tasks.workunit.client.1.smithi136.stdout:3/266: write d3/d14/d22/f1f [4267780,116278] 0 2024-09-18T12:51:10.788 INFO:tasks.workunit.client.1.smithi136.stdout:3/267: chown d3/d10/d4a 3501 1 2024-09-18T12:51:10.788 INFO:tasks.workunit.client.1.smithi136.stdout:7/434: write d0/d35/d41/f5c [627738,51311] 0 2024-09-18T12:51:10.789 INFO:tasks.workunit.client.1.smithi136.stdout:7/435: write d0/d2c/f45 [3275150,15357] 0 2024-09-18T12:51:10.789 INFO:tasks.workunit.client.0.smithi081.stdout:7/88: truncate f0 2212902 0 2024-09-18T12:51:10.789 INFO:tasks.workunit.client.0.smithi081.stdout:7/89: chown f0 1228226 1 2024-09-18T12:51:10.789 INFO:tasks.workunit.client.0.smithi081.stdout:7/90: write d2/d18/f1e [887874,102298] 0 2024-09-18T12:51:10.789 INFO:tasks.workunit.client.1.smithi136.stdout:3/268: dread d3/d14/d22/f42 [0,4194304] 0 2024-09-18T12:51:10.793 INFO:tasks.workunit.client.1.smithi136.stdout:7/436: link d0/d12/d1a/d46/l57 d0/d2c/d85/l99 0 2024-09-18T12:51:10.793 INFO:tasks.workunit.client.1.smithi136.stdout:7/437: write d0/d39/d4d/d69/f88 [556884,30105] 0 2024-09-18T12:51:10.794 INFO:tasks.workunit.client.1.smithi136.stdout:7/438: mkdir d0/d39/d4d/d9a 0 2024-09-18T12:51:10.799 INFO:tasks.workunit.client.1.smithi136.stdout:4/159: dread d0/d13/f18 [0,4194304] 0 2024-09-18T12:51:10.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/91: dread d2/fc [0,4194304] 0 2024-09-18T12:51:10.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/92: creat d2/d18/f20 x:0 0 0 2024-09-18T12:51:10.803 INFO:tasks.workunit.client.1.smithi136.stdout:5/265: dwrite f2 [4194304,4194304] 0 2024-09-18T12:51:10.804 INFO:tasks.workunit.client.0.smithi081.stdout:2/63: chown l4 3 1 2024-09-18T12:51:10.805 INFO:tasks.workunit.client.0.smithi081.stdout:7/93: mkdir d2/d14/d21 0 2024-09-18T12:51:10.805 INFO:tasks.workunit.client.0.smithi081.stdout:7/94: readlink d2/l1a 0 2024-09-18T12:51:10.806 INFO:tasks.workunit.client.1.smithi136.stdout:3/269: dread d3/f34 [0,4194304] 0 2024-09-18T12:51:10.806 INFO:tasks.workunit.client.1.smithi136.stdout:3/270: fdatasync d3/d5/d3c/f4c 0 2024-09-18T12:51:10.806 INFO:tasks.workunit.client.1.smithi136.stdout:3/271: readlink d3/l29 0 2024-09-18T12:51:10.806 INFO:tasks.workunit.client.1.smithi136.stdout:3/272: stat d3/d14/d18/l44 0 2024-09-18T12:51:10.806 INFO:tasks.workunit.client.1.smithi136.stdout:5/266: rename l4 to d5/d1a/d30/l47 0 2024-09-18T12:51:10.810 INFO:tasks.workunit.client.1.smithi136.stdout:9/262: dwrite d6/f42 [0,4194304] 0 2024-09-18T12:51:10.810 INFO:tasks.workunit.client.0.smithi081.stdout:2/64: read fb [741908,38037] 0 2024-09-18T12:51:10.812 INFO:tasks.workunit.client.0.smithi081.stdout:2/65: fdatasync fc 0 2024-09-18T12:51:10.812 INFO:tasks.workunit.client.1.smithi136.stdout:5/267: link d5/f1c d5/d1a/d30/f48 0 2024-09-18T12:51:10.814 INFO:tasks.workunit.client.0.smithi081.stdout:2/66: symlink lf 0 2024-09-18T12:51:10.814 INFO:tasks.workunit.client.0.smithi081.stdout:2/67: write fc [14164,22906] 0 2024-09-18T12:51:10.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/160: dread d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:10.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/161: dread - d0/d2/f17 zero size 2024-09-18T12:51:10.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/162: chown d0/d13/l1f 2946216 1 2024-09-18T12:51:10.815 INFO:tasks.workunit.client.1.smithi136.stdout:3/273: getdents d3/d5 0 2024-09-18T12:51:10.815 INFO:tasks.workunit.client.0.smithi081.stdout:2/68: symlink l10 0 2024-09-18T12:51:10.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/263: dread d6/d13/d15/d25/f27 [0,4194304] 0 2024-09-18T12:51:10.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/264: write d6/da/d3d/d4d/f5a [69445,127146] 0 2024-09-18T12:51:10.816 INFO:tasks.workunit.client.0.smithi081.stdout:2/69: write fd [576549,86701] 0 2024-09-18T12:51:10.816 INFO:tasks.workunit.client.0.smithi081.stdout:2/70: chown l1 96565698 1 2024-09-18T12:51:10.816 INFO:tasks.workunit.client.0.smithi081.stdout:2/71: rmdir - no directory 2024-09-18T12:51:10.817 INFO:tasks.workunit.client.1.smithi136.stdout:3/274: creat d3/d10/d4a/f58 x:0 0 0 2024-09-18T12:51:10.817 INFO:tasks.workunit.client.1.smithi136.stdout:4/163: symlink d0/l33 0 2024-09-18T12:51:10.818 INFO:tasks.workunit.client.1.smithi136.stdout:0/292: dwrite d1/f43 [0,4194304] 0 2024-09-18T12:51:10.818 INFO:tasks.workunit.client.1.smithi136.stdout:7/439: dwrite d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:51:10.819 INFO:tasks.workunit.client.1.smithi136.stdout:9/265: rmdir d6/d13/d4c 39 2024-09-18T12:51:10.820 INFO:tasks.workunit.client.0.smithi081.stdout:2/72: fsync f9 0 2024-09-18T12:51:10.820 INFO:tasks.workunit.client.0.smithi081.stdout:2/73: chown l1 4 1 2024-09-18T12:51:10.820 INFO:tasks.workunit.client.0.smithi081.stdout:2/74: truncate fd 1503223 0 2024-09-18T12:51:10.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/123: dwrite d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:10.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/124: truncate d7/f22 702569 0 2024-09-18T12:51:10.821 INFO:tasks.workunit.client.1.smithi136.stdout:3/275: rename d3/d14/d17/c48 to d3/d14/c59 0 2024-09-18T12:51:10.821 INFO:tasks.workunit.client.0.smithi081.stdout:2/75: link fe f11 0 2024-09-18T12:51:10.821 INFO:tasks.workunit.client.0.smithi081.stdout:2/76: truncate fe 411159 0 2024-09-18T12:51:10.824 INFO:tasks.workunit.client.1.smithi136.stdout:0/293: mkdir d1/d3/d1a/d62 0 2024-09-18T12:51:10.826 INFO:tasks.workunit.client.0.smithi081.stdout:7/95: dwrite d2/d18/f1f [0,4194304] 0 2024-09-18T12:51:10.826 INFO:tasks.workunit.client.1.smithi136.stdout:4/164: getdents d0/d2 0 2024-09-18T12:51:10.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/77: dread f11 [0,4194304] 0 2024-09-18T12:51:10.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/78: chown fd 310 1 2024-09-18T12:51:10.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/79: fsync f9 0 2024-09-18T12:51:10.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/80: rmdir - no directory 2024-09-18T12:51:10.828 INFO:tasks.workunit.client.1.smithi136.stdout:9/266: creat d6/d13/d15/d25/d55/f5b x:0 0 0 2024-09-18T12:51:10.828 INFO:tasks.workunit.client.1.smithi136.stdout:9/267: readlink d6/db/l3e 0 2024-09-18T12:51:10.828 INFO:tasks.workunit.client.1.smithi136.stdout:9/268: stat d6/df/d23/d2b/c51 0 2024-09-18T12:51:10.828 INFO:tasks.workunit.client.1.smithi136.stdout:0/294: symlink d1/d3/l63 0 2024-09-18T12:51:10.830 INFO:tasks.workunit.client.1.smithi136.stdout:7/440: truncate d0/d2c/f45 1327587 0 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/165: unlink d0/d3/c1e 0 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/166: readlink d0/l33 0 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/167: truncate d0/d2/f28 614183 0 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/168: readlink d0/d2/l21 0 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/169: dread - d0/d2/f17 zero size 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.1.smithi136.stdout:4/170: chown d0/d3/c8 894 1 2024-09-18T12:51:10.834 INFO:tasks.workunit.client.0.smithi081.stdout:7/96: mkdir d2/d18/d22 0 2024-09-18T12:51:10.835 INFO:tasks.workunit.client.1.smithi136.stdout:7/441: mkdir d0/d35/d41/d50/d9b 0 2024-09-18T12:51:10.835 INFO:tasks.workunit.client.1.smithi136.stdout:7/442: fdatasync d0/d35/d36/f22 0 2024-09-18T12:51:10.835 INFO:tasks.workunit.client.1.smithi136.stdout:7/443: chown d0/d12/l16 100832399 1 2024-09-18T12:51:10.835 INFO:tasks.workunit.client.1.smithi136.stdout:7/444: creat d0/d39/d4d/f9c x:0 0 0 2024-09-18T12:51:10.838 INFO:tasks.workunit.client.0.smithi081.stdout:7/97: mknod d2/c23 0 2024-09-18T12:51:10.838 INFO:tasks.workunit.client.0.smithi081.stdout:2/81: dread f7 [0,4194304] 0 2024-09-18T12:51:10.839 INFO:tasks.workunit.client.1.smithi136.stdout:7/445: mknod d0/c9d 0 2024-09-18T12:51:10.842 INFO:tasks.workunit.client.1.smithi136.stdout:7/446: link d0/d2c/f2f d0/d35/d36/d7c/f9e 0 2024-09-18T12:51:10.842 INFO:tasks.workunit.client.1.smithi136.stdout:7/447: fdatasync d0/d2c/f45 0 2024-09-18T12:51:10.843 INFO:tasks.workunit.client.0.smithi081.stdout:0/125: dwrite d7/d13/f1a [0,4194304] 0 2024-09-18T12:51:10.846 INFO:tasks.workunit.client.1.smithi136.stdout:0/295: dread d1/fe [0,4194304] 0 2024-09-18T12:51:10.846 INFO:tasks.workunit.client.1.smithi136.stdout:0/296: chown d1/d17/d2d/c39 2848818 1 2024-09-18T12:51:10.846 INFO:tasks.workunit.client.0.smithi081.stdout:0/126: unlink d7/d9/c27 0 2024-09-18T12:51:10.846 INFO:tasks.workunit.client.0.smithi081.stdout:0/127: write d7/f21 [892562,10635] 0 2024-09-18T12:51:10.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/128: dread - d7/d9/d12/f26 zero size 2024-09-18T12:51:10.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/129: symlink d7/l2d 0 2024-09-18T12:51:10.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/130: readlink d7/l2d 0 2024-09-18T12:51:10.848 INFO:tasks.workunit.client.1.smithi136.stdout:0/297: mknod d1/d3/c64 0 2024-09-18T12:51:10.848 INFO:tasks.workunit.client.0.smithi081.stdout:0/131: mkdir d7/d9/d2e 0 2024-09-18T12:51:10.848 INFO:tasks.workunit.client.0.smithi081.stdout:0/132: symlink d7/d9/l2f 0 2024-09-18T12:51:10.850 INFO:tasks.workunit.client.0.smithi081.stdout:0/133: unlink d7/d9/d12/l18 0 2024-09-18T12:51:10.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/298: dread d1/d17/f4c [0,4194304] 0 2024-09-18T12:51:10.859 INFO:tasks.workunit.client.1.smithi136.stdout:8/377: sync 2024-09-18T12:51:10.859 INFO:tasks.workunit.client.1.smithi136.stdout:8/378: chown d9/d18/d34/d3d 24 1 2024-09-18T12:51:10.860 INFO:tasks.workunit.client.1.smithi136.stdout:0/299: mknod d1/d17/d2d/d35/c65 0 2024-09-18T12:51:10.860 INFO:tasks.workunit.client.1.smithi136.stdout:8/379: creat d9/d14/d1a/d7f/f8f x:0 0 0 2024-09-18T12:51:10.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/224: sync 2024-09-18T12:51:10.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/225: creat d2/d1c/f45 x:0 0 0 2024-09-18T12:51:10.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/226: write d2/f41 [715162,56422] 0 2024-09-18T12:51:10.863 INFO:tasks.workunit.client.0.smithi081.stdout:0/134: read f0 [15742010,46778] 0 2024-09-18T12:51:10.865 INFO:tasks.workunit.client.0.smithi081.stdout:7/98: write d2/f12 [3773711,33305] 0 2024-09-18T12:51:10.865 INFO:tasks.workunit.client.0.smithi081.stdout:7/99: chown d2/l17 166 1 2024-09-18T12:51:10.866 INFO:tasks.workunit.client.1.smithi136.stdout:0/300: link d1/d17/d2d/d51/f57 d1/d46/f66 0 2024-09-18T12:51:10.867 INFO:tasks.workunit.client.0.smithi081.stdout:7/100: creat d2/d14/f24 x:0 0 0 2024-09-18T12:51:10.869 INFO:tasks.workunit.client.0.smithi081.stdout:2/82: dwrite fe [0,4194304] 0 2024-09-18T12:51:10.869 INFO:tasks.workunit.client.0.smithi081.stdout:7/101: dread f0 [0,4194304] 0 2024-09-18T12:51:10.870 INFO:tasks.workunit.client.1.smithi136.stdout:4/171: dwrite d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:10.874 INFO:tasks.workunit.client.0.smithi081.stdout:7/102: creat d2/d18/d22/f25 x:0 0 0 2024-09-18T12:51:10.874 INFO:tasks.workunit.client.0.smithi081.stdout:7/103: readlink d2/l5 0 2024-09-18T12:51:10.874 INFO:tasks.workunit.client.1.smithi136.stdout:4/172: getdents d0/d25 0 2024-09-18T12:51:10.876 INFO:tasks.workunit.client.0.smithi081.stdout:7/104: unlink c1 0 2024-09-18T12:51:10.876 INFO:tasks.workunit.client.0.smithi081.stdout:7/105: chown d2/d14/c19 6221340 1 2024-09-18T12:51:10.876 INFO:tasks.workunit.client.0.smithi081.stdout:7/106: write d2/f13 [3328914,20035] 0 2024-09-18T12:51:10.883 INFO:tasks.workunit.client.1.smithi136.stdout:8/380: dwrite d9/d18/f41 [0,4194304] 0 2024-09-18T12:51:10.883 INFO:tasks.workunit.client.1.smithi136.stdout:8/381: chown d9/d14/f11 19841023 1 2024-09-18T12:51:10.883 INFO:tasks.workunit.client.0.smithi081.stdout:2/83: dread fe [0,4194304] 0 2024-09-18T12:51:10.884 INFO:tasks.workunit.client.0.smithi081.stdout:7/107: dread d2/f10 [0,4194304] 0 2024-09-18T12:51:10.885 INFO:tasks.workunit.client.0.smithi081.stdout:2/84: mknod c12 0 2024-09-18T12:51:10.888 INFO:tasks.workunit.client.1.smithi136.stdout:4/173: write d0/d2/f16 [653270,30576] 0 2024-09-18T12:51:10.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/60: sync 2024-09-18T12:51:10.890 INFO:tasks.workunit.client.0.smithi081.stdout:4/45: sync 2024-09-18T12:51:10.890 INFO:tasks.workunit.client.1.smithi136.stdout:4/174: unlink d0/d3/c1d 0 2024-09-18T12:51:10.890 INFO:tasks.workunit.client.1.smithi136.stdout:4/175: creat d0/d13/f34 x:0 0 0 2024-09-18T12:51:10.891 INFO:tasks.workunit.client.0.smithi081.stdout:4/46: creat d3/db/fe x:0 0 0 2024-09-18T12:51:10.891 INFO:tasks.workunit.client.0.smithi081.stdout:7/108: dread d2/fc [0,4194304] 0 2024-09-18T12:51:10.892 INFO:tasks.workunit.client.0.smithi081.stdout:8/61: symlink d3/l16 0 2024-09-18T12:51:10.894 INFO:tasks.workunit.client.0.smithi081.stdout:4/47: rename d3/l4 to d3/lf 0 2024-09-18T12:51:10.894 INFO:tasks.workunit.client.0.smithi081.stdout:4/48: dread - d3/db/fe zero size 2024-09-18T12:51:10.895 INFO:tasks.workunit.client.0.smithi081.stdout:7/109: rename d2/fc to d2/d14/d21/f26 0 2024-09-18T12:51:10.896 INFO:tasks.workunit.client.0.smithi081.stdout:8/62: unlink d3/l16 0 2024-09-18T12:51:10.898 INFO:tasks.workunit.client.0.smithi081.stdout:4/49: unlink d3/f9 0 2024-09-18T12:51:10.898 INFO:tasks.workunit.client.0.smithi081.stdout:4/50: chown d3/c6 128933032 1 2024-09-18T12:51:10.898 INFO:tasks.workunit.client.0.smithi081.stdout:4/51: creat d3/f10 x:0 0 0 2024-09-18T12:51:10.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/52: link d3/c8 d3/db/c11 0 2024-09-18T12:51:10.900 INFO:tasks.workunit.client.0.smithi081.stdout:4/53: truncate d3/db/fe 41489 0 2024-09-18T12:51:10.900 INFO:tasks.workunit.client.0.smithi081.stdout:4/54: write d3/db/fe [181529,123182] 0 2024-09-18T12:51:10.909 INFO:tasks.workunit.client.0.smithi081.stdout:8/63: dread d3/f13 [0,4194304] 0 2024-09-18T12:51:10.911 INFO:tasks.workunit.client.0.smithi081.stdout:8/64: rename d3/fd to d3/f17 0 2024-09-18T12:51:10.911 INFO:tasks.workunit.client.1.smithi136.stdout:4/176: dwrite d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:10.912 INFO:tasks.workunit.client.1.smithi136.stdout:8/382: dwrite d9/d14/f63 [0,4194304] 0 2024-09-18T12:51:10.912 INFO:tasks.workunit.client.1.smithi136.stdout:8/383: chown d9/fa 2026 1 2024-09-18T12:51:10.912 INFO:tasks.workunit.client.0.smithi081.stdout:7/110: write d2/d18/f1f [983210,118226] 0 2024-09-18T12:51:10.912 INFO:tasks.workunit.client.0.smithi081.stdout:7/111: chown d2/d18 4 1 2024-09-18T12:51:10.913 INFO:tasks.workunit.client.0.smithi081.stdout:8/65: unlink d3/f12 0 2024-09-18T12:51:10.914 INFO:tasks.workunit.client.0.smithi081.stdout:7/112: truncate d2/d14/f16 49201 0 2024-09-18T12:51:10.915 INFO:tasks.workunit.client.1.smithi136.stdout:8/384: mknod d9/d18/d34/d3d/d47/c90 0 2024-09-18T12:51:10.917 INFO:tasks.workunit.client.0.smithi081.stdout:7/113: mkdir d2/d1d/d27 0 2024-09-18T12:51:10.917 INFO:tasks.workunit.client.0.smithi081.stdout:7/114: stat d2 0 2024-09-18T12:51:10.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/385: getdents d9/d18/d34/d88 0 2024-09-18T12:51:10.918 INFO:tasks.workunit.client.0.smithi081.stdout:7/115: creat d2/d1d/f28 x:0 0 0 2024-09-18T12:51:10.918 INFO:tasks.workunit.client.0.smithi081.stdout:7/116: creat d2/d14/f29 x:0 0 0 2024-09-18T12:51:10.919 INFO:tasks.workunit.client.0.smithi081.stdout:7/117: creat d2/d18/d22/f2a x:0 0 0 2024-09-18T12:51:10.924 INFO:tasks.workunit.client.1.smithi136.stdout:1/227: dwrite d2/d5/d11/f19 [0,4194304] 0 2024-09-18T12:51:10.924 INFO:tasks.workunit.client.1.smithi136.stdout:1/228: fdatasync d2/d1c/f45 0 2024-09-18T12:51:10.925 INFO:tasks.workunit.client.1.smithi136.stdout:7/448: dwrite d0/fa [4194304,4194304] 0 2024-09-18T12:51:10.925 INFO:tasks.workunit.client.0.smithi081.stdout:2/85: dwrite f9 [0,4194304] 0 2024-09-18T12:51:10.928 INFO:tasks.workunit.client.1.smithi136.stdout:1/229: truncate d2/d5/d11/d1b/f25 4051918 0 2024-09-18T12:51:10.929 INFO:tasks.workunit.client.1.smithi136.stdout:1/230: creat d2/d1c/f46 x:0 0 0 2024-09-18T12:51:10.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/86: creat f13 x:0 0 0 2024-09-18T12:51:10.934 INFO:tasks.workunit.client.1.smithi136.stdout:1/231: rename d2/d5/d9/fc to d2/d5/d2b/d34/f47 0 2024-09-18T12:51:10.934 INFO:tasks.workunit.client.0.smithi081.stdout:2/87: creat f14 x:0 0 0 2024-09-18T12:51:10.936 INFO:tasks.workunit.client.1.smithi136.stdout:1/232: creat d2/d5/d9/d23/f48 x:0 0 0 2024-09-18T12:51:10.936 INFO:tasks.workunit.client.1.smithi136.stdout:6/275: sync 2024-09-18T12:51:10.936 INFO:tasks.workunit.client.1.smithi136.stdout:2/317: sync 2024-09-18T12:51:10.937 INFO:tasks.workunit.client.1.smithi136.stdout:2/318: getdents d5/d4a 0 2024-09-18T12:51:10.939 INFO:tasks.workunit.client.1.smithi136.stdout:2/319: creat d5/d7/d41/d53/f63 x:0 0 0 2024-09-18T12:51:10.940 INFO:tasks.workunit.client.0.smithi081.stdout:2/88: read f11 [61370,55554] 0 2024-09-18T12:51:10.940 INFO:tasks.workunit.client.1.smithi136.stdout:7/449: write d0/fa [3725117,42629] 0 2024-09-18T12:51:10.940 INFO:tasks.workunit.client.1.smithi136.stdout:7/450: dread - d0/d39/d4d/f92 zero size 2024-09-18T12:51:10.941 INFO:tasks.workunit.client.1.smithi136.stdout:7/451: mknod d0/d35/d41/d50/d5a/c9f 0 2024-09-18T12:51:10.942 INFO:tasks.workunit.client.0.smithi081.stdout:4/55: dwrite d3/f10 [0,4194304] 0 2024-09-18T12:51:10.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/56: creat d3/db/f12 x:0 0 0 2024-09-18T12:51:10.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/177: dwrite d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:10.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/178: fsync d0/d2/f17 0 2024-09-18T12:51:10.943 INFO:tasks.workunit.client.0.smithi081.stdout:8/66: rename d3/f17 to d3/f18 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:8/386: dwrite d9/d14/d1a/d2b/d42/f6d [0,4194304] 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:8/387: write d9/d14/d1a/d2b/d42/d6e/f84 [1005657,81677] 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:8/388: fsync d9/d14/d1a/f4e 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:7/452: creat d0/d35/fa0 x:0 0 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:7/453: chown d0/d35/d41/d50/d7f/c38 9 1 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:7/454: write d0/d39/d4d/d69/f88 [1168131,87184] 0 2024-09-18T12:51:10.944 INFO:tasks.workunit.client.1.smithi136.stdout:7/455: chown d0/d35/d36/d7c 18987 1 2024-09-18T12:51:10.945 INFO:tasks.workunit.client.0.smithi081.stdout:2/89: dread fe [0,4194304] 0 2024-09-18T12:51:10.948 INFO:tasks.workunit.client.1.smithi136.stdout:6/276: dread d8/f3b [0,4194304] 0 2024-09-18T12:51:10.951 INFO:tasks.workunit.client.1.smithi136.stdout:8/389: rename d9/fa to d9/d14/d1a/d2b/f91 0 2024-09-18T12:51:10.951 INFO:tasks.workunit.client.1.smithi136.stdout:8/390: dread - d9/d18/d34/d3d/f54 zero size 2024-09-18T12:51:10.951 INFO:tasks.workunit.client.1.smithi136.stdout:1/233: write d2/d5/d11/d2e/f31 [3606785,15855] 0 2024-09-18T12:51:10.952 INFO:tasks.workunit.client.1.smithi136.stdout:8/391: write d9/d14/f26 [1318067,48613] 0 2024-09-18T12:51:10.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/90: unlink lf 0 2024-09-18T12:51:10.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/91: write fe [1635158,24265] 0 2024-09-18T12:51:10.955 INFO:tasks.workunit.client.1.smithi136.stdout:2/320: rmdir d5 39 2024-09-18T12:51:10.955 INFO:tasks.workunit.client.1.smithi136.stdout:2/321: readlink d5/d7/lc 0 2024-09-18T12:51:10.955 INFO:tasks.workunit.client.1.smithi136.stdout:7/456: mknod d0/d2c/d85/ca1 0 2024-09-18T12:51:10.957 INFO:tasks.workunit.client.1.smithi136.stdout:6/277: mkdir d8/d9/d64 0 2024-09-18T12:51:10.957 INFO:tasks.workunit.client.1.smithi136.stdout:6/278: fsync d8/d9/de/d1c/f42 0 2024-09-18T12:51:10.957 INFO:tasks.workunit.client.1.smithi136.stdout:6/279: chown d8/d9/f34 2 1 2024-09-18T12:51:10.957 INFO:tasks.workunit.client.1.smithi136.stdout:8/392: mkdir d9/d18/d34/d3d/d47/d65/d92 0 2024-09-18T12:51:10.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/322: chown d5/d25/c37 367008 1 2024-09-18T12:51:10.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/323: chown d5/d7/d41/l46 19946643 1 2024-09-18T12:51:10.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/324: truncate d5/d7/f55 875416 0 2024-09-18T12:51:10.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/325: truncate d5/d7/f3f 5167798 0 2024-09-18T12:51:10.965 INFO:tasks.workunit.client.0.smithi081.stdout:2/92: truncate f11 1519337 0 2024-09-18T12:51:10.966 INFO:tasks.workunit.client.0.smithi081.stdout:2/93: dread fb [0,4194304] 0 2024-09-18T12:51:10.967 INFO:tasks.workunit.client.0.smithi081.stdout:2/94: mkdir d15 0 2024-09-18T12:51:10.985 INFO:tasks.workunit.client.0.smithi081.stdout:4/57: dwrite d3/db/fc [0,4194304] 0 2024-09-18T12:51:10.985 INFO:tasks.workunit.client.1.smithi136.stdout:7/457: fdatasync d0/fa 0 2024-09-18T12:51:10.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/67: dwrite d3/f15 [0,4194304] 0 2024-09-18T12:51:10.986 INFO:tasks.workunit.client.0.smithi081.stdout:2/95: mkdir d15/d16 0 2024-09-18T12:51:10.987 INFO:tasks.workunit.client.1.smithi136.stdout:6/280: link d8/d9/de/f16 d8/f65 0 2024-09-18T12:51:10.987 INFO:tasks.workunit.client.1.smithi136.stdout:6/281: chown d8/dc/l1b 6 1 2024-09-18T12:51:10.988 INFO:tasks.workunit.client.1.smithi136.stdout:1/234: mknod d2/d5/d9/c49 0 2024-09-18T12:51:10.989 INFO:tasks.workunit.client.1.smithi136.stdout:8/393: mkdir d9/d18/d34/d3d/d47/d65/d93 0 2024-09-18T12:51:10.989 INFO:tasks.workunit.client.0.smithi081.stdout:4/58: mknod d3/dd/c13 0 2024-09-18T12:51:10.990 INFO:tasks.workunit.client.1.smithi136.stdout:2/326: unlink d5/d25/d2d/f30 0 2024-09-18T12:51:10.992 INFO:tasks.workunit.client.1.smithi136.stdout:4/179: dwrite d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:10.992 INFO:tasks.workunit.client.1.smithi136.stdout:4/180: creat d0/d13/f35 x:0 0 0 2024-09-18T12:51:10.993 INFO:tasks.workunit.client.0.smithi081.stdout:8/68: unlink d3/ca 0 2024-09-18T12:51:10.993 INFO:tasks.workunit.client.0.smithi081.stdout:8/69: dread - d3/f11 zero size 2024-09-18T12:51:10.995 INFO:tasks.workunit.client.0.smithi081.stdout:4/59: mkdir d3/dd/d14 0 2024-09-18T12:51:10.996 INFO:tasks.workunit.client.1.smithi136.stdout:7/458: mkdir d0/d39/d4d/d9a/da2 0 2024-09-18T12:51:10.996 INFO:tasks.workunit.client.1.smithi136.stdout:7/459: chown d0/d2c/f2f 88 1 2024-09-18T12:51:10.997 INFO:tasks.workunit.client.0.smithi081.stdout:8/70: link d3/l10 d3/l19 0 2024-09-18T12:51:10.997 INFO:tasks.workunit.client.1.smithi136.stdout:6/282: mknod d8/c66 0 2024-09-18T12:51:10.997 INFO:tasks.workunit.client.1.smithi136.stdout:1/235: truncate f1 1312095 0 2024-09-18T12:51:10.998 INFO:tasks.workunit.client.1.smithi136.stdout:1/236: fdatasync d2/d5/d9/f3b 0 2024-09-18T12:51:10.998 INFO:tasks.workunit.client.0.smithi081.stdout:2/96: truncate f11 2128490 0 2024-09-18T12:51:10.999 INFO:tasks.workunit.client.1.smithi136.stdout:8/394: link d9/d18/d34/d88/c8d d9/d18/d34/d3d/d47/d65/d6b/c94 0 2024-09-18T12:51:11.000 INFO:tasks.workunit.client.1.smithi136.stdout:8/395: write d9/d18/f44 [729597,45812] 0 2024-09-18T12:51:11.000 INFO:tasks.workunit.client.0.smithi081.stdout:4/60: unlink d3/ca 0 2024-09-18T12:51:11.002 INFO:tasks.workunit.client.0.smithi081.stdout:8/71: rename d3/f14 to d3/f1a 0 2024-09-18T12:51:11.002 INFO:tasks.workunit.client.0.smithi081.stdout:8/72: write d3/f18 [846320,104960] 0 2024-09-18T12:51:11.002 INFO:tasks.workunit.client.0.smithi081.stdout:8/73: write d3/f1a [857277,71885] 0 2024-09-18T12:51:11.002 INFO:tasks.workunit.client.0.smithi081.stdout:8/74: write d3/f18 [1609036,28024] 0 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.0.smithi081.stdout:3/73: sync 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.0.smithi081.stdout:6/50: sync 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.0.smithi081.stdout:9/53: sync 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.0.smithi081.stdout:9/54: chown dd 175630233 1 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.0.smithi081.stdout:9/55: chown dd/de 489 1 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.1.smithi136.stdout:7/460: symlink d0/d35/d36/d7c/la3 0 2024-09-18T12:51:11.003 INFO:tasks.workunit.client.1.smithi136.stdout:6/283: creat d8/d9/d56/f67 x:0 0 0 2024-09-18T12:51:11.004 INFO:tasks.workunit.client.0.smithi081.stdout:2/97: creat d15/f17 x:0 0 0 2024-09-18T12:51:11.005 INFO:tasks.workunit.client.1.smithi136.stdout:8/396: creat d9/d14/d1a/d2b/d42/d6e/d75/f95 x:0 0 0 2024-09-18T12:51:11.007 INFO:tasks.workunit.client.0.smithi081.stdout:4/61: symlink d3/dd/l15 0 2024-09-18T12:51:11.007 INFO:tasks.workunit.client.1.smithi136.stdout:8/397: mkdir d9/d18/d34/d3d/d47/d65/d93/d96 0 2024-09-18T12:51:11.009 INFO:tasks.workunit.client.1.smithi136.stdout:8/398: mknod d9/d14/d1a/d2b/d42/d6e/d75/c97 0 2024-09-18T12:51:11.009 INFO:tasks.workunit.client.1.smithi136.stdout:8/399: dread - d9/d14/d1a/d2b/f4d zero size 2024-09-18T12:51:11.012 INFO:tasks.workunit.client.1.smithi136.stdout:8/400: mknod d9/d18/d34/d3d/d8b/c98 0 2024-09-18T12:51:11.012 INFO:tasks.workunit.client.0.smithi081.stdout:2/98: creat d15/d16/f18 x:0 0 0 2024-09-18T12:51:11.012 INFO:tasks.workunit.client.0.smithi081.stdout:2/99: fdatasync f11 0 2024-09-18T12:51:11.012 INFO:tasks.workunit.client.0.smithi081.stdout:2/100: read - f14 zero size 2024-09-18T12:51:11.012 INFO:tasks.workunit.client.0.smithi081.stdout:2/101: creat d15/d16/f19 x:0 0 0 2024-09-18T12:51:11.013 INFO:tasks.workunit.client.0.smithi081.stdout:4/62: link d3/c6 d3/db/c16 0 2024-09-18T12:51:11.013 INFO:tasks.workunit.client.0.smithi081.stdout:4/63: readlink d3/dd/l15 0 2024-09-18T12:51:11.014 INFO:tasks.workunit.client.1.smithi136.stdout:8/401: creat d9/d18/d34/d3d/d47/d65/d92/f99 x:0 0 0 2024-09-18T12:51:11.016 INFO:tasks.workunit.client.0.smithi081.stdout:6/51: mkdir d4/d12 0 2024-09-18T12:51:11.017 INFO:tasks.workunit.client.1.smithi136.stdout:8/402: mkdir d9/d14/d1a/d2b/d42/d6e/d75/d9a 0 2024-09-18T12:51:11.017 INFO:tasks.workunit.client.1.smithi136.stdout:8/403: write d9/d18/d34/d3d/f50 [1694664,25745] 0 2024-09-18T12:51:11.017 INFO:tasks.workunit.client.1.smithi136.stdout:8/404: chown d9/d14/d1a 10850819 1 2024-09-18T12:51:11.017 INFO:tasks.workunit.client.1.smithi136.stdout:8/405: write d9/d18/d34/d3d/f4b [1283166,117859] 0 2024-09-18T12:51:11.019 INFO:tasks.workunit.client.0.smithi081.stdout:9/56: write fb [1976673,116961] 0 2024-09-18T12:51:11.020 INFO:tasks.workunit.client.0.smithi081.stdout:2/102: mknod d15/d16/c1a 0 2024-09-18T12:51:11.020 INFO:tasks.workunit.client.0.smithi081.stdout:2/103: creat d15/d16/f1b x:0 0 0 2024-09-18T12:51:11.029 INFO:tasks.workunit.client.1.smithi136.stdout:8/406: read d9/d18/f7a [4096457,31629] 0 2024-09-18T12:51:11.030 INFO:tasks.workunit.client.1.smithi136.stdout:8/407: mkdir d9/d18/d34/d3d/d47/d65/d93/d96/d9b 0 2024-09-18T12:51:11.030 INFO:tasks.workunit.client.1.smithi136.stdout:8/408: write d9/d18/d34/f3e [649573,115845] 0 2024-09-18T12:51:11.031 INFO:tasks.workunit.client.1.smithi136.stdout:8/409: mknod d9/d14/d1a/d7f/c9c 0 2024-09-18T12:51:11.032 INFO:tasks.workunit.client.1.smithi136.stdout:1/237: dwrite d2/d5/d11/f19 [4194304,4194304] 0 2024-09-18T12:51:11.032 INFO:tasks.workunit.client.1.smithi136.stdout:1/238: chown d2/d5/d9/c30 745 1 2024-09-18T12:51:11.032 INFO:tasks.workunit.client.1.smithi136.stdout:1/239: fsync d2/d5/d9/d23/f2c 0 2024-09-18T12:51:11.036 INFO:tasks.workunit.client.1.smithi136.stdout:1/240: dread d2/f41 [0,4194304] 0 2024-09-18T12:51:11.036 INFO:tasks.workunit.client.1.smithi136.stdout:1/241: readlink d2/d1c/l39 0 2024-09-18T12:51:11.036 INFO:tasks.workunit.client.1.smithi136.stdout:1/242: chown d2 2763482 1 2024-09-18T12:51:11.037 INFO:tasks.workunit.client.1.smithi136.stdout:1/243: truncate d2/f16 1119080 0 2024-09-18T12:51:11.039 INFO:tasks.workunit.client.0.smithi081.stdout:3/74: dwrite f1 [0,4194304] 0 2024-09-18T12:51:11.041 INFO:tasks.workunit.client.0.smithi081.stdout:3/75: rename d3/fd to d3/db/dc/de/d13/f1e 0 2024-09-18T12:51:11.043 INFO:tasks.workunit.client.0.smithi081.stdout:3/76: truncate d3/db/dc/de/d13/f1e 385271 0 2024-09-18T12:51:11.043 INFO:tasks.workunit.client.0.smithi081.stdout:3/77: fsync d3/f7 0 2024-09-18T12:51:11.057 INFO:tasks.workunit.client.0.smithi081.stdout:9/57: dwrite fb [0,4194304] 0 2024-09-18T12:51:11.066 INFO:tasks.workunit.client.0.smithi081.stdout:3/78: dwrite d3/db/dc/de/f19 [0,4194304] 0 2024-09-18T12:51:11.068 INFO:tasks.workunit.client.0.smithi081.stdout:3/79: creat d3/db/d1b/f1f x:0 0 0 2024-09-18T12:51:11.069 INFO:tasks.workunit.client.0.smithi081.stdout:9/58: dread fb [0,4194304] 0 2024-09-18T12:51:11.070 INFO:tasks.workunit.client.0.smithi081.stdout:9/59: link c9 dd/c14 0 2024-09-18T12:51:11.071 INFO:tasks.workunit.client.0.smithi081.stdout:9/60: unlink dd/de/f12 0 2024-09-18T12:51:11.071 INFO:tasks.workunit.client.0.smithi081.stdout:9/61: write f8 [249150,48512] 0 2024-09-18T12:51:11.072 INFO:tasks.workunit.client.0.smithi081.stdout:9/62: mkdir dd/d15 0 2024-09-18T12:51:11.073 INFO:tasks.workunit.client.0.smithi081.stdout:9/63: rename fb to dd/d15/f16 0 2024-09-18T12:51:11.073 INFO:tasks.workunit.client.0.smithi081.stdout:9/64: mknod dd/de/c17 0 2024-09-18T12:51:11.074 INFO:tasks.workunit.client.0.smithi081.stdout:9/65: link dd/de/l11 dd/de/l18 0 2024-09-18T12:51:11.074 INFO:tasks.workunit.client.0.smithi081.stdout:9/66: chown fa 81308 1 2024-09-18T12:51:11.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/75: write d3/f1a [776258,57500] 0 2024-09-18T12:51:11.100 INFO:tasks.workunit.client.1.smithi136.stdout:2/327: dwrite d5/d7/f12 [0,4194304] 0 2024-09-18T12:51:11.105 INFO:tasks.workunit.client.1.smithi136.stdout:7/461: dwrite d0/d35/d4f/f82 [0,4194304] 0 2024-09-18T12:51:11.105 INFO:tasks.workunit.client.1.smithi136.stdout:7/462: fdatasync d0/d39/f43 0 2024-09-18T12:51:11.106 INFO:tasks.workunit.client.0.smithi081.stdout:2/104: rmdir d15 39 2024-09-18T12:51:11.108 INFO:tasks.workunit.client.0.smithi081.stdout:2/105: symlink d15/l1c 0 2024-09-18T12:51:11.108 INFO:tasks.workunit.client.0.smithi081.stdout:2/106: fsync d15/f17 0 2024-09-18T12:51:11.112 INFO:tasks.workunit.client.1.smithi136.stdout:7/463: rename d0/d12/d1a/c1f to d0/d12/d5e/ca4 0 2024-09-18T12:51:11.113 INFO:tasks.workunit.client.1.smithi136.stdout:2/328: write d5/d7/d17/f24 [748512,32185] 0 2024-09-18T12:51:11.116 INFO:tasks.workunit.client.1.smithi136.stdout:6/284: getdents d8 0 2024-09-18T12:51:11.116 INFO:tasks.workunit.client.1.smithi136.stdout:6/285: creat d8/d9/d3c/f68 x:0 0 0 2024-09-18T12:51:11.117 INFO:tasks.workunit.client.1.smithi136.stdout:2/329: mkdir d5/d4a/d64 0 2024-09-18T12:51:11.119 INFO:tasks.workunit.client.1.smithi136.stdout:5/268: sync 2024-09-18T12:51:11.119 INFO:tasks.workunit.client.1.smithi136.stdout:5/269: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:11.120 INFO:tasks.workunit.client.1.smithi136.stdout:5/270: write d5/d1a/d2d/d34/f13 [4784414,81356] 0 2024-09-18T12:51:11.121 INFO:tasks.workunit.client.0.smithi081.stdout:8/76: fdatasync d3/f1a 0 2024-09-18T12:51:11.121 INFO:tasks.workunit.client.1.smithi136.stdout:2/330: link d5/d7/f3f d5/f65 0 2024-09-18T12:51:11.122 INFO:tasks.workunit.client.0.smithi081.stdout:4/64: dwrite d3/f10 [0,4194304] 0 2024-09-18T12:51:11.124 INFO:tasks.workunit.client.0.smithi081.stdout:4/65: link d3/dd/c13 d3/dd/d14/c17 0 2024-09-18T12:51:11.125 INFO:tasks.workunit.client.0.smithi081.stdout:4/66: write d3/db/f12 [693702,59626] 0 2024-09-18T12:51:11.125 INFO:tasks.workunit.client.0.smithi081.stdout:4/67: creat d3/db/f18 x:0 0 0 2024-09-18T12:51:11.125 INFO:tasks.workunit.client.0.smithi081.stdout:6/52: dwrite d4/d6/fc [0,4194304] 0 2024-09-18T12:51:11.125 INFO:tasks.workunit.client.0.smithi081.stdout:6/53: chown d4/d6/d10 16 1 2024-09-18T12:51:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:4/68: creat d3/dd/f19 x:0 0 0 2024-09-18T12:51:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:4/69: rename d3 to d3/db/d1a 22 2024-09-18T12:51:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:4/70: creat d3/f1b x:0 0 0 2024-09-18T12:51:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:6/54: creat d4/f13 x:0 0 0 2024-09-18T12:51:11.132 INFO:tasks.workunit.client.1.smithi136.stdout:6/286: write d8/d9/de/d1c/f42 [3834313,62838] 0 2024-09-18T12:51:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:8/77: fsync d3/f18 0 2024-09-18T12:51:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:6/55: link d4/fe d4/d6/f14 0 2024-09-18T12:51:11.133 INFO:tasks.workunit.client.1.smithi136.stdout:8/410: dwrite d9/d18/d34/d3d/f54 [0,4194304] 0 2024-09-18T12:51:11.133 INFO:tasks.workunit.client.1.smithi136.stdout:8/411: fdatasync d9/d14/f11 0 2024-09-18T12:51:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:4/71: link d3/f1b d3/dd/f1c 0 2024-09-18T12:51:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:8/78: symlink d3/l1b 0 2024-09-18T12:51:11.137 INFO:tasks.workunit.client.1.smithi136.stdout:8/412: getdents d9/d14/d1a/d2b 0 2024-09-18T12:51:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:4/72: mknod d3/dd/d14/c1d 0 2024-09-18T12:51:11.139 INFO:tasks.workunit.client.1.smithi136.stdout:7/464: dwrite d0/d39/f7e [0,4194304] 0 2024-09-18T12:51:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:8/79: unlink d3/fb 0 2024-09-18T12:51:11.146 INFO:tasks.workunit.client.1.smithi136.stdout:3/276: sync 2024-09-18T12:51:11.146 INFO:tasks.workunit.client.1.smithi136.stdout:3/277: read - d3/d5/d3c/f4c zero size 2024-09-18T12:51:11.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/413: dread d9/d18/d34/f67 [0,4194304] 0 2024-09-18T12:51:11.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/414: dread - d9/d14/d1a/d2b/f4d zero size 2024-09-18T12:51:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:4/73: dread d3/f10 [0,4194304] 0 2024-09-18T12:51:11.159 INFO:tasks.workunit.client.1.smithi136.stdout:7/465: dread d0/d35/d41/d50/d5a/f86 [0,4194304] 0 2024-09-18T12:51:11.159 INFO:tasks.workunit.client.1.smithi136.stdout:7/466: chown d0/d35/d41/d50/d5a/d98 938813621 1 2024-09-18T12:51:11.160 INFO:tasks.workunit.client.1.smithi136.stdout:7/467: truncate d0/f29 3410646 0 2024-09-18T12:51:11.160 INFO:tasks.workunit.client.1.smithi136.stdout:7/468: fsync d0/d39/f43 0 2024-09-18T12:51:11.162 INFO:tasks.workunit.client.1.smithi136.stdout:7/469: rmdir d0/d35/d41/d58/d96/d95 0 2024-09-18T12:51:11.163 INFO:tasks.workunit.client.1.smithi136.stdout:7/470: mkdir d0/d39/d4d/d9a/da2/da5 0 2024-09-18T12:51:11.163 INFO:tasks.workunit.client.1.smithi136.stdout:3/278: read d3/d14/f3a [6346085,15703] 0 2024-09-18T12:51:11.165 INFO:tasks.workunit.client.1.smithi136.stdout:7/471: rmdir d0/d39/d4d/d9a/da2/da5 0 2024-09-18T12:51:11.167 INFO:tasks.workunit.client.1.smithi136.stdout:7/472: creat d0/d2c/d85/fa6 x:0 0 0 2024-09-18T12:51:11.172 INFO:tasks.workunit.client.1.smithi136.stdout:5/271: dwrite d5/d1a/f43 [4194304,4194304] 0 2024-09-18T12:51:11.172 INFO:tasks.workunit.client.1.smithi136.stdout:5/272: fdatasync d5/d1a/d30/f3c 0 2024-09-18T12:51:11.172 INFO:tasks.workunit.client.1.smithi136.stdout:5/273: chown d5/d1a/d2d/d34/f35 101980 1 2024-09-18T12:51:11.172 INFO:tasks.workunit.client.1.smithi136.stdout:5/274: readlink d5/d1a/d2d/d34/l3d 0 2024-09-18T12:51:11.175 INFO:tasks.workunit.client.1.smithi136.stdout:5/275: symlink d5/d1a/d30/l49 0 2024-09-18T12:51:11.180 INFO:tasks.workunit.client.1.smithi136.stdout:3/279: write d3/d10/f16 [1685795,108533] 0 2024-09-18T12:51:11.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/280: unlink d3/d14/d18/c26 0 2024-09-18T12:51:11.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/281: rename d3/d14 to d3/d14/d22/d2c/d3d/d5a 22 2024-09-18T12:51:11.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/282: write d3/f9 [2684780,68945] 0 2024-09-18T12:51:11.183 INFO:tasks.workunit.client.1.smithi136.stdout:3/283: write d3/d14/f40 [204805,48278] 0 2024-09-18T12:51:11.183 INFO:tasks.workunit.client.0.smithi081.stdout:2/107: dwrite fd [0,4194304] 0 2024-09-18T12:51:11.183 INFO:tasks.workunit.client.1.smithi136.stdout:3/284: symlink d3/d14/l5b 0 2024-09-18T12:51:11.184 INFO:tasks.workunit.client.0.smithi081.stdout:2/108: mknod d15/d16/c1d 0 2024-09-18T12:51:11.186 INFO:tasks.workunit.client.0.smithi081.stdout:2/109: creat d15/f1e x:0 0 0 2024-09-18T12:51:11.187 INFO:tasks.workunit.client.0.smithi081.stdout:2/110: mkdir d15/d1f 0 2024-09-18T12:51:11.187 INFO:tasks.workunit.client.0.smithi081.stdout:2/111: truncate d15/f17 346400 0 2024-09-18T12:51:11.188 INFO:tasks.workunit.client.0.smithi081.stdout:2/112: stat c8 0 2024-09-18T12:51:11.188 INFO:tasks.workunit.client.0.smithi081.stdout:2/113: write d15/d16/f1b [212856,112749] 0 2024-09-18T12:51:11.189 INFO:tasks.workunit.client.0.smithi081.stdout:2/114: readlink l2 0 2024-09-18T12:51:11.190 INFO:tasks.workunit.client.1.smithi136.stdout:3/285: read d3/d5/f35 [855763,45409] 0 2024-09-18T12:51:11.192 INFO:tasks.workunit.client.0.smithi081.stdout:9/67: dwrite f8 [0,4194304] 0 2024-09-18T12:51:11.192 INFO:tasks.workunit.client.0.smithi081.stdout:3/80: dwrite d3/db/dc/de/d13/f1e [0,4194304] 0 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:3/286: getdents d3/d14/d17 0 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:5/276: dread d5/f23 [4194304,4194304] 0 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:5/277: read - d5/f1c zero size 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:5/278: fdatasync d5/d1a/f1b 0 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:3/287: mknod d3/d14/d22/d2c/d3d/c5c 0 2024-09-18T12:51:11.193 INFO:tasks.workunit.client.1.smithi136.stdout:3/288: write d3/f9 [1715235,65844] 0 2024-09-18T12:51:11.194 INFO:tasks.workunit.client.1.smithi136.stdout:5/279: mkdir d5/d1a/d4a 0 2024-09-18T12:51:11.194 INFO:tasks.workunit.client.1.smithi136.stdout:5/280: readlink d5/l20 0 2024-09-18T12:51:11.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/68: unlink cc 0 2024-09-18T12:51:11.195 INFO:tasks.workunit.client.1.smithi136.stdout:5/281: mknod d5/d1a/d2d/d34/c4b 0 2024-09-18T12:51:11.196 INFO:tasks.workunit.client.0.smithi081.stdout:8/80: dwrite d3/f13 [4194304,4194304] 0 2024-09-18T12:51:11.196 INFO:tasks.workunit.client.1.smithi136.stdout:6/287: dwrite d8/f26 [0,4194304] 0 2024-09-18T12:51:11.197 INFO:tasks.workunit.client.1.smithi136.stdout:7/473: dwrite d0/f62 [0,4194304] 0 2024-09-18T12:51:11.197 INFO:tasks.workunit.client.1.smithi136.stdout:7/474: chown d0/d35/fa0 629 1 2024-09-18T12:51:11.198 INFO:tasks.workunit.client.1.smithi136.stdout:8/415: dwrite d9/d14/d1a/d2b/f4d [0,4194304] 0 2024-09-18T12:51:11.198 INFO:tasks.workunit.client.0.smithi081.stdout:2/115: fsync d15/d16/f1b 0 2024-09-18T12:51:11.198 INFO:tasks.workunit.client.0.smithi081.stdout:4/74: dwrite d3/f1b [0,4194304] 0 2024-09-18T12:51:11.198 INFO:tasks.workunit.client.0.smithi081.stdout:4/75: write d3/db/f18 [598149,13996] 0 2024-09-18T12:51:11.198 INFO:tasks.workunit.client.0.smithi081.stdout:6/56: getdents d4/d6 0 2024-09-18T12:51:11.199 INFO:tasks.workunit.client.1.smithi136.stdout:5/282: rename d5/d1a/d2d/d34/f33 to d5/d1a/d30/f4c 0 2024-09-18T12:51:11.199 INFO:tasks.workunit.client.1.smithi136.stdout:5/283: write d5/ff [7498958,3275] 0 2024-09-18T12:51:11.200 INFO:tasks.workunit.client.1.smithi136.stdout:5/284: fdatasync d5/d1a/f43 0 2024-09-18T12:51:11.201 INFO:tasks.workunit.client.1.smithi136.stdout:6/288: creat d8/d9/d64/f69 x:0 0 0 2024-09-18T12:51:11.201 INFO:tasks.workunit.client.1.smithi136.stdout:6/289: chown d8/d9/de/d1c/f42 202208368 1 2024-09-18T12:51:11.205 INFO:tasks.workunit.client.0.smithi081.stdout:3/81: dread d3/db/dc/de/d13/f1e [0,4194304] 0 2024-09-18T12:51:11.206 INFO:tasks.workunit.client.0.smithi081.stdout:6/57: dread d4/d6/fb [0,4194304] 0 2024-09-18T12:51:11.210 INFO:tasks.workunit.client.1.smithi136.stdout:5/285: creat d5/d1a/f4d x:0 0 0 2024-09-18T12:51:11.212 INFO:tasks.workunit.client.0.smithi081.stdout:8/81: symlink d3/l1c 0 2024-09-18T12:51:11.213 INFO:tasks.workunit.client.1.smithi136.stdout:6/290: creat d8/d9/de/f6a x:0 0 0 2024-09-18T12:51:11.215 INFO:tasks.workunit.client.1.smithi136.stdout:8/416: getdents d9/d14 0 2024-09-18T12:51:11.218 INFO:tasks.workunit.client.1.smithi136.stdout:8/417: creat d9/d18/d34/d3d/d47/d65/d6b/f9d x:0 0 0 2024-09-18T12:51:11.219 INFO:tasks.workunit.client.0.smithi081.stdout:2/116: mkdir d15/d16/d20 0 2024-09-18T12:51:11.219 INFO:tasks.workunit.client.0.smithi081.stdout:2/117: chown c12 363882498 1 2024-09-18T12:51:11.219 INFO:tasks.workunit.client.0.smithi081.stdout:4/76: link d3/db/f18 d3/dd/d14/f1e 0 2024-09-18T12:51:11.219 INFO:tasks.workunit.client.0.smithi081.stdout:6/58: creat d4/f15 x:0 0 0 2024-09-18T12:51:11.220 INFO:tasks.workunit.client.1.smithi136.stdout:8/418: rmdir d9/d14/d1a/d2b 39 2024-09-18T12:51:11.220 INFO:tasks.workunit.client.0.smithi081.stdout:6/59: write d4/f5 [773857,107803] 0 2024-09-18T12:51:11.220 INFO:tasks.workunit.client.0.smithi081.stdout:6/60: chown d4/d6/fc 31394 1 2024-09-18T12:51:11.220 INFO:tasks.workunit.client.0.smithi081.stdout:2/118: symlink d15/d16/d20/l21 0 2024-09-18T12:51:11.222 INFO:tasks.workunit.client.0.smithi081.stdout:4/77: mknod d3/dd/d14/c1f 0 2024-09-18T12:51:11.222 INFO:tasks.workunit.client.0.smithi081.stdout:4/78: fdatasync d3/db/fc 0 2024-09-18T12:51:11.222 INFO:tasks.workunit.client.0.smithi081.stdout:4/79: chown d3/f7 104083 1 2024-09-18T12:51:11.223 INFO:tasks.workunit.client.0.smithi081.stdout:3/82: rename d3/db/df/c1d to d3/c20 0 2024-09-18T12:51:11.223 INFO:tasks.workunit.client.0.smithi081.stdout:3/83: fsync d3/db/d1b/f1f 0 2024-09-18T12:51:11.223 INFO:tasks.workunit.client.1.smithi136.stdout:9/269: sync 2024-09-18T12:51:11.224 INFO:tasks.workunit.client.1.smithi136.stdout:0/301: sync 2024-09-18T12:51:11.224 INFO:tasks.workunit.client.1.smithi136.stdout:5/286: dread d5/d1a/d2d/d34/f13 [0,4194304] 0 2024-09-18T12:51:11.224 INFO:tasks.workunit.client.1.smithi136.stdout:9/270: write d6/d13/d15/d25/f27 [283454,72092] 0 2024-09-18T12:51:11.225 INFO:tasks.workunit.client.1.smithi136.stdout:9/271: read d6/d13/d15/d25/f27 [189704,68817] 0 2024-09-18T12:51:11.225 INFO:tasks.workunit.client.1.smithi136.stdout:8/419: mkdir d9/d14/d1a/d2b/d42/d9e 0 2024-09-18T12:51:11.225 INFO:tasks.workunit.client.0.smithi081.stdout:3/84: symlink d3/l21 0 2024-09-18T12:51:11.225 INFO:tasks.workunit.client.0.smithi081.stdout:3/85: read d3/fa [20965,960] 0 2024-09-18T12:51:11.227 INFO:tasks.workunit.client.1.smithi136.stdout:5/287: unlink d5/c38 0 2024-09-18T12:51:11.227 INFO:tasks.workunit.client.1.smithi136.stdout:3/289: dwrite d3/d10/f16 [0,4194304] 0 2024-09-18T12:51:11.227 INFO:tasks.workunit.client.1.smithi136.stdout:0/302: getdents d1/d60 0 2024-09-18T12:51:11.228 INFO:tasks.workunit.client.1.smithi136.stdout:0/303: chown d1/d17/d2d/c56 13 1 2024-09-18T12:51:11.231 INFO:tasks.workunit.client.1.smithi136.stdout:5/288: mkdir d5/d1a/d2d/d34/d4e 0 2024-09-18T12:51:11.231 INFO:tasks.workunit.client.1.smithi136.stdout:9/272: read d6/df/f3b [397933,14036] 0 2024-09-18T12:51:11.232 INFO:tasks.workunit.client.1.smithi136.stdout:0/304: symlink d1/d3/d1a/d62/l67 0 2024-09-18T12:51:11.232 INFO:tasks.workunit.client.0.smithi081.stdout:4/80: write d3/db/fc [2612978,109812] 0 2024-09-18T12:51:11.232 INFO:tasks.workunit.client.0.smithi081.stdout:4/81: fdatasync d3/f1b 0 2024-09-18T12:51:11.232 INFO:tasks.workunit.client.1.smithi136.stdout:9/273: unlink d6/d13/l3f 0 2024-09-18T12:51:11.232 INFO:tasks.workunit.client.1.smithi136.stdout:9/274: chown d6/df/d23/d2b/c48 194669418 1 2024-09-18T12:51:11.233 INFO:tasks.workunit.client.1.smithi136.stdout:3/290: dread d3/d14/f3a [4194304,4194304] 0 2024-09-18T12:51:11.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/69: dwrite f6 [4194304,4194304] 0 2024-09-18T12:51:11.235 INFO:tasks.workunit.client.1.smithi136.stdout:0/305: creat d1/d60/f68 x:0 0 0 2024-09-18T12:51:11.235 INFO:tasks.workunit.client.1.smithi136.stdout:9/275: mkdir d6/db/d49/d53/d5c 0 2024-09-18T12:51:11.238 INFO:tasks.workunit.client.1.smithi136.stdout:9/276: write d6/d13/d15/d25/f27 [1432629,104048] 0 2024-09-18T12:51:11.238 INFO:tasks.workunit.client.1.smithi136.stdout:3/291: symlink d3/d10/d4a/l5d 0 2024-09-18T12:51:11.238 INFO:tasks.workunit.client.1.smithi136.stdout:3/292: fsync d3/d14/f54 0 2024-09-18T12:51:11.238 INFO:tasks.workunit.client.1.smithi136.stdout:3/293: chown d3/d10/d4a/l5d 1 1 2024-09-18T12:51:11.238 INFO:tasks.workunit.client.1.smithi136.stdout:3/294: stat d3/d14/d17 0 2024-09-18T12:51:11.239 INFO:tasks.workunit.client.1.smithi136.stdout:3/295: creat d3/d10/f5e x:0 0 0 2024-09-18T12:51:11.239 INFO:tasks.workunit.client.1.smithi136.stdout:3/296: truncate d3/d14/d22/d2c/d3d/f3f 742577 0 2024-09-18T12:51:11.239 INFO:tasks.workunit.client.0.smithi081.stdout:9/70: stat dd/cf 0 2024-09-18T12:51:11.239 INFO:tasks.workunit.client.0.smithi081.stdout:8/82: dwrite d3/f15 [0,4194304] 0 2024-09-18T12:51:11.239 INFO:tasks.workunit.client.0.smithi081.stdout:9/71: mknod dd/c19 0 2024-09-18T12:51:11.240 INFO:tasks.workunit.client.0.smithi081.stdout:5/118: sync 2024-09-18T12:51:11.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/97: sync 2024-09-18T12:51:11.242 INFO:tasks.workunit.client.1.smithi136.stdout:9/277: rmdir d6/d13/d4c 39 2024-09-18T12:51:11.242 INFO:tasks.workunit.client.1.smithi136.stdout:9/278: chown d6/d13/d4c/f50 510 1 2024-09-18T12:51:11.245 INFO:tasks.workunit.client.0.smithi081.stdout:3/86: dread d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:11.246 INFO:tasks.workunit.client.0.smithi081.stdout:8/83: mkdir d3/d1d 0 2024-09-18T12:51:11.246 INFO:tasks.workunit.client.0.smithi081.stdout:1/98: creat d0/d18/d1a/d1f/f21 x:0 0 0 2024-09-18T12:51:11.246 INFO:tasks.workunit.client.1.smithi136.stdout:6/291: dwrite d8/d9/de/d1c/f5e [0,4194304] 0 2024-09-18T12:51:11.246 INFO:tasks.workunit.client.1.smithi136.stdout:6/292: write d8/d9/de/f6a [462679,6999] 0 2024-09-18T12:51:11.246 INFO:tasks.workunit.client.1.smithi136.stdout:3/297: truncate d3/f34 4938806 0 2024-09-18T12:51:11.247 INFO:tasks.workunit.client.1.smithi136.stdout:9/279: mknod d6/db/c5d 0 2024-09-18T12:51:11.247 INFO:tasks.workunit.client.1.smithi136.stdout:5/289: write f2 [4428303,81645] 0 2024-09-18T12:51:11.247 INFO:tasks.workunit.client.1.smithi136.stdout:5/290: write d5/ff [9192492,71580] 0 2024-09-18T12:51:11.247 INFO:tasks.workunit.client.0.smithi081.stdout:8/84: mkdir d3/d1e 0 2024-09-18T12:51:11.248 INFO:tasks.workunit.client.0.smithi081.stdout:6/61: dwrite d4/d6/fc [0,4194304] 0 2024-09-18T12:51:11.251 INFO:tasks.workunit.client.1.smithi136.stdout:9/280: link d6/df/d23/d2b/c48 d6/d13/d15/c5e 0 2024-09-18T12:51:11.251 INFO:tasks.workunit.client.0.smithi081.stdout:1/99: creat d0/db/d12/f22 x:0 0 0 2024-09-18T12:51:11.251 INFO:tasks.workunit.client.0.smithi081.stdout:1/100: stat d0/d18/d1a/d1f 0 2024-09-18T12:51:11.257 INFO:tasks.workunit.client.1.smithi136.stdout:9/281: mknod d6/db/d12/c5f 0 2024-09-18T12:51:11.258 INFO:tasks.workunit.client.0.smithi081.stdout:9/72: dread f7 [0,4194304] 0 2024-09-18T12:51:11.259 INFO:tasks.workunit.client.1.smithi136.stdout:9/282: dread d6/db/d49/d53/f54 [0,4194304] 0 2024-09-18T12:51:11.259 INFO:tasks.workunit.client.1.smithi136.stdout:9/283: chown d6/d13/d4c/f50 15380084 1 2024-09-18T12:51:11.259 INFO:tasks.workunit.client.0.smithi081.stdout:3/87: read d3/db/dc/de/f19 [341502,53497] 0 2024-09-18T12:51:11.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/284: creat d6/db/d12/f60 x:0 0 0 2024-09-18T12:51:11.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/285: fdatasync d6/df/f1f 0 2024-09-18T12:51:11.262 INFO:tasks.workunit.client.1.smithi136.stdout:9/286: write d6/db/d49/d53/f54 [1432631,14186] 0 2024-09-18T12:51:11.262 INFO:tasks.workunit.client.1.smithi136.stdout:9/287: fdatasync d6/d59/f35 0 2024-09-18T12:51:11.264 INFO:tasks.workunit.client.0.smithi081.stdout:4/82: dwrite d3/db/fe [0,4194304] 0 2024-09-18T12:51:11.268 INFO:tasks.workunit.client.1.smithi136.stdout:9/288: dread d6/d13/d15/f16 [4194304,4194304] 0 2024-09-18T12:51:11.268 INFO:tasks.workunit.client.1.smithi136.stdout:9/289: creat d6/d59/f61 x:0 0 0 2024-09-18T12:51:11.269 INFO:tasks.workunit.client.0.smithi081.stdout:8/85: write d3/f15 [395273,56173] 0 2024-09-18T12:51:11.269 INFO:tasks.workunit.client.0.smithi081.stdout:8/86: read - d3/f11 zero size 2024-09-18T12:51:11.270 INFO:tasks.workunit.client.0.smithi081.stdout:4/83: mkdir d3/d20 0 2024-09-18T12:51:11.270 INFO:tasks.workunit.client.0.smithi081.stdout:4/84: fsync d3/f10 0 2024-09-18T12:51:11.270 INFO:tasks.workunit.client.1.smithi136.stdout:8/420: dwrite d9/d14/d1a/d2b/f4d [0,4194304] 0 2024-09-18T12:51:11.270 INFO:tasks.workunit.client.1.smithi136.stdout:8/421: getdents d9/d14 0 2024-09-18T12:51:11.271 INFO:tasks.workunit.client.1.smithi136.stdout:6/293: truncate d8/d9/de/d1c/f5e 3760888 0 2024-09-18T12:51:11.271 INFO:tasks.workunit.client.1.smithi136.stdout:6/294: write d8/d9/d3c/f62 [862223,13671] 0 2024-09-18T12:51:11.271 INFO:tasks.workunit.client.0.smithi081.stdout:8/87: write d3/f18 [467441,29300] 0 2024-09-18T12:51:11.271 INFO:tasks.workunit.client.0.smithi081.stdout:8/88: write d3/f11 [672267,130568] 0 2024-09-18T12:51:11.272 INFO:tasks.workunit.client.1.smithi136.stdout:9/290: mkdir d6/db/d12/d62 0 2024-09-18T12:51:11.273 INFO:tasks.workunit.client.1.smithi136.stdout:8/422: write d9/d14/d1a/d2b/d42/f43 [1331753,47401] 0 2024-09-18T12:51:11.273 INFO:tasks.workunit.client.1.smithi136.stdout:8/423: fdatasync d9/d14/d1a/d2b/d42/d6e/f84 0 2024-09-18T12:51:11.275 INFO:tasks.workunit.client.1.smithi136.stdout:0/306: dwrite d1/d17/d2d/d35/f40 [0,4194304] 0 2024-09-18T12:51:11.276 INFO:tasks.workunit.client.1.smithi136.stdout:6/295: mknod d8/d9/d56/c6b 0 2024-09-18T12:51:11.276 INFO:tasks.workunit.client.0.smithi081.stdout:1/101: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:11.277 INFO:tasks.workunit.client.1.smithi136.stdout:9/291: mknod d6/db/d12/d62/c63 0 2024-09-18T12:51:11.277 INFO:tasks.workunit.client.1.smithi136.stdout:9/292: chown d6/df/f3b 201 1 2024-09-18T12:51:11.278 INFO:tasks.workunit.client.0.smithi081.stdout:4/85: write d3/f10 [62695,49420] 0 2024-09-18T12:51:11.278 INFO:tasks.workunit.client.0.smithi081.stdout:4/86: stat d3/f10 0 2024-09-18T12:51:11.278 INFO:tasks.workunit.client.1.smithi136.stdout:8/424: dread d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:11.279 INFO:tasks.workunit.client.0.smithi081.stdout:1/102: rename d0/d18/f1c to d0/db/d12/f23 0 2024-09-18T12:51:11.279 INFO:tasks.workunit.client.0.smithi081.stdout:1/103: creat d0/db/d12/f24 x:0 0 0 2024-09-18T12:51:11.279 INFO:tasks.workunit.client.0.smithi081.stdout:1/104: chown d0 0 1 2024-09-18T12:51:11.282 INFO:tasks.workunit.client.0.smithi081.stdout:9/73: read f8 [3242046,34723] 0 2024-09-18T12:51:11.282 INFO:tasks.workunit.client.0.smithi081.stdout:9/74: readlink dd/de/l18 0 2024-09-18T12:51:11.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/75: mkdir dd/d15/d1a 0 2024-09-18T12:51:11.285 INFO:tasks.workunit.client.0.smithi081.stdout:9/76: chown dd/de/l18 31310448 1 2024-09-18T12:51:11.286 INFO:tasks.workunit.client.0.smithi081.stdout:9/77: mkdir dd/d1b 0 2024-09-18T12:51:11.286 INFO:tasks.workunit.client.0.smithi081.stdout:9/78: stat dd/d1b 0 2024-09-18T12:51:11.287 INFO:tasks.workunit.client.0.smithi081.stdout:3/88: dwrite d3/db/dc/de/d13/f14 [0,4194304] 0 2024-09-18T12:51:11.287 INFO:tasks.workunit.client.0.smithi081.stdout:3/89: stat d3/l9 0 2024-09-18T12:51:11.287 INFO:tasks.workunit.client.0.smithi081.stdout:3/90: creat d3/db/dc/f22 x:0 0 0 2024-09-18T12:51:11.287 INFO:tasks.workunit.client.0.smithi081.stdout:3/91: dread - d3/db/dc/de/d13/d17/f18 zero size 2024-09-18T12:51:11.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/79: symlink dd/d15/d1a/l1c 0 2024-09-18T12:51:11.288 INFO:tasks.workunit.client.0.smithi081.stdout:6/62: dwrite d4/fe [0,4194304] 0 2024-09-18T12:51:11.289 INFO:tasks.workunit.client.1.smithi136.stdout:0/307: read d1/d17/f45 [3443406,11211] 0 2024-09-18T12:51:11.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/92: mkdir d3/d23 0 2024-09-18T12:51:11.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/93: write d3/f7 [3891297,29659] 0 2024-09-18T12:51:11.292 INFO:tasks.workunit.client.1.smithi136.stdout:8/425: mknod d9/d18/d34/d88/c9f 0 2024-09-18T12:51:11.292 INFO:tasks.workunit.client.1.smithi136.stdout:8/426: fdatasync d9/d18/f44 0 2024-09-18T12:51:11.292 INFO:tasks.workunit.client.1.smithi136.stdout:8/427: creat d9/d14/d1a/d7f/fa0 x:0 0 0 2024-09-18T12:51:11.295 INFO:tasks.workunit.client.0.smithi081.stdout:3/94: link d3/l6 d3/l24 0 2024-09-18T12:51:11.295 INFO:tasks.workunit.client.0.smithi081.stdout:3/95: fdatasync d3/db/dc/de/f19 0 2024-09-18T12:51:11.295 INFO:tasks.workunit.client.0.smithi081.stdout:3/96: getdents d3/db/dc/d1a 0 2024-09-18T12:51:11.305 INFO:tasks.workunit.client.1.smithi136.stdout:3/298: dwrite d3/f34 [0,4194304] 0 2024-09-18T12:51:11.310 INFO:tasks.workunit.client.0.smithi081.stdout:8/89: dwrite d3/f13 [0,4194304] 0 2024-09-18T12:51:11.312 INFO:tasks.workunit.client.0.smithi081.stdout:8/90: mknod d3/d1d/c1f 0 2024-09-18T12:51:11.312 INFO:tasks.workunit.client.0.smithi081.stdout:6/63: write d4/fe [11489,64009] 0 2024-09-18T12:51:11.312 INFO:tasks.workunit.client.0.smithi081.stdout:6/64: stat d4/fe 0 2024-09-18T12:51:11.313 INFO:tasks.workunit.client.0.smithi081.stdout:6/65: fsync f0 0 2024-09-18T12:51:11.313 INFO:tasks.workunit.client.0.smithi081.stdout:6/66: truncate d4/f13 1039085 0 2024-09-18T12:51:11.314 INFO:tasks.workunit.client.0.smithi081.stdout:8/91: link d3/l1c d3/l20 0 2024-09-18T12:51:11.322 INFO:tasks.workunit.client.1.smithi136.stdout:3/299: write d3/d14/d18/f50 [1882960,71148] 0 2024-09-18T12:51:11.323 INFO:tasks.workunit.client.1.smithi136.stdout:3/300: rename d3/l29 to d3/d5/d31/l5f 0 2024-09-18T12:51:11.325 INFO:tasks.workunit.client.1.smithi136.stdout:3/301: symlink d3/d10/l60 0 2024-09-18T12:51:11.325 INFO:tasks.workunit.client.1.smithi136.stdout:3/302: readlink d3/d14/d22/d2c/d3d/l45 0 2024-09-18T12:51:11.325 INFO:tasks.workunit.client.1.smithi136.stdout:3/303: creat d3/d14/d18/f61 x:0 0 0 2024-09-18T12:51:11.325 INFO:tasks.workunit.client.0.smithi081.stdout:8/92: write d3/f13 [3787884,79876] 0 2024-09-18T12:51:11.326 INFO:tasks.workunit.client.1.smithi136.stdout:6/296: dwrite d8/d9/de/d1c/f2b [4194304,4194304] 0 2024-09-18T12:51:11.326 INFO:tasks.workunit.client.1.smithi136.stdout:9/293: dwrite d6/d59/f2a [0,4194304] 0 2024-09-18T12:51:11.329 INFO:tasks.workunit.client.1.smithi136.stdout:3/304: unlink d3/d10/f16 0 2024-09-18T12:51:11.329 INFO:tasks.workunit.client.1.smithi136.stdout:3/305: write d3/d10/d4a/f58 [889132,30279] 0 2024-09-18T12:51:11.329 INFO:tasks.workunit.client.1.smithi136.stdout:0/308: dwrite d1/d17/f47 [4194304,4194304] 0 2024-09-18T12:51:11.329 INFO:tasks.workunit.client.1.smithi136.stdout:0/309: getdents d1/d60/d61 0 2024-09-18T12:51:11.333 INFO:tasks.workunit.client.1.smithi136.stdout:6/297: rmdir d8/d9/de/d1c/d4e 0 2024-09-18T12:51:11.334 INFO:tasks.workunit.client.1.smithi136.stdout:3/306: truncate d3/d14/f3a 3786698 0 2024-09-18T12:51:11.334 INFO:tasks.workunit.client.1.smithi136.stdout:3/307: write d3/d14/d22/f42 [1102769,67905] 0 2024-09-18T12:51:11.335 INFO:tasks.workunit.client.1.smithi136.stdout:6/298: creat d8/f6c x:0 0 0 2024-09-18T12:51:11.336 INFO:tasks.workunit.client.1.smithi136.stdout:6/299: rename d8/d9/d3c/d45/c5d to d8/d9/c6d 0 2024-09-18T12:51:11.336 INFO:tasks.workunit.client.1.smithi136.stdout:6/300: creat d8/dc/f6e x:0 0 0 2024-09-18T12:51:11.337 INFO:tasks.workunit.client.1.smithi136.stdout:0/310: rmdir d1/d60/d61 0 2024-09-18T12:51:11.338 INFO:tasks.workunit.client.1.smithi136.stdout:6/301: symlink d8/l6f 0 2024-09-18T12:51:11.338 INFO:tasks.workunit.client.1.smithi136.stdout:6/302: write d8/d9/f34 [4629726,84058] 0 2024-09-18T12:51:11.339 INFO:tasks.workunit.client.1.smithi136.stdout:0/311: mkdir d1/db/d69 0 2024-09-18T12:51:11.339 INFO:tasks.workunit.client.1.smithi136.stdout:6/303: creat d8/d9/de/f70 x:0 0 0 2024-09-18T12:51:11.340 INFO:tasks.workunit.client.1.smithi136.stdout:6/304: mkdir d8/d9/de/d60/d71 0 2024-09-18T12:51:11.340 INFO:tasks.workunit.client.1.smithi136.stdout:8/428: dwrite d9/d14/d1a/d2b/d42/d6e/f84 [0,4194304] 0 2024-09-18T12:51:11.341 INFO:tasks.workunit.client.0.smithi081.stdout:3/97: dwrite d3/fa [0,4194304] 0 2024-09-18T12:51:11.341 INFO:tasks.workunit.client.0.smithi081.stdout:6/67: fsync d4/d6/fd 0 2024-09-18T12:51:11.341 INFO:tasks.workunit.client.0.smithi081.stdout:6/68: fdatasync d4/f15 0 2024-09-18T12:51:11.342 INFO:tasks.workunit.client.0.smithi081.stdout:3/98: symlink d3/db/dc/de/d12/l25 0 2024-09-18T12:51:11.344 INFO:tasks.workunit.client.0.smithi081.stdout:9/80: dwrite f8 [0,4194304] 0 2024-09-18T12:51:11.344 INFO:tasks.workunit.client.1.smithi136.stdout:0/312: dread d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:11.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/69: rename d4/d6/c11 to d4/d12/c16 0 2024-09-18T12:51:11.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/70: chown d4/fa 3 1 2024-09-18T12:51:11.347 INFO:tasks.workunit.client.0.smithi081.stdout:3/99: unlink d3/l8 0 2024-09-18T12:51:11.348 INFO:tasks.workunit.client.0.smithi081.stdout:9/81: rmdir dd/de 39 2024-09-18T12:51:11.349 INFO:tasks.workunit.client.0.smithi081.stdout:9/82: mkdir dd/d1d 0 2024-09-18T12:51:11.350 INFO:tasks.workunit.client.0.smithi081.stdout:4/87: dwrite d3/f10 [0,4194304] 0 2024-09-18T12:51:11.351 INFO:tasks.workunit.client.0.smithi081.stdout:9/83: getdents dd/d15/d1a 0 2024-09-18T12:51:11.353 INFO:tasks.workunit.client.0.smithi081.stdout:4/88: link d3/db/fe d3/dd/f21 0 2024-09-18T12:51:11.353 INFO:tasks.workunit.client.0.smithi081.stdout:4/89: creat d3/f22 x:0 0 0 2024-09-18T12:51:11.354 INFO:tasks.workunit.client.1.smithi136.stdout:2/331: sync 2024-09-18T12:51:11.354 INFO:tasks.workunit.client.1.smithi136.stdout:4/181: sync 2024-09-18T12:51:11.354 INFO:tasks.workunit.client.1.smithi136.stdout:1/244: sync 2024-09-18T12:51:11.354 INFO:tasks.workunit.client.1.smithi136.stdout:4/182: dread - d0/d13/f35 zero size 2024-09-18T12:51:11.354 INFO:tasks.workunit.client.1.smithi136.stdout:4/183: fsync d0/d13/f35 0 2024-09-18T12:51:11.355 INFO:tasks.workunit.client.1.smithi136.stdout:2/332: truncate d5/d25/f2e 1514073 0 2024-09-18T12:51:11.355 INFO:tasks.workunit.client.1.smithi136.stdout:2/333: stat d5/d7/d3b/c4b 0 2024-09-18T12:51:11.355 INFO:tasks.workunit.client.1.smithi136.stdout:2/334: chown d5/d25/d2d/c54 14002384 1 2024-09-18T12:51:11.355 INFO:tasks.workunit.client.1.smithi136.stdout:2/335: fsync d5/f22 0 2024-09-18T12:51:11.358 INFO:tasks.workunit.client.1.smithi136.stdout:1/245: creat d2/d5/d2b/f4a x:0 0 0 2024-09-18T12:51:11.359 INFO:tasks.workunit.client.1.smithi136.stdout:3/308: dread d3/d14/d22/f42 [0,4194304] 0 2024-09-18T12:51:11.359 INFO:tasks.workunit.client.1.smithi136.stdout:4/184: truncate d0/d3/f4 4640591 0 2024-09-18T12:51:11.361 INFO:tasks.workunit.client.0.smithi081.stdout:3/100: write d3/fa [3502822,22106] 0 2024-09-18T12:51:11.362 INFO:tasks.workunit.client.1.smithi136.stdout:2/336: mknod d5/d7/d17/d48/c66 0 2024-09-18T12:51:11.364 INFO:tasks.workunit.client.0.smithi081.stdout:8/93: dwrite d3/f15 [0,4194304] 0 2024-09-18T12:51:11.364 INFO:tasks.workunit.client.1.smithi136.stdout:8/429: dread d9/d14/d1a/d2b/f58 [0,4194304] 0 2024-09-18T12:51:11.365 INFO:tasks.workunit.client.1.smithi136.stdout:8/430: chown d9/d18/f44 64083533 1 2024-09-18T12:51:11.365 INFO:tasks.workunit.client.1.smithi136.stdout:8/431: fdatasync d9/d14/f1f 0 2024-09-18T12:51:11.365 INFO:tasks.workunit.client.1.smithi136.stdout:1/246: rename d2/d5/d9/d23/f3e to d2/d5/d2b/d34/f4b 0 2024-09-18T12:51:11.368 INFO:tasks.workunit.client.1.smithi136.stdout:3/309: creat d3/d14/d17/f62 x:0 0 0 2024-09-18T12:51:11.369 INFO:tasks.workunit.client.0.smithi081.stdout:4/90: write d3/db/fe [3192649,27543] 0 2024-09-18T12:51:11.369 INFO:tasks.workunit.client.0.smithi081.stdout:4/91: chown d3/lf 53 1 2024-09-18T12:51:11.369 INFO:tasks.workunit.client.0.smithi081.stdout:4/92: write d3/db/fe [265449,128462] 0 2024-09-18T12:51:11.369 INFO:tasks.workunit.client.0.smithi081.stdout:4/93: chown d3/dd/d14/c17 226 1 2024-09-18T12:51:11.369 INFO:tasks.workunit.client.0.smithi081.stdout:4/94: stat d3/dd/d14/f1e 0 2024-09-18T12:51:11.370 INFO:tasks.workunit.client.1.smithi136.stdout:4/185: creat d0/d3/f36 x:0 0 0 2024-09-18T12:51:11.370 INFO:tasks.workunit.client.0.smithi081.stdout:4/95: write d3/dd/d14/f1e [322033,97635] 0 2024-09-18T12:51:11.374 INFO:tasks.workunit.client.1.smithi136.stdout:8/432: mknod d9/d14/d1a/d2b/ca1 0 2024-09-18T12:51:11.375 INFO:tasks.workunit.client.1.smithi136.stdout:4/186: symlink d0/d2/l37 0 2024-09-18T12:51:11.375 INFO:tasks.workunit.client.1.smithi136.stdout:4/187: fsync d0/d13/f35 0 2024-09-18T12:51:11.376 INFO:tasks.workunit.client.1.smithi136.stdout:2/337: getdents d5/d25/d2d 0 2024-09-18T12:51:11.378 INFO:tasks.workunit.client.1.smithi136.stdout:3/310: dread d3/d14/d17/f4d [0,4194304] 0 2024-09-18T12:51:11.379 INFO:tasks.workunit.client.1.smithi136.stdout:2/338: dread d5/d25/f28 [0,4194304] 0 2024-09-18T12:51:11.379 INFO:tasks.workunit.client.1.smithi136.stdout:2/339: fdatasync d5/f9 0 2024-09-18T12:51:11.379 INFO:tasks.workunit.client.1.smithi136.stdout:2/340: stat d5/d7/d3b/l49 0 2024-09-18T12:51:11.380 INFO:tasks.workunit.client.1.smithi136.stdout:3/311: mknod d3/d14/d17/d53/c63 0 2024-09-18T12:51:11.382 INFO:tasks.workunit.client.0.smithi081.stdout:3/101: dread d3/db/dc/de/d13/f14 [0,4194304] 0 2024-09-18T12:51:11.382 INFO:tasks.workunit.client.0.smithi081.stdout:3/102: chown d3/l24 3826928 1 2024-09-18T12:51:11.382 INFO:tasks.workunit.client.1.smithi136.stdout:2/341: mkdir d5/d4a/d67 0 2024-09-18T12:51:11.383 INFO:tasks.workunit.client.0.smithi081.stdout:3/103: symlink d3/db/dc/l26 0 2024-09-18T12:51:11.385 INFO:tasks.workunit.client.1.smithi136.stdout:6/305: dwrite d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:11.385 INFO:tasks.workunit.client.1.smithi136.stdout:6/306: read - d8/d9/d64/f69 zero size 2024-09-18T12:51:11.385 INFO:tasks.workunit.client.1.smithi136.stdout:6/307: creat d8/d9/d56/f72 x:0 0 0 2024-09-18T12:51:11.385 INFO:tasks.workunit.client.1.smithi136.stdout:6/308: fsync d8/dc/f14 0 2024-09-18T12:51:11.386 INFO:tasks.workunit.client.1.smithi136.stdout:2/342: mknod d5/d7/d41/c68 0 2024-09-18T12:51:11.386 INFO:tasks.workunit.client.0.smithi081.stdout:3/104: creat d3/db/dc/d1a/f27 x:0 0 0 2024-09-18T12:51:11.386 INFO:tasks.workunit.client.0.smithi081.stdout:3/105: write d3/db/dc/f22 [327913,81453] 0 2024-09-18T12:51:11.386 INFO:tasks.workunit.client.0.smithi081.stdout:3/106: chown d3/db/l11 1559578 1 2024-09-18T12:51:11.386 INFO:tasks.workunit.client.0.smithi081.stdout:3/107: creat d3/db/dc/f28 x:0 0 0 2024-09-18T12:51:11.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/94: read d3/f13 [8294161,129162] 0 2024-09-18T12:51:11.387 INFO:tasks.workunit.client.1.smithi136.stdout:6/309: dread d8/d9/de/f28 [0,4194304] 0 2024-09-18T12:51:11.390 INFO:tasks.workunit.client.1.smithi136.stdout:7/475: sync 2024-09-18T12:51:11.390 INFO:tasks.workunit.client.1.smithi136.stdout:7/476: stat d0/f29 0 2024-09-18T12:51:11.390 INFO:tasks.workunit.client.1.smithi136.stdout:7/477: write d0/d35/d41/f5c [3951268,126380] 0 2024-09-18T12:51:11.390 INFO:tasks.workunit.client.1.smithi136.stdout:7/478: dread - d0/d2c/d85/fa6 zero size 2024-09-18T12:51:11.391 INFO:tasks.workunit.client.1.smithi136.stdout:2/343: rmdir d5/d25/d43/d5c 0 2024-09-18T12:51:11.392 INFO:tasks.workunit.client.0.smithi081.stdout:3/108: dread d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:11.392 INFO:tasks.workunit.client.1.smithi136.stdout:5/291: sync 2024-09-18T12:51:11.396 INFO:tasks.workunit.client.1.smithi136.stdout:2/344: creat d5/d7/d3b/f69 x:0 0 0 2024-09-18T12:51:11.397 INFO:tasks.workunit.client.0.smithi081.stdout:3/109: rename d3/db/dc/de to d3/db/df/d29 0 2024-09-18T12:51:11.398 INFO:tasks.workunit.client.1.smithi136.stdout:5/292: truncate d5/d1a/f3a 7252240 0 2024-09-18T12:51:11.400 INFO:tasks.workunit.client.1.smithi136.stdout:0/313: dwrite d1/f18 [0,4194304] 0 2024-09-18T12:51:11.400 INFO:tasks.workunit.client.0.smithi081.stdout:3/110: rename d3/fa to d3/db/df/d29/d13/f2a 0 2024-09-18T12:51:11.401 INFO:tasks.workunit.client.0.smithi081.stdout:6/71: dwrite d4/f7 [0,4194304] 0 2024-09-18T12:51:11.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/111: rename d3/db/df/d29/d13/d17/f18 to d3/db/df/d29/d13/f2b 0 2024-09-18T12:51:11.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/112: read d3/db/df/d29/f19 [1653710,1215] 0 2024-09-18T12:51:11.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/113: stat d3/db/df/d29 0 2024-09-18T12:51:11.407 INFO:tasks.workunit.client.1.smithi136.stdout:2/345: mknod d5/d7/d3b/c6a 0 2024-09-18T12:51:11.407 INFO:tasks.workunit.client.1.smithi136.stdout:2/346: chown d5/d7/d17/f47 652654 1 2024-09-18T12:51:11.408 INFO:tasks.workunit.client.1.smithi136.stdout:6/310: rmdir d8 39 2024-09-18T12:51:11.408 INFO:tasks.workunit.client.1.smithi136.stdout:6/311: truncate d8/d9/d3c/d4a/f54 814466 0 2024-09-18T12:51:11.410 INFO:tasks.workunit.client.0.smithi081.stdout:3/114: rmdir d3/db/d1b 39 2024-09-18T12:51:11.411 INFO:tasks.workunit.client.0.smithi081.stdout:3/115: write d3/db/dc/f22 [51183,36924] 0 2024-09-18T12:51:11.412 INFO:tasks.workunit.client.1.smithi136.stdout:2/347: creat d5/d7/d17/f6b x:0 0 0 2024-09-18T12:51:11.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/72: dread f1 [0,4194304] 0 2024-09-18T12:51:11.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/73: chown f3 1648486553 1 2024-09-18T12:51:11.413 INFO:tasks.workunit.client.0.smithi081.stdout:3/116: creat d3/db/f2c x:0 0 0 2024-09-18T12:51:11.414 INFO:tasks.workunit.client.0.smithi081.stdout:3/117: creat d3/db/df/d29/d13/d17/f2d x:0 0 0 2024-09-18T12:51:11.414 INFO:tasks.workunit.client.0.smithi081.stdout:3/118: dread - d3/db/dc/f28 zero size 2024-09-18T12:51:11.414 INFO:tasks.workunit.client.0.smithi081.stdout:3/119: chown d3/db/df/d29/d13/d17/c1c 114364418 1 2024-09-18T12:51:11.415 INFO:tasks.workunit.client.0.smithi081.stdout:9/84: dwrite f7 [0,4194304] 0 2024-09-18T12:51:11.416 INFO:tasks.workunit.client.0.smithi081.stdout:9/85: mkdir dd/d1d/d1e 0 2024-09-18T12:51:11.416 INFO:tasks.workunit.client.0.smithi081.stdout:9/86: dread - fa zero size 2024-09-18T12:51:11.416 INFO:tasks.workunit.client.1.smithi136.stdout:6/312: creat d8/d9/de/d1c/d50/f73 x:0 0 0 2024-09-18T12:51:11.417 INFO:tasks.workunit.client.1.smithi136.stdout:6/313: fsync d8/dc/f15 0 2024-09-18T12:51:11.417 INFO:tasks.workunit.client.1.smithi136.stdout:7/479: dwrite d0/d39/f43 [0,4194304] 0 2024-09-18T12:51:11.417 INFO:tasks.workunit.client.1.smithi136.stdout:1/247: dwrite d2/d5/d11/f19 [4194304,4194304] 0 2024-09-18T12:51:11.417 INFO:tasks.workunit.client.1.smithi136.stdout:8/433: dwrite d9/d18/d34/f6f [0,4194304] 0 2024-09-18T12:51:11.418 INFO:tasks.workunit.client.0.smithi081.stdout:9/87: rmdir dd 39 2024-09-18T12:51:11.418 INFO:tasks.workunit.client.1.smithi136.stdout:3/312: dwrite d3/d10/f43 [0,4194304] 0 2024-09-18T12:51:11.418 INFO:tasks.workunit.client.1.smithi136.stdout:3/313: chown d3 375874 1 2024-09-18T12:51:11.418 INFO:tasks.workunit.client.1.smithi136.stdout:2/348: creat d5/d25/f6c x:0 0 0 2024-09-18T12:51:11.420 INFO:tasks.workunit.client.0.smithi081.stdout:9/88: dread f0 [0,4194304] 0 2024-09-18T12:51:11.421 INFO:tasks.workunit.client.0.smithi081.stdout:9/89: chown dd/c14 1377433947 1 2024-09-18T12:51:11.421 INFO:tasks.workunit.client.0.smithi081.stdout:3/120: truncate d3/db/df/d29/d13/f2a 1091832 0 2024-09-18T12:51:11.421 INFO:tasks.workunit.client.1.smithi136.stdout:5/293: rename d5/ff to d5/f4f 0 2024-09-18T12:51:11.422 INFO:tasks.workunit.client.0.smithi081.stdout:3/121: mkdir d3/db/df/d29/d13/d17/d2e 0 2024-09-18T12:51:11.430 INFO:tasks.workunit.client.1.smithi136.stdout:3/314: mknod d3/d14/d17/d27/c64 0 2024-09-18T12:51:11.430 INFO:tasks.workunit.client.1.smithi136.stdout:3/315: chown d3/d10/d4a/c55 10553372 1 2024-09-18T12:51:11.430 INFO:tasks.workunit.client.1.smithi136.stdout:2/349: truncate d5/d7/f12 3329655 0 2024-09-18T12:51:11.430 INFO:tasks.workunit.client.1.smithi136.stdout:2/350: chown d5/d7/d11/c18 37 1 2024-09-18T12:51:11.431 INFO:tasks.workunit.client.0.smithi081.stdout:0/135: sync 2024-09-18T12:51:11.431 INFO:tasks.workunit.client.0.smithi081.stdout:0/136: chown d7/d13/l28 12822198 1 2024-09-18T12:51:11.431 INFO:tasks.workunit.client.1.smithi136.stdout:7/480: dread d0/d39/f7e [0,4194304] 0 2024-09-18T12:51:11.431 INFO:tasks.workunit.client.1.smithi136.stdout:7/481: chown d0/d35/d41/d50/d5a/d98 409 1 2024-09-18T12:51:11.432 INFO:tasks.workunit.client.1.smithi136.stdout:5/294: mknod d5/d1a/d30/c50 0 2024-09-18T12:51:11.432 INFO:tasks.workunit.client.0.smithi081.stdout:0/137: symlink d7/l30 0 2024-09-18T12:51:11.432 INFO:tasks.workunit.client.0.smithi081.stdout:0/138: stat d7/d9/cc 0 2024-09-18T12:51:11.433 INFO:tasks.workunit.client.0.smithi081.stdout:9/90: dread f7 [0,4194304] 0 2024-09-18T12:51:11.433 INFO:tasks.workunit.client.1.smithi136.stdout:3/316: truncate d3/d2b/f4b 2203585 0 2024-09-18T12:51:11.433 INFO:tasks.workunit.client.1.smithi136.stdout:3/317: write d3/f9 [2782553,125219] 0 2024-09-18T12:51:11.435 INFO:tasks.workunit.client.1.smithi136.stdout:2/351: creat d5/d25/d2d/f6d x:0 0 0 2024-09-18T12:51:11.436 INFO:tasks.workunit.client.1.smithi136.stdout:5/295: chown d5/cb 288 1 2024-09-18T12:51:11.436 INFO:tasks.workunit.client.1.smithi136.stdout:5/296: fsync d5/f2a 0 2024-09-18T12:51:11.436 INFO:tasks.workunit.client.1.smithi136.stdout:5/297: chown d5/d1a/d2d/d34/c4b 1145 1 2024-09-18T12:51:11.437 INFO:tasks.workunit.client.1.smithi136.stdout:1/248: rename d2/d1c to d2/d5/d11/d2e/d4c 0 2024-09-18T12:51:11.439 INFO:tasks.workunit.client.1.smithi136.stdout:3/318: creat d3/d5/d31/f65 x:0 0 0 2024-09-18T12:51:11.439 INFO:tasks.workunit.client.0.smithi081.stdout:6/74: dwrite f1 [4194304,4194304] 0 2024-09-18T12:51:11.440 INFO:tasks.workunit.client.1.smithi136.stdout:2/352: mknod d5/d25/d2d/c6e 0 2024-09-18T12:51:11.441 INFO:tasks.workunit.client.1.smithi136.stdout:2/353: dread d5/d7/d41/f58 [0,4194304] 0 2024-09-18T12:51:11.441 INFO:tasks.workunit.client.1.smithi136.stdout:1/249: symlink d2/d5/d11/d2e/l4d 0 2024-09-18T12:51:11.442 INFO:tasks.workunit.client.1.smithi136.stdout:3/319: symlink d3/d14/d22/d2c/d3d/l66 0 2024-09-18T12:51:11.442 INFO:tasks.workunit.client.1.smithi136.stdout:3/320: chown d3/d14/d17/d1a/c4f 7984077 1 2024-09-18T12:51:11.443 INFO:tasks.workunit.client.1.smithi136.stdout:2/354: truncate d5/d7/d17/f47 5874591 0 2024-09-18T12:51:11.444 INFO:tasks.workunit.client.1.smithi136.stdout:6/314: getdents d8/d9/de/d1c/d50 0 2024-09-18T12:51:11.445 INFO:tasks.workunit.client.0.smithi081.stdout:9/91: write dd/d15/f16 [3531489,34979] 0 2024-09-18T12:51:11.445 INFO:tasks.workunit.client.0.smithi081.stdout:9/92: fdatasync f7 0 2024-09-18T12:51:11.446 INFO:tasks.workunit.client.0.smithi081.stdout:9/93: creat dd/d1b/f1f x:0 0 0 2024-09-18T12:51:11.448 INFO:tasks.workunit.client.0.smithi081.stdout:6/75: dread f3 [0,4194304] 0 2024-09-18T12:51:11.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/122: dwrite d3/db/f2c [0,4194304] 0 2024-09-18T12:51:11.449 INFO:tasks.workunit.client.0.smithi081.stdout:9/94: creat dd/f20 x:0 0 0 2024-09-18T12:51:11.449 INFO:tasks.workunit.client.0.smithi081.stdout:3/123: chown d3/l9 62651 1 2024-09-18T12:51:11.449 INFO:tasks.workunit.client.1.smithi136.stdout:8/434: dwrite d9/d18/d34/d3d/f4b [0,4194304] 0 2024-09-18T12:51:11.449 INFO:tasks.workunit.client.1.smithi136.stdout:8/435: truncate d9/d18/d34/d3d/d47/d65/f76 39377 0 2024-09-18T12:51:11.449 INFO:tasks.workunit.client.1.smithi136.stdout:8/436: write d9/d18/d34/d3d/f50 [153444,87593] 0 2024-09-18T12:51:11.450 INFO:tasks.workunit.client.1.smithi136.stdout:3/321: getdents d3/d14/d17/d27 0 2024-09-18T12:51:11.452 INFO:tasks.workunit.client.1.smithi136.stdout:5/298: read d5/d1a/f43 [8251926,53659] 0 2024-09-18T12:51:11.453 INFO:tasks.workunit.client.0.smithi081.stdout:6/76: dread d4/d6/fb [0,4194304] 0 2024-09-18T12:51:11.453 INFO:tasks.workunit.client.0.smithi081.stdout:6/77: write d4/d6/fd [1521612,125321] 0 2024-09-18T12:51:11.454 INFO:tasks.workunit.client.1.smithi136.stdout:3/322: getdents d3/d14/d17/d53 0 2024-09-18T12:51:11.455 INFO:tasks.workunit.client.1.smithi136.stdout:3/323: write d3/d14/f3a [1774890,40267] 0 2024-09-18T12:51:11.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/78: rmdir d4/d6/d10 0 2024-09-18T12:51:11.457 INFO:tasks.workunit.client.1.smithi136.stdout:1/250: dread d2/d5/fa [0,4194304] 0 2024-09-18T12:51:11.458 INFO:tasks.workunit.client.0.smithi081.stdout:6/79: getdents d4 0 2024-09-18T12:51:11.460 INFO:tasks.workunit.client.1.smithi136.stdout:5/299: mknod d5/d1a/d4a/c51 0 2024-09-18T12:51:11.461 INFO:tasks.workunit.client.1.smithi136.stdout:3/324: symlink d3/d14/d17/d1a/l67 0 2024-09-18T12:51:11.462 INFO:tasks.workunit.client.1.smithi136.stdout:3/325: creat d3/d14/d22/d2c/f68 x:0 0 0 2024-09-18T12:51:11.462 INFO:tasks.workunit.client.1.smithi136.stdout:8/437: dread d9/d18/f41 [0,4194304] 0 2024-09-18T12:51:11.463 INFO:tasks.workunit.client.1.smithi136.stdout:1/251: mknod d2/d5/d11/d2e/c4e 0 2024-09-18T12:51:11.464 INFO:tasks.workunit.client.1.smithi136.stdout:5/300: mknod d5/d1a/d4a/c52 0 2024-09-18T12:51:11.465 INFO:tasks.workunit.client.1.smithi136.stdout:5/301: creat d5/d1a/f53 x:0 0 0 2024-09-18T12:51:11.465 INFO:tasks.workunit.client.1.smithi136.stdout:8/438: write d9/d14/f1d [1315165,15962] 0 2024-09-18T12:51:11.466 INFO:tasks.workunit.client.1.smithi136.stdout:6/315: dwrite d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:11.469 INFO:tasks.workunit.client.1.smithi136.stdout:3/326: link d3/d14/d22/c25 d3/d10/c69 0 2024-09-18T12:51:11.469 INFO:tasks.workunit.client.1.smithi136.stdout:3/327: fdatasync d3/f9 0 2024-09-18T12:51:11.470 INFO:tasks.workunit.client.1.smithi136.stdout:1/252: creat d2/d5/d11/d2e/f4f x:0 0 0 2024-09-18T12:51:11.472 INFO:tasks.workunit.client.1.smithi136.stdout:7/482: dwrite d0/d2c/d2e/f3f [0,4194304] 0 2024-09-18T12:51:11.472 INFO:tasks.workunit.client.1.smithi136.stdout:7/483: fdatasync d0/d35/d41/d50/f5d 0 2024-09-18T12:51:11.472 INFO:tasks.workunit.client.1.smithi136.stdout:7/484: creat d0/d35/d41/d50/d5a/fa7 x:0 0 0 2024-09-18T12:51:11.474 INFO:tasks.workunit.client.1.smithi136.stdout:8/439: mknod d9/d18/d34/d3d/d47/d65/d93/d96/d9b/ca2 0 2024-09-18T12:51:11.478 INFO:tasks.workunit.client.1.smithi136.stdout:6/316: creat d8/d9/f74 x:0 0 0 2024-09-18T12:51:11.479 INFO:tasks.workunit.client.0.smithi081.stdout:0/139: dwrite d7/d13/f24 [4194304,4194304] 0 2024-09-18T12:51:11.482 INFO:tasks.workunit.client.0.smithi081.stdout:0/140: rename d7/d13/f24 to d7/d9/d12/f31 0 2024-09-18T12:51:11.483 INFO:tasks.workunit.client.0.smithi081.stdout:3/124: dwrite d3/db/df/d29/d13/f14 [0,4194304] 0 2024-09-18T12:51:11.483 INFO:tasks.workunit.client.0.smithi081.stdout:3/125: readlink d3/l9 0 2024-09-18T12:51:11.484 INFO:tasks.workunit.client.0.smithi081.stdout:0/141: creat d7/f32 x:0 0 0 2024-09-18T12:51:11.484 INFO:tasks.workunit.client.1.smithi136.stdout:8/440: symlink d9/d18/d34/la3 0 2024-09-18T12:51:11.485 INFO:tasks.workunit.client.1.smithi136.stdout:6/317: rmdir d8 39 2024-09-18T12:51:11.486 INFO:tasks.workunit.client.1.smithi136.stdout:5/302: dwrite d5/d1a/f1b [0,4194304] 0 2024-09-18T12:51:11.487 INFO:tasks.workunit.client.0.smithi081.stdout:0/142: rmdir d7/d9/d2e 0 2024-09-18T12:51:11.487 INFO:tasks.workunit.client.0.smithi081.stdout:3/126: dread d3/db/dc/f22 [0,4194304] 0 2024-09-18T12:51:11.487 INFO:tasks.workunit.client.0.smithi081.stdout:3/127: stat d3 0 2024-09-18T12:51:11.488 INFO:tasks.workunit.client.0.smithi081.stdout:3/128: creat d3/db/df/d29/d13/d17/d2e/f2f x:0 0 0 2024-09-18T12:51:11.488 INFO:tasks.workunit.client.0.smithi081.stdout:3/129: stat d3 0 2024-09-18T12:51:11.492 INFO:tasks.workunit.client.1.smithi136.stdout:8/441: mkdir d9/d14/d1a/d2b/d42/da4 0 2024-09-18T12:51:11.494 INFO:tasks.workunit.client.1.smithi136.stdout:6/318: dread d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:11.495 INFO:tasks.workunit.client.0.smithi081.stdout:3/130: dread d3/db/df/d29/d13/f1e [0,4194304] 0 2024-09-18T12:51:11.495 INFO:tasks.workunit.client.0.smithi081.stdout:3/131: chown d3/c20 564753 1 2024-09-18T12:51:11.495 INFO:tasks.workunit.client.0.smithi081.stdout:3/132: stat d3/d23 0 2024-09-18T12:51:11.495 INFO:tasks.workunit.client.0.smithi081.stdout:3/133: stat d3/c4 0 2024-09-18T12:51:11.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/134: creat d3/db/df/d29/f30 x:0 0 0 2024-09-18T12:51:11.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/135: chown d3/db/dc/d1a/f27 8156 1 2024-09-18T12:51:11.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/136: write d3/db/d1b/f1f [511516,76142] 0 2024-09-18T12:51:11.498 INFO:tasks.workunit.client.1.smithi136.stdout:6/319: mknod d8/d9/de/d60/c75 0 2024-09-18T12:51:11.498 INFO:tasks.workunit.client.0.smithi081.stdout:3/137: mknod d3/db/df/d29/d13/d17/c31 0 2024-09-18T12:51:11.499 INFO:tasks.workunit.client.0.smithi081.stdout:3/138: truncate f1 2428988 0 2024-09-18T12:51:11.500 INFO:tasks.workunit.client.1.smithi136.stdout:5/303: link d5/d1a/d2d/d34/f2e d5/f54 0 2024-09-18T12:51:11.500 INFO:tasks.workunit.client.1.smithi136.stdout:1/253: getdents d2/d5/d11/d2e 0 2024-09-18T12:51:11.501 INFO:tasks.workunit.client.1.smithi136.stdout:1/254: stat d2/d5/d9/f32 0 2024-09-18T12:51:11.502 INFO:tasks.workunit.client.1.smithi136.stdout:6/320: getdents d8/d9/d3c 0 2024-09-18T12:51:11.503 INFO:tasks.workunit.client.1.smithi136.stdout:5/304: symlink d5/d1a/l55 0 2024-09-18T12:51:11.505 INFO:tasks.workunit.client.1.smithi136.stdout:1/255: mkdir d2/d5/d9/d23/d50 0 2024-09-18T12:51:11.505 INFO:tasks.workunit.client.1.smithi136.stdout:1/256: write d2/d5/d11/d2e/f4f [1023261,50099] 0 2024-09-18T12:51:11.506 INFO:tasks.workunit.client.1.smithi136.stdout:1/257: truncate d2/d5/d9/d23/f48 773461 0 2024-09-18T12:51:11.506 INFO:tasks.workunit.client.1.smithi136.stdout:5/305: mknod d5/d1a/c56 0 2024-09-18T12:51:11.507 INFO:tasks.workunit.client.1.smithi136.stdout:5/306: creat d5/d1a/d30/f57 x:0 0 0 2024-09-18T12:51:11.508 INFO:tasks.workunit.client.1.smithi136.stdout:5/307: creat d5/d1a/d2d/f58 x:0 0 0 2024-09-18T12:51:11.508 INFO:tasks.workunit.client.0.smithi081.stdout:6/80: dwrite d4/f13 [0,4194304] 0 2024-09-18T12:51:11.510 INFO:tasks.workunit.client.1.smithi136.stdout:5/308: rename d5/d1a/d2d/f39 to d5/d1a/d4a/f59 0 2024-09-18T12:51:11.510 INFO:tasks.workunit.client.1.smithi136.stdout:5/309: chown d5/d1a/d2d/d34/f35 3 1 2024-09-18T12:51:11.512 INFO:tasks.workunit.client.1.smithi136.stdout:5/310: symlink d5/d1a/d30/l5a 0 2024-09-18T12:51:11.512 INFO:tasks.workunit.client.1.smithi136.stdout:5/311: chown d5/d1a/d30/f48 398569 1 2024-09-18T12:51:11.523 INFO:tasks.workunit.client.1.smithi136.stdout:3/328: dwrite d3/d10/f5e [0,4194304] 0 2024-09-18T12:51:11.526 INFO:tasks.workunit.client.0.smithi081.stdout:0/143: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:51:11.527 INFO:tasks.workunit.client.1.smithi136.stdout:3/329: symlink d3/d14/d17/d1a/l6a 0 2024-09-18T12:51:11.527 INFO:tasks.workunit.client.1.smithi136.stdout:7/485: dwrite d0/f29 [0,4194304] 0 2024-09-18T12:51:11.529 INFO:tasks.workunit.client.1.smithi136.stdout:3/330: symlink d3/d5/l6b 0 2024-09-18T12:51:11.532 INFO:tasks.workunit.client.0.smithi081.stdout:3/139: getdents d3/db/df/d29/d13/d17 0 2024-09-18T12:51:11.532 INFO:tasks.workunit.client.0.smithi081.stdout:3/140: read - d3/db/df/d29/d13/f2b zero size 2024-09-18T12:51:11.533 INFO:tasks.workunit.client.1.smithi136.stdout:7/486: rename d0/d35/d4f/d66 to d0/da8 0 2024-09-18T12:51:11.533 INFO:tasks.workunit.client.1.smithi136.stdout:7/487: chown d0/d35/d4f/f82 248 1 2024-09-18T12:51:11.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/144: mkdir d7/d9/d12/d2b/d33 0 2024-09-18T12:51:11.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/145: chown d7/l2d 536569732 1 2024-09-18T12:51:11.535 INFO:tasks.workunit.client.1.smithi136.stdout:3/331: rename d3/d14/d17/d27 to d3/d2b/d6c 0 2024-09-18T12:51:11.535 INFO:tasks.workunit.client.1.smithi136.stdout:3/332: creat d3/d14/d17/d1a/f6d x:0 0 0 2024-09-18T12:51:11.536 INFO:tasks.workunit.client.0.smithi081.stdout:3/141: symlink d3/l32 0 2024-09-18T12:51:11.536 INFO:tasks.workunit.client.1.smithi136.stdout:8/442: dwrite d9/d14/f1d [0,4194304] 0 2024-09-18T12:51:11.536 INFO:tasks.workunit.client.1.smithi136.stdout:7/488: link d0/l8 d0/d39/d4d/d9a/da2/la9 0 2024-09-18T12:51:11.536 INFO:tasks.workunit.client.1.smithi136.stdout:7/489: chown d0/d35/d36/f22 10061040 1 2024-09-18T12:51:11.537 INFO:tasks.workunit.client.0.smithi081.stdout:3/142: link d3/c4 d3/db/d1b/c33 0 2024-09-18T12:51:11.539 INFO:tasks.workunit.client.1.smithi136.stdout:3/333: unlink d3/f34 0 2024-09-18T12:51:11.539 INFO:tasks.workunit.client.1.smithi136.stdout:3/334: truncate d3/d14/d22/d2c/d3d/f3f 1762291 0 2024-09-18T12:51:11.541 INFO:tasks.workunit.client.0.smithi081.stdout:6/81: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:51:11.542 INFO:tasks.workunit.client.1.smithi136.stdout:1/258: dwrite d2/d5/d9/f3b [4194304,4194304] 0 2024-09-18T12:51:11.543 INFO:tasks.workunit.client.0.smithi081.stdout:3/143: dread d3/db/df/d29/d13/f1e [0,4194304] 0 2024-09-18T12:51:11.543 INFO:tasks.workunit.client.0.smithi081.stdout:3/144: write d3/db/df/d29/d13/f2b [834216,123499] 0 2024-09-18T12:51:11.543 INFO:tasks.workunit.client.1.smithi136.stdout:8/443: truncate d9/d18/d34/d3d/f54 367666 0 2024-09-18T12:51:11.543 INFO:tasks.workunit.client.1.smithi136.stdout:5/312: dwrite d5/d1a/d2d/d34/f35 [0,4194304] 0 2024-09-18T12:51:11.543 INFO:tasks.workunit.client.1.smithi136.stdout:5/313: creat d5/d1a/d30/f5b x:0 0 0 2024-09-18T12:51:11.545 INFO:tasks.workunit.client.1.smithi136.stdout:7/490: creat d0/d35/d36/d64/faa x:0 0 0 2024-09-18T12:51:11.547 INFO:tasks.workunit.client.0.smithi081.stdout:6/82: mknod d4/c17 0 2024-09-18T12:51:11.547 INFO:tasks.workunit.client.0.smithi081.stdout:6/83: fdatasync f0 0 2024-09-18T12:51:11.548 INFO:tasks.workunit.client.0.smithi081.stdout:0/146: dread d7/d9/d12/f31 [4194304,4194304] 0 2024-09-18T12:51:11.548 INFO:tasks.workunit.client.1.smithi136.stdout:3/335: mknod d3/d14/d22/d2c/d3d/c6e 0 2024-09-18T12:51:11.550 INFO:tasks.workunit.client.0.smithi081.stdout:3/145: rename d3/db/df/d29/d13/d17/f2d to d3/db/d1b/f34 0 2024-09-18T12:51:11.550 INFO:tasks.workunit.client.0.smithi081.stdout:3/146: write d3/db/df/d29/d13/d17/d2e/f2f [216165,41028] 0 2024-09-18T12:51:11.552 INFO:tasks.workunit.client.0.smithi081.stdout:7/118: sync 2024-09-18T12:51:11.556 INFO:tasks.workunit.client.0.smithi081.stdout:6/84: rename f3 to d4/f18 0 2024-09-18T12:51:11.556 INFO:tasks.workunit.client.1.smithi136.stdout:1/259: mkdir d2/d5/d9/d23/d51 0 2024-09-18T12:51:11.556 INFO:tasks.workunit.client.1.smithi136.stdout:1/260: chown d2/f3c 11632 1 2024-09-18T12:51:11.559 INFO:tasks.workunit.client.1.smithi136.stdout:1/261: dread d2/d5/fa [0,4194304] 0 2024-09-18T12:51:11.559 INFO:tasks.workunit.client.1.smithi136.stdout:1/262: fdatasync d2/d5/d11/d2e/d4c/f45 0 2024-09-18T12:51:11.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/85: mknod d4/d6/c19 0 2024-09-18T12:51:11.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/86: write d4/fa [68070,118655] 0 2024-09-18T12:51:11.561 INFO:tasks.workunit.client.0.smithi081.stdout:3/147: mknod d3/c35 0 2024-09-18T12:51:11.561 INFO:tasks.workunit.client.0.smithi081.stdout:3/148: dread - d3/db/dc/d1a/f27 zero size 2024-09-18T12:51:11.561 INFO:tasks.workunit.client.1.smithi136.stdout:3/336: creat d3/d2b/d6c/f6f x:0 0 0 2024-09-18T12:51:11.562 INFO:tasks.workunit.client.0.smithi081.stdout:3/149: write d3/db/df/d29/d13/f2b [251071,122984] 0 2024-09-18T12:51:11.562 INFO:tasks.workunit.client.0.smithi081.stdout:3/150: write d3/db/df/d29/d13/f2a [1187304,44454] 0 2024-09-18T12:51:11.562 INFO:tasks.workunit.client.0.smithi081.stdout:3/151: truncate d3/db/df/d29/d13/f2b 970943 0 2024-09-18T12:51:11.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/119: rmdir d2 39 2024-09-18T12:51:11.564 INFO:tasks.workunit.client.1.smithi136.stdout:3/337: symlink d3/d2b/l70 0 2024-09-18T12:51:11.565 INFO:tasks.workunit.client.1.smithi136.stdout:8/444: dread d9/d14/d1a/d2b/d42/f6d [0,4194304] 0 2024-09-18T12:51:11.565 INFO:tasks.workunit.client.0.smithi081.stdout:6/87: rmdir d4/d12 39 2024-09-18T12:51:11.566 INFO:tasks.workunit.client.1.smithi136.stdout:8/445: symlink d9/d18/d34/d3d/d47/d65/d93/d96/d9b/la5 0 2024-09-18T12:51:11.575 INFO:tasks.workunit.client.0.smithi081.stdout:3/152: read d3/db/f2c [2094960,67079] 0 2024-09-18T12:51:11.576 INFO:tasks.workunit.client.0.smithi081.stdout:0/147: dwrite d7/d13/f1b [0,4194304] 0 2024-09-18T12:51:11.576 INFO:tasks.workunit.client.0.smithi081.stdout:0/148: fsync d7/d13/f16 0 2024-09-18T12:51:11.577 INFO:tasks.workunit.client.0.smithi081.stdout:3/153: symlink d3/db/df/d29/d12/l36 0 2024-09-18T12:51:11.577 INFO:tasks.workunit.client.0.smithi081.stdout:3/154: getdents d3/d23 0 2024-09-18T12:51:11.577 INFO:tasks.workunit.client.0.smithi081.stdout:3/155: chown d3/db/dc 31746 1 2024-09-18T12:51:11.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/149: creat d7/d9/d12/d2b/d33/f34 x:0 0 0 2024-09-18T12:51:11.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/150: readlink d7/l30 0 2024-09-18T12:51:11.582 INFO:tasks.workunit.client.0.smithi081.stdout:3/156: link d3/l6 d3/db/df/d29/d12/l37 0 2024-09-18T12:51:11.584 INFO:tasks.workunit.client.1.smithi136.stdout:3/338: write d3/d14/d17/d1a/f56 [1757199,70133] 0 2024-09-18T12:51:11.585 INFO:tasks.workunit.client.1.smithi136.stdout:3/339: chown d3/d2b/c38 699 1 2024-09-18T12:51:11.585 INFO:tasks.workunit.client.1.smithi136.stdout:3/340: chown d3/d5/d31/l52 14703235 1 2024-09-18T12:51:11.585 INFO:tasks.workunit.client.1.smithi136.stdout:3/341: readlink d3/d14/d22/l1c 0 2024-09-18T12:51:11.585 INFO:tasks.workunit.client.1.smithi136.stdout:3/342: creat d3/d14/f71 x:0 0 0 2024-09-18T12:51:11.585 INFO:tasks.workunit.client.1.smithi136.stdout:3/343: chown d3/d10/c69 736955254 1 2024-09-18T12:51:11.586 INFO:tasks.workunit.client.1.smithi136.stdout:3/344: mknod d3/d14/c72 0 2024-09-18T12:51:11.586 INFO:tasks.workunit.client.1.smithi136.stdout:3/345: readlink d3/d14/d18/l44 0 2024-09-18T12:51:11.587 INFO:tasks.workunit.client.1.smithi136.stdout:5/314: dwrite d5/d1a/f3a [0,4194304] 0 2024-09-18T12:51:11.587 INFO:tasks.workunit.client.1.smithi136.stdout:3/346: mkdir d3/d14/d17/d53/d73 0 2024-09-18T12:51:11.588 INFO:tasks.workunit.client.1.smithi136.stdout:3/347: write d3/d2b/d6c/f6f [145984,106602] 0 2024-09-18T12:51:11.592 INFO:tasks.workunit.client.0.smithi081.stdout:7/120: dwrite d2/d18/d22/f25 [0,4194304] 0 2024-09-18T12:51:11.592 INFO:tasks.workunit.client.0.smithi081.stdout:7/121: read d2/d18/f1f [3092003,20874] 0 2024-09-18T12:51:11.593 INFO:tasks.workunit.client.0.smithi081.stdout:6/88: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:51:11.593 INFO:tasks.workunit.client.0.smithi081.stdout:3/157: fdatasync d3/db/df/d29/d13/d17/d2e/f2f 0 2024-09-18T12:51:11.593 INFO:tasks.workunit.client.0.smithi081.stdout:3/158: readlink d3/l6 0 2024-09-18T12:51:11.593 INFO:tasks.workunit.client.0.smithi081.stdout:3/159: readlink d3/l9 0 2024-09-18T12:51:11.593 INFO:tasks.workunit.client.0.smithi081.stdout:3/160: write d3/db/dc/d1a/f27 [372490,77703] 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/446: dwrite d9/d18/f41 [0,4194304] 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/447: write d9/d18/f48 [1441163,41205] 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/448: chown d9/d14/d1a/d2b/d42/c69 13050029 1 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/449: stat c2 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/450: stat d9/d18/d34/d3d/c45 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/451: creat d9/d14/d1a/d7f/fa6 x:0 0 0 2024-09-18T12:51:11.594 INFO:tasks.workunit.client.1.smithi136.stdout:8/452: truncate d9/d18/f5a 368051 0 2024-09-18T12:51:11.598 INFO:tasks.workunit.client.1.smithi136.stdout:8/453: rmdir d9/d18/d34/d3d/d8b 39 2024-09-18T12:51:11.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/151: write d7/d9/f23 [4113045,15000] 0 2024-09-18T12:51:11.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/152: chown d7/f32 58 1 2024-09-18T12:51:11.601 INFO:tasks.workunit.client.0.smithi081.stdout:3/161: mkdir d3/db/df/d29/d13/d38 0 2024-09-18T12:51:11.601 INFO:tasks.workunit.client.0.smithi081.stdout:3/162: fsync d3/db/dc/f22 0 2024-09-18T12:51:11.603 INFO:tasks.workunit.client.1.smithi136.stdout:8/454: mkdir d9/d14/d1a/d2b/d42/da4/da7 0 2024-09-18T12:51:11.603 INFO:tasks.workunit.client.1.smithi136.stdout:8/455: chown d9/d14/f1d 891697212 1 2024-09-18T12:51:11.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/153: mknod d7/d9/d12/d2b/d33/c35 0 2024-09-18T12:51:11.605 INFO:tasks.workunit.client.0.smithi081.stdout:6/89: write f0 [3811464,92165] 0 2024-09-18T12:51:11.605 INFO:tasks.workunit.client.0.smithi081.stdout:6/90: write d4/d6/f14 [4123043,27003] 0 2024-09-18T12:51:11.608 INFO:tasks.workunit.client.0.smithi081.stdout:0/154: mkdir d7/d9/d12/d2b/d33/d36 0 2024-09-18T12:51:11.609 INFO:tasks.workunit.client.0.smithi081.stdout:6/91: creat d4/d6/f1a x:0 0 0 2024-09-18T12:51:11.610 INFO:tasks.workunit.client.0.smithi081.stdout:7/122: dread d2/f11 [0,4194304] 0 2024-09-18T12:51:11.612 INFO:tasks.workunit.client.0.smithi081.stdout:0/155: symlink d7/d9/d12/l37 0 2024-09-18T12:51:11.614 INFO:tasks.workunit.client.0.smithi081.stdout:7/123: symlink d2/d18/l2b 0 2024-09-18T12:51:11.616 INFO:tasks.workunit.client.0.smithi081.stdout:7/124: rename d2/d18/f1c to d2/d1d/f2c 0 2024-09-18T12:51:11.617 INFO:tasks.workunit.client.0.smithi081.stdout:3/163: dread d3/db/df/d29/d13/f14 [0,4194304] 0 2024-09-18T12:51:11.618 INFO:tasks.workunit.client.0.smithi081.stdout:7/125: symlink d2/d14/l2d 0 2024-09-18T12:51:11.619 INFO:tasks.workunit.client.1.smithi136.stdout:3/348: dwrite d3/d5/d31/f65 [0,4194304] 0 2024-09-18T12:51:11.619 INFO:tasks.workunit.client.0.smithi081.stdout:7/126: creat d2/d1d/d27/f2e x:0 0 0 2024-09-18T12:51:11.619 INFO:tasks.workunit.client.0.smithi081.stdout:7/127: fsync d2/f13 0 2024-09-18T12:51:11.620 INFO:tasks.workunit.client.1.smithi136.stdout:5/315: dwrite d5/d1a/d30/f4c [4194304,4194304] 0 2024-09-18T12:51:11.622 INFO:tasks.workunit.client.1.smithi136.stdout:5/316: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:11.622 INFO:tasks.workunit.client.0.smithi081.stdout:7/128: link d2/f9 d2/d14/f2f 0 2024-09-18T12:51:11.623 INFO:tasks.workunit.client.1.smithi136.stdout:5/317: mknod d5/d1a/d2d/d3f/c5c 0 2024-09-18T12:51:11.623 INFO:tasks.workunit.client.1.smithi136.stdout:5/318: write d5/f1c [712007,105631] 0 2024-09-18T12:51:11.623 INFO:tasks.workunit.client.1.smithi136.stdout:5/319: dread - d5/d1a/f53 zero size 2024-09-18T12:51:11.624 INFO:tasks.workunit.client.0.smithi081.stdout:7/129: mknod d2/d1d/d27/c30 0 2024-09-18T12:51:11.625 INFO:tasks.workunit.client.0.smithi081.stdout:7/130: dread d2/d14/f16 [0,4194304] 0 2024-09-18T12:51:11.627 INFO:tasks.workunit.client.1.smithi136.stdout:5/320: link d5/d1a/f27 d5/d1a/d2d/d34/f5d 0 2024-09-18T12:51:11.627 INFO:tasks.workunit.client.1.smithi136.stdout:5/321: chown d5/f1c 346325 1 2024-09-18T12:51:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:7/131: rename d2/d14/l15 to d2/d1b/l31 0 2024-09-18T12:51:11.629 INFO:tasks.workunit.client.1.smithi136.stdout:8/456: dwrite d9/d18/f41 [4194304,4194304] 0 2024-09-18T12:51:11.630 INFO:tasks.workunit.client.1.smithi136.stdout:9/294: sync 2024-09-18T12:51:11.631 INFO:tasks.workunit.client.1.smithi136.stdout:3/349: dread d3/d14/d17/d1a/f56 [0,4194304] 0 2024-09-18T12:51:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:6/92: dread d4/d6/fd [0,4194304] 0 2024-09-18T12:51:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:7/132: unlink d2/d14/c19 0 2024-09-18T12:51:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:7/133: link d2/d18/f20 d2/d18/d22/f32 0 2024-09-18T12:51:11.635 INFO:tasks.workunit.client.1.smithi136.stdout:8/457: rename d9/d18/l4f to d9/d18/d34/d3d/d47/la8 0 2024-09-18T12:51:11.636 INFO:tasks.workunit.client.1.smithi136.stdout:3/350: symlink d3/d2b/l74 0 2024-09-18T12:51:11.637 INFO:tasks.workunit.client.1.smithi136.stdout:8/458: creat d9/d14/d1a/d2b/d42/da4/da7/fa9 x:0 0 0 2024-09-18T12:51:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:7/134: write d2/f11 [3567821,46273] 0 2024-09-18T12:51:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:7/135: rmdir d2/d14/d21 39 2024-09-18T12:51:11.640 INFO:tasks.workunit.client.1.smithi136.stdout:8/459: symlink d9/d14/d1a/laa 0 2024-09-18T12:51:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:7/136: mknod d2/d18/c33 0 2024-09-18T12:51:11.642 INFO:tasks.workunit.client.1.smithi136.stdout:3/351: rmdir d3/d5/d31 39 2024-09-18T12:51:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:7/137: truncate d2/d18/f1f 3242272 0 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:7/138: truncate d2/d18/d22/f2a 414857 0 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:0/156: dwrite d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:0/157: chown d7/f22 19 1 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:0/158: chown d7/l30 223 1 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:0/159: truncate d7/d13/f16 4229741 0 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:3/164: dwrite f1 [0,4194304] 0 2024-09-18T12:51:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:3/165: write d3/db/df/d29/d13/f2b [1207700,38031] 0 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:6/93: write d4/f5 [2457618,117760] 0 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:3/166: symlink d3/db/df/d29/d12/l39 0 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:3/167: creat d3/db/df/d29/f3a x:0 0 0 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.1.smithi136.stdout:5/322: dread d5/d1a/d2d/d34/f35 [0,4194304] 0 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.1.smithi136.stdout:5/323: chown d5/d1a/c56 116 1 2024-09-18T12:51:11.644 INFO:tasks.workunit.client.1.smithi136.stdout:5/324: read d5/d1a/d2d/d34/f2e [6436853,109328] 0 2024-09-18T12:51:11.645 INFO:tasks.workunit.client.1.smithi136.stdout:8/460: link d9/d18/d34/f3e d9/d18/d34/d3d/d47/d65/fab 0 2024-09-18T12:51:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/139: rename f0 to d2/f34 0 2024-09-18T12:51:11.646 INFO:tasks.workunit.client.1.smithi136.stdout:3/352: mkdir d3/d14/d17/d75 0 2024-09-18T12:51:11.646 INFO:tasks.workunit.client.1.smithi136.stdout:3/353: stat d3/d10/d4a/d51/c57 0 2024-09-18T12:51:11.646 INFO:tasks.workunit.client.1.smithi136.stdout:3/354: creat d3/d2b/d6c/f76 x:0 0 0 2024-09-18T12:51:11.646 INFO:tasks.workunit.client.1.smithi136.stdout:9/295: dwrite d6/d13/d15/d25/f31 [0,4194304] 0 2024-09-18T12:51:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:0/160: getdents d7/d13 0 2024-09-18T12:51:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/94: symlink d4/l1b 0 2024-09-18T12:51:11.650 INFO:tasks.workunit.client.1.smithi136.stdout:5/325: dread d5/f1c [0,4194304] 0 2024-09-18T12:51:11.651 INFO:tasks.workunit.client.1.smithi136.stdout:3/355: rename d3/d14/f54 to d3/d14/d17/d53/f77 0 2024-09-18T12:51:11.652 INFO:tasks.workunit.client.1.smithi136.stdout:3/356: truncate d3/d14/d22/d2c/f68 443069 0 2024-09-18T12:51:11.652 INFO:tasks.workunit.client.1.smithi136.stdout:3/357: chown d3/d14/d17/d1a/c2d 25382 1 2024-09-18T12:51:11.652 INFO:tasks.workunit.client.1.smithi136.stdout:3/358: fdatasync d3/d5/d3c/f4c 0 2024-09-18T12:51:11.652 INFO:tasks.workunit.client.1.smithi136.stdout:3/359: chown d3/d5/d31/f65 72789 1 2024-09-18T12:51:11.652 INFO:tasks.workunit.client.1.smithi136.stdout:8/461: write d9/d14/f1f [1079830,105233] 0 2024-09-18T12:51:11.653 INFO:tasks.workunit.client.1.smithi136.stdout:8/462: readlink d9/d18/d34/l59 0 2024-09-18T12:51:11.653 INFO:tasks.workunit.client.1.smithi136.stdout:8/463: dread - d9/d18/d34/d3d/d47/d65/d6b/f9d zero size 2024-09-18T12:51:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:3/168: mkdir d3/db/df/d3b 0 2024-09-18T12:51:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:6/95: getdents d4/d12 0 2024-09-18T12:51:11.654 INFO:tasks.workunit.client.1.smithi136.stdout:5/326: symlink d5/d1a/d2d/d3f/l5e 0 2024-09-18T12:51:11.656 INFO:tasks.workunit.client.1.smithi136.stdout:8/464: truncate d9/f20 49882 0 2024-09-18T12:51:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:3/169: dread d3/db/df/d29/d13/f2b [0,4194304] 0 2024-09-18T12:51:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:3/170: dread - d3/db/dc/f28 zero size 2024-09-18T12:51:11.658 INFO:tasks.workunit.client.1.smithi136.stdout:8/465: creat d9/d14/d1a/d7f/d8c/fac x:0 0 0 2024-09-18T12:51:11.658 INFO:tasks.workunit.client.1.smithi136.stdout:8/466: write d9/d14/f11 [287417,107882] 0 2024-09-18T12:51:11.659 INFO:tasks.workunit.client.1.smithi136.stdout:9/296: dread d6/df/f3b [0,4194304] 0 2024-09-18T12:51:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/96: mkdir d4/d12/d1c 0 2024-09-18T12:51:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/97: write d4/f5 [2067231,53386] 0 2024-09-18T12:51:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/98: readlink d4/l1b 0 2024-09-18T12:51:11.660 INFO:tasks.workunit.client.1.smithi136.stdout:8/467: rename d9/d14/d1a/d2b/d42/d6e/d75/c97 to d9/d14/d1a/d2b/cad 0 2024-09-18T12:51:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:3/171: mkdir d3/db/df/d29/d13/d3c 0 2024-09-18T12:51:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:3/172: fsync d3/db/dc/f28 0 2024-09-18T12:51:11.663 INFO:tasks.workunit.client.1.smithi136.stdout:5/327: write d5/f23 [4172433,112604] 0 2024-09-18T12:51:11.667 INFO:tasks.workunit.client.0.smithi081.stdout:6/99: mknod d4/d6/c1d 0 2024-09-18T12:51:11.667 INFO:tasks.workunit.client.0.smithi081.stdout:3/173: dread d3/db/f2c [0,4194304] 0 2024-09-18T12:51:11.669 INFO:tasks.workunit.client.0.smithi081.stdout:3/174: truncate d3/db/dc/f15 251322 0 2024-09-18T12:51:11.670 INFO:tasks.workunit.client.0.smithi081.stdout:3/175: stat d3/db/df/d29/d12 0 2024-09-18T12:51:11.670 INFO:tasks.workunit.client.0.smithi081.stdout:3/176: mknod d3/db/df/d29/d13/d17/d2e/c3d 0 2024-09-18T12:51:11.671 INFO:tasks.workunit.client.1.smithi136.stdout:5/328: rename d5/d1a/d4a/f59 to d5/f5f 0 2024-09-18T12:51:11.672 INFO:tasks.workunit.client.0.smithi081.stdout:0/161: dwrite d7/d9/f11 [4194304,4194304] 0 2024-09-18T12:51:11.674 INFO:tasks.workunit.client.1.smithi136.stdout:5/329: rename d5/d1a/d2d/d34/f5d to d5/d1a/d30/f60 0 2024-09-18T12:51:11.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/330: getdents d5 0 2024-09-18T12:51:11.680 INFO:tasks.workunit.client.1.smithi136.stdout:5/331: symlink d5/d1a/d2d/l61 0 2024-09-18T12:51:11.680 INFO:tasks.workunit.client.0.smithi081.stdout:0/162: creat d7/d9/d12/d2b/f38 x:0 0 0 2024-09-18T12:51:11.680 INFO:tasks.workunit.client.0.smithi081.stdout:6/100: getdents d4/d12 0 2024-09-18T12:51:11.681 INFO:tasks.workunit.client.0.smithi081.stdout:6/101: chown d4/fa 1245888 1 2024-09-18T12:51:11.682 INFO:tasks.workunit.client.0.smithi081.stdout:0/163: creat d7/d9/d12/f39 x:0 0 0 2024-09-18T12:51:11.682 INFO:tasks.workunit.client.0.smithi081.stdout:0/164: rename d7/d9 to d7/d9/d12/d2b/d33/d3a 22 2024-09-18T12:51:11.682 INFO:tasks.workunit.client.1.smithi136.stdout:5/332: unlink d5/d1a/d2d/f58 0 2024-09-18T12:51:11.682 INFO:tasks.workunit.client.0.smithi081.stdout:6/102: symlink d4/l1e 0 2024-09-18T12:51:11.685 INFO:tasks.workunit.client.0.smithi081.stdout:0/165: rmdir d7/d9/d12/d2b/d33/d36 0 2024-09-18T12:51:11.685 INFO:tasks.workunit.client.1.smithi136.stdout:4/188: sync 2024-09-18T12:51:11.685 INFO:tasks.workunit.client.1.smithi136.stdout:6/321: sync 2024-09-18T12:51:11.686 INFO:tasks.workunit.client.1.smithi136.stdout:0/314: sync 2024-09-18T12:51:11.686 INFO:tasks.workunit.client.1.smithi136.stdout:0/315: truncate d1/d17/f4c 4481406 0 2024-09-18T12:51:11.686 INFO:tasks.workunit.client.1.smithi136.stdout:2/355: sync 2024-09-18T12:51:11.686 INFO:tasks.workunit.client.1.smithi136.stdout:2/356: fsync d5/f9 0 2024-09-18T12:51:11.687 INFO:tasks.workunit.client.1.smithi136.stdout:6/322: mkdir d8/d9/de/d60/d71/d76 0 2024-09-18T12:51:11.687 INFO:tasks.workunit.client.1.smithi136.stdout:6/323: chown d8/d9/f21 242709219 1 2024-09-18T12:51:11.688 INFO:tasks.workunit.client.0.smithi081.stdout:0/166: mknod d7/d9/d12/d2b/d33/c3b 0 2024-09-18T12:51:11.688 INFO:tasks.workunit.client.0.smithi081.stdout:0/167: chown d7/l30 381997 1 2024-09-18T12:51:11.688 INFO:tasks.workunit.client.0.smithi081.stdout:0/168: creat d7/f3c x:0 0 0 2024-09-18T12:51:11.689 INFO:tasks.workunit.client.1.smithi136.stdout:5/333: dread d5/f54 [4194304,4194304] 0 2024-09-18T12:51:11.689 INFO:tasks.workunit.client.1.smithi136.stdout:0/316: getdents d1/d3/d1a/d62 0 2024-09-18T12:51:11.689 INFO:tasks.workunit.client.1.smithi136.stdout:0/317: write d1/db/fd [1976136,16035] 0 2024-09-18T12:51:11.689 INFO:tasks.workunit.client.0.smithi081.stdout:6/103: rmdir d4/d6 39 2024-09-18T12:51:11.689 INFO:tasks.workunit.client.0.smithi081.stdout:6/104: readlink d4/l1e 0 2024-09-18T12:51:11.691 INFO:tasks.workunit.client.1.smithi136.stdout:5/334: truncate d5/d1a/f3a 2273586 0 2024-09-18T12:51:11.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/169: mkdir d7/d9/d12/d2b/d3d 0 2024-09-18T12:51:11.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/170: write f0 [10285958,11788] 0 2024-09-18T12:51:11.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/171: truncate d7/f3c 220833 0 2024-09-18T12:51:11.692 INFO:tasks.workunit.client.0.smithi081.stdout:6/105: mknod d4/d12/c1f 0 2024-09-18T12:51:11.693 INFO:tasks.workunit.client.1.smithi136.stdout:0/318: mknod d1/d17/d2d/d35/c6a 0 2024-09-18T12:51:11.693 INFO:tasks.workunit.client.1.smithi136.stdout:0/319: write d1/d17/f47 [9220628,126706] 0 2024-09-18T12:51:11.693 INFO:tasks.workunit.client.0.smithi081.stdout:6/106: symlink d4/d12/d1c/l20 0 2024-09-18T12:51:11.693 INFO:tasks.workunit.client.0.smithi081.stdout:2/119: sync 2024-09-18T12:51:11.694 INFO:tasks.workunit.client.1.smithi136.stdout:2/357: getdents d5/d7/d3b 0 2024-09-18T12:51:11.694 INFO:tasks.workunit.client.1.smithi136.stdout:2/358: fsync d5/d7/d17/f24 0 2024-09-18T12:51:11.694 INFO:tasks.workunit.client.1.smithi136.stdout:2/359: dread - d5/d25/f62 zero size 2024-09-18T12:51:11.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/120: rmdir d15/d1f 0 2024-09-18T12:51:11.696 INFO:tasks.workunit.client.1.smithi136.stdout:5/335: creat d5/f62 x:0 0 0 2024-09-18T12:51:11.697 INFO:tasks.workunit.client.1.smithi136.stdout:5/336: readlink d5/d1a/l1e 0 2024-09-18T12:51:11.697 INFO:tasks.workunit.client.1.smithi136.stdout:5/337: chown d5/d1a/d2d/d34/c15 0 1 2024-09-18T12:51:11.698 INFO:tasks.workunit.client.1.smithi136.stdout:0/320: getdents d1/d17/d2d 0 2024-09-18T12:51:11.699 INFO:tasks.workunit.client.1.smithi136.stdout:5/338: dread d5/d1a/d30/f60 [0,4194304] 0 2024-09-18T12:51:11.702 INFO:tasks.workunit.client.1.smithi136.stdout:5/339: rename d5/d1a/f4d to d5/d1a/f63 0 2024-09-18T12:51:11.702 INFO:tasks.workunit.client.1.smithi136.stdout:5/340: chown d5/f62 2349 1 2024-09-18T12:51:11.704 INFO:tasks.workunit.client.0.smithi081.stdout:0/172: read d7/d13/f1a [3693463,31139] 0 2024-09-18T12:51:11.706 INFO:tasks.workunit.client.0.smithi081.stdout:2/121: dread f9 [0,4194304] 0 2024-09-18T12:51:11.706 INFO:tasks.workunit.client.0.smithi081.stdout:2/122: truncate d15/d16/f1b 915718 0 2024-09-18T12:51:11.706 INFO:tasks.workunit.client.0.smithi081.stdout:0/173: link d7/d9/d12/f31 d7/d9/f3e 0 2024-09-18T12:51:11.708 INFO:tasks.workunit.client.0.smithi081.stdout:2/123: mkdir d15/d16/d20/d22 0 2024-09-18T12:51:11.708 INFO:tasks.workunit.client.0.smithi081.stdout:2/124: dread - d15/d16/f19 zero size 2024-09-18T12:51:11.709 INFO:tasks.workunit.client.1.smithi136.stdout:5/341: dread f2 [4194304,4194304] 0 2024-09-18T12:51:11.709 INFO:tasks.workunit.client.1.smithi136.stdout:5/342: creat d5/d1a/d2d/d34/f64 x:0 0 0 2024-09-18T12:51:11.712 INFO:tasks.workunit.client.0.smithi081.stdout:2/125: dread d15/d16/f1b [0,4194304] 0 2024-09-18T12:51:11.712 INFO:tasks.workunit.client.0.smithi081.stdout:2/126: getdents d15/d16/d20/d22 0 2024-09-18T12:51:11.712 INFO:tasks.workunit.client.1.smithi136.stdout:2/360: read d5/d7/d41/f4f [2955562,22882] 0 2024-09-18T12:51:11.712 INFO:tasks.workunit.client.1.smithi136.stdout:4/189: dwrite d0/f15 [4194304,4194304] 0 2024-09-18T12:51:11.714 INFO:tasks.workunit.client.1.smithi136.stdout:6/324: dwrite d8/dc/f31 [0,4194304] 0 2024-09-18T12:51:11.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/361: dread d5/d7/d11/f32 [0,4194304] 0 2024-09-18T12:51:11.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/362: read d5/f22 [339821,93369] 0 2024-09-18T12:51:11.715 INFO:tasks.workunit.client.1.smithi136.stdout:2/363: truncate d5/d7/d41/d53/f63 762069 0 2024-09-18T12:51:11.716 INFO:tasks.workunit.client.1.smithi136.stdout:2/364: fdatasync d5/d7/d17/f6b 0 2024-09-18T12:51:11.716 INFO:tasks.workunit.client.0.smithi081.stdout:6/107: dread f1 [4194304,4194304] 0 2024-09-18T12:51:11.717 INFO:tasks.workunit.client.0.smithi081.stdout:6/108: creat d4/f21 x:0 0 0 2024-09-18T12:51:11.718 INFO:tasks.workunit.client.1.smithi136.stdout:6/325: creat d8/d9/d64/f77 x:0 0 0 2024-09-18T12:51:11.718 INFO:tasks.workunit.client.1.smithi136.stdout:2/365: readlink d5/d25/l26 0 2024-09-18T12:51:11.719 INFO:tasks.workunit.client.1.smithi136.stdout:6/326: rename d8/d9/de/f25 to d8/d9/d56/f78 0 2024-09-18T12:51:11.720 INFO:tasks.workunit.client.1.smithi136.stdout:2/366: creat d5/d7/d41/d53/f6f x:0 0 0 2024-09-18T12:51:11.721 INFO:tasks.workunit.client.1.smithi136.stdout:2/367: rename d5 to d5/d7/d3b/d70 22 2024-09-18T12:51:11.721 INFO:tasks.workunit.client.1.smithi136.stdout:2/368: fdatasync d5/d7/f10 0 2024-09-18T12:51:11.723 INFO:tasks.workunit.client.1.smithi136.stdout:2/369: rename d5/d7/d41/l46 to d5/d4a/d67/l71 0 2024-09-18T12:51:11.724 INFO:tasks.workunit.client.1.smithi136.stdout:4/190: write d0/fc [667370,36005] 0 2024-09-18T12:51:11.726 INFO:tasks.workunit.client.0.smithi081.stdout:0/174: dwrite d7/f3c [0,4194304] 0 2024-09-18T12:51:11.729 INFO:tasks.workunit.client.1.smithi136.stdout:5/343: rmdir d5/d1a 39 2024-09-18T12:51:11.729 INFO:tasks.workunit.client.0.smithi081.stdout:0/175: rename d7/f32 to d7/d9/d12/d2b/f3f 0 2024-09-18T12:51:11.730 INFO:tasks.workunit.client.0.smithi081.stdout:2/127: dread fd [0,4194304] 0 2024-09-18T12:51:11.731 INFO:tasks.workunit.client.0.smithi081.stdout:0/176: symlink d7/d9/d12/l40 0 2024-09-18T12:51:11.731 INFO:tasks.workunit.client.0.smithi081.stdout:0/177: write d7/d9/d12/f39 [526751,105508] 0 2024-09-18T12:51:11.731 INFO:tasks.workunit.client.1.smithi136.stdout:6/327: getdents d8/d9/de 0 2024-09-18T12:51:11.733 INFO:tasks.workunit.client.1.smithi136.stdout:4/191: dread d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:11.733 INFO:tasks.workunit.client.1.smithi136.stdout:0/321: dwrite d1/f36 [0,4194304] 0 2024-09-18T12:51:11.733 INFO:tasks.workunit.client.1.smithi136.stdout:0/322: write d1/d3/f22 [405418,108821] 0 2024-09-18T12:51:11.733 INFO:tasks.workunit.client.1.smithi136.stdout:0/323: creat d1/d17/f6b x:0 0 0 2024-09-18T12:51:11.733 INFO:tasks.workunit.client.1.smithi136.stdout:0/324: write d1/d3/d1a/f20 [952178,112523] 0 2024-09-18T12:51:11.734 INFO:tasks.workunit.client.0.smithi081.stdout:2/128: rename f14 to d15/d16/f23 0 2024-09-18T12:51:11.734 INFO:tasks.workunit.client.0.smithi081.stdout:2/129: write d15/f1e [1043270,72535] 0 2024-09-18T12:51:11.734 INFO:tasks.workunit.client.1.smithi136.stdout:6/328: getdents d8/d9/de/d60 0 2024-09-18T12:51:11.736 INFO:tasks.workunit.client.1.smithi136.stdout:2/370: write d5/d7/d17/d48/f4e [3253692,53405] 0 2024-09-18T12:51:11.736 INFO:tasks.workunit.client.1.smithi136.stdout:0/325: mkdir d1/d46/d6c 0 2024-09-18T12:51:11.737 INFO:tasks.workunit.client.1.smithi136.stdout:4/192: dread d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:11.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/130: unlink d15/d16/f1b 0 2024-09-18T12:51:11.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/131: read fb [721434,56222] 0 2024-09-18T12:51:11.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/132: chown d15/d16/f18 689 1 2024-09-18T12:51:11.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/133: fdatasync fb 0 2024-09-18T12:51:11.738 INFO:tasks.workunit.client.1.smithi136.stdout:2/371: link d5/d7/l16 d5/d4a/l72 0 2024-09-18T12:51:11.738 INFO:tasks.workunit.client.1.smithi136.stdout:2/372: chown d5/d25/c5b 904183044 1 2024-09-18T12:51:11.738 INFO:tasks.workunit.client.1.smithi136.stdout:2/373: write d5/d25/f62 [896995,17408] 0 2024-09-18T12:51:11.738 INFO:tasks.workunit.client.1.smithi136.stdout:2/374: chown d5/d25/l5d 14 1 2024-09-18T12:51:11.739 INFO:tasks.workunit.client.0.smithi081.stdout:2/134: symlink d15/d16/l24 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.1.smithi136.stdout:5/344: dread d5/f31 [0,4194304] 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.1.smithi136.stdout:4/193: creat d0/f38 x:0 0 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.1.smithi136.stdout:4/194: write d0/d3/f10 [4705975,130944] 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.0.smithi081.stdout:0/178: write d7/d9/f10 [1498645,66434] 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.0.smithi081.stdout:6/109: dwrite d4/fe [0,4194304] 0 2024-09-18T12:51:11.740 INFO:tasks.workunit.client.0.smithi081.stdout:6/110: write d4/f5 [1478100,17543] 0 2024-09-18T12:51:11.742 INFO:tasks.workunit.client.1.smithi136.stdout:5/345: rename d5/d1a/d4a/c51 to d5/d1a/c65 0 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/195: creat d0/d25/f39 x:0 0 0 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/196: creat d0/d25/f3a x:0 0 0 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/197: creat d0/d3/f3b x:0 0 0 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/198: chown d0/d13/l31 1 1 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/199: chown d0/d2/l21 14765811 1 2024-09-18T12:51:11.743 INFO:tasks.workunit.client.1.smithi136.stdout:4/200: fdatasync d0/d25/f2d 0 2024-09-18T12:51:11.744 INFO:tasks.workunit.client.0.smithi081.stdout:2/135: dread f7 [0,4194304] 0 2024-09-18T12:51:11.744 INFO:tasks.workunit.client.0.smithi081.stdout:2/136: chown d15/d16/f18 11889725 1 2024-09-18T12:51:11.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/137: mkdir d15/d16/d25 0 2024-09-18T12:51:11.746 INFO:tasks.workunit.client.0.smithi081.stdout:2/138: mkdir d15/d26 0 2024-09-18T12:51:11.746 INFO:tasks.workunit.client.0.smithi081.stdout:2/139: truncate d15/f1e 2043073 0 2024-09-18T12:51:11.747 INFO:tasks.workunit.client.1.smithi136.stdout:6/329: dread d8/dc/f14 [0,4194304] 0 2024-09-18T12:51:11.747 INFO:tasks.workunit.client.1.smithi136.stdout:4/201: symlink d0/d2/l3c 0 2024-09-18T12:51:11.750 INFO:tasks.workunit.client.0.smithi081.stdout:0/179: write d7/f3c [1373706,36672] 0 2024-09-18T12:51:11.750 INFO:tasks.workunit.client.0.smithi081.stdout:2/140: dread f11 [0,4194304] 0 2024-09-18T12:51:11.751 INFO:tasks.workunit.client.1.smithi136.stdout:6/330: symlink d8/d9/de/d60/l79 0 2024-09-18T12:51:11.751 INFO:tasks.workunit.client.0.smithi081.stdout:2/141: creat d15/d16/d25/f27 x:0 0 0 2024-09-18T12:51:11.752 INFO:tasks.workunit.client.1.smithi136.stdout:6/331: write d8/dc/f43 [150001,82279] 0 2024-09-18T12:51:11.752 INFO:tasks.workunit.client.1.smithi136.stdout:6/332: fsync d8/d9/de/f70 0 2024-09-18T12:51:11.752 INFO:tasks.workunit.client.1.smithi136.stdout:6/333: dread - d8/f30 zero size 2024-09-18T12:51:11.753 INFO:tasks.workunit.client.0.smithi081.stdout:2/142: mknod d15/d16/d20/c28 0 2024-09-18T12:51:11.753 INFO:tasks.workunit.client.1.smithi136.stdout:6/334: creat d8/d9/d3c/f7a x:0 0 0 2024-09-18T12:51:11.753 INFO:tasks.workunit.client.1.smithi136.stdout:6/335: fdatasync d8/dc/f6e 0 2024-09-18T12:51:11.753 INFO:tasks.workunit.client.1.smithi136.stdout:6/336: chown d8/d9/d56/c5c 31946 1 2024-09-18T12:51:11.755 INFO:tasks.workunit.client.1.smithi136.stdout:6/337: mknod d8/d9/d56/c7b 0 2024-09-18T12:51:11.755 INFO:tasks.workunit.client.1.smithi136.stdout:6/338: truncate d8/d9/de/f70 235282 0 2024-09-18T12:51:11.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/375: dwrite d5/d7/f12 [0,4194304] 0 2024-09-18T12:51:11.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/376: write d5/d7/d11/f29 [69448,127913] 0 2024-09-18T12:51:11.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/377: write d5/d7/d17/f24 [3429810,106161] 0 2024-09-18T12:51:11.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/339: creat d8/d9/de/d1c/d50/f7c x:0 0 0 2024-09-18T12:51:11.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/340: write d8/d9/d3c/d4a/f54 [1293349,30411] 0 2024-09-18T12:51:11.758 INFO:tasks.workunit.client.1.smithi136.stdout:6/341: stat d8/d9/de/d1c/f20 0 2024-09-18T12:51:11.759 INFO:tasks.workunit.client.0.smithi081.stdout:6/111: dread d4/fe [0,4194304] 0 2024-09-18T12:51:11.759 INFO:tasks.workunit.client.0.smithi081.stdout:6/112: truncate d4/d6/fc 5012782 0 2024-09-18T12:51:11.759 INFO:tasks.workunit.client.0.smithi081.stdout:6/113: write d4/f21 [787140,12907] 0 2024-09-18T12:51:11.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/114: symlink d4/d6/l22 0 2024-09-18T12:51:11.762 INFO:tasks.workunit.client.0.smithi081.stdout:6/115: rmdir d4/d12 39 2024-09-18T12:51:11.765 INFO:tasks.workunit.client.1.smithi136.stdout:2/378: link d5/d7/d3b/l49 d5/d7/d11/d34/l73 0 2024-09-18T12:51:11.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/326: dwrite d1/f31 [0,4194304] 0 2024-09-18T12:51:11.766 INFO:tasks.workunit.client.0.smithi081.stdout:6/116: rename d4/d6/f14 to d4/d12/d1c/f23 0 2024-09-18T12:51:11.766 INFO:tasks.workunit.client.1.smithi136.stdout:2/379: mkdir d5/d25/d43/d74 0 2024-09-18T12:51:11.767 INFO:tasks.workunit.client.1.smithi136.stdout:5/346: dwrite d5/d1a/d30/f60 [0,4194304] 0 2024-09-18T12:51:11.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/143: link d15/d16/f23 d15/d26/f29 0 2024-09-18T12:51:11.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/144: dread - d15/d16/f18 zero size 2024-09-18T12:51:11.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/145: chown fd 14 1 2024-09-18T12:51:11.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/146: stat d15/d16/l24 0 2024-09-18T12:51:11.770 INFO:tasks.workunit.client.0.smithi081.stdout:2/147: dread d15/f17 [0,4194304] 0 2024-09-18T12:51:11.774 INFO:tasks.workunit.client.1.smithi136.stdout:6/342: write d8/d9/de/f3d [259125,22176] 0 2024-09-18T12:51:11.774 INFO:tasks.workunit.client.1.smithi136.stdout:2/380: creat d5/d4a/d67/f75 x:0 0 0 2024-09-18T12:51:11.774 INFO:tasks.workunit.client.1.smithi136.stdout:2/381: dread - d5/d7/f5a zero size 2024-09-18T12:51:11.774 INFO:tasks.workunit.client.1.smithi136.stdout:6/343: write d8/f19 [2920171,43539] 0 2024-09-18T12:51:11.774 INFO:tasks.workunit.client.1.smithi136.stdout:2/382: chown d5/d25/d2d/c59 50638079 1 2024-09-18T12:51:11.775 INFO:tasks.workunit.client.1.smithi136.stdout:4/202: rmdir d0 39 2024-09-18T12:51:11.775 INFO:tasks.workunit.client.0.smithi081.stdout:0/180: dwrite d7/d13/f1a [0,4194304] 0 2024-09-18T12:51:11.776 INFO:tasks.workunit.client.1.smithi136.stdout:5/347: read d5/d1a/d2d/d34/f35 [1503012,59860] 0 2024-09-18T12:51:11.780 INFO:tasks.workunit.client.1.smithi136.stdout:0/327: dread d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:11.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/148: creat d15/d16/d20/d22/f2a x:0 0 0 2024-09-18T12:51:11.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/149: write d15/d16/d25/f27 [59702,93423] 0 2024-09-18T12:51:11.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/150: truncate d15/f17 1179197 0 2024-09-18T12:51:11.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/181: link d7/d9/cd d7/d9/d12/d2b/d3d/c41 0 2024-09-18T12:51:11.785 INFO:tasks.workunit.client.0.smithi081.stdout:0/182: write d7/f22 [181457,44448] 0 2024-09-18T12:51:11.785 INFO:tasks.workunit.client.0.smithi081.stdout:0/183: stat d7/d9/cc 0 2024-09-18T12:51:11.785 INFO:tasks.workunit.client.0.smithi081.stdout:0/184: stat d7/d9/d12/d2b/d33/f34 0 2024-09-18T12:51:11.786 INFO:tasks.workunit.client.0.smithi081.stdout:2/151: mknod d15/d16/d20/c2b 0 2024-09-18T12:51:11.786 INFO:tasks.workunit.client.1.smithi136.stdout:5/348: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:11.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/117: truncate d4/d6/fc 4940882 0 2024-09-18T12:51:11.788 INFO:tasks.workunit.client.1.smithi136.stdout:6/344: dwrite d8/dc/f6e [0,4194304] 0 2024-09-18T12:51:11.788 INFO:tasks.workunit.client.0.smithi081.stdout:0/185: symlink d7/l42 0 2024-09-18T12:51:11.789 INFO:tasks.workunit.client.1.smithi136.stdout:2/383: unlink d5/ca 0 2024-09-18T12:51:11.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/203: creat d0/d2/f3d x:0 0 0 2024-09-18T12:51:11.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/204: dread - d0/d2/f3d zero size 2024-09-18T12:51:11.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/205: stat d0/d2/l21 0 2024-09-18T12:51:11.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/206: creat d0/d2/f3e x:0 0 0 2024-09-18T12:51:11.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/207: fsync d0/d3/f10 0 2024-09-18T12:51:11.791 INFO:tasks.workunit.client.0.smithi081.stdout:2/152: symlink d15/d16/d20/d22/l2c 0 2024-09-18T12:51:11.792 INFO:tasks.workunit.client.0.smithi081.stdout:6/118: unlink c2 0 2024-09-18T12:51:11.792 INFO:tasks.workunit.client.1.smithi136.stdout:0/328: mkdir d1/d17/d6d 0 2024-09-18T12:51:11.793 INFO:tasks.workunit.client.1.smithi136.stdout:0/329: chown d1/db/c3f 274695 1 2024-09-18T12:51:11.794 INFO:tasks.workunit.client.0.smithi081.stdout:0/186: mkdir d7/d9/d12/d2b/d33/d43 0 2024-09-18T12:51:11.796 INFO:tasks.workunit.client.1.smithi136.stdout:2/384: write d5/d7/f12 [2418219,122820] 0 2024-09-18T12:51:11.796 INFO:tasks.workunit.client.1.smithi136.stdout:2/385: chown d5/d25/f36 24779271 1 2024-09-18T12:51:11.797 INFO:tasks.workunit.client.0.smithi081.stdout:0/187: creat d7/d9/f44 x:0 0 0 2024-09-18T12:51:11.800 INFO:tasks.workunit.client.1.smithi136.stdout:6/345: mknod d8/d9/c7d 0 2024-09-18T12:51:11.804 INFO:tasks.workunit.client.1.smithi136.stdout:2/386: creat d5/d25/d43/d74/f76 x:0 0 0 2024-09-18T12:51:11.804 INFO:tasks.workunit.client.1.smithi136.stdout:2/387: truncate d5/d25/f6c 351201 0 2024-09-18T12:51:11.805 INFO:tasks.workunit.client.1.smithi136.stdout:6/346: creat d8/d9/d56/f7e x:0 0 0 2024-09-18T12:51:11.806 INFO:tasks.workunit.client.1.smithi136.stdout:6/347: write d8/d9/de/f40 [180031,12946] 0 2024-09-18T12:51:11.806 INFO:tasks.workunit.client.1.smithi136.stdout:6/348: chown d8/dc/cd 78114459 1 2024-09-18T12:51:11.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/330: getdents d1/d3 0 2024-09-18T12:51:11.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/331: creat d1/d3/d1a/f6e x:0 0 0 2024-09-18T12:51:11.807 INFO:tasks.workunit.client.1.smithi136.stdout:0/332: readlink d1/d17/d2d/l3c 0 2024-09-18T12:51:11.807 INFO:tasks.workunit.client.0.smithi081.stdout:0/188: dread d7/d13/f1a [0,4194304] 0 2024-09-18T12:51:11.807 INFO:tasks.workunit.client.0.smithi081.stdout:0/189: stat d7/d9/c2a 0 2024-09-18T12:51:11.810 INFO:tasks.workunit.client.1.smithi136.stdout:0/333: link d1/d3/d1a/f50 d1/d60/f6f 0 2024-09-18T12:51:11.810 INFO:tasks.workunit.client.1.smithi136.stdout:5/349: dwrite d5/f23 [0,4194304] 0 2024-09-18T12:51:11.812 INFO:tasks.workunit.client.1.smithi136.stdout:0/334: mkdir d1/d17/d2d/d70 0 2024-09-18T12:51:11.814 INFO:tasks.workunit.client.1.smithi136.stdout:5/350: mknod d5/d1a/d2d/d3f/c66 0 2024-09-18T12:51:11.816 INFO:tasks.workunit.client.1.smithi136.stdout:0/335: creat d1/db/f71 x:0 0 0 2024-09-18T12:51:11.820 INFO:tasks.workunit.client.1.smithi136.stdout:7/491: sync 2024-09-18T12:51:11.822 INFO:tasks.workunit.client.1.smithi136.stdout:7/492: symlink d0/d39/d4d/d69/lab 0 2024-09-18T12:51:11.823 INFO:tasks.workunit.client.1.smithi136.stdout:4/208: dwrite d0/d13/f34 [0,4194304] 0 2024-09-18T12:51:11.824 INFO:tasks.workunit.client.1.smithi136.stdout:7/493: rename d0/d39/d4d/d69/d8c to d0/d12/d1a/dac 0 2024-09-18T12:51:11.831 INFO:tasks.workunit.client.1.smithi136.stdout:4/209: rmdir d0/d3 39 2024-09-18T12:51:11.832 INFO:tasks.workunit.client.1.smithi136.stdout:2/388: dwrite d5/d25/f40 [0,4194304] 0 2024-09-18T12:51:11.832 INFO:tasks.workunit.client.1.smithi136.stdout:2/389: creat d5/d7/d17/f77 x:0 0 0 2024-09-18T12:51:11.832 INFO:tasks.workunit.client.1.smithi136.stdout:2/390: chown d5/d7/f55 525186 1 2024-09-18T12:51:11.833 INFO:tasks.workunit.client.1.smithi136.stdout:6/349: dwrite d8/d9/de/f28 [0,4194304] 0 2024-09-18T12:51:11.833 INFO:tasks.workunit.client.1.smithi136.stdout:6/350: readlink d8/dc/l1b 0 2024-09-18T12:51:11.833 INFO:tasks.workunit.client.1.smithi136.stdout:6/351: readlink d8/d9/d3c/l52 0 2024-09-18T12:51:11.833 INFO:tasks.workunit.client.1.smithi136.stdout:6/352: readlink d8/d9/d3c/l61 0 2024-09-18T12:51:11.834 INFO:tasks.workunit.client.1.smithi136.stdout:5/351: dwrite d5/d1a/f53 [0,4194304] 0 2024-09-18T12:51:11.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/391: creat d5/d7/f78 x:0 0 0 2024-09-18T12:51:11.841 INFO:tasks.workunit.client.1.smithi136.stdout:4/210: symlink d0/l3f 0 2024-09-18T12:51:11.841 INFO:tasks.workunit.client.1.smithi136.stdout:6/353: read d8/dc/f1d [3236227,17391] 0 2024-09-18T12:51:11.841 INFO:tasks.workunit.client.1.smithi136.stdout:6/354: fsync d8/dc/f41 0 2024-09-18T12:51:11.841 INFO:tasks.workunit.client.1.smithi136.stdout:6/355: fdatasync d8/d9/d3c/f7a 0 2024-09-18T12:51:11.842 INFO:tasks.workunit.client.1.smithi136.stdout:1/263: sync 2024-09-18T12:51:11.843 INFO:tasks.workunit.client.1.smithi136.stdout:5/352: symlink d5/d1a/d2d/d3f/l67 0 2024-09-18T12:51:11.843 INFO:tasks.workunit.client.1.smithi136.stdout:4/211: symlink d0/d3/l40 0 2024-09-18T12:51:11.845 INFO:tasks.workunit.client.1.smithi136.stdout:5/353: creat d5/d1a/f68 x:0 0 0 2024-09-18T12:51:11.846 INFO:tasks.workunit.client.1.smithi136.stdout:4/212: symlink d0/d2/l41 0 2024-09-18T12:51:11.846 INFO:tasks.workunit.client.1.smithi136.stdout:4/213: dread - d0/d3/f36 zero size 2024-09-18T12:51:11.846 INFO:tasks.workunit.client.1.smithi136.stdout:4/214: dread - d0/d25/f3a zero size 2024-09-18T12:51:11.846 INFO:tasks.workunit.client.1.smithi136.stdout:4/215: read d0/fc [416108,128431] 0 2024-09-18T12:51:11.847 INFO:tasks.workunit.client.1.smithi136.stdout:4/216: write d0/d2/f28 [951816,64414] 0 2024-09-18T12:51:11.847 INFO:tasks.workunit.client.1.smithi136.stdout:4/217: dread - d0/d2/f17 zero size 2024-09-18T12:51:11.847 INFO:tasks.workunit.client.1.smithi136.stdout:1/264: mknod d2/c52 0 2024-09-18T12:51:11.847 INFO:tasks.workunit.client.1.smithi136.stdout:4/218: symlink d0/d3/l42 0 2024-09-18T12:51:11.848 INFO:tasks.workunit.client.1.smithi136.stdout:1/265: unlink d2/c24 0 2024-09-18T12:51:11.849 INFO:tasks.workunit.client.1.smithi136.stdout:4/219: creat d0/d3/f43 x:0 0 0 2024-09-18T12:51:11.849 INFO:tasks.workunit.client.1.smithi136.stdout:4/220: chown d0/d13 2511404 1 2024-09-18T12:51:11.850 INFO:tasks.workunit.client.1.smithi136.stdout:1/266: link d2/d5/d11/d2e/l4d d2/d5/d11/d2e/d4c/l53 0 2024-09-18T12:51:11.850 INFO:tasks.workunit.client.1.smithi136.stdout:1/267: chown d2/d5/f1e 3585 1 2024-09-18T12:51:11.854 INFO:tasks.workunit.client.1.smithi136.stdout:1/268: link d2/d5/d9/d23/f2c d2/d5/d11/f54 0 2024-09-18T12:51:11.857 INFO:tasks.workunit.client.1.smithi136.stdout:1/269: symlink d2/d5/d9/d23/l55 0 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:1/105: sync 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:4/96: sync 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:8/95: sync 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:5/119: sync 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:4/97: fdatasync d3/db/fe 0 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:5/120: write d2/dd/f21 [1564917,30980] 0 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.0.smithi081.stdout:9/95: sync 2024-09-18T12:51:11.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/270: rename d2/l28 to d2/d5/d2b/d34/l56 0 2024-09-18T12:51:11.860 INFO:tasks.workunit.client.0.smithi081.stdout:8/96: creat d3/d1d/f21 x:0 0 0 2024-09-18T12:51:11.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/271: creat d2/d5/d9/d23/d50/f57 x:0 0 0 2024-09-18T12:51:11.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/272: stat d2/f42 0 2024-09-18T12:51:11.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/121: write d2/d14/f1e [1778238,16104] 0 2024-09-18T12:51:11.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/122: readlink d2/l5 0 2024-09-18T12:51:11.862 INFO:tasks.workunit.client.0.smithi081.stdout:8/97: symlink d3/l22 0 2024-09-18T12:51:11.862 INFO:tasks.workunit.client.0.smithi081.stdout:8/98: symlink d3/d1d/l23 0 2024-09-18T12:51:11.862 INFO:tasks.workunit.client.0.smithi081.stdout:8/99: creat d3/f24 x:0 0 0 2024-09-18T12:51:11.862 INFO:tasks.workunit.client.0.smithi081.stdout:8/100: dread - d3/f24 zero size 2024-09-18T12:51:11.863 INFO:tasks.workunit.client.0.smithi081.stdout:8/101: fdatasync d3/f1a 0 2024-09-18T12:51:11.869 INFO:tasks.workunit.client.0.smithi081.stdout:1/106: dread d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:11.869 INFO:tasks.workunit.client.0.smithi081.stdout:1/107: creat d0/d18/f25 x:0 0 0 2024-09-18T12:51:11.872 INFO:tasks.workunit.client.0.smithi081.stdout:1/108: mkdir d0/d6/d7/d26 0 2024-09-18T12:51:11.872 INFO:tasks.workunit.client.0.smithi081.stdout:1/109: read - d0/d18/d1a/d1f/f21 zero size 2024-09-18T12:51:11.873 INFO:tasks.workunit.client.0.smithi081.stdout:1/110: symlink d0/d18/d1a/d1f/l27 0 2024-09-18T12:51:11.874 INFO:tasks.workunit.client.0.smithi081.stdout:1/111: mkdir d0/db/d12/d28 0 2024-09-18T12:51:11.874 INFO:tasks.workunit.client.0.smithi081.stdout:1/112: creat d0/d6/d7/d8/f29 x:0 0 0 2024-09-18T12:51:11.874 INFO:tasks.workunit.client.0.smithi081.stdout:1/113: write d0/d6/f9 [4897948,364] 0 2024-09-18T12:51:11.876 INFO:tasks.workunit.client.0.smithi081.stdout:4/98: write d3/dd/f1c [3548727,4025] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.1.smithi136.stdout:4/221: dwrite d0/d2/f17 [0,4194304] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.1.smithi136.stdout:5/354: dwrite d5/d1a/d30/f4c [4194304,4194304] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.1.smithi136.stdout:5/355: truncate d5/d1a/f37 433203 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.1.smithi136.stdout:5/356: dread - d5/d1a/d30/f57 zero size 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/119: dwrite d4/d6/fc [0,4194304] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/120: stat d4 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/121: write d4/f18 [1192843,96849] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/122: write d4/d6/f1a [570979,87021] 0 2024-09-18T12:51:11.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/123: stat d4/f7 0 2024-09-18T12:51:11.881 INFO:tasks.workunit.client.0.smithi081.stdout:6/124: truncate d4/d12/d1c/f23 2395903 0 2024-09-18T12:51:11.881 INFO:tasks.workunit.client.0.smithi081.stdout:6/125: write d4/fa [1236106,36427] 0 2024-09-18T12:51:11.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/99: rmdir d3/db 39 2024-09-18T12:51:11.883 INFO:tasks.workunit.client.1.smithi136.stdout:4/222: getdents d0/d25 0 2024-09-18T12:51:11.883 INFO:tasks.workunit.client.1.smithi136.stdout:4/223: write d0/d2/f16 [4494537,21758] 0 2024-09-18T12:51:11.885 INFO:tasks.workunit.client.0.smithi081.stdout:6/126: rename d4/f15 to d4/f24 0 2024-09-18T12:51:11.885 INFO:tasks.workunit.client.0.smithi081.stdout:6/127: stat d4/d6/c19 0 2024-09-18T12:51:11.885 INFO:tasks.workunit.client.0.smithi081.stdout:8/102: dwrite d3/f18 [0,4194304] 0 2024-09-18T12:51:11.885 INFO:tasks.workunit.client.0.smithi081.stdout:8/103: readlink d3/d1d/l23 0 2024-09-18T12:51:11.886 INFO:tasks.workunit.client.0.smithi081.stdout:4/100: rename d3/db/f12 to d3/db/f23 0 2024-09-18T12:51:11.887 INFO:tasks.workunit.client.0.smithi081.stdout:5/123: dwrite d2/d14/f27 [0,4194304] 0 2024-09-18T12:51:11.887 INFO:tasks.workunit.client.0.smithi081.stdout:5/124: truncate d2/d4/d18/f25 906196 0 2024-09-18T12:51:11.888 INFO:tasks.workunit.client.1.smithi136.stdout:5/357: write d5/d1a/d30/f60 [3070291,66492] 0 2024-09-18T12:51:11.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/358: write d5/d1a/d30/f60 [1193326,95934] 0 2024-09-18T12:51:11.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/359: chown d5/d1a/d30 37158 1 2024-09-18T12:51:11.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/360: write d5/f1c [1052816,98969] 0 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/104: dread d3/f1a [0,4194304] 0 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/105: creat d3/f25 x:0 0 0 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/106: chown d3/f13 38631 1 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.1.smithi136.stdout:4/224: dread d0/d3/f10 [0,4194304] 0 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.1.smithi136.stdout:4/225: chown d0/d3/f29 4073601 1 2024-09-18T12:51:11.890 INFO:tasks.workunit.client.1.smithi136.stdout:4/226: stat d0 0 2024-09-18T12:51:11.891 INFO:tasks.workunit.client.0.smithi081.stdout:4/101: creat d3/dd/d14/f24 x:0 0 0 2024-09-18T12:51:11.892 INFO:tasks.workunit.client.0.smithi081.stdout:4/102: chown d3/lf 12194 1 2024-09-18T12:51:11.892 INFO:tasks.workunit.client.0.smithi081.stdout:4/103: write d3/f10 [4284868,56969] 0 2024-09-18T12:51:11.893 INFO:tasks.workunit.client.0.smithi081.stdout:1/114: dwrite d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:11.893 INFO:tasks.workunit.client.0.smithi081.stdout:1/115: truncate d0/d6/f1b 38071 0 2024-09-18T12:51:11.896 INFO:tasks.workunit.client.0.smithi081.stdout:5/125: symlink d2/dd/l2c 0 2024-09-18T12:51:11.896 INFO:tasks.workunit.client.1.smithi136.stdout:9/297: sync 2024-09-18T12:51:11.896 INFO:tasks.workunit.client.1.smithi136.stdout:3/360: sync 2024-09-18T12:51:11.896 INFO:tasks.workunit.client.1.smithi136.stdout:3/361: write d3/d5/f35 [1309680,89243] 0 2024-09-18T12:51:11.897 INFO:tasks.workunit.client.1.smithi136.stdout:8/468: sync 2024-09-18T12:51:11.900 INFO:tasks.workunit.client.1.smithi136.stdout:9/298: symlink d6/df/d23/d2b/l64 0 2024-09-18T12:51:11.900 INFO:tasks.workunit.client.1.smithi136.stdout:3/362: dread d3/d14/d22/f42 [0,4194304] 0 2024-09-18T12:51:11.902 INFO:tasks.workunit.client.1.smithi136.stdout:9/299: symlink d6/d13/d15/d25/l65 0 2024-09-18T12:51:11.902 INFO:tasks.workunit.client.1.smithi136.stdout:9/300: chown d6/d13/d15/d25/f57 11 1 2024-09-18T12:51:11.902 INFO:tasks.workunit.client.1.smithi136.stdout:3/363: mknod d3/d14/d18/c78 0 2024-09-18T12:51:11.903 INFO:tasks.workunit.client.0.smithi081.stdout:8/107: mknod d3/d1e/c26 0 2024-09-18T12:51:11.903 INFO:tasks.workunit.client.0.smithi081.stdout:8/108: fdatasync d3/d1d/f21 0 2024-09-18T12:51:11.904 INFO:tasks.workunit.client.0.smithi081.stdout:4/104: creat d3/db/f25 x:0 0 0 2024-09-18T12:51:11.904 INFO:tasks.workunit.client.1.smithi136.stdout:9/301: creat d6/df/d23/f66 x:0 0 0 2024-09-18T12:51:11.905 INFO:tasks.workunit.client.1.smithi136.stdout:9/302: readlink d6/d13/l14 0 2024-09-18T12:51:11.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/364: creat d3/d14/d17/d53/d73/f79 x:0 0 0 2024-09-18T12:51:11.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/365: truncate d3/d14/d17/d53/f77 927442 0 2024-09-18T12:51:11.906 INFO:tasks.workunit.client.0.smithi081.stdout:5/126: dread d2/fe [0,4194304] 0 2024-09-18T12:51:11.907 INFO:tasks.workunit.client.1.smithi136.stdout:9/303: rename d6/d13/c1e to d6/db/d49/c67 0 2024-09-18T12:51:11.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/361: dwrite d5/f62 [0,4194304] 0 2024-09-18T12:51:11.909 INFO:tasks.workunit.client.0.smithi081.stdout:8/109: creat d3/d1e/f27 x:0 0 0 2024-09-18T12:51:11.910 INFO:tasks.workunit.client.1.smithi136.stdout:9/304: link d6/df/f1f d6/d59/f68 0 2024-09-18T12:51:11.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/128: rmdir d4 39 2024-09-18T12:51:11.912 INFO:tasks.workunit.client.1.smithi136.stdout:4/227: dwrite d0/d3/f43 [0,4194304] 0 2024-09-18T12:51:11.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/105: rename d3/dd/d14/c17 to d3/dd/c26 0 2024-09-18T12:51:11.913 INFO:tasks.workunit.client.1.smithi136.stdout:9/305: creat d6/da/d3d/f69 x:0 0 0 2024-09-18T12:51:11.915 INFO:tasks.workunit.client.1.smithi136.stdout:9/306: link d6/df/d23/d2b/f43 d6/da/d3d/f6a 0 2024-09-18T12:51:11.916 INFO:tasks.workunit.client.1.smithi136.stdout:9/307: fsync d6/d13/d15/f16 0 2024-09-18T12:51:11.916 INFO:tasks.workunit.client.0.smithi081.stdout:1/116: getdents d0/d6/d7/d8 0 2024-09-18T12:51:11.917 INFO:tasks.workunit.client.1.smithi136.stdout:3/366: truncate d3/d14/d22/f1f 2934024 0 2024-09-18T12:51:11.918 INFO:tasks.workunit.client.0.smithi081.stdout:5/127: mknod d2/d14/d1d/d1a/c2d 0 2024-09-18T12:51:11.919 INFO:tasks.workunit.client.1.smithi136.stdout:9/308: mknod d6/d59/c6b 0 2024-09-18T12:51:11.919 INFO:tasks.workunit.client.1.smithi136.stdout:9/309: read d6/d13/d15/d25/f27 [724794,123618] 0 2024-09-18T12:51:11.920 INFO:tasks.workunit.client.1.smithi136.stdout:9/310: truncate d6/d13/d15/d25/f31 4428989 0 2024-09-18T12:51:11.920 INFO:tasks.workunit.client.0.smithi081.stdout:8/110: mknod d3/d1d/c28 0 2024-09-18T12:51:11.921 INFO:tasks.workunit.client.0.smithi081.stdout:8/111: stat d3/f1a 0 2024-09-18T12:51:11.921 INFO:tasks.workunit.client.0.smithi081.stdout:4/106: fsync d3/dd/d14/f24 0 2024-09-18T12:51:11.921 INFO:tasks.workunit.client.1.smithi136.stdout:9/311: creat d6/d13/d15/f6c x:0 0 0 2024-09-18T12:51:11.922 INFO:tasks.workunit.client.0.smithi081.stdout:6/129: mknod d4/d12/c25 0 2024-09-18T12:51:11.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/117: mknod d0/db/d12/c2a 0 2024-09-18T12:51:11.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/118: write d0/f20 [801400,53841] 0 2024-09-18T12:51:11.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/119: creat d0/db/f2b x:0 0 0 2024-09-18T12:51:11.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/120: write d0/d6/d7/d8/f11 [734998,6232] 0 2024-09-18T12:51:11.925 INFO:tasks.workunit.client.1.smithi136.stdout:9/312: unlink d6/df/d23/d2b/c51 0 2024-09-18T12:51:11.925 INFO:tasks.workunit.client.0.smithi081.stdout:5/128: rmdir d2/d1f 0 2024-09-18T12:51:11.925 INFO:tasks.workunit.client.0.smithi081.stdout:5/129: write d2/d14/f17 [2987529,61559] 0 2024-09-18T12:51:11.926 INFO:tasks.workunit.client.1.smithi136.stdout:4/228: read d0/d2/f17 [1098763,18954] 0 2024-09-18T12:51:11.926 INFO:tasks.workunit.client.1.smithi136.stdout:4/229: fsync d0/d2/f12 0 2024-09-18T12:51:11.932 INFO:tasks.workunit.client.1.smithi136.stdout:5/362: dwrite d5/d1a/d2d/d34/f2e [4194304,4194304] 0 2024-09-18T12:51:11.935 INFO:tasks.workunit.client.1.smithi136.stdout:3/367: dread d3/d14/d18/f41 [0,4194304] 0 2024-09-18T12:51:11.935 INFO:tasks.workunit.client.1.smithi136.stdout:8/469: dwrite d9/d14/f26 [0,4194304] 0 2024-09-18T12:51:11.935 INFO:tasks.workunit.client.1.smithi136.stdout:3/368: readlink d3/d14/l5b 0 2024-09-18T12:51:11.936 INFO:tasks.workunit.client.1.smithi136.stdout:3/369: creat d3/d14/d17/d1a/f7a x:0 0 0 2024-09-18T12:51:11.949 INFO:tasks.workunit.client.1.smithi136.stdout:5/363: dread d5/f62 [0,4194304] 0 2024-09-18T12:51:11.957 INFO:tasks.workunit.client.0.smithi081.stdout:1/121: dwrite d0/f4 [0,4194304] 0 2024-09-18T12:51:11.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/112: dwrite d3/f25 [0,4194304] 0 2024-09-18T12:51:11.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/113: dread - d3/d1e/f27 zero size 2024-09-18T12:51:11.967 INFO:tasks.workunit.client.1.smithi136.stdout:9/313: dwrite d6/d13/d15/f6c [0,4194304] 0 2024-09-18T12:51:11.967 INFO:tasks.workunit.client.1.smithi136.stdout:9/314: write d6/db/d12/f60 [257176,60139] 0 2024-09-18T12:51:11.969 INFO:tasks.workunit.client.1.smithi136.stdout:9/315: dread d6/db/d49/d53/f54 [0,4194304] 0 2024-09-18T12:51:11.979 INFO:tasks.workunit.client.1.smithi136.stdout:4/230: dwrite d0/d2/f3d [0,4194304] 0 2024-09-18T12:51:11.979 INFO:tasks.workunit.client.1.smithi136.stdout:5/364: dwrite d5/f18 [0,4194304] 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/130: dwrite d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:1/122: dwrite d0/f4 [0,4194304] 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/131: chown d2/dd/l2c 605 1 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:1/123: chown d0/d18/d1a/d1f/l27 7279214 1 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/132: truncate d2/dd/f29 738402 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/133: creat d2/d14/d1d/d1a/f2e x:0 0 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/134: write d2/d4/d18/d20/f22 [1543426,14776] 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/135: fdatasync d2/d4/d18/f25 0 2024-09-18T12:51:11.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/136: truncate d2/d4/f13 1424855 0 2024-09-18T12:51:11.981 INFO:tasks.workunit.client.0.smithi081.stdout:5/137: dread - d2/d14/d1d/d1a/f2b zero size 2024-09-18T12:51:11.984 INFO:tasks.workunit.client.0.smithi081.stdout:1/124: dread d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:11.985 INFO:tasks.workunit.client.0.smithi081.stdout:1/125: chown d0/d6/f9 15944617 1 2024-09-18T12:51:11.998 INFO:tasks.workunit.client.0.smithi081.stdout:1/126: dwrite d0/db/f14 [0,4194304] 0 2024-09-18T12:51:11.998 INFO:tasks.workunit.client.0.smithi081.stdout:4/107: mkdir d3/dd/d14/d27 0 2024-09-18T12:51:11.998 INFO:tasks.workunit.client.0.smithi081.stdout:4/108: chown d3/dd/f21 313963 1 2024-09-18T12:51:12.006 INFO:tasks.workunit.client.0.smithi081.stdout:8/114: rename d3/d1d/c1f to d3/d1e/c29 0 2024-09-18T12:51:12.008 INFO:tasks.workunit.client.0.smithi081.stdout:5/138: mknod d2/c2f 0 2024-09-18T12:51:12.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/127: mkdir d0/d18/d1a/d1f/d2c 0 2024-09-18T12:51:12.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/128: fdatasync d0/ff 0 2024-09-18T12:51:12.019 INFO:tasks.workunit.client.0.smithi081.stdout:4/109: link d3/dd/d14/c1d d3/dd/c28 0 2024-09-18T12:51:12.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/115: mknod d3/d1e/c2a 0 2024-09-18T12:51:12.022 INFO:tasks.workunit.client.0.smithi081.stdout:1/129: mkdir d0/db/d12/d2d 0 2024-09-18T12:51:12.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/110: rename d3/dd/d14/f24 to d3/dd/d14/f29 0 2024-09-18T12:51:12.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/111: dread - d3/db/f25 zero size 2024-09-18T12:51:12.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/112: chown d3/db 12019105 1 2024-09-18T12:51:12.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/113: write d3/dd/d14/f1e [206695,26466] 0 2024-09-18T12:51:12.027 INFO:tasks.workunit.client.0.smithi081.stdout:5/139: dwrite d2/d4/d18/d20/f22 [0,4194304] 0 2024-09-18T12:51:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:7/140: sync 2024-09-18T12:51:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:4/114: dread d3/db/f23 [0,4194304] 0 2024-09-18T12:51:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:7/141: getdents d2 0 2024-09-18T12:51:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:7/142: write d2/d18/d22/f2a [943697,95990] 0 2024-09-18T12:51:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:7/143: write d2/f11 [4271589,36822] 0 2024-09-18T12:51:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:5/140: dread d2/fe [0,4194304] 0 2024-09-18T12:51:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:7/144: mknod d2/d14/d21/c35 0 2024-09-18T12:51:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:4/115: fsync d3/dd/d14/f1e 0 2024-09-18T12:51:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:7/145: creat d2/d1d/f36 x:0 0 0 2024-09-18T12:51:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:7/146: read - d2/d1d/f36 zero size 2024-09-18T12:51:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:4/116: mknod d3/c2a 0 2024-09-18T12:51:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:4/117: mkdir d3/dd/d14/d27/d2b 0 2024-09-18T12:51:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:7/147: dread d2/d14/f16 [0,4194304] 0 2024-09-18T12:51:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:7/148: symlink d2/d1d/l37 0 2024-09-18T12:51:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:7/149: fdatasync d2/d14/f29 0 2024-09-18T12:51:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:7/150: truncate d2/d1d/f2c 93373 0 2024-09-18T12:51:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:7/151: creat d2/d1d/f38 x:0 0 0 2024-09-18T12:51:12.043 INFO:tasks.workunit.client.1.smithi136.stdout:8/470: mkdir d9/d14/d1a/dae 0 2024-09-18T12:51:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:8/116: dwrite d3/f25 [0,4194304] 0 2024-09-18T12:51:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:8/117: fsync d3/f25 0 2024-09-18T12:51:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:7/152: fsync d2/f11 0 2024-09-18T12:51:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:7/153: dread - d2/d1d/f38 zero size 2024-09-18T12:51:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:1/130: dwrite d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:12.046 INFO:tasks.workunit.client.1.smithi136.stdout:3/370: mknod d3/d14/d17/d53/c7b 0 2024-09-18T12:51:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:7/154: creat d2/f39 x:0 0 0 2024-09-18T12:51:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:1/131: truncate d0/db/f14 880434 0 2024-09-18T12:51:12.058 INFO:tasks.workunit.client.1.smithi136.stdout:5/365: rename d5/d1a/d2d/d3f/c66 to d5/c69 0 2024-09-18T12:51:12.058 INFO:tasks.workunit.client.1.smithi136.stdout:5/366: stat d5/f2a 0 2024-09-18T12:51:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:5/141: dwrite d2/ff [4194304,4194304] 0 2024-09-18T12:51:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:5/142: fdatasync d2/dd/f10 0 2024-09-18T12:51:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:5/143: creat d2/d4/d18/d20/f30 x:0 0 0 2024-09-18T12:51:12.060 INFO:tasks.workunit.client.1.smithi136.stdout:8/471: rmdir d9/d14/d1a/d7f/d8c 39 2024-09-18T12:51:12.060 INFO:tasks.workunit.client.1.smithi136.stdout:8/472: write d9/d18/d34/d3d/d47/d65/f76 [635277,106706] 0 2024-09-18T12:51:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:8/118: dread d3/f13 [4194304,4194304] 0 2024-09-18T12:51:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:8/119: creat d3/d1e/f2b x:0 0 0 2024-09-18T12:51:12.062 INFO:tasks.workunit.client.1.smithi136.stdout:3/371: dread d3/d14/d17/d1a/f56 [0,4194304] 0 2024-09-18T12:51:12.062 INFO:tasks.workunit.client.1.smithi136.stdout:3/372: chown d3/d10/f5e 2148098 1 2024-09-18T12:51:12.062 INFO:tasks.workunit.client.1.smithi136.stdout:5/367: dread d5/d1a/d30/f40 [0,4194304] 0 2024-09-18T12:51:12.066 INFO:tasks.workunit.client.1.smithi136.stdout:3/373: unlink d3/c32 0 2024-09-18T12:51:12.069 INFO:tasks.workunit.client.1.smithi136.stdout:5/368: symlink d5/d1a/d2d/d3f/l6a 0 2024-09-18T12:51:12.069 INFO:tasks.workunit.client.1.smithi136.stdout:5/369: chown d5/d1a/f1b 3051 1 2024-09-18T12:51:12.069 INFO:tasks.workunit.client.1.smithi136.stdout:5/370: truncate d5/d1a/f68 825860 0 2024-09-18T12:51:12.069 INFO:tasks.workunit.client.1.smithi136.stdout:5/371: chown d5/f1c 0 1 2024-09-18T12:51:12.071 INFO:tasks.workunit.client.0.smithi081.stdout:1/132: write d0/d6/d7/d8/f11 [54673,129031] 0 2024-09-18T12:51:12.071 INFO:tasks.workunit.client.0.smithi081.stdout:1/133: stat d0/d6/d7 0 2024-09-18T12:51:12.076 INFO:tasks.workunit.client.1.smithi136.stdout:4/231: truncate d0/d2/f3d 2737114 0 2024-09-18T12:51:12.079 INFO:tasks.workunit.client.0.smithi081.stdout:7/155: rmdir d2 39 2024-09-18T12:51:12.084 INFO:tasks.workunit.client.1.smithi136.stdout:4/232: rename d0/c1b to d0/d13/c44 0 2024-09-18T12:51:12.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/156: creat d2/f3a x:0 0 0 2024-09-18T12:51:12.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/157: fdatasync d2/d1d/f38 0 2024-09-18T12:51:12.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/158: dread - d2/f3a zero size 2024-09-18T12:51:12.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/159: write d2/d14/f29 [610375,122611] 0 2024-09-18T12:51:12.085 INFO:tasks.workunit.client.0.smithi081.stdout:5/144: dwrite d2/d14/d1d/d1a/f2e [0,4194304] 0 2024-09-18T12:51:12.086 INFO:tasks.workunit.client.0.smithi081.stdout:5/145: mkdir d2/d14/d31 0 2024-09-18T12:51:12.087 INFO:tasks.workunit.client.1.smithi136.stdout:4/233: mkdir d0/d45 0 2024-09-18T12:51:12.092 INFO:tasks.workunit.client.1.smithi136.stdout:5/372: dread d5/d1a/d30/f4c [4194304,4194304] 0 2024-09-18T12:51:12.095 INFO:tasks.workunit.client.0.smithi081.stdout:7/160: write d2/d14/d21/f26 [690406,80442] 0 2024-09-18T12:51:12.095 INFO:tasks.workunit.client.0.smithi081.stdout:7/161: dread - d2/d1d/d27/f2e zero size 2024-09-18T12:51:12.096 INFO:tasks.workunit.client.0.smithi081.stdout:7/162: fdatasync d2/d14/f2f 0 2024-09-18T12:51:12.096 INFO:tasks.workunit.client.1.smithi136.stdout:5/373: dread d5/d1a/f27 [0,4194304] 0 2024-09-18T12:51:12.096 INFO:tasks.workunit.client.1.smithi136.stdout:5/374: chown d5/d1a/c2f 2 1 2024-09-18T12:51:12.097 INFO:tasks.workunit.client.1.smithi136.stdout:5/375: mkdir d5/d6b 0 2024-09-18T12:51:12.097 INFO:tasks.workunit.client.0.smithi081.stdout:7/163: creat d2/d18/f3b x:0 0 0 2024-09-18T12:51:12.098 INFO:tasks.workunit.client.0.smithi081.stdout:7/164: truncate d2/d1d/f28 673286 0 2024-09-18T12:51:12.098 INFO:tasks.workunit.client.0.smithi081.stdout:7/165: stat d2/f13 0 2024-09-18T12:51:12.098 INFO:tasks.workunit.client.0.smithi081.stdout:7/166: mkdir d2/d18/d3c 0 2024-09-18T12:51:12.099 INFO:tasks.workunit.client.0.smithi081.stdout:7/167: stat d2/d14/f16 0 2024-09-18T12:51:12.099 INFO:tasks.workunit.client.0.smithi081.stdout:7/168: creat d2/d1d/d27/f3d x:0 0 0 2024-09-18T12:51:12.101 INFO:tasks.workunit.client.0.smithi081.stdout:7/169: unlink d2/d18/c33 0 2024-09-18T12:51:12.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/146: read d2/d14/d1d/d1a/f2e [664221,63865] 0 2024-09-18T12:51:12.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:11 smithi081 ceph-mon[27646]: pgmap v278: 65 pgs: 65 active+clean; 587 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 37 MiB/s rd, 54 MiB/s wr, 544 op/s 2024-09-18T12:51:12.108 INFO:tasks.workunit.client.0.smithi081.stdout:8/120: dwrite d3/f13 [4194304,4194304] 0 2024-09-18T12:51:12.108 INFO:tasks.workunit.client.1.smithi136.stdout:3/374: dwrite d3/d14/d22/d2c/f68 [0,4194304] 0 2024-09-18T12:51:12.108 INFO:tasks.workunit.client.1.smithi136.stdout:4/234: dread d0/d13/f18 [0,4194304] 0 2024-09-18T12:51:12.108 INFO:tasks.workunit.client.1.smithi136.stdout:8/473: dwrite d9/d14/d1a/f37 [0,4194304] 0 2024-09-18T12:51:12.109 INFO:tasks.workunit.client.0.smithi081.stdout:5/147: unlink d2/d4/d18/l28 0 2024-09-18T12:51:12.109 INFO:tasks.workunit.client.0.smithi081.stdout:5/148: fsync d2/dd/f29 0 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:6/356: sync 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:0/336: sync 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:1/273: sync 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:2/392: sync 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:2/393: fsync d5/d7/d17/f77 0 2024-09-18T12:51:12.111 INFO:tasks.workunit.client.1.smithi136.stdout:7/494: sync 2024-09-18T12:51:12.112 INFO:tasks.workunit.client.0.smithi081.stdout:1/134: dwrite d0/d18/f25 [0,4194304] 0 2024-09-18T12:51:12.112 INFO:tasks.workunit.client.1.smithi136.stdout:6/357: dread d8/d9/de/d1c/f20 [0,4194304] 0 2024-09-18T12:51:12.112 INFO:tasks.workunit.client.1.smithi136.stdout:8/474: dread d9/d14/d1a/d2b/f33 [0,4194304] 0 2024-09-18T12:51:12.114 INFO:tasks.workunit.client.1.smithi136.stdout:3/375: mknod d3/d14/d22/d2c/c7c 0 2024-09-18T12:51:12.115 INFO:tasks.workunit.client.1.smithi136.stdout:2/394: truncate d5/f22 832048 0 2024-09-18T12:51:12.116 INFO:tasks.workunit.client.1.smithi136.stdout:7/495: symlink d0/d12/d1a/lad 0 2024-09-18T12:51:12.116 INFO:tasks.workunit.client.1.smithi136.stdout:7/496: creat d0/d35/d4f/fae x:0 0 0 2024-09-18T12:51:12.119 INFO:tasks.workunit.client.1.smithi136.stdout:2/395: write d5/d25/d2d/f6d [303140,80208] 0 2024-09-18T12:51:12.119 INFO:tasks.workunit.client.1.smithi136.stdout:2/396: dread - d5/d4a/d67/f75 zero size 2024-09-18T12:51:12.120 INFO:tasks.workunit.client.1.smithi136.stdout:7/497: creat d0/d35/d41/d50/faf x:0 0 0 2024-09-18T12:51:12.121 INFO:tasks.workunit.client.1.smithi136.stdout:7/498: write d0/d35/d41/f5c [3604439,52997] 0 2024-09-18T12:51:12.125 INFO:tasks.workunit.client.1.smithi136.stdout:0/337: dread d1/d17/f47 [4194304,4194304] 0 2024-09-18T12:51:12.126 INFO:tasks.workunit.client.1.smithi136.stdout:8/475: read d9/d14/fe [1380785,95290] 0 2024-09-18T12:51:12.127 INFO:tasks.workunit.client.1.smithi136.stdout:2/397: mknod d5/d25/c79 0 2024-09-18T12:51:12.127 INFO:tasks.workunit.client.0.smithi081.stdout:1/135: write d0/d6/fe [1059490,96983] 0 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:3/376: dread d3/d2b/d6c/f6f [0,4194304] 0 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:0/338: mkdir d1/d17/d2d/d72 0 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:0/339: chown d1/db 51788539 1 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/316: sync 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/317: chown d6/db/d12/c5f 5842963 1 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/318: read - d6/df/d23/d2b/f43 zero size 2024-09-18T12:51:12.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/319: readlink d6/d59/l52 0 2024-09-18T12:51:12.131 INFO:tasks.workunit.client.0.smithi081.stdout:5/149: write d2/d4/d18/d20/f22 [1249402,56204] 0 2024-09-18T12:51:12.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/121: dwrite d3/f13 [0,4194304] 0 2024-09-18T12:51:12.131 INFO:tasks.workunit.client.1.smithi136.stdout:2/398: truncate d5/d7/d17/f47 196735 0 2024-09-18T12:51:12.133 INFO:tasks.workunit.client.0.smithi081.stdout:1/136: rename d0/d6/d7/d26 to d0/d6/d7/d2e 0 2024-09-18T12:51:12.134 INFO:tasks.workunit.client.1.smithi136.stdout:7/499: rmdir d0/d35/d41/d58/d96 0 2024-09-18T12:51:12.134 INFO:tasks.workunit.client.1.smithi136.stdout:7/500: dread - d0/d35/d41/d50/d7f/d3c/f65 zero size 2024-09-18T12:51:12.134 INFO:tasks.workunit.client.1.smithi136.stdout:1/274: dread d2/d5/d2b/d34/f35 [0,4194304] 0 2024-09-18T12:51:12.135 INFO:tasks.workunit.client.1.smithi136.stdout:0/340: truncate d1/d17/f45 2191475 0 2024-09-18T12:51:12.135 INFO:tasks.workunit.client.1.smithi136.stdout:0/341: dread - d1/d17/f6b zero size 2024-09-18T12:51:12.136 INFO:tasks.workunit.client.0.smithi081.stdout:5/150: truncate d2/dd/f10 2680509 0 2024-09-18T12:51:12.137 INFO:tasks.workunit.client.0.smithi081.stdout:8/122: symlink d3/d1d/l2c 0 2024-09-18T12:51:12.139 INFO:tasks.workunit.client.0.smithi081.stdout:1/137: creat d0/db/d12/d2d/f2f x:0 0 0 2024-09-18T12:51:12.140 INFO:tasks.workunit.client.0.smithi081.stdout:1/138: rmdir d0/d6/d7/d8 39 2024-09-18T12:51:12.140 INFO:tasks.workunit.client.0.smithi081.stdout:1/139: truncate d0/db/f14 1424191 0 2024-09-18T12:51:12.140 INFO:tasks.workunit.client.1.smithi136.stdout:7/501: unlink d0/d35/d36/f22 0 2024-09-18T12:51:12.142 INFO:tasks.workunit.client.1.smithi136.stdout:6/358: dwrite d8/dc/f41 [0,4194304] 0 2024-09-18T12:51:12.142 INFO:tasks.workunit.client.1.smithi136.stdout:4/235: dwrite d0/d25/f2d [0,4194304] 0 2024-09-18T12:51:12.143 INFO:tasks.workunit.client.1.smithi136.stdout:1/275: truncate d2/f4 265833 0 2024-09-18T12:51:12.143 INFO:tasks.workunit.client.1.smithi136.stdout:9/320: getdents d6/d59 0 2024-09-18T12:51:12.143 INFO:tasks.workunit.client.1.smithi136.stdout:1/276: creat d2/d5/d11/f58 x:0 0 0 2024-09-18T12:51:12.144 INFO:tasks.workunit.client.1.smithi136.stdout:3/377: dread d3/d14/d17/d1a/f56 [0,4194304] 0 2024-09-18T12:51:12.148 INFO:tasks.workunit.client.1.smithi136.stdout:6/359: mkdir d8/d9/de/d60/d71/d7f 0 2024-09-18T12:51:12.151 INFO:tasks.workunit.client.0.smithi081.stdout:1/140: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:12.152 INFO:tasks.workunit.client.1.smithi136.stdout:7/502: dread d0/d39/f7e [0,4194304] 0 2024-09-18T12:51:12.154 INFO:tasks.workunit.client.1.smithi136.stdout:0/342: write d1/d17/d2d/d35/f40 [2365051,64224] 0 2024-09-18T12:51:12.154 INFO:tasks.workunit.client.1.smithi136.stdout:0/343: write d1/d3/f58 [836471,99035] 0 2024-09-18T12:51:12.154 INFO:tasks.workunit.client.1.smithi136.stdout:1/277: dread d2/d5/d9/f1a [0,4194304] 0 2024-09-18T12:51:12.154 INFO:tasks.workunit.client.0.smithi081.stdout:1/141: rename d0/d18/d1a/d1f/f21 to d0/d18/d1a/f30 0 2024-09-18T12:51:12.156 INFO:tasks.workunit.client.1.smithi136.stdout:3/378: rename d3/d10/d4a/f58 to d3/d14/d18/f7d 0 2024-09-18T12:51:12.157 INFO:tasks.workunit.client.1.smithi136.stdout:3/379: readlink d3/d14/d17/d1a/l67 0 2024-09-18T12:51:12.160 INFO:tasks.workunit.client.1.smithi136.stdout:9/321: dread d6/d13/d15/d25/f31 [0,4194304] 0 2024-09-18T12:51:12.160 INFO:tasks.workunit.client.1.smithi136.stdout:9/322: chown d6/d13/f22 19591 1 2024-09-18T12:51:12.160 INFO:tasks.workunit.client.1.smithi136.stdout:9/323: truncate d6/d13/d15/d25/f31 4749345 0 2024-09-18T12:51:12.160 INFO:tasks.workunit.client.1.smithi136.stdout:6/360: mknod d8/dc/c80 0 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/151: dwrite d2/ff [8388608,4194304] 0 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/152: creat d2/d14/f32 x:0 0 0 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/153: chown d2/d4/ca 2 1 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.1.smithi136.stdout:4/236: getdents d0/d3 0 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.1.smithi136.stdout:4/237: chown d0/d2/l1c 132287 1 2024-09-18T12:51:12.161 INFO:tasks.workunit.client.1.smithi136.stdout:4/238: fdatasync d0/fc 0 2024-09-18T12:51:12.162 INFO:tasks.workunit.client.1.smithi136.stdout:4/239: write d0/d2/f16 [1115219,83793] 0 2024-09-18T12:51:12.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/154: mkdir d2/d14/d33 0 2024-09-18T12:51:12.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/155: chown d2/d14/d1d 76777 1 2024-09-18T12:51:12.163 INFO:tasks.workunit.client.1.smithi136.stdout:1/278: creat d2/d5/d11/d2e/d4c/f59 x:0 0 0 2024-09-18T12:51:12.163 INFO:tasks.workunit.client.1.smithi136.stdout:3/380: mknod d3/d14/d17/d53/d73/c7e 0 2024-09-18T12:51:12.164 INFO:tasks.workunit.client.0.smithi081.stdout:5/156: getdents d2/d14/d1d 0 2024-09-18T12:51:12.165 INFO:tasks.workunit.client.0.smithi081.stdout:5/157: creat d2/d14/d1d/d1a/f34 x:0 0 0 2024-09-18T12:51:12.165 INFO:tasks.workunit.client.0.smithi081.stdout:5/158: chown d2/d4 53774 1 2024-09-18T12:51:12.165 INFO:tasks.workunit.client.0.smithi081.stdout:5/159: creat d2/d4/d18/f35 x:0 0 0 2024-09-18T12:51:12.168 INFO:tasks.workunit.client.1.smithi136.stdout:0/344: dread d1/d17/f2b [0,4194304] 0 2024-09-18T12:51:12.168 INFO:tasks.workunit.client.1.smithi136.stdout:9/324: creat d6/da/d3d/d41/f6d x:0 0 0 2024-09-18T12:51:12.168 INFO:tasks.workunit.client.1.smithi136.stdout:9/325: dread - d6/d13/d15/d25/f3a zero size 2024-09-18T12:51:12.169 INFO:tasks.workunit.client.1.smithi136.stdout:1/279: truncate d2/f17 3303095 0 2024-09-18T12:51:12.173 INFO:tasks.workunit.client.1.smithi136.stdout:0/345: creat d1/d17/d2d/d72/f73 x:0 0 0 2024-09-18T12:51:12.175 INFO:tasks.workunit.client.0.smithi081.stdout:8/123: dwrite d3/d1e/f27 [0,4194304] 0 2024-09-18T12:51:12.175 INFO:tasks.workunit.client.0.smithi081.stdout:8/124: creat d3/f2d x:0 0 0 2024-09-18T12:51:12.176 INFO:tasks.workunit.client.1.smithi136.stdout:7/503: rename d0/d35/d36/d64 to d0/d35/d41/d50/d7f/d3c/d94/db0 0 2024-09-18T12:51:12.176 INFO:tasks.workunit.client.1.smithi136.stdout:7/504: chown d0/d2c/d85/l99 685122 1 2024-09-18T12:51:12.176 INFO:tasks.workunit.client.1.smithi136.stdout:4/240: write d0/d3/f4 [5679811,48492] 0 2024-09-18T12:51:12.176 INFO:tasks.workunit.client.1.smithi136.stdout:4/241: chown d0/l22 2538 1 2024-09-18T12:51:12.176 INFO:tasks.workunit.client.1.smithi136.stdout:0/346: creat d1/d3/d1a/d62/f74 x:0 0 0 2024-09-18T12:51:12.177 INFO:tasks.workunit.client.1.smithi136.stdout:0/347: fdatasync d1/d17/d2d/f55 0 2024-09-18T12:51:12.177 INFO:tasks.workunit.client.1.smithi136.stdout:0/348: read d1/db/fd [632987,24644] 0 2024-09-18T12:51:12.178 INFO:tasks.workunit.client.1.smithi136.stdout:6/361: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:12.179 INFO:tasks.workunit.client.1.smithi136.stdout:6/362: chown d8/d9/de/f6a 4432 1 2024-09-18T12:51:12.181 INFO:tasks.workunit.client.1.smithi136.stdout:4/242: symlink d0/d25/l46 0 2024-09-18T12:51:12.183 INFO:tasks.workunit.client.1.smithi136.stdout:0/349: mkdir d1/d3/d1a/d62/d75 0 2024-09-18T12:51:12.184 INFO:tasks.workunit.client.1.smithi136.stdout:0/350: chown d1/f43 4602040 1 2024-09-18T12:51:12.184 INFO:tasks.workunit.client.1.smithi136.stdout:0/351: stat d1/f18 0 2024-09-18T12:51:12.184 INFO:tasks.workunit.client.0.smithi081.stdout:8/125: link d3/d1e/c2a d3/d1d/c2e 0 2024-09-18T12:51:12.186 INFO:tasks.workunit.client.0.smithi081.stdout:8/126: mkdir d3/d2f 0 2024-09-18T12:51:12.186 INFO:tasks.workunit.client.1.smithi136.stdout:6/363: creat d8/d9/de/d60/f81 x:0 0 0 2024-09-18T12:51:12.188 INFO:tasks.workunit.client.0.smithi081.stdout:8/127: truncate d3/f18 3197069 0 2024-09-18T12:51:12.191 INFO:tasks.workunit.client.1.smithi136.stdout:4/243: read d0/d2/f12 [1126476,51197] 0 2024-09-18T12:51:12.191 INFO:tasks.workunit.client.1.smithi136.stdout:4/244: stat d0/d2/c20 0 2024-09-18T12:51:12.192 INFO:tasks.workunit.client.0.smithi081.stdout:8/128: rename d3/l1c to d3/l30 0 2024-09-18T12:51:12.194 INFO:tasks.workunit.client.0.smithi081.stdout:1/142: dwrite d0/d6/fe [4194304,4194304] 0 2024-09-18T12:51:12.195 INFO:tasks.workunit.client.0.smithi081.stdout:8/129: creat d3/d2f/f31 x:0 0 0 2024-09-18T12:51:12.197 INFO:tasks.workunit.client.1.smithi136.stdout:4/245: getdents d0/d2 0 2024-09-18T12:51:12.197 INFO:tasks.workunit.client.1.smithi136.stdout:4/246: chown d0/d25/f39 647764 1 2024-09-18T12:51:12.197 INFO:tasks.workunit.client.1.smithi136.stdout:4/247: read d0/d3/f4 [6191754,46530] 0 2024-09-18T12:51:12.197 INFO:tasks.workunit.client.1.smithi136.stdout:4/248: dread - d0/d25/f3a zero size 2024-09-18T12:51:12.199 INFO:tasks.workunit.client.1.smithi136.stdout:0/352: dread d1/d46/f66 [0,4194304] 0 2024-09-18T12:51:12.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/143: mkdir d0/d6/d31 0 2024-09-18T12:51:12.200 INFO:tasks.workunit.client.1.smithi136.stdout:4/249: rename d0/d3/f10 to d0/d13/f47 0 2024-09-18T12:51:12.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/280: dwrite d2/d5/d11/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:12.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/281: creat d2/d5/f5a x:0 0 0 2024-09-18T12:51:12.200 INFO:tasks.workunit.client.1.smithi136.stdout:1/282: fdatasync d2/d5/f5a 0 2024-09-18T12:51:12.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/250: creat d0/d3/f48 x:0 0 0 2024-09-18T12:51:12.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/144: mkdir d0/db/d32 0 2024-09-18T12:51:12.204 INFO:tasks.workunit.client.0.smithi081.stdout:5/160: dwrite d2/d4/d18/f35 [0,4194304] 0 2024-09-18T12:51:12.204 INFO:tasks.workunit.client.0.smithi081.stdout:5/161: readlink d2/d4/l11 0 2024-09-18T12:51:12.205 INFO:tasks.workunit.client.1.smithi136.stdout:1/283: creat d2/f5b x:0 0 0 2024-09-18T12:51:12.205 INFO:tasks.workunit.client.1.smithi136.stdout:1/284: dread - d2/f3f zero size 2024-09-18T12:51:12.205 INFO:tasks.workunit.client.1.smithi136.stdout:1/285: fsync d2/d5/d11/d2e/d4c/f2f 0 2024-09-18T12:51:12.206 INFO:tasks.workunit.client.1.smithi136.stdout:4/251: creat d0/d2/f49 x:0 0 0 2024-09-18T12:51:12.206 INFO:tasks.workunit.client.1.smithi136.stdout:4/252: chown d0/d13 50920076 1 2024-09-18T12:51:12.206 INFO:tasks.workunit.client.1.smithi136.stdout:4/253: dread - d0/d3/f36 zero size 2024-09-18T12:51:12.206 INFO:tasks.workunit.client.0.smithi081.stdout:1/145: mkdir d0/d6/d33 0 2024-09-18T12:51:12.207 INFO:tasks.workunit.client.1.smithi136.stdout:1/286: mkdir d2/d5/d2b/d34/d5c 0 2024-09-18T12:51:12.207 INFO:tasks.workunit.client.1.smithi136.stdout:0/353: dread d1/d3/f8 [0,4194304] 0 2024-09-18T12:51:12.208 INFO:tasks.workunit.client.1.smithi136.stdout:0/354: write d1/d17/d2d/d35/f49 [335144,39837] 0 2024-09-18T12:51:12.209 INFO:tasks.workunit.client.1.smithi136.stdout:6/364: dwrite d8/d9/de/f70 [0,4194304] 0 2024-09-18T12:51:12.209 INFO:tasks.workunit.client.1.smithi136.stdout:6/365: creat d8/d9/d64/f82 x:0 0 0 2024-09-18T12:51:12.209 INFO:tasks.workunit.client.1.smithi136.stdout:6/366: write d8/d9/de/f23 [706222,42203] 0 2024-09-18T12:51:12.209 INFO:tasks.workunit.client.0.smithi081.stdout:5/162: fsync d2/d4/d18/d20/f22 0 2024-09-18T12:51:12.210 INFO:tasks.workunit.client.1.smithi136.stdout:1/287: symlink d2/d5/d9/d23/d50/l5d 0 2024-09-18T12:51:12.210 INFO:tasks.workunit.client.1.smithi136.stdout:1/288: chown d2/d5/d11/f19 0 1 2024-09-18T12:51:12.210 INFO:tasks.workunit.client.1.smithi136.stdout:0/355: mkdir d1/db/d76 0 2024-09-18T12:51:12.210 INFO:tasks.workunit.client.1.smithi136.stdout:0/356: chown d1/d3/d1a/l3b 8094 1 2024-09-18T12:51:12.210 INFO:tasks.workunit.client.0.smithi081.stdout:5/163: dread d2/dd/f29 [0,4194304] 0 2024-09-18T12:51:12.211 INFO:tasks.workunit.client.0.smithi081.stdout:8/130: rmdir d3 39 2024-09-18T12:51:12.213 INFO:tasks.workunit.client.0.smithi081.stdout:5/164: rename d2/d4/d16/c24 to d2/d4/d2a/c36 0 2024-09-18T12:51:12.213 INFO:tasks.workunit.client.0.smithi081.stdout:5/165: fdatasync d2/dd/f21 0 2024-09-18T12:51:12.215 INFO:tasks.workunit.client.0.smithi081.stdout:8/131: link d3/d1e/f2b d3/f32 0 2024-09-18T12:51:12.215 INFO:tasks.workunit.client.0.smithi081.stdout:8/132: truncate d3/d2f/f31 582355 0 2024-09-18T12:51:12.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/367: symlink d8/d9/de/d60/d71/d7f/l83 0 2024-09-18T12:51:12.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/368: chown f7 2733626 1 2024-09-18T12:51:12.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/369: write d8/d9/d64/f69 [596623,119039] 0 2024-09-18T12:51:12.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/370: write d8/f6c [21314,15781] 0 2024-09-18T12:51:12.216 INFO:tasks.workunit.client.1.smithi136.stdout:6/371: creat d8/d9/de/d60/f84 x:0 0 0 2024-09-18T12:51:12.217 INFO:tasks.workunit.client.1.smithi136.stdout:6/372: creat d8/d9/de/d1c/d50/f85 x:0 0 0 2024-09-18T12:51:12.217 INFO:tasks.workunit.client.1.smithi136.stdout:6/373: truncate d8/d9/d64/f77 763360 0 2024-09-18T12:51:12.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/133: getdents d3/d1e 0 2024-09-18T12:51:12.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/134: fsync d3/f13 0 2024-09-18T12:51:12.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/135: chown d3/d1d/f21 46 1 2024-09-18T12:51:12.218 INFO:tasks.workunit.client.1.smithi136.stdout:1/289: unlink d2/d5/d11/d2e/l4d 0 2024-09-18T12:51:12.218 INFO:tasks.workunit.client.1.smithi136.stdout:1/290: dread - d2/f42 zero size 2024-09-18T12:51:12.220 INFO:tasks.workunit.client.1.smithi136.stdout:0/357: rmdir d1/db/d69 0 2024-09-18T12:51:12.221 INFO:tasks.workunit.client.0.smithi081.stdout:8/136: rename d3/f1a to d3/d1e/f33 0 2024-09-18T12:51:12.222 INFO:tasks.workunit.client.0.smithi081.stdout:1/146: dwrite d0/d18/f25 [0,4194304] 0 2024-09-18T12:51:12.222 INFO:tasks.workunit.client.0.smithi081.stdout:8/137: unlink d3/l19 0 2024-09-18T12:51:12.222 INFO:tasks.workunit.client.0.smithi081.stdout:8/138: chown d3/l30 4654 1 2024-09-18T12:51:12.224 INFO:tasks.workunit.client.0.smithi081.stdout:1/147: creat d0/d6/d7/d8/f34 x:0 0 0 2024-09-18T12:51:12.224 INFO:tasks.workunit.client.1.smithi136.stdout:6/374: unlink d8/d9/de/d60/d71/d7f/l83 0 2024-09-18T12:51:12.224 INFO:tasks.workunit.client.1.smithi136.stdout:6/375: chown d8/d9/de/f18 2136473290 1 2024-09-18T12:51:12.225 INFO:tasks.workunit.client.0.smithi081.stdout:1/148: symlink d0/d18/l35 0 2024-09-18T12:51:12.225 INFO:tasks.workunit.client.1.smithi136.stdout:1/291: symlink d2/d5/d2b/d34/d5c/l5e 0 2024-09-18T12:51:12.225 INFO:tasks.workunit.client.1.smithi136.stdout:1/292: chown d2/d5/d11/d2e/f33 26065387 1 2024-09-18T12:51:12.226 INFO:tasks.workunit.client.1.smithi136.stdout:4/254: fsync d0/d13/f47 0 2024-09-18T12:51:12.227 INFO:tasks.workunit.client.0.smithi081.stdout:1/149: link d0/d6/f17 d0/d6/f36 0 2024-09-18T12:51:12.228 INFO:tasks.workunit.client.1.smithi136.stdout:0/358: unlink d1/d3/d1a/f20 0 2024-09-18T12:51:12.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/150: mkdir d0/d6/d33/d37 0 2024-09-18T12:51:12.231 INFO:tasks.workunit.client.1.smithi136.stdout:4/255: creat d0/f4a x:0 0 0 2024-09-18T12:51:12.231 INFO:tasks.workunit.client.0.smithi081.stdout:1/151: truncate d0/f4 3981791 0 2024-09-18T12:51:12.232 INFO:tasks.workunit.client.1.smithi136.stdout:0/359: truncate d1/d17/d2d/d35/d54/f5e 233665 0 2024-09-18T12:51:12.232 INFO:tasks.workunit.client.1.smithi136.stdout:0/360: chown d1/db/f3e 964 1 2024-09-18T12:51:12.233 INFO:tasks.workunit.client.0.smithi081.stdout:5/166: dwrite d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:12.234 INFO:tasks.workunit.client.0.smithi081.stdout:5/167: mkdir d2/d14/d33/d37 0 2024-09-18T12:51:12.234 INFO:tasks.workunit.client.1.smithi136.stdout:6/376: dread d8/d9/de/f70 [0,4194304] 0 2024-09-18T12:51:12.234 INFO:tasks.workunit.client.1.smithi136.stdout:1/293: mknod d2/d5/d9/c5f 0 2024-09-18T12:51:12.234 INFO:tasks.workunit.client.1.smithi136.stdout:6/377: chown d8/d9/d56 0 1 2024-09-18T12:51:12.236 INFO:tasks.workunit.client.1.smithi136.stdout:4/256: mknod d0/d13/c4b 0 2024-09-18T12:51:12.236 INFO:tasks.workunit.client.0.smithi081.stdout:5/168: unlink d2/d14/d1d/c15 0 2024-09-18T12:51:12.239 INFO:tasks.workunit.client.0.smithi081.stdout:5/169: creat d2/d4/f38 x:0 0 0 2024-09-18T12:51:12.239 INFO:tasks.workunit.client.1.smithi136.stdout:0/361: unlink d1/f43 0 2024-09-18T12:51:12.240 INFO:tasks.workunit.client.0.smithi081.stdout:5/170: mknod d2/d14/d1d/c39 0 2024-09-18T12:51:12.241 INFO:tasks.workunit.client.0.smithi081.stdout:8/139: dwrite d3/f2d [0,4194304] 0 2024-09-18T12:51:12.241 INFO:tasks.workunit.client.0.smithi081.stdout:8/140: readlink d3/d1d/l2c 0 2024-09-18T12:51:12.247 INFO:tasks.workunit.client.0.smithi081.stdout:1/152: rmdir d0/d6 39 2024-09-18T12:51:12.247 INFO:tasks.workunit.client.0.smithi081.stdout:1/153: chown d0/d6/d7/d2e 639669 1 2024-09-18T12:51:12.251 INFO:tasks.workunit.client.1.smithi136.stdout:1/294: creat d2/f60 x:0 0 0 2024-09-18T12:51:12.252 INFO:tasks.workunit.client.1.smithi136.stdout:0/362: mkdir d1/db/d77 0 2024-09-18T12:51:12.252 INFO:tasks.workunit.client.1.smithi136.stdout:0/363: creat d1/d17/d2d/d72/f78 x:0 0 0 2024-09-18T12:51:12.257 INFO:tasks.workunit.client.1.smithi136.stdout:0/364: truncate d1/d17/f37 2917662 0 2024-09-18T12:51:12.257 INFO:tasks.workunit.client.1.smithi136.stdout:0/365: dread - d1/d17/f6b zero size 2024-09-18T12:51:12.257 INFO:tasks.workunit.client.1.smithi136.stdout:0/366: read d1/d17/d2d/d35/f49 [277651,109843] 0 2024-09-18T12:51:12.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/367: unlink d1/d3/f22 0 2024-09-18T12:51:12.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/368: stat d1/d3/d1a/f50 0 2024-09-18T12:51:12.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/369: chown d1/db 1 1 2024-09-18T12:51:12.262 INFO:tasks.workunit.client.1.smithi136.stdout:0/370: truncate d1/d3/f5c 661054 0 2024-09-18T12:51:12.265 INFO:tasks.workunit.client.1.smithi136.stdout:0/371: mknod d1/d3/d1a/d62/d75/c79 0 2024-09-18T12:51:12.265 INFO:tasks.workunit.client.1.smithi136.stdout:0/372: dread - d1/d17/d2d/f53 zero size 2024-09-18T12:51:12.267 INFO:tasks.workunit.client.0.smithi081.stdout:3/177: sync 2024-09-18T12:51:12.267 INFO:tasks.workunit.client.0.smithi081.stdout:8/141: write d3/d1e/f27 [3790658,25560] 0 2024-09-18T12:51:12.268 INFO:tasks.workunit.client.1.smithi136.stdout:0/373: symlink d1/d3/d1a/d62/d75/l7a 0 2024-09-18T12:51:12.268 INFO:tasks.workunit.client.0.smithi081.stdout:3/178: creat d3/d23/f3e x:0 0 0 2024-09-18T12:51:12.268 INFO:tasks.workunit.client.0.smithi081.stdout:3/179: chown d3/db/df/d29/d13/d3c 4 1 2024-09-18T12:51:12.269 INFO:tasks.workunit.client.0.smithi081.stdout:8/142: write d3/d2f/f31 [569045,109284] 0 2024-09-18T12:51:12.272 INFO:tasks.workunit.client.0.smithi081.stdout:8/143: link d3/f11 d3/d1e/f34 0 2024-09-18T12:51:12.274 INFO:tasks.workunit.client.0.smithi081.stdout:8/144: stat d3/d1e/c2a 0 2024-09-18T12:51:12.274 INFO:tasks.workunit.client.1.smithi136.stdout:4/257: dwrite d0/d2/f23 [0,4194304] 0 2024-09-18T12:51:12.275 INFO:tasks.workunit.client.0.smithi081.stdout:5/171: dwrite d2/d14/f27 [0,4194304] 0 2024-09-18T12:51:12.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/378: dwrite d8/f26 [0,4194304] 0 2024-09-18T12:51:12.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/379: chown d8/d9/de/f3d 42051 1 2024-09-18T12:51:12.275 INFO:tasks.workunit.client.1.smithi136.stdout:1/295: dwrite d2/f60 [0,4194304] 0 2024-09-18T12:51:12.279 INFO:tasks.workunit.client.1.smithi136.stdout:4/258: symlink d0/d45/l4c 0 2024-09-18T12:51:12.279 INFO:tasks.workunit.client.1.smithi136.stdout:4/259: creat d0/d2/f4d x:0 0 0 2024-09-18T12:51:12.283 INFO:tasks.workunit.client.1.smithi136.stdout:6/380: unlink f7 0 2024-09-18T12:51:12.288 INFO:tasks.workunit.client.1.smithi136.stdout:5/376: sync 2024-09-18T12:51:12.288 INFO:tasks.workunit.client.1.smithi136.stdout:5/377: chown d5/d1a/d2d/d34/l41 1 1 2024-09-18T12:51:12.288 INFO:tasks.workunit.client.1.smithi136.stdout:5/378: write d5/f11 [997878,59843] 0 2024-09-18T12:51:12.289 INFO:tasks.workunit.client.1.smithi136.stdout:0/374: dwrite d1/d3/d1a/f59 [0,4194304] 0 2024-09-18T12:51:12.289 INFO:tasks.workunit.client.1.smithi136.stdout:1/296: creat d2/d5/d11/d2e/f61 x:0 0 0 2024-09-18T12:51:12.289 INFO:tasks.workunit.client.1.smithi136.stdout:1/297: chown d2/f17 53 1 2024-09-18T12:51:12.289 INFO:tasks.workunit.client.1.smithi136.stdout:1/298: readlink d2/d5/l8 0 2024-09-18T12:51:12.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/180: dwrite d3/db/df/d29/d13/f14 [0,4194304] 0 2024-09-18T12:51:12.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/181: write d3/db/f2c [1642389,95529] 0 2024-09-18T12:51:12.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/182: fsync d3/db/dc/f28 0 2024-09-18T12:51:12.291 INFO:tasks.workunit.client.1.smithi136.stdout:0/375: dread d1/d17/d2d/d35/f4a [0,4194304] 0 2024-09-18T12:51:12.291 INFO:tasks.workunit.client.1.smithi136.stdout:5/379: fsync d5/f11 0 2024-09-18T12:51:12.292 INFO:tasks.workunit.client.1.smithi136.stdout:5/380: read d5/d1a/d30/f3b [2760732,9263] 0 2024-09-18T12:51:12.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/183: dread d3/db/dc/f22 [0,4194304] 0 2024-09-18T12:51:12.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/184: readlink d3/db/df/d29/d12/l25 0 2024-09-18T12:51:12.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/185: write d3/d23/f3e [420190,109764] 0 2024-09-18T12:51:12.296 INFO:tasks.workunit.client.1.smithi136.stdout:6/381: getdents d8/d9/de/d1c 0 2024-09-18T12:51:12.299 INFO:tasks.workunit.client.1.smithi136.stdout:4/260: dwrite d0/d25/f3a [0,4194304] 0 2024-09-18T12:51:12.303 INFO:tasks.workunit.client.1.smithi136.stdout:0/376: getdents d1/d3/d1a/d62/d75 0 2024-09-18T12:51:12.307 INFO:tasks.workunit.client.1.smithi136.stdout:5/381: creat d5/d6b/f6c x:0 0 0 2024-09-18T12:51:12.310 INFO:tasks.workunit.client.1.smithi136.stdout:4/261: rmdir d0/d25 39 2024-09-18T12:51:12.314 INFO:tasks.workunit.client.1.smithi136.stdout:0/377: creat d1/d3/f7b x:0 0 0 2024-09-18T12:51:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:11 smithi136 ceph-mon[35363]: pgmap v278: 65 pgs: 65 active+clean; 587 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 37 MiB/s rd, 54 MiB/s wr, 544 op/s 2024-09-18T12:51:12.315 INFO:tasks.workunit.client.1.smithi136.stdout:5/382: link d5/d1a/d2d/d3f/l67 d5/d6b/l6d 0 2024-09-18T12:51:12.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/186: dwrite d3/d23/f3e [0,4194304] 0 2024-09-18T12:51:12.318 INFO:tasks.workunit.client.1.smithi136.stdout:5/383: link d5/d1a/d30/c50 d5/d1a/d2d/d34/d4e/c6e 0 2024-09-18T12:51:12.318 INFO:tasks.workunit.client.1.smithi136.stdout:5/384: stat d5/d1a/d2d/d34/c17 0 2024-09-18T12:51:12.318 INFO:tasks.workunit.client.1.smithi136.stdout:5/385: stat d5/d1a/c2f 0 2024-09-18T12:51:12.321 INFO:tasks.workunit.client.0.smithi081.stdout:3/187: unlink d3/db/d1b/f1f 0 2024-09-18T12:51:12.322 INFO:tasks.workunit.client.1.smithi136.stdout:6/382: dwrite d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:12.322 INFO:tasks.workunit.client.1.smithi136.stdout:8/476: sync 2024-09-18T12:51:12.324 INFO:tasks.workunit.client.0.smithi081.stdout:3/188: rename d3/db/dc/l26 to d3/db/l3f 0 2024-09-18T12:51:12.324 INFO:tasks.workunit.client.1.smithi136.stdout:6/383: truncate d8/d9/f34 4606296 0 2024-09-18T12:51:12.324 INFO:tasks.workunit.client.1.smithi136.stdout:6/384: readlink d8/l6f 0 2024-09-18T12:51:12.324 INFO:tasks.workunit.client.1.smithi136.stdout:6/385: creat d8/d9/d56/f86 x:0 0 0 2024-09-18T12:51:12.325 INFO:tasks.workunit.client.1.smithi136.stdout:8/477: symlink d9/d18/d34/laf 0 2024-09-18T12:51:12.330 INFO:tasks.workunit.client.1.smithi136.stdout:5/386: write d5/f18 [873316,10900] 0 2024-09-18T12:51:12.331 INFO:tasks.workunit.client.1.smithi136.stdout:5/387: symlink d5/d1a/d2d/d34/l6f 0 2024-09-18T12:51:12.331 INFO:tasks.workunit.client.1.smithi136.stdout:8/478: dread f5 [4194304,4194304] 0 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:4/262: dwrite d0/d3/f29 [4194304,4194304] 0 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:4/263: chown d0 21561225 1 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:4/264: chown d0/l22 3495 1 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:0/378: dwrite d1/d17/f45 [0,4194304] 0 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:0/379: chown d1/d17/d2d/d72 4997303 1 2024-09-18T12:51:12.338 INFO:tasks.workunit.client.1.smithi136.stdout:0/380: creat d1/d3/d1a/f7c x:0 0 0 2024-09-18T12:51:12.345 INFO:tasks.workunit.client.1.smithi136.stdout:5/388: write d5/d1a/f1b [3532829,34207] 0 2024-09-18T12:51:12.345 INFO:tasks.workunit.client.1.smithi136.stdout:5/389: stat d5/d1a/f53 0 2024-09-18T12:51:12.346 INFO:tasks.workunit.client.1.smithi136.stdout:6/386: write d8/d9/de/d1c/f20 [554728,47666] 0 2024-09-18T12:51:12.346 INFO:tasks.workunit.client.1.smithi136.stdout:6/387: stat d8/d9/de 0 2024-09-18T12:51:12.346 INFO:tasks.workunit.client.1.smithi136.stdout:8/479: dwrite d9/f6a [0,4194304] 0 2024-09-18T12:51:12.346 INFO:tasks.workunit.client.1.smithi136.stdout:8/480: readlink d9/d14/l17 0 2024-09-18T12:51:12.349 INFO:tasks.workunit.client.1.smithi136.stdout:6/388: creat d8/d9/de/d60/d71/d7f/f87 x:0 0 0 2024-09-18T12:51:12.350 INFO:tasks.workunit.client.1.smithi136.stdout:0/381: read d1/d17/d2d/d35/d54/f5e [2684098,79736] 0 2024-09-18T12:51:12.350 INFO:tasks.workunit.client.1.smithi136.stdout:8/481: mknod d9/d14/d1a/d2b/cb0 0 2024-09-18T12:51:12.350 INFO:tasks.workunit.client.1.smithi136.stdout:8/482: write d9/d18/d34/d3d/d47/d65/d6b/f9d [222899,9482] 0 2024-09-18T12:51:12.352 INFO:tasks.workunit.client.1.smithi136.stdout:6/389: mknod d8/d9/de/d1c/c88 0 2024-09-18T12:51:12.355 INFO:tasks.workunit.client.1.smithi136.stdout:0/382: rename d1/d17/d2d/d35/l5d to d1/d3/d1a/d62/d75/l7d 0 2024-09-18T12:51:12.355 INFO:tasks.workunit.client.1.smithi136.stdout:0/383: readlink d1/d17/d2d/l38 0 2024-09-18T12:51:12.357 INFO:tasks.workunit.client.1.smithi136.stdout:6/390: creat d8/d9/de/d60/d71/d76/f89 x:0 0 0 2024-09-18T12:51:12.357 INFO:tasks.workunit.client.1.smithi136.stdout:6/391: fsync d8/d9/f74 0 2024-09-18T12:51:12.357 INFO:tasks.workunit.client.1.smithi136.stdout:6/392: write d8/d9/de/d1c/d50/f73 [129875,4904] 0 2024-09-18T12:51:12.359 INFO:tasks.workunit.client.1.smithi136.stdout:4/265: dwrite d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:12.359 INFO:tasks.workunit.client.1.smithi136.stdout:4/266: readlink d0/l22 0 2024-09-18T12:51:12.359 INFO:tasks.workunit.client.1.smithi136.stdout:0/384: write d1/d60/f6f [596594,42567] 0 2024-09-18T12:51:12.361 INFO:tasks.workunit.client.1.smithi136.stdout:6/393: unlink d8/d9/de/d60/l79 0 2024-09-18T12:51:12.361 INFO:tasks.workunit.client.1.smithi136.stdout:6/394: fdatasync d8/dc/f14 0 2024-09-18T12:51:12.361 INFO:tasks.workunit.client.1.smithi136.stdout:6/395: creat d8/d9/f8a x:0 0 0 2024-09-18T12:51:12.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/267: symlink d0/d2/l4e 0 2024-09-18T12:51:12.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/268: write d0/d2/f12 [4280730,91368] 0 2024-09-18T12:51:12.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/269: stat d0/l3f 0 2024-09-18T12:51:12.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/270: write d0/d2/f23 [5150545,39516] 0 2024-09-18T12:51:12.366 INFO:tasks.workunit.client.1.smithi136.stdout:4/271: unlink d0/d13/c44 0 2024-09-18T12:51:12.366 INFO:tasks.workunit.client.1.smithi136.stdout:4/272: truncate d0/d2/f4d 527852 0 2024-09-18T12:51:12.367 INFO:tasks.workunit.client.1.smithi136.stdout:4/273: dread d0/d2/f4d [0,4194304] 0 2024-09-18T12:51:12.369 INFO:tasks.workunit.client.1.smithi136.stdout:5/390: dwrite d5/d1a/d2d/d34/f2e [4194304,4194304] 0 2024-09-18T12:51:12.371 INFO:tasks.workunit.client.1.smithi136.stdout:5/391: creat d5/d1a/d2d/d34/d4e/f70 x:0 0 0 2024-09-18T12:51:12.371 INFO:tasks.workunit.client.1.smithi136.stdout:5/392: creat d5/d6b/f71 x:0 0 0 2024-09-18T12:51:12.373 INFO:tasks.workunit.client.1.smithi136.stdout:0/385: dread d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:12.373 INFO:tasks.workunit.client.1.smithi136.stdout:0/386: write d1/d17/d2d/f55 [439625,3581] 0 2024-09-18T12:51:12.374 INFO:tasks.workunit.client.1.smithi136.stdout:8/483: dwrite d9/d14/d1a/d2b/f91 [0,4194304] 0 2024-09-18T12:51:12.374 INFO:tasks.workunit.client.1.smithi136.stdout:8/484: truncate d9/d18/f41 9166938 0 2024-09-18T12:51:12.375 INFO:tasks.workunit.client.1.smithi136.stdout:5/393: mkdir d5/d72 0 2024-09-18T12:51:12.375 INFO:tasks.workunit.client.1.smithi136.stdout:5/394: write d5/d1a/d2d/d34/d4e/f70 [59415,79112] 0 2024-09-18T12:51:12.375 INFO:tasks.workunit.client.1.smithi136.stdout:5/395: chown d5/d1a/d30/f3b 457248 1 2024-09-18T12:51:12.376 INFO:tasks.workunit.client.1.smithi136.stdout:0/387: mkdir d1/d17/d2d/d70/d7e 0 2024-09-18T12:51:12.377 INFO:tasks.workunit.client.1.smithi136.stdout:8/485: symlink d9/d14/d1a/d2b/lb1 0 2024-09-18T12:51:12.377 INFO:tasks.workunit.client.1.smithi136.stdout:8/486: stat d9/d14/d1a/d2b/c60 0 2024-09-18T12:51:12.378 INFO:tasks.workunit.client.1.smithi136.stdout:5/396: mkdir d5/d1a/d4a/d73 0 2024-09-18T12:51:12.384 INFO:tasks.workunit.client.1.smithi136.stdout:8/487: rmdir d9/d18/d34/d3d/d47/d65/d92 39 2024-09-18T12:51:12.387 INFO:tasks.workunit.client.1.smithi136.stdout:4/274: rmdir d0 39 2024-09-18T12:51:12.388 INFO:tasks.workunit.client.1.smithi136.stdout:4/275: chown d0/d3/f48 1160 1 2024-09-18T12:51:12.388 INFO:tasks.workunit.client.1.smithi136.stdout:4/276: write d0/d2/f4d [1569498,128953] 0 2024-09-18T12:51:12.391 INFO:tasks.workunit.client.1.smithi136.stdout:4/277: symlink d0/d13/l4f 0 2024-09-18T12:51:12.391 INFO:tasks.workunit.client.1.smithi136.stdout:4/278: stat d0/d2/l3c 0 2024-09-18T12:51:12.392 INFO:tasks.workunit.client.1.smithi136.stdout:4/279: fsync d0/d13/f34 0 2024-09-18T12:51:12.404 INFO:tasks.workunit.client.1.smithi136.stdout:4/280: dread d0/d2/f3d [0,4194304] 0 2024-09-18T12:51:12.405 INFO:tasks.workunit.client.1.smithi136.stdout:4/281: link d0/d25/f2d d0/d2/f50 0 2024-09-18T12:51:12.412 INFO:tasks.workunit.client.1.smithi136.stdout:5/397: dwrite d5/d1a/d2d/d34/f35 [0,4194304] 0 2024-09-18T12:51:12.412 INFO:tasks.workunit.client.1.smithi136.stdout:8/488: dwrite d9/d14/d1a/d2b/d42/f6d [0,4194304] 0 2024-09-18T12:51:12.413 INFO:tasks.workunit.client.1.smithi136.stdout:0/388: dwrite d1/d3/d1a/f59 [0,4194304] 0 2024-09-18T12:51:12.420 INFO:tasks.workunit.client.1.smithi136.stdout:0/389: rmdir d1/d17/d2d/d70/d7e 0 2024-09-18T12:51:12.420 INFO:tasks.workunit.client.1.smithi136.stdout:4/282: dwrite d0/d2/f23 [4194304,4194304] 0 2024-09-18T12:51:12.421 INFO:tasks.workunit.client.1.smithi136.stdout:0/390: stat d1/d3/d1a/d62/d75/c79 0 2024-09-18T12:51:12.423 INFO:tasks.workunit.client.1.smithi136.stdout:0/391: dread - d1/db/f3e zero size 2024-09-18T12:51:12.425 INFO:tasks.workunit.client.1.smithi136.stdout:4/283: dread d0/d2/f3d [0,4194304] 0 2024-09-18T12:51:12.425 INFO:tasks.workunit.client.1.smithi136.stdout:0/392: symlink d1/d3/l7f 0 2024-09-18T12:51:12.426 INFO:tasks.workunit.client.1.smithi136.stdout:4/284: unlink d0/f38 0 2024-09-18T12:51:12.427 INFO:tasks.workunit.client.1.smithi136.stdout:0/393: rmdir d1 39 2024-09-18T12:51:12.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/489: dread d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:12.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/490: fsync d9/d14/f1f 0 2024-09-18T12:51:12.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/491: write d9/d18/d34/d3d/d47/d65/d6b/f77 [2137754,126557] 0 2024-09-18T12:51:12.428 INFO:tasks.workunit.client.1.smithi136.stdout:0/394: mknod d1/d17/d2d/d35/c80 0 2024-09-18T12:51:12.428 INFO:tasks.workunit.client.1.smithi136.stdout:0/395: readlink d1/d3/l23 0 2024-09-18T12:51:12.428 INFO:tasks.workunit.client.1.smithi136.stdout:8/492: truncate f5 4537914 0 2024-09-18T12:51:12.428 INFO:tasks.workunit.client.1.smithi136.stdout:9/326: sync 2024-09-18T12:51:12.428 INFO:tasks.workunit.client.1.smithi136.stdout:3/381: sync 2024-09-18T12:51:12.429 INFO:tasks.workunit.client.1.smithi136.stdout:2/399: sync 2024-09-18T12:51:12.430 INFO:tasks.workunit.client.1.smithi136.stdout:3/382: rmdir d3/d10/d4a/d51 39 2024-09-18T12:51:12.431 INFO:tasks.workunit.client.1.smithi136.stdout:2/400: mkdir d5/d4a/d7a 0 2024-09-18T12:51:12.432 INFO:tasks.workunit.client.1.smithi136.stdout:8/493: getdents d9/d14/d1a/d2b/d42/d6e 0 2024-09-18T12:51:12.432 INFO:tasks.workunit.client.1.smithi136.stdout:5/398: dwrite d5/d1a/d30/f57 [0,4194304] 0 2024-09-18T12:51:12.433 INFO:tasks.workunit.client.1.smithi136.stdout:8/494: truncate d9/f6a 2292562 0 2024-09-18T12:51:12.434 INFO:tasks.workunit.client.1.smithi136.stdout:4/285: write d0/d3/f29 [1371931,86199] 0 2024-09-18T12:51:12.434 INFO:tasks.workunit.client.1.smithi136.stdout:4/286: write d0/f1 [7021723,79254] 0 2024-09-18T12:51:12.435 INFO:tasks.workunit.client.1.smithi136.stdout:2/401: dread d5/d7/d17/f47 [0,4194304] 0 2024-09-18T12:51:12.435 INFO:tasks.workunit.client.1.smithi136.stdout:7/505: sync 2024-09-18T12:51:12.439 INFO:tasks.workunit.client.1.smithi136.stdout:0/396: rename d1/d17/d2d to d1/d17/d6d/d81 0 2024-09-18T12:51:12.441 INFO:tasks.workunit.client.1.smithi136.stdout:5/399: mkdir d5/d1a/d2d/d34/d74 0 2024-09-18T12:51:12.444 INFO:tasks.workunit.client.1.smithi136.stdout:7/506: creat d0/d39/d4d/d9a/fb1 x:0 0 0 2024-09-18T12:51:12.444 INFO:tasks.workunit.client.1.smithi136.stdout:7/507: write d0/d35/d4f/f78 [575123,92581] 0 2024-09-18T12:51:12.444 INFO:tasks.workunit.client.1.smithi136.stdout:7/508: chown d0/d39/d4d/d9a/da2 420219 1 2024-09-18T12:51:12.446 INFO:tasks.workunit.client.1.smithi136.stdout:9/327: rename d6/db/lc to d6/df/d23/d2b/l6e 0 2024-09-18T12:51:12.446 INFO:tasks.workunit.client.1.smithi136.stdout:9/328: creat d6/d13/d15/f6f x:0 0 0 2024-09-18T12:51:12.446 INFO:tasks.workunit.client.1.smithi136.stdout:9/329: chown d6/db/d12/d62/c63 55596020 1 2024-09-18T12:51:12.446 INFO:tasks.workunit.client.1.smithi136.stdout:0/397: mkdir d1/d60/d82 0 2024-09-18T12:51:12.448 INFO:tasks.workunit.client.1.smithi136.stdout:5/400: rmdir d5/d1a/d4a/d73 0 2024-09-18T12:51:12.449 INFO:tasks.workunit.client.1.smithi136.stdout:5/401: write d5/f1c [803458,19321] 0 2024-09-18T12:51:12.450 INFO:tasks.workunit.client.1.smithi136.stdout:4/287: dwrite d0/d2/f17 [4194304,4194304] 0 2024-09-18T12:51:12.452 INFO:tasks.workunit.client.1.smithi136.stdout:9/330: mknod d6/db/d49/d53/d5c/c70 0 2024-09-18T12:51:12.452 INFO:tasks.workunit.client.1.smithi136.stdout:9/331: read d6/da/d3d/d4d/f5a [112457,120844] 0 2024-09-18T12:51:12.455 INFO:tasks.workunit.client.1.smithi136.stdout:2/402: link d5/d25/l26 d5/d25/l7b 0 2024-09-18T12:51:12.457 INFO:tasks.workunit.client.1.smithi136.stdout:1/299: sync 2024-09-18T12:51:12.457 INFO:tasks.workunit.client.1.smithi136.stdout:6/396: sync 2024-09-18T12:51:12.457 INFO:tasks.workunit.client.1.smithi136.stdout:1/300: dread - d2/d5/d11/d2e/f61 zero size 2024-09-18T12:51:12.458 INFO:tasks.workunit.client.1.smithi136.stdout:5/402: creat d5/d72/f75 x:0 0 0 2024-09-18T12:51:12.458 INFO:tasks.workunit.client.1.smithi136.stdout:5/403: readlink d5/d1a/l1e 0 2024-09-18T12:51:12.458 INFO:tasks.workunit.client.1.smithi136.stdout:5/404: write d5/d1a/d2d/d34/d4e/f70 [1040596,1398] 0 2024-09-18T12:51:12.460 INFO:tasks.workunit.client.1.smithi136.stdout:4/288: symlink d0/d13/l51 0 2024-09-18T12:51:12.460 INFO:tasks.workunit.client.1.smithi136.stdout:4/289: truncate d0/d3/f48 256694 0 2024-09-18T12:51:12.461 INFO:tasks.workunit.client.1.smithi136.stdout:9/332: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:51:12.462 INFO:tasks.workunit.client.1.smithi136.stdout:9/333: fdatasync d6/d13/f22 0 2024-09-18T12:51:12.462 INFO:tasks.workunit.client.1.smithi136.stdout:9/334: dread - d6/d59/f61 zero size 2024-09-18T12:51:12.462 INFO:tasks.workunit.client.1.smithi136.stdout:9/335: dread - d6/d13/d15/d25/f39 zero size 2024-09-18T12:51:12.464 INFO:tasks.workunit.client.1.smithi136.stdout:0/398: link d1/f18 d1/db/d76/f83 0 2024-09-18T12:51:12.465 INFO:tasks.workunit.client.1.smithi136.stdout:2/403: unlink d5/f15 0 2024-09-18T12:51:12.465 INFO:tasks.workunit.client.1.smithi136.stdout:2/404: chown d5/d7/d41/f4f 9021 1 2024-09-18T12:51:12.465 INFO:tasks.workunit.client.1.smithi136.stdout:2/405: stat d5/d7/d11/f32 0 2024-09-18T12:51:12.465 INFO:tasks.workunit.client.1.smithi136.stdout:2/406: read - d5/d7/d17/f3c zero size 2024-09-18T12:51:12.466 INFO:tasks.workunit.client.1.smithi136.stdout:6/397: symlink d8/d9/d3c/d4a/l8b 0 2024-09-18T12:51:12.467 INFO:tasks.workunit.client.1.smithi136.stdout:7/509: dwrite d0/d12/f60 [0,4194304] 0 2024-09-18T12:51:12.468 INFO:tasks.workunit.client.1.smithi136.stdout:1/301: symlink d2/d5/d9/d23/l62 0 2024-09-18T12:51:12.473 INFO:tasks.workunit.client.1.smithi136.stdout:5/405: unlink d5/d1a/f63 0 2024-09-18T12:51:12.474 INFO:tasks.workunit.client.1.smithi136.stdout:0/399: dread d1/d17/d6d/d81/d35/f40 [0,4194304] 0 2024-09-18T12:51:12.474 INFO:tasks.workunit.client.1.smithi136.stdout:4/290: symlink d0/d13/l52 0 2024-09-18T12:51:12.477 INFO:tasks.workunit.client.1.smithi136.stdout:3/383: rename d3/d14/d17/d1a to d3/d14/d18/d7f 0 2024-09-18T12:51:12.479 INFO:tasks.workunit.client.1.smithi136.stdout:6/398: symlink d8/d9/d3c/l8c 0 2024-09-18T12:51:12.480 INFO:tasks.workunit.client.1.smithi136.stdout:1/302: mkdir d2/d5/d2b/d63 0 2024-09-18T12:51:12.483 INFO:tasks.workunit.client.1.smithi136.stdout:0/400: unlink d1/db/fd 0 2024-09-18T12:51:12.486 INFO:tasks.workunit.client.1.smithi136.stdout:4/291: write d0/d25/f2d [2386699,98679] 0 2024-09-18T12:51:12.486 INFO:tasks.workunit.client.1.smithi136.stdout:8/495: rename d9/d14/d1a/d2b/cad to d9/d14/d1a/d7f/cb2 0 2024-09-18T12:51:12.487 INFO:tasks.workunit.client.1.smithi136.stdout:5/406: write d5/f62 [3953997,19525] 0 2024-09-18T12:51:12.487 INFO:tasks.workunit.client.1.smithi136.stdout:1/303: symlink d2/d5/d2b/d34/l64 0 2024-09-18T12:51:12.488 INFO:tasks.workunit.client.1.smithi136.stdout:0/401: mkdir d1/d17/d6d/d81/d35/d84 0 2024-09-18T12:51:12.488 INFO:tasks.workunit.client.1.smithi136.stdout:2/407: rename d5/d25/d2d/c2f to d5/d4a/d67/c7c 0 2024-09-18T12:51:12.489 INFO:tasks.workunit.client.1.smithi136.stdout:2/408: write d5/d7/f5a [135064,62990] 0 2024-09-18T12:51:12.492 INFO:tasks.workunit.client.1.smithi136.stdout:5/407: symlink d5/d72/l76 0 2024-09-18T12:51:12.493 INFO:tasks.workunit.client.1.smithi136.stdout:3/384: write d3/d5/d31/f65 [259627,27927] 0 2024-09-18T12:51:12.493 INFO:tasks.workunit.client.1.smithi136.stdout:3/385: write d3/d14/d22/f1f [3424742,17900] 0 2024-09-18T12:51:12.496 INFO:tasks.workunit.client.1.smithi136.stdout:0/402: unlink d1/f36 0 2024-09-18T12:51:12.496 INFO:tasks.workunit.client.1.smithi136.stdout:9/336: dwrite d6/db/d12/f60 [0,4194304] 0 2024-09-18T12:51:12.497 INFO:tasks.workunit.client.1.smithi136.stdout:7/510: dwrite d0/d12/d1a/f3e [4194304,4194304] 0 2024-09-18T12:51:12.498 INFO:tasks.workunit.client.1.smithi136.stdout:3/386: rename d3/d5/d31/f65 to d3/d14/d22/d2c/d3d/f80 0 2024-09-18T12:51:12.500 INFO:tasks.workunit.client.1.smithi136.stdout:0/403: mknod d1/d3/d1a/d62/c85 0 2024-09-18T12:51:12.502 INFO:tasks.workunit.client.1.smithi136.stdout:7/511: dread d0/d35/d41/d50/d5a/f86 [0,4194304] 0 2024-09-18T12:51:12.506 INFO:tasks.workunit.client.1.smithi136.stdout:4/292: dwrite d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:12.508 INFO:tasks.workunit.client.1.smithi136.stdout:2/409: link d5/d25/f6c d5/d4a/d64/f7d 0 2024-09-18T12:51:12.508 INFO:tasks.workunit.client.1.smithi136.stdout:2/410: chown d5/d4a/d67/c7c 0 1 2024-09-18T12:51:12.513 INFO:tasks.workunit.client.1.smithi136.stdout:4/293: dread d0/d2/f50 [0,4194304] 0 2024-09-18T12:51:12.513 INFO:tasks.workunit.client.1.smithi136.stdout:3/387: rename d3/d2b/d6c/l49 to d3/d14/d17/d53/l81 0 2024-09-18T12:51:12.515 INFO:tasks.workunit.client.1.smithi136.stdout:0/404: creat d1/d17/d6d/d81/d70/f86 x:0 0 0 2024-09-18T12:51:12.519 INFO:tasks.workunit.client.1.smithi136.stdout:4/294: creat d0/d3/f53 x:0 0 0 2024-09-18T12:51:12.521 INFO:tasks.workunit.client.1.smithi136.stdout:1/304: dwrite d2/d5/d11/f58 [0,4194304] 0 2024-09-18T12:51:12.521 INFO:tasks.workunit.client.1.smithi136.stdout:3/388: symlink d3/d14/d17/l82 0 2024-09-18T12:51:12.522 INFO:tasks.workunit.client.1.smithi136.stdout:2/411: link d5/d25/l5d d5/l7e 0 2024-09-18T12:51:12.523 INFO:tasks.workunit.client.1.smithi136.stdout:4/295: mkdir d0/d3/d54 0 2024-09-18T12:51:12.524 INFO:tasks.workunit.client.1.smithi136.stdout:1/305: mkdir d2/d5/d9/d23/d50/d65 0 2024-09-18T12:51:12.527 INFO:tasks.workunit.client.1.smithi136.stdout:4/296: unlink d0/d2/l4e 0 2024-09-18T12:51:12.527 INFO:tasks.workunit.client.1.smithi136.stdout:4/297: readlink d0/d2/l1c 0 2024-09-18T12:51:12.527 INFO:tasks.workunit.client.1.smithi136.stdout:4/298: write d0/d25/f39 [214555,104104] 0 2024-09-18T12:51:12.527 INFO:tasks.workunit.client.1.smithi136.stdout:4/299: chown d0/d2/f50 1462 1 2024-09-18T12:51:12.529 INFO:tasks.workunit.client.1.smithi136.stdout:5/408: dwrite d5/d1a/d30/f5b [0,4194304] 0 2024-09-18T12:51:12.529 INFO:tasks.workunit.client.1.smithi136.stdout:2/412: rename d5/d25/c5b to d5/d25/c7f 0 2024-09-18T12:51:12.530 INFO:tasks.workunit.client.1.smithi136.stdout:2/413: dread d5/d7/f55 [0,4194304] 0 2024-09-18T12:51:12.532 INFO:tasks.workunit.client.1.smithi136.stdout:2/414: mknod d5/d7/c80 0 2024-09-18T12:51:12.535 INFO:tasks.workunit.client.1.smithi136.stdout:2/415: link d5/d4a/d67/f75 d5/d7/d41/f81 0 2024-09-18T12:51:12.537 INFO:tasks.workunit.client.1.smithi136.stdout:1/306: dread d2/d5/d11/f54 [0,4194304] 0 2024-09-18T12:51:12.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/416: truncate d5/d25/f40 1674465 0 2024-09-18T12:51:12.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/417: dread - d5/d4a/d67/f75 zero size 2024-09-18T12:51:12.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/418: fsync d5/d7/d41/f58 0 2024-09-18T12:51:12.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/419: rename d5 to d5/d82 22 2024-09-18T12:51:12.538 INFO:tasks.workunit.client.1.smithi136.stdout:1/307: rmdir d2/d5/d9/d23/d51 0 2024-09-18T12:51:12.540 INFO:tasks.workunit.client.1.smithi136.stdout:2/420: rename d5/d7/d3b/c6a to d5/d7/d11/c83 0 2024-09-18T12:51:12.543 INFO:tasks.workunit.client.1.smithi136.stdout:5/409: dread f2 [4194304,4194304] 0 2024-09-18T12:51:12.543 INFO:tasks.workunit.client.1.smithi136.stdout:7/512: dwrite d0/d2c/f48 [0,4194304] 0 2024-09-18T12:51:12.546 INFO:tasks.workunit.client.1.smithi136.stdout:5/410: truncate d5/d1a/d2d/d34/f35 2621901 0 2024-09-18T12:51:12.548 INFO:tasks.workunit.client.1.smithi136.stdout:4/300: dwrite d0/d13/f35 [0,4194304] 0 2024-09-18T12:51:12.548 INFO:tasks.workunit.client.1.smithi136.stdout:4/301: fdatasync d0/d3/f53 0 2024-09-18T12:51:12.548 INFO:tasks.workunit.client.1.smithi136.stdout:0/405: dwrite d1/d3/f58 [0,4194304] 0 2024-09-18T12:51:12.549 INFO:tasks.workunit.client.1.smithi136.stdout:9/337: dwrite d6/f40 [0,4194304] 0 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/338: write d6/df/f3b [4632572,89046] 0 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/339: dread - d6/da/d3d/f69 zero size 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/340: truncate d6/d13/d15/f6f 659671 0 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/341: write d6/d13/d15/d25/f57 [849947,4086] 0 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/342: write d6/d13/d15/d25/d55/f5b [549204,55281] 0 2024-09-18T12:51:12.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/343: read d6/d13/d15/f16 [3925213,39646] 0 2024-09-18T12:51:12.553 INFO:tasks.workunit.client.0.smithi081.stdout:2/153: sync 2024-09-18T12:51:12.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/154: mknod d15/d16/d20/c2d 0 2024-09-18T12:51:12.556 INFO:tasks.workunit.client.0.smithi081.stdout:2/155: truncate d15/f1e 1497944 0 2024-09-18T12:51:12.557 INFO:tasks.workunit.client.1.smithi136.stdout:5/411: write d5/f23 [560710,19586] 0 2024-09-18T12:51:12.567 INFO:tasks.workunit.client.1.smithi136.stdout:9/344: truncate d6/db/d49/d53/f54 955026 0 2024-09-18T12:51:12.567 INFO:tasks.workunit.client.1.smithi136.stdout:9/345: creat d6/d13/d15/d25/f71 x:0 0 0 2024-09-18T12:51:12.568 INFO:tasks.workunit.client.1.smithi136.stdout:1/308: dwrite d2/d5/d9/f3b [4194304,4194304] 0 2024-09-18T12:51:12.568 INFO:tasks.workunit.client.1.smithi136.stdout:0/406: symlink d1/d46/l87 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.1.smithi136.stdout:2/421: dwrite d5/f1c [0,4194304] 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.1.smithi136.stdout:7/513: dwrite d0/d12/d5e/d67/f68 [0,4194304] 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.1.smithi136.stdout:7/514: write d0/d35/fa0 [174341,7654] 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.1.smithi136.stdout:7/515: truncate d0/d35/d4f/f82 4920939 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.1.smithi136.stdout:7/516: write d0/d35/d36/d7c/f7d [292908,12771] 0 2024-09-18T12:51:12.569 INFO:tasks.workunit.client.0.smithi081.stdout:2/156: write fd [1298825,105555] 0 2024-09-18T12:51:12.571 INFO:tasks.workunit.client.0.smithi081.stdout:2/157: dread d15/d16/d25/f27 [0,4194304] 0 2024-09-18T12:51:12.571 INFO:tasks.workunit.client.0.smithi081.stdout:2/158: write d15/d16/f19 [758448,31468] 0 2024-09-18T12:51:12.572 INFO:tasks.workunit.client.0.smithi081.stdout:2/159: creat d15/d16/d20/d22/f2e x:0 0 0 2024-09-18T12:51:12.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/160: mkdir d15/d16/d25/d2f 0 2024-09-18T12:51:12.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/161: dread - d15/d16/f23 zero size 2024-09-18T12:51:12.574 INFO:tasks.workunit.client.1.smithi136.stdout:5/412: dread d5/d1a/f53 [0,4194304] 0 2024-09-18T12:51:12.574 INFO:tasks.workunit.client.1.smithi136.stdout:3/389: rmdir d3/d14/d22 39 2024-09-18T12:51:12.578 INFO:tasks.workunit.client.1.smithi136.stdout:1/309: rmdir d2/d5/d11/d1b 39 2024-09-18T12:51:12.578 INFO:tasks.workunit.client.1.smithi136.stdout:1/310: fsync d2/d5/d9/d23/f48 0 2024-09-18T12:51:12.578 INFO:tasks.workunit.client.1.smithi136.stdout:1/311: chown d2/d5/d11/d1b/f25 147287692 1 2024-09-18T12:51:12.580 INFO:tasks.workunit.client.1.smithi136.stdout:2/422: dread d5/d7/f12 [0,4194304] 0 2024-09-18T12:51:12.584 INFO:tasks.workunit.client.1.smithi136.stdout:9/346: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:51:12.585 INFO:tasks.workunit.client.1.smithi136.stdout:7/517: read d0/d12/f60 [3868545,43680] 0 2024-09-18T12:51:12.589 INFO:tasks.workunit.client.1.smithi136.stdout:5/413: creat d5/d1a/d4a/f77 x:0 0 0 2024-09-18T12:51:12.591 INFO:tasks.workunit.client.1.smithi136.stdout:1/312: fsync d2/d5/d11/d2e/d4c/f59 0 2024-09-18T12:51:12.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/423: rename d5/d25/d2d/c54 to d5/d7/d41/d53/c84 0 2024-09-18T12:51:12.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/424: truncate d5/d7/d11/d34/f50 559368 0 2024-09-18T12:51:12.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/425: write d5/d7/d3b/f69 [957725,3116] 0 2024-09-18T12:51:12.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/426: fsync d5/d7/f10 0 2024-09-18T12:51:12.594 INFO:tasks.workunit.client.1.smithi136.stdout:9/347: mkdir d6/db/d72 0 2024-09-18T12:51:12.594 INFO:tasks.workunit.client.1.smithi136.stdout:5/414: getdents d5/d1a/d2d 0 2024-09-18T12:51:12.595 INFO:tasks.workunit.client.1.smithi136.stdout:0/407: getdents d1/d17/d6d/d81/d70 0 2024-09-18T12:51:12.596 INFO:tasks.workunit.client.1.smithi136.stdout:1/313: truncate d2/d5/d11/d2e/f31 3184311 0 2024-09-18T12:51:12.597 INFO:tasks.workunit.client.0.smithi081.stdout:2/162: dwrite fe [0,4194304] 0 2024-09-18T12:51:12.598 INFO:tasks.workunit.client.1.smithi136.stdout:3/390: dwrite d3/d14/d18/f7d [0,4194304] 0 2024-09-18T12:51:12.598 INFO:tasks.workunit.client.0.smithi081.stdout:2/163: mknod d15/d16/d25/d2f/c30 0 2024-09-18T12:51:12.599 INFO:tasks.workunit.client.0.smithi081.stdout:2/164: write f13 [350452,55645] 0 2024-09-18T12:51:12.599 INFO:tasks.workunit.client.0.smithi081.stdout:2/165: write fd [650208,33067] 0 2024-09-18T12:51:12.599 INFO:tasks.workunit.client.1.smithi136.stdout:7/518: rename d0/d12/d1a/c27 to d0/d35/d41/d50/cb2 0 2024-09-18T12:51:12.600 INFO:tasks.workunit.client.1.smithi136.stdout:2/427: read d5/d25/d43/f52 [1248360,99623] 0 2024-09-18T12:51:12.601 INFO:tasks.workunit.client.1.smithi136.stdout:9/348: link d6/db/c45 d6/d13/c73 0 2024-09-18T12:51:12.604 INFO:tasks.workunit.client.1.smithi136.stdout:1/314: symlink d2/d5/d2b/d34/d5c/l66 0 2024-09-18T12:51:12.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/315: chown d2/c52 254331 1 2024-09-18T12:51:12.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/316: write d2/d5/d11/d2e/f61 [560868,50517] 0 2024-09-18T12:51:12.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/317: creat d2/d5/d2b/f67 x:0 0 0 2024-09-18T12:51:12.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/318: write d2/d5/d11/d2e/f4f [2111408,120478] 0 2024-09-18T12:51:12.608 INFO:tasks.workunit.client.1.smithi136.stdout:5/415: dwrite d5/d1a/d2d/d34/f42 [0,4194304] 0 2024-09-18T12:51:12.608 INFO:tasks.workunit.client.1.smithi136.stdout:3/391: mknod d3/d14/d17/d75/c83 0 2024-09-18T12:51:12.611 INFO:tasks.workunit.client.1.smithi136.stdout:7/519: rename d0/d12/d1a/f33 to d0/d35/d36/fb3 0 2024-09-18T12:51:12.611 INFO:tasks.workunit.client.0.smithi081.stdout:2/166: dread d15/d16/f19 [0,4194304] 0 2024-09-18T12:51:12.612 INFO:tasks.workunit.client.1.smithi136.stdout:9/349: creat d6/db/d12/d62/f74 x:0 0 0 2024-09-18T12:51:12.612 INFO:tasks.workunit.client.1.smithi136.stdout:9/350: dread - d6/d59/f35 zero size 2024-09-18T12:51:12.613 INFO:tasks.workunit.client.0.smithi081.stdout:2/167: mkdir d15/d16/d20/d31 0 2024-09-18T12:51:12.614 INFO:tasks.workunit.client.1.smithi136.stdout:0/408: getdents d1/d3/d1a/d62 0 2024-09-18T12:51:12.614 INFO:tasks.workunit.client.0.smithi081.stdout:2/168: mkdir d15/d16/d25/d32 0 2024-09-18T12:51:12.617 INFO:tasks.workunit.client.1.smithi136.stdout:0/409: dread d1/d17/f45 [0,4194304] 0 2024-09-18T12:51:12.618 INFO:tasks.workunit.client.0.smithi081.stdout:2/169: mkdir d15/d16/d33 0 2024-09-18T12:51:12.619 INFO:tasks.workunit.client.1.smithi136.stdout:1/319: symlink d2/d5/d9/d23/d50/d65/l68 0 2024-09-18T12:51:12.621 INFO:tasks.workunit.client.1.smithi136.stdout:4/302: write d0/d13/f35 [5220730,112352] 0 2024-09-18T12:51:12.624 INFO:tasks.workunit.client.1.smithi136.stdout:7/520: mknod d0/d39/d4d/d9a/cb4 0 2024-09-18T12:51:12.625 INFO:tasks.workunit.client.1.smithi136.stdout:9/351: mkdir d6/df/d75 0 2024-09-18T12:51:12.628 INFO:tasks.workunit.client.0.smithi081.stdout:2/170: dread f9 [0,4194304] 0 2024-09-18T12:51:12.628 INFO:tasks.workunit.client.0.smithi081.stdout:2/171: truncate fd 4673806 0 2024-09-18T12:51:12.628 INFO:tasks.workunit.client.1.smithi136.stdout:3/392: dread d3/d10/f5e [0,4194304] 0 2024-09-18T12:51:12.629 INFO:tasks.workunit.client.1.smithi136.stdout:4/303: creat d0/d45/f55 x:0 0 0 2024-09-18T12:51:12.629 INFO:tasks.workunit.client.1.smithi136.stdout:4/304: readlink d0/d13/l51 0 2024-09-18T12:51:12.629 INFO:tasks.workunit.client.1.smithi136.stdout:4/305: write d0/d25/f2d [806557,23466] 0 2024-09-18T12:51:12.636 INFO:tasks.workunit.client.1.smithi136.stdout:6/399: sync 2024-09-18T12:51:12.636 INFO:tasks.workunit.client.1.smithi136.stdout:7/521: creat d0/d2c/d2e/fb5 x:0 0 0 2024-09-18T12:51:12.636 INFO:tasks.workunit.client.1.smithi136.stdout:9/352: mknod d6/db/d49/d53/d5c/c76 0 2024-09-18T12:51:12.636 INFO:tasks.workunit.client.1.smithi136.stdout:3/393: mkdir d3/d10/d84 0 2024-09-18T12:51:12.636 INFO:tasks.workunit.client.1.smithi136.stdout:3/394: truncate d3/d14/d17/d53/d73/f79 541704 0 2024-09-18T12:51:12.637 INFO:tasks.workunit.client.1.smithi136.stdout:9/353: symlink d6/df/d23/l77 0 2024-09-18T12:51:12.641 INFO:tasks.workunit.client.1.smithi136.stdout:3/395: rename d3/d14/c72 to d3/d10/c85 0 2024-09-18T12:51:12.641 INFO:tasks.workunit.client.1.smithi136.stdout:9/354: mknod d6/db/d12/d56/c78 0 2024-09-18T12:51:12.644 INFO:tasks.workunit.client.1.smithi136.stdout:8/496: sync 2024-09-18T12:51:12.644 INFO:tasks.workunit.client.1.smithi136.stdout:8/497: fsync d9/d14/f11 0 2024-09-18T12:51:12.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/396: dread d3/d14/d18/f50 [0,4194304] 0 2024-09-18T12:51:12.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/397: chown d3/c2e 52698801 1 2024-09-18T12:51:12.663 INFO:tasks.workunit.client.1.smithi136.stdout:8/498: write d9/d14/d1a/d2b/f4d [2265499,104944] 0 2024-09-18T12:51:12.663 INFO:tasks.workunit.client.1.smithi136.stdout:8/499: write d9/d18/f44 [1424942,68779] 0 2024-09-18T12:51:12.663 INFO:tasks.workunit.client.1.smithi136.stdout:2/428: dwrite d5/d7/f1e [0,4194304] 0 2024-09-18T12:51:12.663 INFO:tasks.workunit.client.1.smithi136.stdout:2/429: dread - d5/d4a/d67/f75 zero size 2024-09-18T12:51:12.663 INFO:tasks.workunit.client.1.smithi136.stdout:2/430: chown d5/l42 7 1 2024-09-18T12:51:12.664 INFO:tasks.workunit.client.1.smithi136.stdout:3/398: mkdir d3/d14/d17/d75/d86 0 2024-09-18T12:51:12.666 INFO:tasks.workunit.client.1.smithi136.stdout:8/500: link d9/d14/d1a/d2b/d42/f6d d9/d18/d34/d3d/d47/d65/d92/fb3 0 2024-09-18T12:51:12.666 INFO:tasks.workunit.client.1.smithi136.stdout:3/399: rmdir d3/d10/d4a/d51 39 2024-09-18T12:51:12.666 INFO:tasks.workunit.client.1.smithi136.stdout:3/400: write d3/d5/d3c/f4c [925515,4969] 0 2024-09-18T12:51:12.667 INFO:tasks.workunit.client.1.smithi136.stdout:3/401: mkdir d3/d14/d17/d75/d87 0 2024-09-18T12:51:12.667 INFO:tasks.workunit.client.1.smithi136.stdout:3/402: chown d3/c2e 90 1 2024-09-18T12:51:12.667 INFO:tasks.workunit.client.1.smithi136.stdout:3/403: dread - d3/d14/d18/d7f/f6d zero size 2024-09-18T12:51:12.667 INFO:tasks.workunit.client.1.smithi136.stdout:5/416: dwrite d5/d1a/d2d/d34/f2e [4194304,4194304] 0 2024-09-18T12:51:12.668 INFO:tasks.workunit.client.1.smithi136.stdout:3/404: unlink d3/d14/d18/c78 0 2024-09-18T12:51:12.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/522: dwrite d0/d39/d4d/f92 [0,4194304] 0 2024-09-18T12:51:12.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/523: readlink d0/d12/d1a/lad 0 2024-09-18T12:51:12.673 INFO:tasks.workunit.client.1.smithi136.stdout:7/524: getdents d0/d2c/d85 0 2024-09-18T12:51:12.675 INFO:tasks.workunit.client.1.smithi136.stdout:2/431: dread d5/d7/d41/f4f [0,4194304] 0 2024-09-18T12:51:12.675 INFO:tasks.workunit.client.1.smithi136.stdout:7/525: dread d0/d35/d41/d50/d7f/d6b/f75 [0,4194304] 0 2024-09-18T12:51:12.675 INFO:tasks.workunit.client.1.smithi136.stdout:7/526: chown d0/d35/d36/cd 30860397 1 2024-09-18T12:51:12.676 INFO:tasks.workunit.client.1.smithi136.stdout:5/417: dread d5/f1c [0,4194304] 0 2024-09-18T12:51:12.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/418: mkdir d5/d78 0 2024-09-18T12:51:12.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/419: write d5/d1a/f68 [1090691,75452] 0 2024-09-18T12:51:12.678 INFO:tasks.workunit.client.1.smithi136.stdout:5/420: chown d5/d1a/d2d/d3f/c5c 397014876 1 2024-09-18T12:51:12.680 INFO:tasks.workunit.client.1.smithi136.stdout:5/421: mkdir d5/d1a/d4a/d79 0 2024-09-18T12:51:12.680 INFO:tasks.workunit.client.1.smithi136.stdout:5/422: getdents d5/d1a/d2d/d34/d74 0 2024-09-18T12:51:12.681 INFO:tasks.workunit.client.1.smithi136.stdout:5/423: mkdir d5/d1a/d2d/d34/d4e/d7a 0 2024-09-18T12:51:12.682 INFO:tasks.workunit.client.1.smithi136.stdout:4/306: dwrite d0/d45/f55 [0,4194304] 0 2024-09-18T12:51:12.682 INFO:tasks.workunit.client.1.smithi136.stdout:1/320: dwrite d2/d5/d9/f32 [8388608,4194304] 0 2024-09-18T12:51:12.682 INFO:tasks.workunit.client.1.smithi136.stdout:5/424: mkdir d5/d1a/d30/d7b 0 2024-09-18T12:51:12.684 INFO:tasks.workunit.client.1.smithi136.stdout:4/307: symlink d0/d13/l56 0 2024-09-18T12:51:12.685 INFO:tasks.workunit.client.1.smithi136.stdout:8/501: read d9/d14/d1a/f4a [4011648,69195] 0 2024-09-18T12:51:12.686 INFO:tasks.workunit.client.1.smithi136.stdout:8/502: fsync d9/d18/d34/d3d/d47/d65/d6b/f9d 0 2024-09-18T12:51:12.687 INFO:tasks.workunit.client.1.smithi136.stdout:2/432: dread d5/d25/d43/f52 [0,4194304] 0 2024-09-18T12:51:12.687 INFO:tasks.workunit.client.1.smithi136.stdout:8/503: mkdir d9/d14/d1a/d2b/d42/d6e/d75/db4 0 2024-09-18T12:51:12.687 INFO:tasks.workunit.client.1.smithi136.stdout:8/504: chown d9/d14/d1a/d7f/f8f 2689733 1 2024-09-18T12:51:12.688 INFO:tasks.workunit.client.1.smithi136.stdout:9/355: dwrite d6/d13/d15/f6f [0,4194304] 0 2024-09-18T12:51:12.689 INFO:tasks.workunit.client.1.smithi136.stdout:7/527: dread d0/f29 [0,4194304] 0 2024-09-18T12:51:12.689 INFO:tasks.workunit.client.1.smithi136.stdout:7/528: write d0/d35/d41/d50/d5a/fa7 [369418,119744] 0 2024-09-18T12:51:12.689 INFO:tasks.workunit.client.1.smithi136.stdout:6/400: dwrite d8/d9/de/d1c/f42 [0,4194304] 0 2024-09-18T12:51:12.690 INFO:tasks.workunit.client.1.smithi136.stdout:6/401: chown d8/d9/f8a 4065150 1 2024-09-18T12:51:12.690 INFO:tasks.workunit.client.1.smithi136.stdout:6/402: read d8/d9/fa [485979,57789] 0 2024-09-18T12:51:12.690 INFO:tasks.workunit.client.1.smithi136.stdout:0/410: dwrite d1/d17/d6d/d81/d35/f4a [0,4194304] 0 2024-09-18T12:51:12.692 INFO:tasks.workunit.client.1.smithi136.stdout:3/405: dwrite d3/d14/d18/f50 [0,4194304] 0 2024-09-18T12:51:12.693 INFO:tasks.workunit.client.0.smithi081.stdout:2/172: dwrite f11 [4194304,4194304] 0 2024-09-18T12:51:12.693 INFO:tasks.workunit.client.0.smithi081.stdout:2/173: fsync fc 0 2024-09-18T12:51:12.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/174: write d15/f17 [316702,65558] 0 2024-09-18T12:51:12.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/175: truncate d15/d16/f19 1285459 0 2024-09-18T12:51:12.696 INFO:tasks.workunit.client.0.smithi081.stdout:2/176: creat d15/d16/d20/d22/f34 x:0 0 0 2024-09-18T12:51:12.697 INFO:tasks.workunit.client.0.smithi081.stdout:2/177: read f7 [768371,19430] 0 2024-09-18T12:51:12.697 INFO:tasks.workunit.client.1.smithi136.stdout:1/321: dread d2/d5/d11/d2e/f31 [0,4194304] 0 2024-09-18T12:51:12.697 INFO:tasks.workunit.client.1.smithi136.stdout:8/505: write d9/d18/f48 [1106326,18453] 0 2024-09-18T12:51:12.697 INFO:tasks.workunit.client.1.smithi136.stdout:8/506: stat d9/d18/f1c 0 2024-09-18T12:51:12.697 INFO:tasks.workunit.client.1.smithi136.stdout:8/507: write d9/d14/d1a/d7f/d8c/fac [853815,115045] 0 2024-09-18T12:51:12.698 INFO:tasks.workunit.client.1.smithi136.stdout:6/403: rmdir d8/d9/de 39 2024-09-18T12:51:12.698 INFO:tasks.workunit.client.1.smithi136.stdout:6/404: truncate d8/dc/f43 1160195 0 2024-09-18T12:51:12.698 INFO:tasks.workunit.client.1.smithi136.stdout:7/529: write d0/d35/f6c [2304,109845] 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.0.smithi081.stdout:2/178: mknod d15/c35 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.0.smithi081.stdout:2/179: write d15/d16/d20/d22/f2e [151980,78782] 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.1.smithi136.stdout:7/530: creat d0/d35/d41/d50/d7b/fb6 x:0 0 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.1.smithi136.stdout:7/531: creat d0/d2c/d2e/fb7 x:0 0 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.1.smithi136.stdout:7/532: creat d0/d39/fb8 x:0 0 0 2024-09-18T12:51:12.699 INFO:tasks.workunit.client.1.smithi136.stdout:5/425: dread d5/d1a/f53 [0,4194304] 0 2024-09-18T12:51:12.701 INFO:tasks.workunit.client.1.smithi136.stdout:0/411: symlink d1/db/l88 0 2024-09-18T12:51:12.708 INFO:tasks.workunit.client.1.smithi136.stdout:8/508: mkdir d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5 0 2024-09-18T12:51:12.709 INFO:tasks.workunit.client.0.smithi081.stdout:9/96: sync 2024-09-18T12:51:12.711 INFO:tasks.workunit.client.0.smithi081.stdout:9/97: mknod dd/d1d/d1e/c21 0 2024-09-18T12:51:12.714 INFO:tasks.workunit.client.1.smithi136.stdout:9/356: rename d6/db/d49 to d6/df/d23/d2b/d79 0 2024-09-18T12:51:12.714 INFO:tasks.workunit.client.1.smithi136.stdout:1/322: symlink d2/d5/d11/d2e/d4c/l69 0 2024-09-18T12:51:12.720 INFO:tasks.workunit.client.1.smithi136.stdout:9/357: mknod d6/db/d72/c7a 0 2024-09-18T12:51:12.720 INFO:tasks.workunit.client.1.smithi136.stdout:9/358: creat d6/da/d3d/f7b x:0 0 0 2024-09-18T12:51:12.721 INFO:tasks.workunit.client.1.smithi136.stdout:5/426: dread d5/d1a/d30/f4c [0,4194304] 0 2024-09-18T12:51:12.723 INFO:tasks.workunit.client.1.smithi136.stdout:0/412: rename d1/d3/d1a/f59 to d1/d17/d6d/d81/d35/d54/f89 0 2024-09-18T12:51:12.723 INFO:tasks.workunit.client.1.smithi136.stdout:0/413: fsync d1/d3/f1e 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:8/145: sync 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:0/190: sync 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:7/170: sync 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:0/191: truncate d7/d9/f44 413959 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:0/192: chown d7/d9/d12/d2b/d3d/c41 195223 1 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/154: sync 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/155: creat d0/d18/f38 x:0 0 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/156: getdents d0/d6/d7/d2e 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/157: fsync d0/d6/fe 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/158: creat d0/db/f39 x:0 0 0 2024-09-18T12:51:12.724 INFO:tasks.workunit.client.0.smithi081.stdout:6/130: sync 2024-09-18T12:51:12.725 INFO:tasks.workunit.client.0.smithi081.stdout:5/172: sync 2024-09-18T12:51:12.725 INFO:tasks.workunit.client.0.smithi081.stdout:4/118: sync 2024-09-18T12:51:12.725 INFO:tasks.workunit.client.0.smithi081.stdout:3/189: sync 2024-09-18T12:51:12.725 INFO:tasks.workunit.client.0.smithi081.stdout:5/173: write d2/d14/d1d/d1a/f34 [253454,125533] 0 2024-09-18T12:51:12.726 INFO:tasks.workunit.client.0.smithi081.stdout:7/171: mkdir d2/d18/d3c/d3e 0 2024-09-18T12:51:12.726 INFO:tasks.workunit.client.0.smithi081.stdout:7/172: creat d2/d18/f3f x:0 0 0 2024-09-18T12:51:12.727 INFO:tasks.workunit.client.0.smithi081.stdout:7/173: chown d2/d14/d21 93959 1 2024-09-18T12:51:12.727 INFO:tasks.workunit.client.1.smithi136.stdout:8/509: dread d9/f6a [0,4194304] 0 2024-09-18T12:51:12.728 INFO:tasks.workunit.client.1.smithi136.stdout:2/433: dwrite d5/d7/d41/f58 [0,4194304] 0 2024-09-18T12:51:12.728 INFO:tasks.workunit.client.1.smithi136.stdout:2/434: chown d5/d4a 12076954 1 2024-09-18T12:51:12.729 INFO:tasks.workunit.client.1.smithi136.stdout:9/359: mknod d6/df/d23/d2b/c7c 0 2024-09-18T12:51:12.729 INFO:tasks.workunit.client.1.smithi136.stdout:9/360: chown d6/df/d23/d2b/d79/f4f 3029 1 2024-09-18T12:51:12.730 INFO:tasks.workunit.client.0.smithi081.stdout:1/159: mknod d0/db/d32/c3a 0 2024-09-18T12:51:12.731 INFO:tasks.workunit.client.1.smithi136.stdout:5/427: mkdir d5/d1a/d7c 0 2024-09-18T12:51:12.731 INFO:tasks.workunit.client.1.smithi136.stdout:5/428: fsync d5/d6b/f71 0 2024-09-18T12:51:12.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/131: rename d4/f5 to d4/d6/f26 0 2024-09-18T12:51:12.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/132: chown f1 1 1 2024-09-18T12:51:12.733 INFO:tasks.workunit.client.1.smithi136.stdout:0/414: unlink d1/db/c2e 0 2024-09-18T12:51:12.735 INFO:tasks.workunit.client.0.smithi081.stdout:5/174: creat d2/d14/d31/f3a x:0 0 0 2024-09-18T12:51:12.736 INFO:tasks.workunit.client.1.smithi136.stdout:8/510: link d9/d14/d1a/d2b/d42/c69 d9/d14/d1a/d2b/cb6 0 2024-09-18T12:51:12.736 INFO:tasks.workunit.client.0.smithi081.stdout:7/174: symlink d2/d14/l40 0 2024-09-18T12:51:12.738 INFO:tasks.workunit.client.0.smithi081.stdout:1/160: symlink d0/db/d32/l3b 0 2024-09-18T12:51:12.740 INFO:tasks.workunit.client.1.smithi136.stdout:6/405: dwrite d8/d9/de/d60/d71/d76/f89 [0,4194304] 0 2024-09-18T12:51:12.740 INFO:tasks.workunit.client.0.smithi081.stdout:6/133: unlink d4/l1b 0 2024-09-18T12:51:12.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/406: dwrite d3/d14/d17/d53/f77 [0,4194304] 0 2024-09-18T12:51:12.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/407: write d3/d5/f35 [698931,4064] 0 2024-09-18T12:51:12.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/408: creat d3/d14/d18/f88 x:0 0 0 2024-09-18T12:51:12.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/409: dread - d3/d2b/d6c/f76 zero size 2024-09-18T12:51:12.742 INFO:tasks.workunit.client.1.smithi136.stdout:9/361: truncate d6/f42 160225 0 2024-09-18T12:51:12.742 INFO:tasks.workunit.client.1.smithi136.stdout:9/362: stat d6/df/f3b 0 2024-09-18T12:51:12.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/180: dwrite fc [0,4194304] 0 2024-09-18T12:51:12.742 INFO:tasks.workunit.client.0.smithi081.stdout:4/119: rmdir d3/dd/d14 39 2024-09-18T12:51:12.742 INFO:tasks.workunit.client.0.smithi081.stdout:4/120: read - d3/db/f25 zero size 2024-09-18T12:51:12.743 INFO:tasks.workunit.client.1.smithi136.stdout:1/323: dwrite d2/d5/d11/f58 [0,4194304] 0 2024-09-18T12:51:12.743 INFO:tasks.workunit.client.1.smithi136.stdout:1/324: fsync d2/f3c 0 2024-09-18T12:51:12.744 INFO:tasks.workunit.client.1.smithi136.stdout:7/533: dwrite d0/fa [4194304,4194304] 0 2024-09-18T12:51:12.744 INFO:tasks.workunit.client.1.smithi136.stdout:7/534: chown d0/d35/d41/d50/d7f/c2d 63394877 1 2024-09-18T12:51:12.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/98: dwrite f8 [0,4194304] 0 2024-09-18T12:51:12.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/99: write f0 [776510,97653] 0 2024-09-18T12:51:12.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/100: dread - fa zero size 2024-09-18T12:51:12.745 INFO:tasks.workunit.client.1.smithi136.stdout:5/429: symlink d5/d1a/d2d/d34/d4e/d7a/l7d 0 2024-09-18T12:51:12.745 INFO:tasks.workunit.client.1.smithi136.stdout:5/430: write d5/d6b/f71 [507220,18901] 0 2024-09-18T12:51:12.745 INFO:tasks.workunit.client.0.smithi081.stdout:7/175: truncate d2/f12 4062552 0 2024-09-18T12:51:12.746 INFO:tasks.workunit.client.1.smithi136.stdout:0/415: rename d1/d3/d1a/d62/f74 to d1/d46/d6c/f8a 0 2024-09-18T12:51:12.751 INFO:tasks.workunit.client.1.smithi136.stdout:8/511: creat d9/d18/d34/d3d/d47/fb7 x:0 0 0 2024-09-18T12:51:12.751 INFO:tasks.workunit.client.1.smithi136.stdout:8/512: truncate d9/d18/d34/d3d/d47/d65/d6b/f77 4614215 0 2024-09-18T12:51:12.751 INFO:tasks.workunit.client.1.smithi136.stdout:2/435: rmdir d5/d7/d17 39 2024-09-18T12:51:12.754 INFO:tasks.workunit.client.0.smithi081.stdout:6/134: link f1 d4/d6/f27 0 2024-09-18T12:51:12.754 INFO:tasks.workunit.client.0.smithi081.stdout:6/135: read d4/d6/f26 [498393,99785] 0 2024-09-18T12:51:12.754 INFO:tasks.workunit.client.0.smithi081.stdout:6/136: write d4/f24 [18237,47772] 0 2024-09-18T12:51:12.754 INFO:tasks.workunit.client.0.smithi081.stdout:4/121: rename d3/dd/f1c to d3/dd/f2c 0 2024-09-18T12:51:12.754 INFO:tasks.workunit.client.0.smithi081.stdout:2/181: link f7 d15/d16/d20/d31/f36 0 2024-09-18T12:51:12.755 INFO:tasks.workunit.client.0.smithi081.stdout:9/101: creat dd/d15/d1a/f22 x:0 0 0 2024-09-18T12:51:12.755 INFO:tasks.workunit.client.0.smithi081.stdout:9/102: truncate dd/de/f13 813671 0 2024-09-18T12:51:12.757 INFO:tasks.workunit.client.0.smithi081.stdout:8/146: dwrite d3/f2d [0,4194304] 0 2024-09-18T12:51:12.758 INFO:tasks.workunit.client.1.smithi136.stdout:3/410: read d3/d14/d18/f50 [2140087,124943] 0 2024-09-18T12:51:12.759 INFO:tasks.workunit.client.1.smithi136.stdout:4/308: getdents d0/d13 0 2024-09-18T12:51:12.759 INFO:tasks.workunit.client.1.smithi136.stdout:4/309: fdatasync d0/d3/f48 0 2024-09-18T12:51:12.759 INFO:tasks.workunit.client.1.smithi136.stdout:6/406: symlink d8/d9/de/l8d 0 2024-09-18T12:51:12.759 INFO:tasks.workunit.client.1.smithi136.stdout:6/407: fsync d8/d9/d3c/d4a/f54 0 2024-09-18T12:51:12.761 INFO:tasks.workunit.client.1.smithi136.stdout:1/325: write d2/d5/d9/f3b [5030995,102028] 0 2024-09-18T12:51:12.764 INFO:tasks.workunit.client.1.smithi136.stdout:9/363: mknod d6/da/d3d/d41/c7d 0 2024-09-18T12:51:12.765 INFO:tasks.workunit.client.0.smithi081.stdout:6/137: dread d4/d12/d1c/f23 [0,4194304] 0 2024-09-18T12:51:12.765 INFO:tasks.workunit.client.0.smithi081.stdout:6/138: write d4/fa [2518002,76105] 0 2024-09-18T12:51:12.765 INFO:tasks.workunit.client.1.smithi136.stdout:8/513: write d9/d14/d1a/d2b/f91 [3991658,9263] 0 2024-09-18T12:51:12.765 INFO:tasks.workunit.client.1.smithi136.stdout:8/514: fsync d9/d14/d1a/d2b/f2e 0 2024-09-18T12:51:12.766 INFO:tasks.workunit.client.0.smithi081.stdout:7/176: creat d2/d18/d3c/d3e/f41 x:0 0 0 2024-09-18T12:51:12.767 INFO:tasks.workunit.client.1.smithi136.stdout:7/535: unlink d0/d35/d4f/fae 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.1.smithi136.stdout:5/431: link d5/c12 d5/d1a/d2d/d34/d74/c7e 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.1.smithi136.stdout:0/416: fdatasync d1/d17/d6d/d81/f53 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.1.smithi136.stdout:5/432: write d5/f1c [1873053,101691] 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.1.smithi136.stdout:5/433: fdatasync d5/d1a/f37 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.0.smithi081.stdout:3/190: dwrite f1 [0,4194304] 0 2024-09-18T12:51:12.774 INFO:tasks.workunit.client.0.smithi081.stdout:3/191: chown d3/db/d1b/c33 507615 1 2024-09-18T12:51:12.776 INFO:tasks.workunit.client.1.smithi136.stdout:6/408: symlink d8/d9/l8e 0 2024-09-18T12:51:12.776 INFO:tasks.workunit.client.1.smithi136.stdout:6/409: write d8/d9/de/f3d [2686754,2280] 0 2024-09-18T12:51:12.776 INFO:tasks.workunit.client.1.smithi136.stdout:4/310: symlink d0/d13/l57 0 2024-09-18T12:51:12.780 INFO:tasks.workunit.client.1.smithi136.stdout:1/326: mknod d2/d5/d2b/d34/c6a 0 2024-09-18T12:51:12.781 INFO:tasks.workunit.client.0.smithi081.stdout:4/122: truncate d3/f1b 1164512 0 2024-09-18T12:51:12.783 INFO:tasks.workunit.client.1.smithi136.stdout:9/364: creat d6/d13/d4c/f7e x:0 0 0 2024-09-18T12:51:12.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/182: creat d15/d16/f37 x:0 0 0 2024-09-18T12:51:12.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/183: readlink d15/d16/l24 0 2024-09-18T12:51:12.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/184: creat d15/d16/d25/f38 x:0 0 0 2024-09-18T12:51:12.787 INFO:tasks.workunit.client.1.smithi136.stdout:8/515: dread d9/d18/f48 [0,4194304] 0 2024-09-18T12:51:12.787 INFO:tasks.workunit.client.1.smithi136.stdout:8/516: dread - d9/d18/d34/d3d/d47/d65/f7b zero size 2024-09-18T12:51:12.787 INFO:tasks.workunit.client.1.smithi136.stdout:8/517: write d9/d18/d34/d3d/d47/d65/f66 [4893490,71798] 0 2024-09-18T12:51:12.787 INFO:tasks.workunit.client.1.smithi136.stdout:8/518: write d9/f20 [121478,124555] 0 2024-09-18T12:51:12.788 INFO:tasks.workunit.client.0.smithi081.stdout:1/161: dwrite d0/db/d12/d2d/f2f [0,4194304] 0 2024-09-18T12:51:12.789 INFO:tasks.workunit.client.1.smithi136.stdout:5/434: rename d5/d1a/d7c to d5/d1a/d2d/d3f/d7f 0 2024-09-18T12:51:12.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/103: symlink dd/de/l23 0 2024-09-18T12:51:12.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/104: write f0 [360950,35583] 0 2024-09-18T12:51:12.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/105: chown dd/d15/d1a/f22 1 1 2024-09-18T12:51:12.790 INFO:tasks.workunit.client.0.smithi081.stdout:9/106: chown f0 4318770 1 2024-09-18T12:51:12.790 INFO:tasks.workunit.client.1.smithi136.stdout:0/417: creat d1/d17/d6d/d81/d35/d84/f8b x:0 0 0 2024-09-18T12:51:12.791 INFO:tasks.workunit.client.1.smithi136.stdout:6/410: write d8/dc/f14 [2337874,62508] 0 2024-09-18T12:51:12.791 INFO:tasks.workunit.client.1.smithi136.stdout:9/365: fsync d6/d13/d15/d25/d55/f5b 0 2024-09-18T12:51:12.792 INFO:tasks.workunit.client.1.smithi136.stdout:9/366: fdatasync d6/df/d23/d2b/f43 0 2024-09-18T12:51:12.792 INFO:tasks.workunit.client.1.smithi136.stdout:4/311: creat d0/f58 x:0 0 0 2024-09-18T12:51:12.793 INFO:tasks.workunit.client.0.smithi081.stdout:8/147: symlink d3/d1d/l35 0 2024-09-18T12:51:12.794 INFO:tasks.workunit.client.0.smithi081.stdout:5/175: rename d2/d4 to d2/d14/d33/d37/d3b 0 2024-09-18T12:51:12.797 INFO:tasks.workunit.client.0.smithi081.stdout:6/139: unlink d4/d6/f1a 0 2024-09-18T12:51:12.798 INFO:tasks.workunit.client.0.smithi081.stdout:7/177: dwrite d2/f9 [0,4194304] 0 2024-09-18T12:51:12.800 INFO:tasks.workunit.client.0.smithi081.stdout:7/178: dread d2/d1d/f28 [0,4194304] 0 2024-09-18T12:51:12.800 INFO:tasks.workunit.client.0.smithi081.stdout:9/107: dread f7 [0,4194304] 0 2024-09-18T12:51:12.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/185: dwrite d15/d16/d20/d22/f2e [0,4194304] 0 2024-09-18T12:51:12.804 INFO:tasks.workunit.client.1.smithi136.stdout:1/327: unlink d2/d5/d9/l15 0 2024-09-18T12:51:12.804 INFO:tasks.workunit.client.1.smithi136.stdout:1/328: creat d2/d5/d11/d2e/f6b x:0 0 0 2024-09-18T12:51:12.804 INFO:tasks.workunit.client.1.smithi136.stdout:1/329: fsync d2/d5/d9/d23/f48 0 2024-09-18T12:51:12.804 INFO:tasks.workunit.client.1.smithi136.stdout:3/411: dwrite d3/d14/d18/d7f/f7a [0,4194304] 0 2024-09-18T12:51:12.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/192: mknod d3/db/c40 0 2024-09-18T12:51:12.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/193: rename d3/db/df/d29 to d3/db/df/d29/d13/d38/d41 22 2024-09-18T12:51:12.806 INFO:tasks.workunit.client.1.smithi136.stdout:5/435: dread d5/f54 [4194304,4194304] 0 2024-09-18T12:51:12.806 INFO:tasks.workunit.client.1.smithi136.stdout:5/436: fdatasync f2 0 2024-09-18T12:51:12.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/162: symlink d0/d6/d7/d2e/l3c 0 2024-09-18T12:51:12.809 INFO:tasks.workunit.client.0.smithi081.stdout:2/186: read f13 [245120,119262] 0 2024-09-18T12:51:12.810 INFO:tasks.workunit.client.0.smithi081.stdout:2/187: read - d15/d26/f29 zero size 2024-09-18T12:51:12.810 INFO:tasks.workunit.client.0.smithi081.stdout:8/148: creat d3/d1e/f36 x:0 0 0 2024-09-18T12:51:12.810 INFO:tasks.workunit.client.0.smithi081.stdout:8/149: readlink d3/l30 0 2024-09-18T12:51:12.813 INFO:tasks.workunit.client.0.smithi081.stdout:5/176: truncate d2/ff 9971682 0 2024-09-18T12:51:12.813 INFO:tasks.workunit.client.0.smithi081.stdout:6/140: mkdir d4/d12/d28 0 2024-09-18T12:51:12.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/177: dread d2/d14/d33/d37/d3b/d18/f25 [0,4194304] 0 2024-09-18T12:51:12.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/178: creat d2/d14/d31/f3c x:0 0 0 2024-09-18T12:51:12.814 INFO:tasks.workunit.client.0.smithi081.stdout:4/123: getdents d3/dd 0 2024-09-18T12:51:12.818 INFO:tasks.workunit.client.0.smithi081.stdout:1/163: rename d0/f2 to d0/d6/f3d 0 2024-09-18T12:51:12.818 INFO:tasks.workunit.client.0.smithi081.stdout:1/164: write d0/f15 [1240012,117881] 0 2024-09-18T12:51:12.821 INFO:tasks.workunit.client.0.smithi081.stdout:5/179: link d2/d14/d33/d37/d3b/d16/c1b d2/d14/c3d 0 2024-09-18T12:51:12.823 INFO:tasks.workunit.client.0.smithi081.stdout:4/124: mkdir d3/db/d2d 0 2024-09-18T12:51:12.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/188: getdents d15/d16 0 2024-09-18T12:51:12.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/189: chown fb 408656 1 2024-09-18T12:51:12.829 INFO:tasks.workunit.client.1.smithi136.stdout:0/418: mknod d1/d46/d6c/c8c 0 2024-09-18T12:51:12.829 INFO:tasks.workunit.client.1.smithi136.stdout:0/419: chown d1/f18 15 1 2024-09-18T12:51:12.829 INFO:tasks.workunit.client.1.smithi136.stdout:6/411: mknod d8/d9/d64/c8f 0 2024-09-18T12:51:12.830 INFO:tasks.workunit.client.0.smithi081.stdout:4/125: symlink d3/db/d2d/l2e 0 2024-09-18T12:51:12.830 INFO:tasks.workunit.client.0.smithi081.stdout:4/126: chown d3/dd/c13 6615 1 2024-09-18T12:51:12.832 INFO:tasks.workunit.client.0.smithi081.stdout:2/190: unlink d15/d16/c1a 0 2024-09-18T12:51:12.838 INFO:tasks.workunit.client.0.smithi081.stdout:7/179: dwrite d2/d1d/d27/f2e [0,4194304] 0 2024-09-18T12:51:12.839 INFO:tasks.workunit.client.1.smithi136.stdout:9/367: link d6/c20 d6/db/d12/d62/c7f 0 2024-09-18T12:51:12.839 INFO:tasks.workunit.client.1.smithi136.stdout:4/312: truncate d0/d13/f47 3683493 0 2024-09-18T12:51:12.842 INFO:tasks.workunit.client.0.smithi081.stdout:8/150: dwrite d3/f18 [0,4194304] 0 2024-09-18T12:51:12.844 INFO:tasks.workunit.client.0.smithi081.stdout:4/127: dread d3/dd/f2c [0,4194304] 0 2024-09-18T12:51:12.844 INFO:tasks.workunit.client.0.smithi081.stdout:7/180: dread d2/f10 [0,4194304] 0 2024-09-18T12:51:12.845 INFO:tasks.workunit.client.0.smithi081.stdout:7/181: fdatasync d2/d1d/f2c 0 2024-09-18T12:51:12.845 INFO:tasks.workunit.client.0.smithi081.stdout:8/151: creat d3/d1e/f37 x:0 0 0 2024-09-18T12:51:12.846 INFO:tasks.workunit.client.0.smithi081.stdout:4/128: truncate d3/f10 2015417 0 2024-09-18T12:51:12.847 INFO:tasks.workunit.client.0.smithi081.stdout:3/194: dwrite d3/db/df/d29/f19 [4194304,4194304] 0 2024-09-18T12:51:12.848 INFO:tasks.workunit.client.0.smithi081.stdout:4/129: mkdir d3/dd/d2f 0 2024-09-18T12:51:12.848 INFO:tasks.workunit.client.1.smithi136.stdout:1/330: creat d2/f6c x:0 0 0 2024-09-18T12:51:12.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/152: dread d3/f11 [0,4194304] 0 2024-09-18T12:51:12.852 INFO:tasks.workunit.client.1.smithi136.stdout:3/412: rename d3/d2b/d6c/f76 to d3/d14/d17/d53/f89 0 2024-09-18T12:51:12.852 INFO:tasks.workunit.client.0.smithi081.stdout:3/195: rename d3/c20 to d3/db/dc/d1a/c42 0 2024-09-18T12:51:12.853 INFO:tasks.workunit.client.0.smithi081.stdout:9/108: dwrite dd/d1b/f1f [0,4194304] 0 2024-09-18T12:51:12.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/437: rmdir d5/d1a/d2d/d34/d74 39 2024-09-18T12:51:12.855 INFO:tasks.workunit.client.0.smithi081.stdout:7/182: rmdir d2/d18 39 2024-09-18T12:51:12.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/130: rmdir d3/dd/d14/d27 39 2024-09-18T12:51:12.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/131: fsync d3/dd/f2c 0 2024-09-18T12:51:12.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/132: write d3/db/f18 [157601,82312] 0 2024-09-18T12:51:12.859 INFO:tasks.workunit.client.0.smithi081.stdout:4/133: write d3/dd/d14/f1e [1310817,38154] 0 2024-09-18T12:51:12.859 INFO:tasks.workunit.client.1.smithi136.stdout:8/519: truncate d9/d14/d1a/d2b/f4d 1164056 0 2024-09-18T12:51:12.861 INFO:tasks.workunit.client.1.smithi136.stdout:1/331: dread d2/d5/d11/d1b/f25 [0,4194304] 0 2024-09-18T12:51:12.862 INFO:tasks.workunit.client.1.smithi136.stdout:1/332: write d2/f17 [4125605,74224] 0 2024-09-18T12:51:12.862 INFO:tasks.workunit.client.1.smithi136.stdout:9/368: truncate d6/d59/f68 862770 0 2024-09-18T12:51:12.862 INFO:tasks.workunit.client.1.smithi136.stdout:4/313: symlink d0/d13/l59 0 2024-09-18T12:51:12.863 INFO:tasks.workunit.client.0.smithi081.stdout:3/196: rmdir d3/db/df/d29/d13/d38 0 2024-09-18T12:51:12.864 INFO:tasks.workunit.client.1.smithi136.stdout:0/420: dwrite d1/d17/d6d/d81/d35/d54/f5e [0,4194304] 0 2024-09-18T12:51:12.865 INFO:tasks.workunit.client.0.smithi081.stdout:1/165: dwrite d0/d18/f25 [0,4194304] 0 2024-09-18T12:51:12.865 INFO:tasks.workunit.client.0.smithi081.stdout:2/191: dwrite d15/d16/f37 [0,4194304] 0 2024-09-18T12:51:12.865 INFO:tasks.workunit.client.0.smithi081.stdout:2/192: chown fb 79 1 2024-09-18T12:51:12.865 INFO:tasks.workunit.client.0.smithi081.stdout:2/193: chown d15/d26 4 1 2024-09-18T12:51:12.865 INFO:tasks.workunit.client.0.smithi081.stdout:2/194: dread - d15/d26/f29 zero size 2024-09-18T12:51:12.867 INFO:tasks.workunit.client.1.smithi136.stdout:3/413: truncate d3/d10/f43 3671748 0 2024-09-18T12:51:12.867 INFO:tasks.workunit.client.0.smithi081.stdout:9/109: mkdir dd/d1d/d1e/d24 0 2024-09-18T12:51:12.867 INFO:tasks.workunit.client.0.smithi081.stdout:9/110: write dd/d15/f16 [3905223,40041] 0 2024-09-18T12:51:12.870 INFO:tasks.workunit.client.1.smithi136.stdout:5/438: truncate d5/d1a/d30/f60 2395394 0 2024-09-18T12:51:12.870 INFO:tasks.workunit.client.1.smithi136.stdout:5/439: chown d5/c69 94578 1 2024-09-18T12:51:12.871 INFO:tasks.workunit.client.1.smithi136.stdout:7/536: rmdir d0/d35/d41/d58 0 2024-09-18T12:51:12.871 INFO:tasks.workunit.client.1.smithi136.stdout:7/537: creat d0/d39/d4d/d9a/fb9 x:0 0 0 2024-09-18T12:51:12.872 INFO:tasks.workunit.client.0.smithi081.stdout:7/183: rename d2/d18/d3c/d3e to d2/d42 0 2024-09-18T12:51:12.878 INFO:tasks.workunit.client.0.smithi081.stdout:1/166: write d0/d6/d7/d8/fc [2580621,93590] 0 2024-09-18T12:51:12.880 INFO:tasks.workunit.client.1.smithi136.stdout:8/520: rename d9/d14/d1a/d7f/c9c to d9/d14/d1a/d2b/d42/d6e/cb8 0 2024-09-18T12:51:12.880 INFO:tasks.workunit.client.1.smithi136.stdout:8/521: read d9/d14/fe [1866986,71373] 0 2024-09-18T12:51:12.881 INFO:tasks.workunit.client.0.smithi081.stdout:3/197: dread d3/db/df/d29/d13/f14 [0,4194304] 0 2024-09-18T12:51:12.881 INFO:tasks.workunit.client.1.smithi136.stdout:6/412: truncate d8/dc/f14 36715 0 2024-09-18T12:51:12.882 INFO:tasks.workunit.client.1.smithi136.stdout:4/314: creat d0/d25/f5a x:0 0 0 2024-09-18T12:51:12.883 INFO:tasks.workunit.client.0.smithi081.stdout:4/134: link d3/dd/d14/c1f d3/d20/c30 0 2024-09-18T12:51:12.883 INFO:tasks.workunit.client.0.smithi081.stdout:4/135: write d3/db/f18 [1575195,38937] 0 2024-09-18T12:51:12.885 INFO:tasks.workunit.client.0.smithi081.stdout:8/153: dwrite d3/d1d/f21 [0,4194304] 0 2024-09-18T12:51:12.886 INFO:tasks.workunit.client.1.smithi136.stdout:0/421: rmdir d1/d46 39 2024-09-18T12:51:12.887 INFO:tasks.workunit.client.1.smithi136.stdout:0/422: truncate d1/d17/d6d/d81/d35/d84/f8b 376439 0 2024-09-18T12:51:12.889 INFO:tasks.workunit.client.0.smithi081.stdout:2/195: mknod d15/d16/d20/d22/c39 0 2024-09-18T12:51:12.890 INFO:tasks.workunit.client.1.smithi136.stdout:3/414: mknod d3/d14/d22/d2c/c8a 0 2024-09-18T12:51:12.894 INFO:tasks.workunit.client.0.smithi081.stdout:7/184: creat d2/d42/f43 x:0 0 0 2024-09-18T12:51:12.894 INFO:tasks.workunit.client.0.smithi081.stdout:1/167: creat d0/d6/d33/d37/f3e x:0 0 0 2024-09-18T12:51:12.897 INFO:tasks.workunit.client.1.smithi136.stdout:5/440: creat d5/d1a/d30/f80 x:0 0 0 2024-09-18T12:51:12.897 INFO:tasks.workunit.client.0.smithi081.stdout:4/136: creat d3/dd/d14/f31 x:0 0 0 2024-09-18T12:51:12.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/111: dwrite dd/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:51:12.898 INFO:tasks.workunit.client.0.smithi081.stdout:9/112: chown dd/cf 237 1 2024-09-18T12:51:12.902 INFO:tasks.workunit.client.1.smithi136.stdout:7/538: symlink d0/d35/d41/d50/d9b/lba 0 2024-09-18T12:51:12.902 INFO:tasks.workunit.client.1.smithi136.stdout:9/369: dwrite d6/d59/f2a [0,4194304] 0 2024-09-18T12:51:12.903 INFO:tasks.workunit.client.1.smithi136.stdout:1/333: rename d2/d5/d2b/f67 to d2/d5/d9/d23/d50/f6d 0 2024-09-18T12:51:12.905 INFO:tasks.workunit.client.1.smithi136.stdout:8/522: mkdir d9/d14/d1a/d2b/d42/da4/db9 0 2024-09-18T12:51:12.905 INFO:tasks.workunit.client.0.smithi081.stdout:8/154: mknod d3/d1d/c38 0 2024-09-18T12:51:12.907 INFO:tasks.workunit.client.0.smithi081.stdout:7/185: creat d2/d14/f44 x:0 0 0 2024-09-18T12:51:12.909 INFO:tasks.workunit.client.1.smithi136.stdout:3/415: link d3/d14/d18/f50 d3/d10/d4a/f8b 0 2024-09-18T12:51:12.909 INFO:tasks.workunit.client.1.smithi136.stdout:3/416: getdents d3/d14/d17/d75/d87 0 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:1/168: truncate d0/db/f14 98934 0 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/137: write d3/f10 [502293,45] 0 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/138: fdatasync d3/f7 0 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/139: dread - d3/dd/f19 zero size 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/140: creat d3/f32 x:0 0 0 2024-09-18T12:51:12.910 INFO:tasks.workunit.client.0.smithi081.stdout:9/113: symlink dd/l25 0 2024-09-18T12:51:12.911 INFO:tasks.workunit.client.0.smithi081.stdout:1/169: symlink d0/d6/d33/d37/l3f 0 2024-09-18T12:51:12.912 INFO:tasks.workunit.client.1.smithi136.stdout:5/441: link d5/f54 d5/d1a/d30/f81 0 2024-09-18T12:51:12.912 INFO:tasks.workunit.client.1.smithi136.stdout:5/442: chown d5/l14 750813296 1 2024-09-18T12:51:12.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/141: creat d3/dd/d2f/f33 x:0 0 0 2024-09-18T12:51:12.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/142: write d3/db/fe [2101758,44210] 0 2024-09-18T12:51:12.914 INFO:tasks.workunit.client.1.smithi136.stdout:7/539: mkdir d0/d35/d41/dbb 0 2024-09-18T12:51:12.915 INFO:tasks.workunit.client.0.smithi081.stdout:1/170: mkdir d0/d18/d1a/d1f/d40 0 2024-09-18T12:51:12.916 INFO:tasks.workunit.client.0.smithi081.stdout:4/143: symlink d3/d20/l34 0 2024-09-18T12:51:12.917 INFO:tasks.workunit.client.0.smithi081.stdout:1/171: rmdir d0/d6/d7 39 2024-09-18T12:51:12.918 INFO:tasks.workunit.client.1.smithi136.stdout:9/370: symlink d6/df/d23/d2b/l80 0 2024-09-18T12:51:12.918 INFO:tasks.workunit.client.1.smithi136.stdout:8/523: creat d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5/fba x:0 0 0 2024-09-18T12:51:12.919 INFO:tasks.workunit.client.0.smithi081.stdout:1/172: rmdir d0/db/d12/d2d 39 2024-09-18T12:51:12.919 INFO:tasks.workunit.client.0.smithi081.stdout:1/173: readlink d0/d6/d7/l19 0 2024-09-18T12:51:12.920 INFO:tasks.workunit.client.1.smithi136.stdout:0/423: mknod d1/c8d 0 2024-09-18T12:51:12.923 INFO:tasks.workunit.client.1.smithi136.stdout:3/417: truncate d3/d10/d4a/f8b 2629087 0 2024-09-18T12:51:12.923 INFO:tasks.workunit.client.1.smithi136.stdout:3/418: stat d3/d10/d4a/d51/c57 0 2024-09-18T12:51:12.925 INFO:tasks.workunit.client.0.smithi081.stdout:3/198: dwrite d3/db/df/d29/d13/d17/d2e/f2f [0,4194304] 0 2024-09-18T12:51:12.926 INFO:tasks.workunit.client.1.smithi136.stdout:5/443: link d5/d6b/f6c d5/d1a/d2d/d34/d4e/d7a/f82 0 2024-09-18T12:51:12.928 INFO:tasks.workunit.client.1.smithi136.stdout:3/419: mkdir d3/d14/d17/d8c 0 2024-09-18T12:51:12.928 INFO:tasks.workunit.client.1.smithi136.stdout:3/420: creat d3/d14/d18/f8d x:0 0 0 2024-09-18T12:51:12.928 INFO:tasks.workunit.client.1.smithi136.stdout:3/421: fsync d3/d2b/f4b 0 2024-09-18T12:51:12.930 INFO:tasks.workunit.client.1.smithi136.stdout:5/444: mknod d5/d1a/d2d/d34/d74/c83 0 2024-09-18T12:51:12.930 INFO:tasks.workunit.client.1.smithi136.stdout:2/436: sync 2024-09-18T12:51:12.930 INFO:tasks.workunit.client.1.smithi136.stdout:0/424: rmdir d1/db/d76 39 2024-09-18T12:51:12.931 INFO:tasks.workunit.client.1.smithi136.stdout:1/334: dwrite d2/d5/d11/d2e/f4f [0,4194304] 0 2024-09-18T12:51:12.931 INFO:tasks.workunit.client.1.smithi136.stdout:1/335: stat d2/f60 0 2024-09-18T12:51:12.931 INFO:tasks.workunit.client.1.smithi136.stdout:9/371: dread d6/f7 [0,4194304] 0 2024-09-18T12:51:12.932 INFO:tasks.workunit.client.1.smithi136.stdout:2/437: mknod d5/d4a/d67/c85 0 2024-09-18T12:51:12.932 INFO:tasks.workunit.client.0.smithi081.stdout:8/155: write d3/d1d/f21 [5227359,85129] 0 2024-09-18T12:51:12.933 INFO:tasks.workunit.client.0.smithi081.stdout:8/156: truncate d3/d1e/f33 338898 0 2024-09-18T12:51:12.933 INFO:tasks.workunit.client.1.smithi136.stdout:1/336: creat d2/d5/d9/d23/d50/d65/f6e x:0 0 0 2024-09-18T12:51:12.934 INFO:tasks.workunit.client.1.smithi136.stdout:9/372: creat d6/d13/d15/d38/f81 x:0 0 0 2024-09-18T12:51:12.935 INFO:tasks.workunit.client.0.smithi081.stdout:8/157: symlink d3/d1d/l39 0 2024-09-18T12:51:12.935 INFO:tasks.workunit.client.1.smithi136.stdout:0/425: creat d1/d17/d6d/d81/d72/f8e x:0 0 0 2024-09-18T12:51:12.935 INFO:tasks.workunit.client.1.smithi136.stdout:4/315: dwrite d0/d2/f3d [0,4194304] 0 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.1.smithi136.stdout:6/413: dwrite d8/d9/de/f70 [0,4194304] 0 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.1.smithi136.stdout:0/426: fsync d1/d17/d6d/d81/d72/f78 0 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.1.smithi136.stdout:6/414: truncate d8/d9/d3c/f62 1253432 0 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.1.smithi136.stdout:4/316: write d0/d3/f3b [886690,77501] 0 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.0.smithi081.stdout:7/186: rmdir d2 39 2024-09-18T12:51:12.936 INFO:tasks.workunit.client.0.smithi081.stdout:4/144: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:12.938 INFO:tasks.workunit.client.0.smithi081.stdout:8/158: symlink d3/d1d/l3a 0 2024-09-18T12:51:12.939 INFO:tasks.workunit.client.1.smithi136.stdout:9/373: mknod d6/d13/d15/d25/c82 0 2024-09-18T12:51:12.942 INFO:tasks.workunit.client.1.smithi136.stdout:0/427: creat d1/d60/d82/f8f x:0 0 0 2024-09-18T12:51:12.942 INFO:tasks.workunit.client.0.smithi081.stdout:4/145: mkdir d3/db/d35 0 2024-09-18T12:51:12.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/146: fdatasync d3/dd/d14/f31 0 2024-09-18T12:51:12.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/147: creat d3/db/f36 x:0 0 0 2024-09-18T12:51:12.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/148: chown d3/d20 717178 1 2024-09-18T12:51:12.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/337: link d2/f6c d2/f6f 0 2024-09-18T12:51:12.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/338: dread - d2/f42 zero size 2024-09-18T12:51:12.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/339: stat d2/d5/d9/d23/d50/l5d 0 2024-09-18T12:51:12.947 INFO:tasks.workunit.client.0.smithi081.stdout:9/114: truncate f8 3960444 0 2024-09-18T12:51:12.947 INFO:tasks.workunit.client.1.smithi136.stdout:3/422: dread d3/d14/d22/d2c/d3d/f80 [0,4194304] 0 2024-09-18T12:51:12.948 INFO:tasks.workunit.client.1.smithi136.stdout:0/428: truncate d1/db/f3e 964068 0 2024-09-18T12:51:12.948 INFO:tasks.workunit.client.0.smithi081.stdout:3/199: truncate d3/db/df/d29/d13/d17/d2e/f2f 2806243 0 2024-09-18T12:51:12.948 INFO:tasks.workunit.client.0.smithi081.stdout:3/200: read - d3/db/d1b/f34 zero size 2024-09-18T12:51:12.949 INFO:tasks.workunit.client.0.smithi081.stdout:2/196: dwrite d15/d16/d25/f27 [0,4194304] 0 2024-09-18T12:51:12.949 INFO:tasks.workunit.client.1.smithi136.stdout:1/340: mknod d2/d5/c70 0 2024-09-18T12:51:12.949 INFO:tasks.workunit.client.1.smithi136.stdout:1/341: creat d2/d5/d11/f71 x:0 0 0 2024-09-18T12:51:12.950 INFO:tasks.workunit.client.0.smithi081.stdout:1/174: dwrite d0/db/f2b [0,4194304] 0 2024-09-18T12:51:12.953 INFO:tasks.workunit.client.0.smithi081.stdout:8/159: rename d3/l30 to d3/l3b 0 2024-09-18T12:51:12.953 INFO:tasks.workunit.client.1.smithi136.stdout:0/429: creat d1/d17/d6d/d81/d35/f90 x:0 0 0 2024-09-18T12:51:12.954 INFO:tasks.workunit.client.1.smithi136.stdout:0/430: dread - d1/d3/d1a/f6e zero size 2024-09-18T12:51:12.954 INFO:tasks.workunit.client.1.smithi136.stdout:0/431: creat d1/d17/d6d/d81/d35/d84/f91 x:0 0 0 2024-09-18T12:51:12.956 INFO:tasks.workunit.client.1.smithi136.stdout:4/317: write d0/d13/f18 [204524,119200] 0 2024-09-18T12:51:12.956 INFO:tasks.workunit.client.1.smithi136.stdout:4/318: write d0/d13/f18 [211548,16035] 0 2024-09-18T12:51:12.956 INFO:tasks.workunit.client.0.smithi081.stdout:4/149: creat d3/dd/d14/d27/f37 x:0 0 0 2024-09-18T12:51:12.957 INFO:tasks.workunit.client.1.smithi136.stdout:1/342: unlink d2/d5/d2b/d34/d5c/l5e 0 2024-09-18T12:51:12.957 INFO:tasks.workunit.client.1.smithi136.stdout:5/445: dread d5/f23 [0,4194304] 0 2024-09-18T12:51:12.958 INFO:tasks.workunit.client.0.smithi081.stdout:3/201: creat d3/db/d1b/f43 x:0 0 0 2024-09-18T12:51:12.959 INFO:tasks.workunit.client.1.smithi136.stdout:8/524: dwrite d9/d14/d1a/f4a [4194304,4194304] 0 2024-09-18T12:51:12.963 INFO:tasks.workunit.client.1.smithi136.stdout:1/343: readlink d2/d5/d11/d2e/d4c/l39 0 2024-09-18T12:51:12.963 INFO:tasks.workunit.client.1.smithi136.stdout:1/344: truncate d2/d5/d2b/f4a 7199 0 2024-09-18T12:51:12.963 INFO:tasks.workunit.client.1.smithi136.stdout:2/438: dwrite d5/d7/fe [4194304,4194304] 0 2024-09-18T12:51:12.964 INFO:tasks.workunit.client.1.smithi136.stdout:5/446: creat d5/d1a/d2d/d34/d74/f84 x:0 0 0 2024-09-18T12:51:12.964 INFO:tasks.workunit.client.1.smithi136.stdout:5/447: creat d5/d1a/f85 x:0 0 0 2024-09-18T12:51:12.966 INFO:tasks.workunit.client.0.smithi081.stdout:8/160: creat d3/f3c x:0 0 0 2024-09-18T12:51:12.969 INFO:tasks.workunit.client.1.smithi136.stdout:8/525: creat d9/d18/d34/d88/fbb x:0 0 0 2024-09-18T12:51:12.969 INFO:tasks.workunit.client.0.smithi081.stdout:4/150: symlink d3/db/d35/l38 0 2024-09-18T12:51:12.969 INFO:tasks.workunit.client.0.smithi081.stdout:4/151: write d3/db/f18 [1591450,65923] 0 2024-09-18T12:51:12.969 INFO:tasks.workunit.client.0.smithi081.stdout:4/152: creat d3/db/f39 x:0 0 0 2024-09-18T12:51:12.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/153: creat d3/dd/d14/d27/f3a x:0 0 0 2024-09-18T12:51:12.972 INFO:tasks.workunit.client.1.smithi136.stdout:4/319: write d0/d2/f4d [235478,75689] 0 2024-09-18T12:51:12.972 INFO:tasks.workunit.client.1.smithi136.stdout:4/320: dread - d0/f4a zero size 2024-09-18T12:51:12.973 INFO:tasks.workunit.client.1.smithi136.stdout:6/415: dwrite d8/f30 [0,4194304] 0 2024-09-18T12:51:12.973 INFO:tasks.workunit.client.1.smithi136.stdout:6/416: fdatasync d8/f3b 0 2024-09-18T12:51:12.974 INFO:tasks.workunit.client.1.smithi136.stdout:6/417: write d8/d9/d56/f67 [793606,62412] 0 2024-09-18T12:51:12.974 INFO:tasks.workunit.client.1.smithi136.stdout:3/423: dwrite d3/d14/d17/f4d [0,4194304] 0 2024-09-18T12:51:12.974 INFO:tasks.workunit.client.1.smithi136.stdout:5/448: truncate d5/f62 2044292 0 2024-09-18T12:51:12.974 INFO:tasks.workunit.client.1.smithi136.stdout:5/449: fdatasync d5/d1a/d30/f80 0 2024-09-18T12:51:12.975 INFO:tasks.workunit.client.1.smithi136.stdout:6/418: dread d8/dc/f14 [0,4194304] 0 2024-09-18T12:51:12.975 INFO:tasks.workunit.client.0.smithi081.stdout:7/187: dwrite d2/d18/d22/f25 [0,4194304] 0 2024-09-18T12:51:12.975 INFO:tasks.workunit.client.1.smithi136.stdout:8/526: mknod d9/d14/d1a/d2b/d42/da4/da7/cbc 0 2024-09-18T12:51:12.978 INFO:tasks.workunit.client.0.smithi081.stdout:9/115: getdents dd/d15/d1a 0 2024-09-18T12:51:12.979 INFO:tasks.workunit.client.0.smithi081.stdout:1/175: write d0/d6/f36 [2350180,29697] 0 2024-09-18T12:51:12.980 INFO:tasks.workunit.client.1.smithi136.stdout:4/321: mknod d0/d3/c5b 0 2024-09-18T12:51:12.980 INFO:tasks.workunit.client.1.smithi136.stdout:9/374: fsync d6/d13/d15/d38/f81 0 2024-09-18T12:51:12.980 INFO:tasks.workunit.client.1.smithi136.stdout:9/375: write d6/d59/f61 [535343,30135] 0 2024-09-18T12:51:12.981 INFO:tasks.workunit.client.1.smithi136.stdout:4/322: dread d0/d3/f48 [0,4194304] 0 2024-09-18T12:51:12.981 INFO:tasks.workunit.client.1.smithi136.stdout:0/432: dwrite d1/d3/d1a/f50 [0,4194304] 0 2024-09-18T12:51:12.982 INFO:tasks.workunit.client.0.smithi081.stdout:3/202: mkdir d3/db/df/d29/d12/d44 0 2024-09-18T12:51:12.984 INFO:tasks.workunit.client.1.smithi136.stdout:3/424: mknod d3/d14/d18/c8e 0 2024-09-18T12:51:12.985 INFO:tasks.workunit.client.1.smithi136.stdout:6/419: truncate d8/dc/f6e 902697 0 2024-09-18T12:51:12.989 INFO:tasks.workunit.client.0.smithi081.stdout:8/161: symlink d3/d2f/l3d 0 2024-09-18T12:51:12.989 INFO:tasks.workunit.client.0.smithi081.stdout:8/162: readlink d3/lc 0 2024-09-18T12:51:12.990 INFO:tasks.workunit.client.1.smithi136.stdout:4/323: mkdir d0/d3/d54/d5c 0 2024-09-18T12:51:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:4/154: rename d3/f10 to d3/db/d2d/f3b 0 2024-09-18T12:51:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:4/155: write d3/db/d2d/f3b [2276755,19714] 0 2024-09-18T12:51:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:1/176: getdents d0/d6/d33 0 2024-09-18T12:51:12.996 INFO:tasks.workunit.client.1.smithi136.stdout:9/376: dread d6/db/d12/f60 [0,4194304] 0 2024-09-18T12:51:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:3/203: symlink d3/db/df/d3b/l45 0 2024-09-18T12:51:12.998 INFO:tasks.workunit.client.0.smithi081.stdout:4/156: rename d3/f32 to d3/f3c 0 2024-09-18T12:51:12.998 INFO:tasks.workunit.client.1.smithi136.stdout:3/425: symlink d3/d10/l8f 0 2024-09-18T12:51:13.000 INFO:tasks.workunit.client.0.smithi081.stdout:8/163: rename d3/d1d/l23 to d3/d2f/l3e 0 2024-09-18T12:51:13.001 INFO:tasks.workunit.client.0.smithi081.stdout:3/204: creat d3/f46 x:0 0 0 2024-09-18T12:51:13.001 INFO:tasks.workunit.client.0.smithi081.stdout:3/205: fdatasync d3/db/df/d29/f19 0 2024-09-18T12:51:13.002 INFO:tasks.workunit.client.1.smithi136.stdout:4/324: symlink d0/d3/d54/d5c/l5d 0 2024-09-18T12:51:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:2/197: dwrite d15/d16/f23 [0,4194304] 0 2024-09-18T12:51:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:2/198: chown fd 104 1 2024-09-18T12:51:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:2/199: truncate d15/f1e 2531344 0 2024-09-18T12:51:13.004 INFO:tasks.workunit.client.1.smithi136.stdout:9/377: mknod d6/d13/d15/d38/c83 0 2024-09-18T12:51:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:4/157: mkdir d3/d20/d3d 0 2024-09-18T12:51:13.005 INFO:tasks.workunit.client.1.smithi136.stdout:3/426: creat d3/d5/d31/f90 x:0 0 0 2024-09-18T12:51:13.005 INFO:tasks.workunit.client.1.smithi136.stdout:9/378: write d6/df/d23/d2b/d79/d53/f54 [717370,31694] 0 2024-09-18T12:51:13.008 INFO:tasks.workunit.client.1.smithi136.stdout:4/325: rename d0/d2/ca to d0/d3/d54/d5c/c5e 0 2024-09-18T12:51:13.008 INFO:tasks.workunit.client.1.smithi136.stdout:4/326: readlink d0/l3f 0 2024-09-18T12:51:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:4/158: dread d3/db/f23 [0,4194304] 0 2024-09-18T12:51:13.009 INFO:tasks.workunit.client.0.smithi081.stdout:4/159: fsync d3/dd/f19 0 2024-09-18T12:51:13.010 INFO:tasks.workunit.client.1.smithi136.stdout:9/379: truncate d6/d13/d15/f6c 3806733 0 2024-09-18T12:51:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:1/177: read d0/db/f2b [3686266,50774] 0 2024-09-18T12:51:13.015 INFO:tasks.workunit.client.1.smithi136.stdout:9/380: unlink d6/d13/d15/d25/l65 0 2024-09-18T12:51:13.015 INFO:tasks.workunit.client.1.smithi136.stdout:4/327: mkdir d0/d5f 0 2024-09-18T12:51:13.017 INFO:tasks.workunit.client.1.smithi136.stdout:9/381: link d6/d13/d15/d25/f39 d6/da/d3d/d4d/f84 0 2024-09-18T12:51:13.018 INFO:tasks.workunit.client.1.smithi136.stdout:9/382: readlink d6/d13/l3c 0 2024-09-18T12:51:13.018 INFO:tasks.workunit.client.1.smithi136.stdout:3/427: dread d3/d14/d17/f4d [0,4194304] 0 2024-09-18T12:51:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/178: dread d0/d6/d7/d8/fc [0,4194304] 0 2024-09-18T12:51:13.020 INFO:tasks.workunit.client.1.smithi136.stdout:3/428: link d3/f9 d3/d14/d22/d2c/d3d/f91 0 2024-09-18T12:51:13.020 INFO:tasks.workunit.client.1.smithi136.stdout:4/328: read d0/d13/f47 [1772401,49491] 0 2024-09-18T12:51:13.020 INFO:tasks.workunit.client.1.smithi136.stdout:4/329: write d0/f4a [618294,2072] 0 2024-09-18T12:51:13.021 INFO:tasks.workunit.client.1.smithi136.stdout:3/429: rename d3/d14/d17/d53/d73/f79 to d3/d2b/f92 0 2024-09-18T12:51:13.022 INFO:tasks.workunit.client.1.smithi136.stdout:4/330: mknod d0/d5f/c60 0 2024-09-18T12:51:13.023 INFO:tasks.workunit.client.1.smithi136.stdout:1/345: dwrite d2/d5/d9/f32 [8388608,4194304] 0 2024-09-18T12:51:13.024 INFO:tasks.workunit.client.1.smithi136.stdout:1/346: read - d2/d5/f5a zero size 2024-09-18T12:51:13.024 INFO:tasks.workunit.client.1.smithi136.stdout:1/347: dread - d2/f5b zero size 2024-09-18T12:51:13.024 INFO:tasks.workunit.client.1.smithi136.stdout:3/430: unlink d3/d5/c1b 0 2024-09-18T12:51:13.025 INFO:tasks.workunit.client.1.smithi136.stdout:4/331: symlink d0/d3/d54/l61 0 2024-09-18T12:51:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:1/179: dread d0/f15 [0,4194304] 0 2024-09-18T12:51:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:1/180: chown d0/c3 172 1 2024-09-18T12:51:13.035 INFO:tasks.workunit.client.1.smithi136.stdout:9/383: dread d6/f40 [0,4194304] 0 2024-09-18T12:51:13.039 INFO:tasks.workunit.client.0.smithi081.stdout:8/164: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.0.smithi081.stdout:9/116: dwrite dd/d15/f16 [0,4194304] 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.0.smithi081.stdout:2/200: dwrite d15/d16/d25/f27 [0,4194304] 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.1.smithi136.stdout:0/433: dwrite d1/d17/f25 [0,4194304] 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.1.smithi136.stdout:0/434: fsync d1/d60/d82/f8f 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.1.smithi136.stdout:0/435: truncate d1/d17/f2b 1279735 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.1.smithi136.stdout:9/384: symlink d6/d13/d15/l85 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.0.smithi081.stdout:3/206: dwrite d3/db/dc/d1a/f27 [0,4194304] 0 2024-09-18T12:51:13.040 INFO:tasks.workunit.client.0.smithi081.stdout:7/188: dwrite d2/d14/f24 [0,4194304] 0 2024-09-18T12:51:13.041 INFO:tasks.workunit.client.1.smithi136.stdout:5/450: dwrite d5/d1a/f37 [0,4194304] 0 2024-09-18T12:51:13.041 INFO:tasks.workunit.client.1.smithi136.stdout:5/451: creat d5/d72/f86 x:0 0 0 2024-09-18T12:51:13.042 INFO:tasks.workunit.client.0.smithi081.stdout:9/117: symlink dd/d1d/d1e/l26 0 2024-09-18T12:51:13.043 INFO:tasks.workunit.client.1.smithi136.stdout:8/527: dwrite d9/d18/d34/d3d/d47/d65/fab [0,4194304] 0 2024-09-18T12:51:13.043 INFO:tasks.workunit.client.0.smithi081.stdout:2/201: mknod d15/c3a 0 2024-09-18T12:51:13.044 INFO:tasks.workunit.client.0.smithi081.stdout:2/202: write d15/d16/f18 [44559,74820] 0 2024-09-18T12:51:13.046 INFO:tasks.workunit.client.0.smithi081.stdout:3/207: unlink d3/c5 0 2024-09-18T12:51:13.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/189: creat d2/d1d/f45 x:0 0 0 2024-09-18T12:51:13.048 INFO:tasks.workunit.client.1.smithi136.stdout:0/436: creat d1/db/d76/f92 x:0 0 0 2024-09-18T12:51:13.048 INFO:tasks.workunit.client.1.smithi136.stdout:0/437: creat d1/d60/d82/f93 x:0 0 0 2024-09-18T12:51:13.048 INFO:tasks.workunit.client.0.smithi081.stdout:9/118: rename dd/d1d/d1e/l26 to dd/d1b/l27 0 2024-09-18T12:51:13.049 INFO:tasks.workunit.client.0.smithi081.stdout:2/203: mknod d15/d16/d20/d22/c3b 0 2024-09-18T12:51:13.051 INFO:tasks.workunit.client.0.smithi081.stdout:7/190: symlink d2/d1d/l46 0 2024-09-18T12:51:13.051 INFO:tasks.workunit.client.0.smithi081.stdout:7/191: stat d2/d1d/d27 0 2024-09-18T12:51:13.052 INFO:tasks.workunit.client.0.smithi081.stdout:2/204: creat d15/d16/d25/d32/f3c x:0 0 0 2024-09-18T12:51:13.053 INFO:tasks.workunit.client.1.smithi136.stdout:9/385: rename d6/df/d23/d2b/d79/f4f to d6/db/d12/d56/f86 0 2024-09-18T12:51:13.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/192: creat d2/d1d/d27/f47 x:0 0 0 2024-09-18T12:51:13.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/193: write d2/f11 [5122423,30351] 0 2024-09-18T12:51:13.058 INFO:tasks.workunit.client.0.smithi081.stdout:8/165: dread d3/f25 [0,4194304] 0 2024-09-18T12:51:13.059 INFO:tasks.workunit.client.1.smithi136.stdout:3/431: dwrite d3/d5/d3c/f4c [0,4194304] 0 2024-09-18T12:51:13.060 INFO:tasks.workunit.client.1.smithi136.stdout:4/332: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-18T12:51:13.063 INFO:tasks.workunit.client.0.smithi081.stdout:3/208: write d3/db/df/d29/d13/f1e [4135698,30884] 0 2024-09-18T12:51:13.063 INFO:tasks.workunit.client.0.smithi081.stdout:3/209: chown d3/db/df/d29/d13/f14 1 1 2024-09-18T12:51:13.063 INFO:tasks.workunit.client.0.smithi081.stdout:3/210: write d3/db/d1b/f34 [279320,72658] 0 2024-09-18T12:51:13.063 INFO:tasks.workunit.client.0.smithi081.stdout:4/160: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:13.063 INFO:tasks.workunit.client.0.smithi081.stdout:4/161: readlink d3/d20/l34 0 2024-09-18T12:51:13.065 INFO:tasks.workunit.client.1.smithi136.stdout:5/452: creat d5/d1a/d2d/f87 x:0 0 0 2024-09-18T12:51:13.065 INFO:tasks.workunit.client.1.smithi136.stdout:5/453: readlink d5/l26 0 2024-09-18T12:51:13.069 INFO:tasks.workunit.client.0.smithi081.stdout:1/181: dwrite d0/d6/fe [4194304,4194304] 0 2024-09-18T12:51:13.069 INFO:tasks.workunit.client.0.smithi081.stdout:1/182: readlink d0/d6/d7/l19 0 2024-09-18T12:51:13.069 INFO:tasks.workunit.client.0.smithi081.stdout:1/183: readlink d0/db/d12/l1e 0 2024-09-18T12:51:13.071 INFO:tasks.workunit.client.0.smithi081.stdout:4/162: mkdir d3/dd/d14/d3e 0 2024-09-18T12:51:13.075 INFO:tasks.workunit.client.1.smithi136.stdout:9/386: getdents d6 0 2024-09-18T12:51:13.082 INFO:tasks.workunit.client.1.smithi136.stdout:4/333: write d0/d2/f16 [3524600,86032] 0 2024-09-18T12:51:13.083 INFO:tasks.workunit.client.1.smithi136.stdout:4/334: chown d0/d3/d54/d5c/c5e 24 1 2024-09-18T12:51:13.083 INFO:tasks.workunit.client.1.smithi136.stdout:4/335: creat d0/d45/f62 x:0 0 0 2024-09-18T12:51:13.083 INFO:tasks.workunit.client.0.smithi081.stdout:3/211: rmdir d3/db/dc/d1a 39 2024-09-18T12:51:13.085 INFO:tasks.workunit.client.1.smithi136.stdout:4/336: dread d0/f4a [0,4194304] 0 2024-09-18T12:51:13.085 INFO:tasks.workunit.client.1.smithi136.stdout:4/337: creat d0/d45/f63 x:0 0 0 2024-09-18T12:51:13.090 INFO:tasks.workunit.client.0.smithi081.stdout:7/194: dread d2/f11 [0,4194304] 0 2024-09-18T12:51:13.090 INFO:tasks.workunit.client.0.smithi081.stdout:7/195: truncate d2/d18/f3b 648664 0 2024-09-18T12:51:13.090 INFO:tasks.workunit.client.0.smithi081.stdout:3/212: rename d3/db/df/d29/d13/d17/d2e to d3/db/df/d3b/d47 0 2024-09-18T12:51:13.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/213: chown d3/db/df/d3b/l45 262452 1 2024-09-18T12:51:13.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/214: creat d3/db/df/d29/f48 x:0 0 0 2024-09-18T12:51:13.092 INFO:tasks.workunit.client.1.smithi136.stdout:3/432: rename d3/d14/d18/f41 to d3/d14/d22/d2c/d3d/f93 0 2024-09-18T12:51:13.092 INFO:tasks.workunit.client.1.smithi136.stdout:9/387: symlink d6/d13/l87 0 2024-09-18T12:51:13.098 INFO:tasks.workunit.client.1.smithi136.stdout:3/433: mknod d3/d14/d22/d2c/d3d/c94 0 2024-09-18T12:51:13.100 INFO:tasks.workunit.client.1.smithi136.stdout:3/434: symlink d3/d10/d84/l95 0 2024-09-18T12:51:13.104 INFO:tasks.workunit.client.1.smithi136.stdout:3/435: mkdir d3/d14/d17/d8c/d96 0 2024-09-18T12:51:13.104 INFO:tasks.workunit.client.0.smithi081.stdout:2/205: dwrite d15/d16/d20/d22/f34 [0,4194304] 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:9/388: dread d6/da/fd [0,4194304] 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:4/338: write d0/d13/f34 [2889799,105786] 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:4/339: write d0/d2/f3e [815527,50894] 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:4/340: fsync d0/d2/f49 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:4/341: truncate d0/f58 690252 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:3/436: link d3/d10/l8f d3/d14/d17/d75/d86/l97 0 2024-09-18T12:51:13.105 INFO:tasks.workunit.client.1.smithi136.stdout:8/528: dwrite d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5/fba [0,4194304] 0 2024-09-18T12:51:13.106 INFO:tasks.workunit.client.0.smithi081.stdout:4/163: dwrite d3/dd/d14/d27/f37 [0,4194304] 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:9/119: dwrite dd/d15/f16 [0,4194304] 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:8/166: dwrite d3/d1e/f2b [0,4194304] 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:9/120: fdatasync f6 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:9/121: stat dd/de 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:8/167: fdatasync d3/f13 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:8/168: fdatasync d3/d1e/f36 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:4/164: write d3/dd/f21 [2531991,126201] 0 2024-09-18T12:51:13.107 INFO:tasks.workunit.client.0.smithi081.stdout:2/206: mknod d15/d16/d25/c3d 0 2024-09-18T12:51:13.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:13 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:13.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:13 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:13.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:13 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:13.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:13 smithi081 ceph-mon[27646]: pgmap v279: 65 pgs: 65 active+clean; 740 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 69 MiB/s wr, 532 op/s 2024-09-18T12:51:13.108 INFO:tasks.workunit.client.0.smithi081.stdout:1/184: dwrite d0/db/d12/f23 [0,4194304] 0 2024-09-18T12:51:13.109 INFO:tasks.workunit.client.0.smithi081.stdout:9/122: mknod dd/de/c28 0 2024-09-18T12:51:13.110 INFO:tasks.workunit.client.0.smithi081.stdout:4/165: mknod d3/db/c3f 0 2024-09-18T12:51:13.112 INFO:tasks.workunit.client.1.smithi136.stdout:4/342: truncate d0/d13/f35 4048868 0 2024-09-18T12:51:13.114 INFO:tasks.workunit.client.0.smithi081.stdout:1/185: mkdir d0/d6/d7/d2e/d41 0 2024-09-18T12:51:13.114 INFO:tasks.workunit.client.0.smithi081.stdout:1/186: chown d0/d6/f9 0 1 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.1.smithi136.stdout:8/529: unlink d9/d18/d34/f74 0 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.1.smithi136.stdout:8/530: chown d9/d18/d34/d3d 0 1 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.1.smithi136.stdout:8/531: chown d9/d18/d34/l59 438 1 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.1.smithi136.stdout:8/532: read d9/d18/d34/d3d/f50 [295656,61059] 0 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.0.smithi081.stdout:9/123: creat dd/d1d/d1e/f29 x:0 0 0 2024-09-18T12:51:13.117 INFO:tasks.workunit.client.0.smithi081.stdout:9/124: chown f7 1213 1 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.0.smithi081.stdout:4/166: symlink d3/dd/d14/d27/l40 0 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.0.smithi081.stdout:4/167: stat d3/dd/d14/d27/l40 0 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.1.smithi136.stdout:5/454: rename d5/d72 to d5/d1a/d2d/d34/d88 0 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.1.smithi136.stdout:5/455: write d5/d1a/d30/f80 [839924,46042] 0 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.1.smithi136.stdout:4/343: creat d0/d3/d54/d5c/f64 x:0 0 0 2024-09-18T12:51:13.120 INFO:tasks.workunit.client.1.smithi136.stdout:4/344: fdatasync d0/d25/f5a 0 2024-09-18T12:51:13.122 INFO:tasks.workunit.client.1.smithi136.stdout:6/420: truncate d8/dc/f6e 786106 0 2024-09-18T12:51:13.122 INFO:tasks.workunit.client.1.smithi136.stdout:6/421: dread - d8/d9/de/d1c/d50/f85 zero size 2024-09-18T12:51:13.122 INFO:tasks.workunit.client.1.smithi136.stdout:6/422: readlink d8/d9/de/d1c/l3e 0 2024-09-18T12:51:13.122 INFO:tasks.workunit.client.1.smithi136.stdout:6/423: stat d8/d9/de/d60/f81 0 2024-09-18T12:51:13.122 INFO:tasks.workunit.client.0.smithi081.stdout:1/187: unlink d0/d18/d1a/f30 0 2024-09-18T12:51:13.125 INFO:tasks.workunit.client.1.smithi136.stdout:9/389: rename d6/d13/d15/c4a to d6/d59/c88 0 2024-09-18T12:51:13.127 INFO:tasks.workunit.client.1.smithi136.stdout:6/424: mknod d8/d9/de/d60/d71/d7f/c90 0 2024-09-18T12:51:13.131 INFO:tasks.workunit.client.1.smithi136.stdout:9/390: mknod d6/da/d3d/c89 0 2024-09-18T12:51:13.131 INFO:tasks.workunit.client.1.smithi136.stdout:5/456: dread d5/d1a/f53 [0,4194304] 0 2024-09-18T12:51:13.135 INFO:tasks.workunit.client.0.smithi081.stdout:7/196: dwrite d2/d14/f44 [0,4194304] 0 2024-09-18T12:51:13.136 INFO:tasks.workunit.client.1.smithi136.stdout:6/425: creat d8/d9/d3c/d4a/f91 x:0 0 0 2024-09-18T12:51:13.136 INFO:tasks.workunit.client.1.smithi136.stdout:6/426: readlink d8/d9/d3c/d4a/l8b 0 2024-09-18T12:51:13.137 INFO:tasks.workunit.client.0.smithi081.stdout:8/169: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:13.137 INFO:tasks.workunit.client.0.smithi081.stdout:8/170: write d3/f3c [602675,47926] 0 2024-09-18T12:51:13.138 INFO:tasks.workunit.client.1.smithi136.stdout:5/457: creat d5/d1a/d2d/d34/d4e/d7a/f89 x:0 0 0 2024-09-18T12:51:13.138 INFO:tasks.workunit.client.1.smithi136.stdout:5/458: getdents d5/d1a/d4a/d79 0 2024-09-18T12:51:13.138 INFO:tasks.workunit.client.1.smithi136.stdout:3/437: dwrite d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:13.138 INFO:tasks.workunit.client.1.smithi136.stdout:3/438: write d3/d10/d4a/f8b [2241700,67094] 0 2024-09-18T12:51:13.139 INFO:tasks.workunit.client.1.smithi136.stdout:5/459: creat d5/d1a/d2d/d3f/f8a x:0 0 0 2024-09-18T12:51:13.139 INFO:tasks.workunit.client.1.smithi136.stdout:5/460: write d5/d1a/d2d/d34/f13 [2578905,58480] 0 2024-09-18T12:51:13.143 INFO:tasks.workunit.client.0.smithi081.stdout:9/125: write f6 [6978382,47544] 0 2024-09-18T12:51:13.143 INFO:tasks.workunit.client.0.smithi081.stdout:9/126: fdatasync f0 0 2024-09-18T12:51:13.144 INFO:tasks.workunit.client.1.smithi136.stdout:3/439: rename d3/d10/f36 to d3/d14/d22/d2c/f98 0 2024-09-18T12:51:13.145 INFO:tasks.workunit.client.1.smithi136.stdout:3/440: chown d3/d2b/f4b 449626444 1 2024-09-18T12:51:13.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/171: dread d3/f18 [0,4194304] 0 2024-09-18T12:51:13.151 INFO:tasks.workunit.client.0.smithi081.stdout:1/188: dwrite d0/db/f39 [0,4194304] 0 2024-09-18T12:51:13.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/172: creat d3/f3f x:0 0 0 2024-09-18T12:51:13.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/173: fsync d3/d1e/f2b 0 2024-09-18T12:51:13.153 INFO:tasks.workunit.client.1.smithi136.stdout:5/461: mknod d5/d1a/d2d/d34/d4e/c8b 0 2024-09-18T12:51:13.154 INFO:tasks.workunit.client.1.smithi136.stdout:3/441: rmdir d3/d10/d4a/d51 39 2024-09-18T12:51:13.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/207: dwrite d15/d16/d20/d31/f36 [0,4194304] 0 2024-09-18T12:51:13.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/208: write fd [3720654,70927] 0 2024-09-18T12:51:13.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/168: dwrite d3/f1b [0,4194304] 0 2024-09-18T12:51:13.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/169: chown d3/db/f18 782309 1 2024-09-18T12:51:13.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/170: dread - d3/db/f36 zero size 2024-09-18T12:51:13.156 INFO:tasks.workunit.client.1.smithi136.stdout:4/345: dwrite d0/f4a [0,4194304] 0 2024-09-18T12:51:13.158 INFO:tasks.workunit.client.1.smithi136.stdout:5/462: dread d5/f31 [0,4194304] 0 2024-09-18T12:51:13.158 INFO:tasks.workunit.client.1.smithi136.stdout:5/463: write d5/d1a/d4a/f77 [904040,65127] 0 2024-09-18T12:51:13.158 INFO:tasks.workunit.client.0.smithi081.stdout:7/197: truncate d2/f11 1426135 0 2024-09-18T12:51:13.158 INFO:tasks.workunit.client.1.smithi136.stdout:3/442: mknod d3/d14/d17/d8c/c99 0 2024-09-18T12:51:13.161 INFO:tasks.workunit.client.0.smithi081.stdout:8/174: creat d3/d2f/f40 x:0 0 0 2024-09-18T12:51:13.161 INFO:tasks.workunit.client.0.smithi081.stdout:1/189: rename d0/d6/d31 to d0/d6/d33/d42 0 2024-09-18T12:51:13.164 INFO:tasks.workunit.client.0.smithi081.stdout:7/198: mkdir d2/d18/d22/d48 0 2024-09-18T12:51:13.164 INFO:tasks.workunit.client.0.smithi081.stdout:7/199: chown d2/d14/f24 86 1 2024-09-18T12:51:13.164 INFO:tasks.workunit.client.1.smithi136.stdout:5/464: truncate d5/d1a/d30/f57 1365805 0 2024-09-18T12:51:13.164 INFO:tasks.workunit.client.1.smithi136.stdout:5/465: chown d5/f18 18025 1 2024-09-18T12:51:13.166 INFO:tasks.workunit.client.0.smithi081.stdout:1/190: symlink d0/d6/d7/d8/l43 0 2024-09-18T12:51:13.167 INFO:tasks.workunit.client.1.smithi136.stdout:3/443: creat d3/d14/d17/d75/d86/f9a x:0 0 0 2024-09-18T12:51:13.168 INFO:tasks.workunit.client.0.smithi081.stdout:7/200: mkdir d2/d14/d21/d49 0 2024-09-18T12:51:13.168 INFO:tasks.workunit.client.0.smithi081.stdout:7/201: chown d2/d18/d3c 0 1 2024-09-18T12:51:13.170 INFO:tasks.workunit.client.0.smithi081.stdout:1/191: getdents d0/d6/d7 0 2024-09-18T12:51:13.170 INFO:tasks.workunit.client.0.smithi081.stdout:1/192: write d0/d6/f36 [3075454,71812] 0 2024-09-18T12:51:13.170 INFO:tasks.workunit.client.0.smithi081.stdout:1/193: write d0/f20 [885173,75438] 0 2024-09-18T12:51:13.172 INFO:tasks.workunit.client.0.smithi081.stdout:7/202: creat d2/f4a x:0 0 0 2024-09-18T12:51:13.172 INFO:tasks.workunit.client.0.smithi081.stdout:7/203: fsync d2/d1d/d27/f47 0 2024-09-18T12:51:13.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/204: readlink d2/l5 0 2024-09-18T12:51:13.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/205: write d2/d42/f43 [95920,45616] 0 2024-09-18T12:51:13.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/206: chown d2/d14/f16 108971401 1 2024-09-18T12:51:13.173 INFO:tasks.workunit.client.1.smithi136.stdout:5/466: rename d5/f31 to d5/d6b/f8c 0 2024-09-18T12:51:13.174 INFO:tasks.workunit.client.0.smithi081.stdout:1/194: creat d0/d6/d33/d42/f44 x:0 0 0 2024-09-18T12:51:13.174 INFO:tasks.workunit.client.0.smithi081.stdout:1/195: write d0/d6/f17 [1753897,34434] 0 2024-09-18T12:51:13.174 INFO:tasks.workunit.client.0.smithi081.stdout:7/207: rmdir d2/d18 39 2024-09-18T12:51:13.174 INFO:tasks.workunit.client.0.smithi081.stdout:7/208: chown d2/d14/f2f 25849 1 2024-09-18T12:51:13.174 INFO:tasks.workunit.client.0.smithi081.stdout:7/209: fsync d2/d18/f1e 0 2024-09-18T12:51:13.175 INFO:tasks.workunit.client.1.smithi136.stdout:3/444: mknod d3/d14/d17/d8c/d96/c9b 0 2024-09-18T12:51:13.177 INFO:tasks.workunit.client.0.smithi081.stdout:1/196: rename d0/f4 to d0/d18/d1a/d1f/d2c/f45 0 2024-09-18T12:51:13.177 INFO:tasks.workunit.client.1.smithi136.stdout:3/445: rmdir d3/d5/d3c 39 2024-09-18T12:51:13.177 INFO:tasks.workunit.client.1.smithi136.stdout:3/446: chown d3/d14/d22/d2c/d3d/f93 1125317 1 2024-09-18T12:51:13.178 INFO:tasks.workunit.client.1.smithi136.stdout:3/447: dread - d3/d14/d18/d7f/f6d zero size 2024-09-18T12:51:13.178 INFO:tasks.workunit.client.0.smithi081.stdout:7/210: mknod d2/c4b 0 2024-09-18T12:51:13.179 INFO:tasks.workunit.client.1.smithi136.stdout:3/448: getdents d3/d14/d22/d2c/d3d 0 2024-09-18T12:51:13.181 INFO:tasks.workunit.client.1.smithi136.stdout:9/391: dwrite d6/d13/d15/d25/f2e [0,4194304] 0 2024-09-18T12:51:13.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/449: creat d3/d14/d17/d8c/d96/f9c x:0 0 0 2024-09-18T12:51:13.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/450: chown d3/d14/d22 1784680 1 2024-09-18T12:51:13.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/451: creat d3/d14/f9d x:0 0 0 2024-09-18T12:51:13.182 INFO:tasks.workunit.client.1.smithi136.stdout:3/452: write d3/d14/d18/f50 [303442,64790] 0 2024-09-18T12:51:13.182 INFO:tasks.workunit.client.1.smithi136.stdout:9/392: truncate d6/d13/d15/f16 3772186 0 2024-09-18T12:51:13.201 INFO:tasks.workunit.client.0.smithi081.stdout:1/197: dwrite d0/db/d12/f24 [0,4194304] 0 2024-09-18T12:51:13.211 INFO:tasks.workunit.client.0.smithi081.stdout:9/127: dwrite dd/d15/f16 [0,4194304] 0 2024-09-18T12:51:13.211 INFO:tasks.workunit.client.1.smithi136.stdout:6/427: dwrite d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:13.212 INFO:tasks.workunit.client.1.smithi136.stdout:6/428: chown d8/d9/de/d1c/f2d 908 1 2024-09-18T12:51:13.212 INFO:tasks.workunit.client.1.smithi136.stdout:6/429: chown d8/d9/f74 536245 1 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/171: dwrite d3/f22 [0,4194304] 0 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:8/175: dwrite d3/f18 [0,4194304] 0 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/172: write d3/dd/f21 [4755555,122876] 0 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/173: dread - d3/dd/d14/f31 zero size 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/174: chown d3/f1b 1668724731 1 2024-09-18T12:51:13.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/175: dread - d3/db/f25 zero size 2024-09-18T12:51:13.215 INFO:tasks.workunit.client.1.smithi136.stdout:6/430: rename d8/d9/f8a to d8/f92 0 2024-09-18T12:51:13.221 INFO:tasks.workunit.client.0.smithi081.stdout:1/198: dread d0/d6/fe [4194304,4194304] 0 2024-09-18T12:51:13.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/467: dwrite d5/d1a/f68 [0,4194304] 0 2024-09-18T12:51:13.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/468: creat d5/d1a/f8d x:0 0 0 2024-09-18T12:51:13.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/469: chown d5/d1a/d2d/d3f/c46 9 1 2024-09-18T12:51:13.225 INFO:tasks.workunit.client.0.smithi081.stdout:4/176: dread d3/db/d2d/f3b [0,4194304] 0 2024-09-18T12:51:13.227 INFO:tasks.workunit.client.0.smithi081.stdout:4/177: symlink d3/dd/l41 0 2024-09-18T12:51:13.227 INFO:tasks.workunit.client.1.smithi136.stdout:3/453: dwrite d3/d2b/f92 [0,4194304] 0 2024-09-18T12:51:13.229 INFO:tasks.workunit.client.1.smithi136.stdout:9/393: dwrite d6/d13/d15/d25/f27 [0,4194304] 0 2024-09-18T12:51:13.229 INFO:tasks.workunit.client.1.smithi136.stdout:9/394: write d6/d13/d15/d25/f57 [1860486,33240] 0 2024-09-18T12:51:13.229 INFO:tasks.workunit.client.1.smithi136.stdout:9/395: truncate d6/db/d12/f33 58426 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:9/396: write d6/f7 [1097551,111716] 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:9/397: readlink d6/l18 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:9/398: stat d6/d13/l47 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:5/470: truncate d5/d1a/d30/f3b 1904581 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:5/471: write d5/d1a/d2d/d34/f13 [2491273,86317] 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.1.smithi136.stdout:5/472: stat d5/f62 0 2024-09-18T12:51:13.230 INFO:tasks.workunit.client.0.smithi081.stdout:7/211: dwrite d2/d1d/f38 [0,4194304] 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:1/199: dread d0/d6/fe [0,4194304] 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/212: fsync d2/f9 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/213: stat d2/d14/l2d 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/214: truncate d2/d1d/d27/f47 470281 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:1/200: creat d0/f46 x:0 0 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:1/201: creat d0/db/d12/f47 x:0 0 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:4/178: mknod d3/db/d2d/c42 0 2024-09-18T12:51:13.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/215: dread d2/d1d/f28 [0,4194304] 0 2024-09-18T12:51:13.237 INFO:tasks.workunit.client.1.smithi136.stdout:9/399: unlink d6/d13/d15/d25/f2e 0 2024-09-18T12:51:13.237 INFO:tasks.workunit.client.1.smithi136.stdout:9/400: write d6/df/d23/f66 [96847,59835] 0 2024-09-18T12:51:13.239 INFO:tasks.workunit.client.0.smithi081.stdout:1/202: symlink d0/db/l48 0 2024-09-18T12:51:13.239 INFO:tasks.workunit.client.0.smithi081.stdout:1/203: truncate d0/d6/f1b 172176 0 2024-09-18T12:51:13.239 INFO:tasks.workunit.client.0.smithi081.stdout:8/176: dwrite d3/f3f [0,4194304] 0 2024-09-18T12:51:13.241 INFO:tasks.workunit.client.1.smithi136.stdout:5/473: rename d5/f2a to d5/d1a/d2d/f8e 0 2024-09-18T12:51:13.241 INFO:tasks.workunit.client.1.smithi136.stdout:5/474: dread - d5/d1a/d2d/d34/d4e/d7a/f82 zero size 2024-09-18T12:51:13.241 INFO:tasks.workunit.client.1.smithi136.stdout:5/475: write d5/d1a/d2d/d3f/f8a [674623,30814] 0 2024-09-18T12:51:13.241 INFO:tasks.workunit.client.1.smithi136.stdout:5/476: write d5/d1a/d2d/f87 [1018582,119940] 0 2024-09-18T12:51:13.242 INFO:tasks.workunit.client.0.smithi081.stdout:4/179: mknod d3/dd/d2f/c43 0 2024-09-18T12:51:13.242 INFO:tasks.workunit.client.0.smithi081.stdout:4/180: read - d3/dd/d14/f31 zero size 2024-09-18T12:51:13.243 INFO:tasks.workunit.client.0.smithi081.stdout:4/181: dread d3/db/f23 [0,4194304] 0 2024-09-18T12:51:13.244 INFO:tasks.workunit.client.1.smithi136.stdout:9/401: unlink d6/da/d3d/d4d/f5a 0 2024-09-18T12:51:13.244 INFO:tasks.workunit.client.1.smithi136.stdout:6/431: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:13.244 INFO:tasks.workunit.client.1.smithi136.stdout:6/432: write d8/d9/d3c/f58 [438600,30826] 0 2024-09-18T12:51:13.244 INFO:tasks.workunit.client.0.smithi081.stdout:7/216: rename d2/d1b/l31 to d2/d18/d22/d48/l4c 0 2024-09-18T12:51:13.244 INFO:tasks.workunit.client.1.smithi136.stdout:6/433: write d8/dc/f4f [231597,130833] 0 2024-09-18T12:51:13.246 INFO:tasks.workunit.client.0.smithi081.stdout:1/204: mknod d0/db/c49 0 2024-09-18T12:51:13.247 INFO:tasks.workunit.client.0.smithi081.stdout:1/205: read d0/d6/fd [1718482,41929] 0 2024-09-18T12:51:13.247 INFO:tasks.workunit.client.1.smithi136.stdout:9/402: mknod d6/db/d12/c8a 0 2024-09-18T12:51:13.251 INFO:tasks.workunit.client.0.smithi081.stdout:8/177: unlink d3/d1e/f37 0 2024-09-18T12:51:13.253 INFO:tasks.workunit.client.1.smithi136.stdout:6/434: creat d8/d9/de/d60/d71/f93 x:0 0 0 2024-09-18T12:51:13.254 INFO:tasks.workunit.client.1.smithi136.stdout:9/403: mkdir d6/df/d23/d2b/d79/d8b 0 2024-09-18T12:51:13.254 INFO:tasks.workunit.client.1.smithi136.stdout:9/404: truncate d6/d59/f35 1023937 0 2024-09-18T12:51:13.254 INFO:tasks.workunit.client.1.smithi136.stdout:9/405: stat d6/d13/d15/d25/f71 0 2024-09-18T12:51:13.257 INFO:tasks.workunit.client.0.smithi081.stdout:8/178: dread d3/f3c [0,4194304] 0 2024-09-18T12:51:13.258 INFO:tasks.workunit.client.0.smithi081.stdout:8/179: creat d3/d1d/f41 x:0 0 0 2024-09-18T12:51:13.260 INFO:tasks.workunit.client.0.smithi081.stdout:4/182: write d3/dd/f2c [3728652,31026] 0 2024-09-18T12:51:13.261 INFO:tasks.workunit.client.0.smithi081.stdout:8/180: link d3/d1e/f36 d3/d2f/f42 0 2024-09-18T12:51:13.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/181: dread d3/f11 [0,4194304] 0 2024-09-18T12:51:13.264 INFO:tasks.workunit.client.1.smithi136.stdout:4/346: truncate d0/f58 290390 0 2024-09-18T12:51:13.266 INFO:tasks.workunit.client.1.smithi136.stdout:4/347: symlink d0/d3/l65 0 2024-09-18T12:51:13.267 INFO:tasks.workunit.client.1.smithi136.stdout:9/406: dread d6/d13/d15/d25/f31 [0,4194304] 0 2024-09-18T12:51:13.269 INFO:tasks.workunit.client.1.smithi136.stdout:9/407: rename d6/db/d12/d62/c63 to d6/df/d23/c8c 0 2024-09-18T12:51:13.270 INFO:tasks.workunit.client.1.smithi136.stdout:5/477: dwrite d5/d1a/d30/f40 [0,4194304] 0 2024-09-18T12:51:13.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/206: dwrite d0/d6/fe [8388608,4194304] 0 2024-09-18T12:51:13.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/207: readlink d0/db/d12/l1e 0 2024-09-18T12:51:13.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/208: creat d0/f4a x:0 0 0 2024-09-18T12:51:13.276 INFO:tasks.workunit.client.0.smithi081.stdout:8/182: write d3/d1d/f21 [454906,45308] 0 2024-09-18T12:51:13.278 INFO:tasks.workunit.client.0.smithi081.stdout:8/183: mknod d3/d1e/c43 0 2024-09-18T12:51:13.278 INFO:tasks.workunit.client.0.smithi081.stdout:7/217: dwrite d2/d1d/f38 [0,4194304] 0 2024-09-18T12:51:13.279 INFO:tasks.workunit.client.0.smithi081.stdout:8/184: mknod d3/c44 0 2024-09-18T12:51:13.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/218: mknod d2/d1d/d27/c4d 0 2024-09-18T12:51:13.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/219: fsync d2/d1d/f28 0 2024-09-18T12:51:13.281 INFO:tasks.workunit.client.0.smithi081.stdout:8/185: mknod d3/d1d/c45 0 2024-09-18T12:51:13.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/220: dread d2/f10 [0,4194304] 0 2024-09-18T12:51:13.282 INFO:tasks.workunit.client.0.smithi081.stdout:8/186: unlink d3/lc 0 2024-09-18T12:51:13.283 INFO:tasks.workunit.client.0.smithi081.stdout:7/221: write d2/d14/f29 [516671,123927] 0 2024-09-18T12:51:13.283 INFO:tasks.workunit.client.1.smithi136.stdout:9/408: write d6/d13/d15/d25/f27 [3491316,104964] 0 2024-09-18T12:51:13.284 INFO:tasks.workunit.client.0.smithi081.stdout:8/187: mknod d3/d1e/c46 0 2024-09-18T12:51:13.285 INFO:tasks.workunit.client.1.smithi136.stdout:5/478: read d5/d6b/f8c [3061413,117468] 0 2024-09-18T12:51:13.285 INFO:tasks.workunit.client.1.smithi136.stdout:5/479: getdents d5/d78 0 2024-09-18T12:51:13.287 INFO:tasks.workunit.client.0.smithi081.stdout:8/188: rename d3/d1d/l39 to d3/d1e/l47 0 2024-09-18T12:51:13.288 INFO:tasks.workunit.client.0.smithi081.stdout:1/209: dread d0/db/d12/f24 [0,4194304] 0 2024-09-18T12:51:13.288 INFO:tasks.workunit.client.0.smithi081.stdout:1/210: fdatasync d0/d6/d33/d42/f44 0 2024-09-18T12:51:13.289 INFO:tasks.workunit.client.1.smithi136.stdout:9/409: link d6/d13/d15/d25/f57 d6/d13/d15/d25/d55/f8d 0 2024-09-18T12:51:13.289 INFO:tasks.workunit.client.0.smithi081.stdout:8/189: unlink d3/d1d/c38 0 2024-09-18T12:51:13.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/211: rmdir d0/db/d32 39 2024-09-18T12:51:13.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/212: getdents d0/d6/d7/d2e/d41 0 2024-09-18T12:51:13.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/213: fsync d0/d6/f17 0 2024-09-18T12:51:13.290 INFO:tasks.workunit.client.1.smithi136.stdout:5/480: symlink d5/d1a/d2d/d3f/l8f 0 2024-09-18T12:51:13.292 INFO:tasks.workunit.client.0.smithi081.stdout:8/190: truncate d3/f32 3794760 0 2024-09-18T12:51:13.292 INFO:tasks.workunit.client.0.smithi081.stdout:8/191: chown d3/d2f/f31 2720 1 2024-09-18T12:51:13.293 INFO:tasks.workunit.client.0.smithi081.stdout:1/214: mknod d0/db/c4b 0 2024-09-18T12:51:13.294 INFO:tasks.workunit.client.1.smithi136.stdout:9/410: rename d6/d13/d15/d25/f57 to d6/db/d12/d62/f8e 0 2024-09-18T12:51:13.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/192: mknod d3/d1e/c48 0 2024-09-18T12:51:13.297 INFO:tasks.workunit.client.1.smithi136.stdout:9/411: mknod d6/df/c8f 0 2024-09-18T12:51:13.297 INFO:tasks.workunit.client.0.smithi081.stdout:1/215: dread d0/f20 [0,4194304] 0 2024-09-18T12:51:13.298 INFO:tasks.workunit.client.0.smithi081.stdout:1/216: mknod d0/d18/d1a/d1f/d2c/c4c 0 2024-09-18T12:51:13.300 INFO:tasks.workunit.client.1.smithi136.stdout:5/481: rename d5/d1a/d2d/d34/f13 to d5/d1a/d4a/d79/f90 0 2024-09-18T12:51:13.302 INFO:tasks.workunit.client.0.smithi081.stdout:1/217: symlink d0/d6/d7/d8/l4d 0 2024-09-18T12:51:13.302 INFO:tasks.workunit.client.0.smithi081.stdout:1/218: chown d0/d18/d1a/d1f/d40 1386520186 1 2024-09-18T12:51:13.304 INFO:tasks.workunit.client.0.smithi081.stdout:1/219: mkdir d0/d6/d7/d2e/d4e 0 2024-09-18T12:51:13.310 INFO:tasks.workunit.client.1.smithi136.stdout:7/540: sync 2024-09-18T12:51:13.313 INFO:tasks.workunit.client.1.smithi136.stdout:7/541: write d0/da8/f74 [717468,42749] 0 2024-09-18T12:51:13.313 INFO:tasks.workunit.client.1.smithi136.stdout:7/542: stat d0/d35/d36/c5b 0 2024-09-18T12:51:13.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/348: rmdir d0/d3 39 2024-09-18T12:51:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:13 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:13 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:13 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:13 smithi136 ceph-mon[35363]: pgmap v279: 65 pgs: 65 active+clean; 740 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 69 MiB/s wr, 532 op/s 2024-09-18T12:51:13.315 INFO:tasks.workunit.client.1.smithi136.stdout:7/543: truncate d0/d35/d41/d50/d7f/f42 1705447 0 2024-09-18T12:51:13.315 INFO:tasks.workunit.client.1.smithi136.stdout:7/544: creat d0/d35/d41/d50/fbc x:0 0 0 2024-09-18T12:51:13.317 INFO:tasks.workunit.client.1.smithi136.stdout:4/349: unlink d0/d2/f4d 0 2024-09-18T12:51:13.317 INFO:tasks.workunit.client.1.smithi136.stdout:4/350: dread - d0/d3/f53 zero size 2024-09-18T12:51:13.320 INFO:tasks.workunit.client.1.smithi136.stdout:7/545: symlink d0/d35/d36/d7c/lbd 0 2024-09-18T12:51:13.320 INFO:tasks.workunit.client.1.smithi136.stdout:7/546: chown d0/d2c/d2e 1383310 1 2024-09-18T12:51:13.320 INFO:tasks.workunit.client.1.smithi136.stdout:4/351: truncate d0/d45/f55 1070192 0 2024-09-18T12:51:13.322 INFO:tasks.workunit.client.1.smithi136.stdout:7/547: symlink d0/da8/lbe 0 2024-09-18T12:51:13.323 INFO:tasks.workunit.client.1.smithi136.stdout:7/548: mkdir d0/d39/dbf 0 2024-09-18T12:51:13.325 INFO:tasks.workunit.client.1.smithi136.stdout:5/482: dwrite d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:13.325 INFO:tasks.workunit.client.1.smithi136.stdout:5/483: chown d5/d1a/d2d/d34/c36 43056742 1 2024-09-18T12:51:13.325 INFO:tasks.workunit.client.1.smithi136.stdout:9/412: dwrite d6/db/d12/d62/f8e [0,4194304] 0 2024-09-18T12:51:13.326 INFO:tasks.workunit.client.1.smithi136.stdout:7/549: link d0/d12/d1a/d46/c4a d0/d2c/d2e/cc0 0 2024-09-18T12:51:13.330 INFO:tasks.workunit.client.1.smithi136.stdout:9/413: rmdir d6/db 39 2024-09-18T12:51:13.331 INFO:tasks.workunit.client.1.smithi136.stdout:4/352: dread d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:13.334 INFO:tasks.workunit.client.1.smithi136.stdout:9/414: link d6/d59/f61 d6/da/d3d/f90 0 2024-09-18T12:51:13.336 INFO:tasks.workunit.client.1.smithi136.stdout:4/353: creat d0/d13/f66 x:0 0 0 2024-09-18T12:51:13.336 INFO:tasks.workunit.client.1.smithi136.stdout:4/354: read - d0/d3/f53 zero size 2024-09-18T12:51:13.337 INFO:tasks.workunit.client.1.smithi136.stdout:4/355: write d0/d3/f53 [411403,67485] 0 2024-09-18T12:51:13.337 INFO:tasks.workunit.client.1.smithi136.stdout:4/356: fsync d0/d2/f28 0 2024-09-18T12:51:13.343 INFO:tasks.workunit.client.1.smithi136.stdout:7/550: fsync d0/d35/d41/d50/fbc 0 2024-09-18T12:51:13.345 INFO:tasks.workunit.client.1.smithi136.stdout:7/551: rmdir d0/d12 39 2024-09-18T12:51:13.347 INFO:tasks.workunit.client.1.smithi136.stdout:9/415: rename d6/d13/d15 to d6/da/d3d/d4d/d91 0 2024-09-18T12:51:13.348 INFO:tasks.workunit.client.1.smithi136.stdout:9/416: stat d6/c20 0 2024-09-18T12:51:13.348 INFO:tasks.workunit.client.1.smithi136.stdout:9/417: chown d6/d59 1 1 2024-09-18T12:51:13.348 INFO:tasks.workunit.client.1.smithi136.stdout:9/418: chown d6/df/d23/d2b 22 1 2024-09-18T12:51:13.349 INFO:tasks.workunit.client.1.smithi136.stdout:9/419: rename d6/df/d23/d2b/d79/d53 to d6/df/d23/d2b/d79/d53/d92 22 2024-09-18T12:51:13.356 INFO:tasks.workunit.client.1.smithi136.stdout:5/484: dwrite d5/d1a/d30/f80 [0,4194304] 0 2024-09-18T12:51:13.357 INFO:tasks.workunit.client.1.smithi136.stdout:7/552: write d0/d12/d1a/f20 [2986226,62768] 0 2024-09-18T12:51:13.358 INFO:tasks.workunit.client.1.smithi136.stdout:4/357: dwrite d0/d3/f48 [0,4194304] 0 2024-09-18T12:51:13.363 INFO:tasks.workunit.client.1.smithi136.stdout:5/485: symlink d5/d1a/l91 0 2024-09-18T12:51:13.363 INFO:tasks.workunit.client.1.smithi136.stdout:5/486: chown d5/l20 17 1 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:7/553: link d0/d39/fb8 d0/d35/d36/fc1 0 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:7/554: chown d0/d35/d41/d50/d5a/c9f 159192105 1 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:7/555: read d0/d2c/f45 [654195,126192] 0 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/420: dwrite d6/d13/d4c/f7e [0,4194304] 0 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/421: chown d6/d59/f61 7 1 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/422: fdatasync d6/df/d23/d2b/f43 0 2024-09-18T12:51:13.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/423: chown d6/f40 14576 1 2024-09-18T12:51:13.368 INFO:tasks.workunit.client.1.smithi136.stdout:4/358: mkdir d0/d45/d67 0 2024-09-18T12:51:13.369 INFO:tasks.workunit.client.1.smithi136.stdout:5/487: unlink d5/f23 0 2024-09-18T12:51:13.371 INFO:tasks.workunit.client.1.smithi136.stdout:1/348: sync 2024-09-18T12:51:13.371 INFO:tasks.workunit.client.1.smithi136.stdout:2/439: sync 2024-09-18T12:51:13.371 INFO:tasks.workunit.client.1.smithi136.stdout:8/533: sync 2024-09-18T12:51:13.372 INFO:tasks.workunit.client.1.smithi136.stdout:4/359: mknod d0/d3/d54/d5c/c68 0 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:9/424: dread d6/f40 [0,4194304] 0 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:2/440: rename d5/d7/d17/c3d to d5/d7/d3b/c86 0 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:2/441: readlink d5/d7/l8 0 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:2/442: write d5/d7/d11/f31 [4226701,96343] 0 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:2/443: chown d5/d25/d43/d74/f76 169837 1 2024-09-18T12:51:13.375 INFO:tasks.workunit.client.1.smithi136.stdout:0/438: sync 2024-09-18T12:51:13.376 INFO:tasks.workunit.client.1.smithi136.stdout:8/534: symlink d9/d14/lbd 0 2024-09-18T12:51:13.377 INFO:tasks.workunit.client.1.smithi136.stdout:9/425: rename d6/db/l4e to d6/db/l93 0 2024-09-18T12:51:13.379 INFO:tasks.workunit.client.1.smithi136.stdout:8/535: mkdir d9/d18/d34/d3d/d47/dbe 0 2024-09-18T12:51:13.389 INFO:tasks.workunit.client.1.smithi136.stdout:5/488: dread d5/d1a/d2d/d34/f2e [0,4194304] 0 2024-09-18T12:51:13.389 INFO:tasks.workunit.client.1.smithi136.stdout:7/556: dwrite d0/d39/d4d/f92 [0,4194304] 0 2024-09-18T12:51:13.394 INFO:tasks.workunit.client.1.smithi136.stdout:5/489: getdents d5/d1a/d2d 0 2024-09-18T12:51:13.397 INFO:tasks.workunit.client.1.smithi136.stdout:5/490: getdents d5/d1a/d2d/d34/d4e 0 2024-09-18T12:51:13.410 INFO:tasks.workunit.client.1.smithi136.stdout:5/491: write d5/d1a/d30/f57 [976859,99765] 0 2024-09-18T12:51:13.411 INFO:tasks.workunit.client.1.smithi136.stdout:5/492: readlink d5/d1a/d2d/d34/d4e/d7a/l7d 0 2024-09-18T12:51:13.412 INFO:tasks.workunit.client.1.smithi136.stdout:5/493: rename d5/d1a/d2d/d34/c36 to d5/d1a/d2d/c92 0 2024-09-18T12:51:13.413 INFO:tasks.workunit.client.1.smithi136.stdout:5/494: unlink d5/d1a/d2d/l61 0 2024-09-18T12:51:13.414 INFO:tasks.workunit.client.1.smithi136.stdout:5/495: rmdir d5/d1a/d2d/d34/d4e 39 2024-09-18T12:51:13.414 INFO:tasks.workunit.client.1.smithi136.stdout:1/349: dwrite d2/d5/d11/d2e/d4c/f1f [0,4194304] 0 2024-09-18T12:51:13.414 INFO:tasks.workunit.client.1.smithi136.stdout:1/350: dread - d2/d5/d9/d23/d50/f57 zero size 2024-09-18T12:51:13.415 INFO:tasks.workunit.client.1.smithi136.stdout:1/351: unlink d2/l3 0 2024-09-18T12:51:13.415 INFO:tasks.workunit.client.1.smithi136.stdout:1/352: rmdir d2/d5/d11/d1b 39 2024-09-18T12:51:13.416 INFO:tasks.workunit.client.1.smithi136.stdout:1/353: creat d2/d5/d11/d1b/f72 x:0 0 0 2024-09-18T12:51:13.417 INFO:tasks.workunit.client.1.smithi136.stdout:1/354: creat d2/d5/f73 x:0 0 0 2024-09-18T12:51:13.418 INFO:tasks.workunit.client.1.smithi136.stdout:1/355: creat d2/f74 x:0 0 0 2024-09-18T12:51:13.418 INFO:tasks.workunit.client.1.smithi136.stdout:1/356: fdatasync d2/d5/d2b/d34/f47 0 2024-09-18T12:51:13.418 INFO:tasks.workunit.client.1.smithi136.stdout:1/357: write d2/d5/d9/d23/d50/f6d [379973,67939] 0 2024-09-18T12:51:13.418 INFO:tasks.workunit.client.1.smithi136.stdout:5/496: dread d5/d1a/d4a/f77 [0,4194304] 0 2024-09-18T12:51:13.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/358: truncate d2/d5/d11/d1b/f72 322667 0 2024-09-18T12:51:13.419 INFO:tasks.workunit.client.1.smithi136.stdout:5/497: creat d5/d1a/f93 x:0 0 0 2024-09-18T12:51:13.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/359: creat d2/d5/d9/d23/d50/f75 x:0 0 0 2024-09-18T12:51:13.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/360: chown d2/f5b 2 1 2024-09-18T12:51:13.419 INFO:tasks.workunit.client.1.smithi136.stdout:1/361: chown d2/d5/d9/d23/l62 666949 1 2024-09-18T12:51:13.420 INFO:tasks.workunit.client.1.smithi136.stdout:5/498: creat d5/d1a/d4a/d79/f94 x:0 0 0 2024-09-18T12:51:13.420 INFO:tasks.workunit.client.1.smithi136.stdout:1/362: symlink d2/d5/d2b/d34/d5c/l76 0 2024-09-18T12:51:13.421 INFO:tasks.workunit.client.1.smithi136.stdout:1/363: link d2/f41 d2/d5/d11/d1b/f77 0 2024-09-18T12:51:13.426 INFO:tasks.workunit.client.1.smithi136.stdout:9/426: dwrite d6/f40 [0,4194304] 0 2024-09-18T12:51:13.426 INFO:tasks.workunit.client.1.smithi136.stdout:9/427: truncate d6/f2d 643422 0 2024-09-18T12:51:13.426 INFO:tasks.workunit.client.1.smithi136.stdout:4/360: dwrite d0/d13/f47 [0,4194304] 0 2024-09-18T12:51:13.426 INFO:tasks.workunit.client.1.smithi136.stdout:4/361: stat d0/l2a 0 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:2/444: dwrite d5/d25/f6c [0,4194304] 0 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:2/445: dread - d5/d7/d41/f81 zero size 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/536: dwrite d9/d18/d34/f67 [0,4194304] 0 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/537: read d9/d14/f79 [58608,34654] 0 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:8/538: creat d9/d14/d1a/fbf x:0 0 0 2024-09-18T12:51:13.427 INFO:tasks.workunit.client.1.smithi136.stdout:9/428: creat d6/df/d23/d2b/d79/d53/d5c/f94 x:0 0 0 2024-09-18T12:51:13.428 INFO:tasks.workunit.client.1.smithi136.stdout:7/557: dwrite d0/d39/fb8 [0,4194304] 0 2024-09-18T12:51:13.428 INFO:tasks.workunit.client.1.smithi136.stdout:4/362: rename d0/d13/f35 to d0/d13/f69 0 2024-09-18T12:51:13.430 INFO:tasks.workunit.client.1.smithi136.stdout:5/499: dread d5/d1a/f1b [0,4194304] 0 2024-09-18T12:51:13.430 INFO:tasks.workunit.client.1.smithi136.stdout:1/364: dread d2/d5/d9/f3b [0,4194304] 0 2024-09-18T12:51:13.430 INFO:tasks.workunit.client.1.smithi136.stdout:1/365: read - d2/f74 zero size 2024-09-18T12:51:13.433 INFO:tasks.workunit.client.1.smithi136.stdout:5/500: read d5/d1a/d30/f4c [2675200,5552] 0 2024-09-18T12:51:13.433 INFO:tasks.workunit.client.1.smithi136.stdout:8/539: dread d9/d18/d34/d3d/f4b [0,4194304] 0 2024-09-18T12:51:13.441 INFO:tasks.workunit.client.1.smithi136.stdout:2/446: mknod d5/d7/d11/d34/c87 0 2024-09-18T12:51:13.442 INFO:tasks.workunit.client.1.smithi136.stdout:1/366: dread d2/d5/d11/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:13.442 INFO:tasks.workunit.client.1.smithi136.stdout:1/367: dread - d2/d5/f73 zero size 2024-09-18T12:51:13.453 INFO:tasks.workunit.client.1.smithi136.stdout:9/429: link d6/da/d3d/d4d/d91/d25/d55/f5b d6/df/f95 0 2024-09-18T12:51:13.453 INFO:tasks.workunit.client.1.smithi136.stdout:9/430: dread - d6/da/d3d/d41/f6d zero size 2024-09-18T12:51:13.454 INFO:tasks.workunit.client.1.smithi136.stdout:7/558: mkdir d0/d35/d41/d50/d9b/dc2 0 2024-09-18T12:51:13.456 INFO:tasks.workunit.client.1.smithi136.stdout:4/363: unlink d0/d13/f47 0 2024-09-18T12:51:13.458 INFO:tasks.workunit.client.1.smithi136.stdout:9/431: rename d6/db/d12/d56 to d6/d96 0 2024-09-18T12:51:13.460 INFO:tasks.workunit.client.1.smithi136.stdout:4/364: rename d0/d3/f36 to d0/f6a 0 2024-09-18T12:51:13.461 INFO:tasks.workunit.client.1.smithi136.stdout:9/432: rename d6/d13/d4c/c58 to d6/db/d12/d62/c97 0 2024-09-18T12:51:13.462 INFO:tasks.workunit.client.1.smithi136.stdout:9/433: write d6/da/d3d/d4d/d91/f16 [3004602,129893] 0 2024-09-18T12:51:13.462 INFO:tasks.workunit.client.1.smithi136.stdout:9/434: stat d6/db/f2c 0 2024-09-18T12:51:13.470 INFO:tasks.workunit.client.1.smithi136.stdout:9/435: dread d6/d13/d4c/f50 [0,4194304] 0 2024-09-18T12:51:13.483 INFO:tasks.workunit.client.1.smithi136.stdout:8/540: dwrite d9/d18/d34/d3d/d47/d65/d6b/f9d [0,4194304] 0 2024-09-18T12:51:13.484 INFO:tasks.workunit.client.1.smithi136.stdout:5/501: dwrite d5/d1a/f68 [0,4194304] 0 2024-09-18T12:51:13.484 INFO:tasks.workunit.client.1.smithi136.stdout:8/541: readlink d9/d14/l10 0 2024-09-18T12:51:13.485 INFO:tasks.workunit.client.1.smithi136.stdout:2/447: dwrite d5/d7/d3b/f51 [0,4194304] 0 2024-09-18T12:51:13.485 INFO:tasks.workunit.client.1.smithi136.stdout:1/368: dwrite d2/d5/d9/d23/f27 [0,4194304] 0 2024-09-18T12:51:13.485 INFO:tasks.workunit.client.1.smithi136.stdout:9/436: fdatasync d6/da/d3d/d4d/d91/f16 0 2024-09-18T12:51:13.485 INFO:tasks.workunit.client.1.smithi136.stdout:9/437: chown d6/da/d3d/d4d/d91/d25/f71 12 1 2024-09-18T12:51:13.485 INFO:tasks.workunit.client.1.smithi136.stdout:4/365: dwrite d0/d45/f63 [0,4194304] 0 2024-09-18T12:51:13.487 INFO:tasks.workunit.client.1.smithi136.stdout:8/542: unlink d9/d14/d1a/d2b/d42/f43 0 2024-09-18T12:51:13.489 INFO:tasks.workunit.client.1.smithi136.stdout:5/502: creat d5/d1a/d2d/d34/f95 x:0 0 0 2024-09-18T12:51:13.495 INFO:tasks.workunit.client.1.smithi136.stdout:2/448: truncate d5/d7/f3f 3415132 0 2024-09-18T12:51:13.496 INFO:tasks.workunit.client.1.smithi136.stdout:2/449: creat d5/d25/d43/d74/f88 x:0 0 0 2024-09-18T12:51:13.497 INFO:tasks.workunit.client.1.smithi136.stdout:1/369: creat d2/f78 x:0 0 0 2024-09-18T12:51:13.497 INFO:tasks.workunit.client.1.smithi136.stdout:1/370: creat d2/d5/d11/d2e/f79 x:0 0 0 2024-09-18T12:51:13.497 INFO:tasks.workunit.client.1.smithi136.stdout:9/438: creat d6/df/d75/f98 x:0 0 0 2024-09-18T12:51:13.498 INFO:tasks.workunit.client.1.smithi136.stdout:9/439: fdatasync d6/df/d75/f98 0 2024-09-18T12:51:13.499 INFO:tasks.workunit.client.1.smithi136.stdout:4/366: dwrite d0/f1 [4194304,4194304] 0 2024-09-18T12:51:13.501 INFO:tasks.workunit.client.1.smithi136.stdout:5/503: truncate d5/d1a/d30/f5b 2564434 0 2024-09-18T12:51:13.501 INFO:tasks.workunit.client.1.smithi136.stdout:5/504: chown d5/d1a/f3a 0 1 2024-09-18T12:51:13.505 INFO:tasks.workunit.client.1.smithi136.stdout:2/450: unlink d5/d7/f3e 0 2024-09-18T12:51:13.507 INFO:tasks.workunit.client.1.smithi136.stdout:1/371: symlink d2/d5/d11/l7a 0 2024-09-18T12:51:13.507 INFO:tasks.workunit.client.1.smithi136.stdout:1/372: chown d2/d5 1897 1 2024-09-18T12:51:13.508 INFO:tasks.workunit.client.1.smithi136.stdout:9/440: truncate d6/da/d3d/d4d/d91/d25/f31 3650188 0 2024-09-18T12:51:13.509 INFO:tasks.workunit.client.1.smithi136.stdout:1/373: dread d2/d5/d2b/d34/f4b [0,4194304] 0 2024-09-18T12:51:13.512 INFO:tasks.workunit.client.1.smithi136.stdout:5/505: mknod d5/c96 0 2024-09-18T12:51:13.517 INFO:tasks.workunit.client.1.smithi136.stdout:9/441: mknod d6/df/d75/c99 0 2024-09-18T12:51:13.517 INFO:tasks.workunit.client.1.smithi136.stdout:9/442: dread - d6/df/d75/f98 zero size 2024-09-18T12:51:13.517 INFO:tasks.workunit.client.1.smithi136.stdout:9/443: chown d6/da/d3d/d4d/d91/f16 3186319 1 2024-09-18T12:51:13.517 INFO:tasks.workunit.client.1.smithi136.stdout:9/444: readlink d6/d59/l52 0 2024-09-18T12:51:13.518 INFO:tasks.workunit.client.1.smithi136.stdout:4/367: getdents d0/d13 0 2024-09-18T12:51:13.518 INFO:tasks.workunit.client.1.smithi136.stdout:4/368: dread - d0/f6a zero size 2024-09-18T12:51:13.519 INFO:tasks.workunit.client.1.smithi136.stdout:8/543: rename d9/d18/d34/d3d/d47/d65/d6b to d9/d14/d1a/d2b/d42/da4/db9/dc0 0 2024-09-18T12:51:13.519 INFO:tasks.workunit.client.1.smithi136.stdout:8/544: write d9/d14/f79 [1634131,110229] 0 2024-09-18T12:51:13.520 INFO:tasks.workunit.client.1.smithi136.stdout:8/545: readlink d9/d14/d1a/d2b/l30 0 2024-09-18T12:51:13.521 INFO:tasks.workunit.client.1.smithi136.stdout:2/451: getdents d5 0 2024-09-18T12:51:13.521 INFO:tasks.workunit.client.1.smithi136.stdout:2/452: chown d5/d7/f1e 4329814 1 2024-09-18T12:51:13.521 INFO:tasks.workunit.client.1.smithi136.stdout:2/453: stat d5/d7/d17 0 2024-09-18T12:51:13.523 INFO:tasks.workunit.client.1.smithi136.stdout:9/445: rename d6/d59/c88 to d6/df/c9a 0 2024-09-18T12:51:13.526 INFO:tasks.workunit.client.1.smithi136.stdout:8/546: rmdir d9/d14/d1a/dae 0 2024-09-18T12:51:13.526 INFO:tasks.workunit.client.1.smithi136.stdout:1/374: dwrite d2/f6f [0,4194304] 0 2024-09-18T12:51:13.527 INFO:tasks.workunit.client.1.smithi136.stdout:9/446: symlink d6/df/l9b 0 2024-09-18T12:51:13.527 INFO:tasks.workunit.client.1.smithi136.stdout:9/447: write d6/df/d23/f66 [1121453,70262] 0 2024-09-18T12:51:13.529 INFO:tasks.workunit.client.1.smithi136.stdout:5/506: dread d5/d1a/d30/f5b [0,4194304] 0 2024-09-18T12:51:13.529 INFO:tasks.workunit.client.1.smithi136.stdout:8/547: rename d9/f1e to d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 0 2024-09-18T12:51:13.531 INFO:tasks.workunit.client.1.smithi136.stdout:4/369: write d0/f15 [2465554,83200] 0 2024-09-18T12:51:13.531 INFO:tasks.workunit.client.1.smithi136.stdout:2/454: dread d5/d25/f2e [0,4194304] 0 2024-09-18T12:51:13.533 INFO:tasks.workunit.client.1.smithi136.stdout:1/375: chown d2/lf 321 1 2024-09-18T12:51:13.535 INFO:tasks.workunit.client.1.smithi136.stdout:8/548: stat d9/d14/d1a/d7f/cb2 0 2024-09-18T12:51:13.536 INFO:tasks.workunit.client.1.smithi136.stdout:4/370: symlink d0/d45/d67/l6b 0 2024-09-18T12:51:13.538 INFO:tasks.workunit.client.1.smithi136.stdout:5/507: write d5/d1a/d2d/d34/f35 [461920,118611] 0 2024-09-18T12:51:13.538 INFO:tasks.workunit.client.1.smithi136.stdout:2/455: creat d5/d25/d43/f89 x:0 0 0 2024-09-18T12:51:13.539 INFO:tasks.workunit.client.1.smithi136.stdout:1/376: truncate d2/d5/d11/d2e/d4c/f1f 3165403 0 2024-09-18T12:51:13.540 INFO:tasks.workunit.client.1.smithi136.stdout:8/549: getdents d9/d14/d1a/d2b/d42/d6e/d75/db4 0 2024-09-18T12:51:13.542 INFO:tasks.workunit.client.1.smithi136.stdout:4/371: creat d0/d13/f6c x:0 0 0 2024-09-18T12:51:13.544 INFO:tasks.workunit.client.1.smithi136.stdout:5/508: mknod d5/d1a/d2d/d3f/c97 0 2024-09-18T12:51:13.547 INFO:tasks.workunit.client.1.smithi136.stdout:2/456: creat d5/f8a x:0 0 0 2024-09-18T12:51:13.547 INFO:tasks.workunit.client.1.smithi136.stdout:4/372: rename d0/l3f to d0/d3/d54/l6d 0 2024-09-18T12:51:13.550 INFO:tasks.workunit.client.1.smithi136.stdout:2/457: truncate d5/d7/fe 1366848 0 2024-09-18T12:51:13.555 INFO:tasks.workunit.client.1.smithi136.stdout:9/448: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:51:13.559 INFO:tasks.workunit.client.1.smithi136.stdout:9/449: mknod d6/df/d23/d2b/c9c 0 2024-09-18T12:51:13.561 INFO:tasks.workunit.client.1.smithi136.stdout:2/458: dread d5/d7/f3f [0,4194304] 0 2024-09-18T12:51:13.565 INFO:tasks.workunit.client.1.smithi136.stdout:1/377: dwrite d2/d5/d11/d2e/f6b [0,4194304] 0 2024-09-18T12:51:13.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/378: dread - d2/d5/d11/f71 zero size 2024-09-18T12:51:13.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/379: stat d2/f5b 0 2024-09-18T12:51:13.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/380: truncate d2/f16 1498415 0 2024-09-18T12:51:13.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/381: fsync d2/d5/d11/f71 0 2024-09-18T12:51:13.566 INFO:tasks.workunit.client.1.smithi136.stdout:8/550: dwrite d9/d14/d1a/d2b/d42/d6e/f84 [0,4194304] 0 2024-09-18T12:51:13.569 INFO:tasks.workunit.client.1.smithi136.stdout:5/509: dwrite d5/d1a/d4a/f77 [0,4194304] 0 2024-09-18T12:51:13.574 INFO:tasks.workunit.client.1.smithi136.stdout:2/459: write d5/d25/f36 [3328704,88993] 0 2024-09-18T12:51:13.574 INFO:tasks.workunit.client.1.smithi136.stdout:2/460: chown d5/d4a/d64 53168 1 2024-09-18T12:51:13.574 INFO:tasks.workunit.client.1.smithi136.stdout:2/461: stat d5/d7/d17/f47 0 2024-09-18T12:51:13.579 INFO:tasks.workunit.client.1.smithi136.stdout:8/551: read d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 [3863852,41806] 0 2024-09-18T12:51:13.580 INFO:tasks.workunit.client.1.smithi136.stdout:9/450: dwrite d6/da/d3d/f7b [0,4194304] 0 2024-09-18T12:51:13.580 INFO:tasks.workunit.client.1.smithi136.stdout:9/451: creat d6/da/d3d/d4d/f9d x:0 0 0 2024-09-18T12:51:13.581 INFO:tasks.workunit.client.1.smithi136.stdout:2/462: dread f3 [0,4194304] 0 2024-09-18T12:51:13.584 INFO:tasks.workunit.client.1.smithi136.stdout:9/452: mknod d6/df/d23/d2b/d79/d53/c9e 0 2024-09-18T12:51:13.593 INFO:tasks.workunit.client.1.smithi136.stdout:2/463: read d5/d7/f1e [1344678,49676] 0 2024-09-18T12:51:13.594 INFO:tasks.workunit.client.1.smithi136.stdout:2/464: creat d5/d7/f8b x:0 0 0 2024-09-18T12:51:13.599 INFO:tasks.workunit.client.1.smithi136.stdout:1/382: dwrite d2/d5/d9/d23/d50/f57 [0,4194304] 0 2024-09-18T12:51:13.601 INFO:tasks.workunit.client.1.smithi136.stdout:5/510: dwrite d5/f18 [0,4194304] 0 2024-09-18T12:51:13.601 INFO:tasks.workunit.client.1.smithi136.stdout:5/511: stat d5/d1a/d2d/d34/d88/f75 0 2024-09-18T12:51:13.602 INFO:tasks.workunit.client.1.smithi136.stdout:8/552: dwrite d9/d18/f5a [0,4194304] 0 2024-09-18T12:51:13.602 INFO:tasks.workunit.client.1.smithi136.stdout:9/453: dwrite d6/f2d [0,4194304] 0 2024-09-18T12:51:13.602 INFO:tasks.workunit.client.1.smithi136.stdout:6/435: sync 2024-09-18T12:51:13.603 INFO:tasks.workunit.client.1.smithi136.stdout:3/454: sync 2024-09-18T12:51:13.603 INFO:tasks.workunit.client.1.smithi136.stdout:0/439: sync 2024-09-18T12:51:13.603 INFO:tasks.workunit.client.1.smithi136.stdout:6/436: fsync d8/f6c 0 2024-09-18T12:51:13.603 INFO:tasks.workunit.client.1.smithi136.stdout:6/437: write d8/d9/d3c/d4a/f53 [448042,64155] 0 2024-09-18T12:51:13.603 INFO:tasks.workunit.client.1.smithi136.stdout:6/438: truncate d8/f6c 977379 0 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:0/193: sync 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:6/141: sync 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:5/180: sync 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:5/181: dread - d2/d14/d33/d37/d3b/f38 zero size 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:5/182: chown d2/d14/d33/d37/d3b/d18/d20/f22 7625 1 2024-09-18T12:51:13.683 INFO:tasks.workunit.client.0.smithi081.stdout:0/194: creat d7/d9/f45 x:0 0 0 2024-09-18T12:51:13.684 INFO:tasks.workunit.client.0.smithi081.stdout:5/183: symlink d2/d14/d33/d37/d3b/d2a/l3e 0 2024-09-18T12:51:13.684 INFO:tasks.workunit.client.0.smithi081.stdout:0/195: mknod d7/d9/d12/d2b/c46 0 2024-09-18T12:51:13.685 INFO:tasks.workunit.client.0.smithi081.stdout:0/196: readlink d7/l8 0 2024-09-18T12:51:13.685 INFO:tasks.workunit.client.0.smithi081.stdout:5/184: rmdir d2 39 2024-09-18T12:51:13.686 INFO:tasks.workunit.client.0.smithi081.stdout:0/197: dread d7/d13/f16 [4194304,4194304] 0 2024-09-18T12:51:13.686 INFO:tasks.workunit.client.0.smithi081.stdout:0/198: fdatasync d7/f21 0 2024-09-18T12:51:13.686 INFO:tasks.workunit.client.0.smithi081.stdout:0/199: fdatasync d7/f3c 0 2024-09-18T12:51:13.686 INFO:tasks.workunit.client.0.smithi081.stdout:5/185: mknod d2/d14/d1d/d1a/c3f 0 2024-09-18T12:51:13.688 INFO:tasks.workunit.client.0.smithi081.stdout:5/186: unlink d2/d14/d1d/d1a/f2e 0 2024-09-18T12:51:13.688 INFO:tasks.workunit.client.0.smithi081.stdout:5/187: write d2/dd/f21 [2207695,62946] 0 2024-09-18T12:51:13.689 INFO:tasks.workunit.client.0.smithi081.stdout:5/188: truncate d2/dd/f29 695883 0 2024-09-18T12:51:13.689 INFO:tasks.workunit.client.0.smithi081.stdout:5/189: write d2/d14/d33/d37/d3b/d18/d20/f30 [551758,21817] 0 2024-09-18T12:51:13.696 INFO:tasks.workunit.client.1.smithi136.stdout:2/465: mknod d5/d7/d3b/c8c 0 2024-09-18T12:51:13.697 INFO:tasks.workunit.client.1.smithi136.stdout:1/383: rename d2 to d2/d5/d9/d7b 22 2024-09-18T12:51:13.701 INFO:tasks.workunit.client.1.smithi136.stdout:9/454: symlink d6/da/d3d/d4d/d91/d25/d55/l9f 0 2024-09-18T12:51:13.702 INFO:tasks.workunit.client.1.smithi136.stdout:3/455: mknod d3/d14/d17/c9e 0 2024-09-18T12:51:13.703 INFO:tasks.workunit.client.1.smithi136.stdout:6/439: getdents d8/d9/de/d1c 0 2024-09-18T12:51:13.707 INFO:tasks.workunit.client.1.smithi136.stdout:8/553: rename d9/d14/l17 to d9/d18/d34/d88/lc2 0 2024-09-18T12:51:13.708 INFO:tasks.workunit.client.1.smithi136.stdout:9/455: truncate d6/df/d23/f66 203977 0 2024-09-18T12:51:13.708 INFO:tasks.workunit.client.1.smithi136.stdout:9/456: write d6/d59/f68 [409075,99132] 0 2024-09-18T12:51:13.709 INFO:tasks.workunit.client.1.smithi136.stdout:3/456: creat d3/d5/f9f x:0 0 0 2024-09-18T12:51:13.709 INFO:tasks.workunit.client.1.smithi136.stdout:3/457: fdatasync d3/d10/d4a/f8b 0 2024-09-18T12:51:13.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/466: read d5/f1c [3760144,45648] 0 2024-09-18T12:51:13.709 INFO:tasks.workunit.client.1.smithi136.stdout:7/559: sync 2024-09-18T12:51:13.709 INFO:tasks.workunit.client.1.smithi136.stdout:2/467: write d5/d7/fe [1510290,120413] 0 2024-09-18T12:51:13.711 INFO:tasks.workunit.client.1.smithi136.stdout:1/384: rename d2/d5/c26 to d2/d5/d2b/d34/c7c 0 2024-09-18T12:51:13.712 INFO:tasks.workunit.client.1.smithi136.stdout:1/385: readlink d2/d5/d2b/d34/d5c/l76 0 2024-09-18T12:51:13.712 INFO:tasks.workunit.client.1.smithi136.stdout:8/554: creat d9/d14/d1a/d2b/d42/d9e/fc3 x:0 0 0 2024-09-18T12:51:13.713 INFO:tasks.workunit.client.1.smithi136.stdout:9/457: symlink d6/db/la0 0 2024-09-18T12:51:13.716 INFO:tasks.workunit.client.1.smithi136.stdout:6/440: rmdir d8/d9 39 2024-09-18T12:51:13.716 INFO:tasks.workunit.client.1.smithi136.stdout:6/441: getdents d8/d9/de/d1c 0 2024-09-18T12:51:13.718 INFO:tasks.workunit.client.1.smithi136.stdout:1/386: mknod d2/d5/d11/d1b/c7d 0 2024-09-18T12:51:13.719 INFO:tasks.workunit.client.1.smithi136.stdout:8/555: creat d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 x:0 0 0 2024-09-18T12:51:13.720 INFO:tasks.workunit.client.1.smithi136.stdout:1/387: symlink d2/d5/d2b/d34/l7e 0 2024-09-18T12:51:13.721 INFO:tasks.workunit.client.1.smithi136.stdout:2/468: dread d5/d7/d11/f31 [0,4194304] 0 2024-09-18T12:51:13.723 INFO:tasks.workunit.client.1.smithi136.stdout:2/469: unlink d5/d25/d2d/c59 0 2024-09-18T12:51:13.723 INFO:tasks.workunit.client.1.smithi136.stdout:2/470: write d5/d25/d43/f52 [2728778,70958] 0 2024-09-18T12:51:13.725 INFO:tasks.workunit.client.1.smithi136.stdout:2/471: creat d5/d25/f8d x:0 0 0 2024-09-18T12:51:13.725 INFO:tasks.workunit.client.1.smithi136.stdout:2/472: creat d5/d25/d43/d74/f8e x:0 0 0 2024-09-18T12:51:13.725 INFO:tasks.workunit.client.1.smithi136.stdout:2/473: chown d5/d7/d11/d34/c5f 540 1 2024-09-18T12:51:13.729 INFO:tasks.workunit.client.1.smithi136.stdout:1/388: dread d2/d5/d11/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:13.730 INFO:tasks.workunit.client.1.smithi136.stdout:1/389: symlink d2/d5/d2b/d34/l7f 0 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:1/390: rename d2/d5/d11/d1b/f72 to d2/d5/d2b/f80 0 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:1/391: chown d2/d5/d11/d1b/c7d 28189518 1 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:1/392: creat d2/d5/d2b/f81 x:0 0 0 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:9/458: dwrite d6/d13/f22 [0,4194304] 0 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:9/459: fsync d6/df/d23/d2b/d79/d53/f54 0 2024-09-18T12:51:13.732 INFO:tasks.workunit.client.1.smithi136.stdout:9/460: read - d6/df/d23/d2b/f43 zero size 2024-09-18T12:51:13.734 INFO:tasks.workunit.client.1.smithi136.stdout:1/393: mknod d2/d5/d2b/c82 0 2024-09-18T12:51:13.737 INFO:tasks.workunit.client.1.smithi136.stdout:9/461: rename d6/f7 to d6/df/d23/fa1 0 2024-09-18T12:51:13.737 INFO:tasks.workunit.client.1.smithi136.stdout:9/462: creat d6/da/d3d/d4d/fa2 x:0 0 0 2024-09-18T12:51:13.738 INFO:tasks.workunit.client.1.smithi136.stdout:9/463: read d6/d59/f35 [918947,58072] 0 2024-09-18T12:51:13.741 INFO:tasks.workunit.client.1.smithi136.stdout:1/394: dread d2/d5/d11/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:13.742 INFO:tasks.workunit.client.1.smithi136.stdout:9/464: creat d6/da/d3d/d4d/d91/d38/fa3 x:0 0 0 2024-09-18T12:51:13.742 INFO:tasks.workunit.client.1.smithi136.stdout:8/556: dwrite d9/d14/d1a/d7f/fa6 [0,4194304] 0 2024-09-18T12:51:13.743 INFO:tasks.workunit.client.1.smithi136.stdout:1/395: mknod d2/d5/d11/d2e/c83 0 2024-09-18T12:51:13.743 INFO:tasks.workunit.client.1.smithi136.stdout:1/396: fsync d2/d5/f1e 0 2024-09-18T12:51:13.743 INFO:tasks.workunit.client.1.smithi136.stdout:1/397: dread - d2/d5/d11/f71 zero size 2024-09-18T12:51:13.746 INFO:tasks.workunit.client.1.smithi136.stdout:1/398: rename d2/d5/d9/f32 to d2/d5/d11/d2e/d4c/f84 0 2024-09-18T12:51:13.746 INFO:tasks.workunit.client.1.smithi136.stdout:9/465: dread d6/df/d23/d2b/d79/d53/f54 [0,4194304] 0 2024-09-18T12:51:13.747 INFO:tasks.workunit.client.1.smithi136.stdout:1/399: rmdir d2/d5/d2b/d34/d5c 39 2024-09-18T12:51:13.753 INFO:tasks.workunit.client.0.smithi081.stdout:0/200: dwrite d7/d9/f25 [0,4194304] 0 2024-09-18T12:51:13.756 INFO:tasks.workunit.client.1.smithi136.stdout:8/557: write d9/d14/d1a/d2b/f58 [1421439,123111] 0 2024-09-18T12:51:13.757 INFO:tasks.workunit.client.0.smithi081.stdout:6/142: dwrite d4/fa [0,4194304] 0 2024-09-18T12:51:13.757 INFO:tasks.workunit.client.0.smithi081.stdout:6/143: chown d4/d6/l22 53376 1 2024-09-18T12:51:13.762 INFO:tasks.workunit.client.0.smithi081.stdout:6/144: mknod d4/d12/d1c/c29 0 2024-09-18T12:51:13.764 INFO:tasks.workunit.client.0.smithi081.stdout:6/145: mkdir d4/d12/d28/d2a 0 2024-09-18T12:51:13.764 INFO:tasks.workunit.client.0.smithi081.stdout:6/146: chown d4/d6/fd 80 1 2024-09-18T12:51:13.766 INFO:tasks.workunit.client.0.smithi081.stdout:6/147: mknod d4/d12/d1c/c2b 0 2024-09-18T12:51:13.766 INFO:tasks.workunit.client.1.smithi136.stdout:5/512: dwrite d5/d1a/f3a [0,4194304] 0 2024-09-18T12:51:13.771 INFO:tasks.workunit.client.1.smithi136.stdout:8/558: getdents d9/d14 0 2024-09-18T12:51:13.773 INFO:tasks.workunit.client.1.smithi136.stdout:3/458: dread d3/d14/d22/d2c/d3d/f80 [0,4194304] 0 2024-09-18T12:51:13.773 INFO:tasks.workunit.client.1.smithi136.stdout:3/459: fdatasync d3/d14/f40 0 2024-09-18T12:51:13.774 INFO:tasks.workunit.client.1.smithi136.stdout:8/559: mkdir d9/d18/dc5 0 2024-09-18T12:51:13.776 INFO:tasks.workunit.client.1.smithi136.stdout:3/460: link d3/d14/d22/d2c/d3d/f80 d3/d10/d4a/d51/fa0 0 2024-09-18T12:51:13.776 INFO:tasks.workunit.client.1.smithi136.stdout:3/461: creat d3/d5/fa1 x:0 0 0 2024-09-18T12:51:13.776 INFO:tasks.workunit.client.1.smithi136.stdout:3/462: stat d3/d14/l5b 0 2024-09-18T12:51:13.777 INFO:tasks.workunit.client.1.smithi136.stdout:8/560: mknod d9/d14/d1a/d7f/d8c/cc6 0 2024-09-18T12:51:13.778 INFO:tasks.workunit.client.0.smithi081.stdout:6/148: dread d4/d6/fc [0,4194304] 0 2024-09-18T12:51:13.780 INFO:tasks.workunit.client.1.smithi136.stdout:3/463: rename d3/d10/f43 to d3/d2b/d6c/fa2 0 2024-09-18T12:51:13.781 INFO:tasks.workunit.client.1.smithi136.stdout:8/561: write d9/d18/d34/d3d/f54 [1309359,118427] 0 2024-09-18T12:51:13.782 INFO:tasks.workunit.client.1.smithi136.stdout:5/513: dread d5/d1a/f3a [0,4194304] 0 2024-09-18T12:51:13.782 INFO:tasks.workunit.client.1.smithi136.stdout:5/514: creat d5/d1a/d4a/d79/f98 x:0 0 0 2024-09-18T12:51:13.782 INFO:tasks.workunit.client.1.smithi136.stdout:8/562: mknod d9/d14/d1a/cc7 0 2024-09-18T12:51:13.783 INFO:tasks.workunit.client.1.smithi136.stdout:5/515: creat d5/d1a/d2d/f99 x:0 0 0 2024-09-18T12:51:13.784 INFO:tasks.workunit.client.1.smithi136.stdout:5/516: creat d5/d1a/d2d/d34/d88/f9a x:0 0 0 2024-09-18T12:51:13.790 INFO:tasks.workunit.client.0.smithi081.stdout:3/215: sync 2024-09-18T12:51:13.791 INFO:tasks.workunit.client.0.smithi081.stdout:6/149: write d4/d12/d1c/f23 [89823,29277] 0 2024-09-18T12:51:13.792 INFO:tasks.workunit.client.1.smithi136.stdout:1/400: dwrite d2/d5/d11/d2e/f79 [0,4194304] 0 2024-09-18T12:51:13.792 INFO:tasks.workunit.client.1.smithi136.stdout:2/474: dwrite d5/d7/d17/f47 [0,4194304] 0 2024-09-18T12:51:13.793 INFO:tasks.workunit.client.1.smithi136.stdout:6/442: dwrite d8/d9/d56/f72 [0,4194304] 0 2024-09-18T12:51:13.793 INFO:tasks.workunit.client.1.smithi136.stdout:6/443: fsync d8/d9/d56/f78 0 2024-09-18T12:51:13.794 INFO:tasks.workunit.client.0.smithi081.stdout:6/150: creat d4/f2c x:0 0 0 2024-09-18T12:51:13.794 INFO:tasks.workunit.client.0.smithi081.stdout:6/151: readlink d4/d12/d1c/l20 0 2024-09-18T12:51:13.794 INFO:tasks.workunit.client.1.smithi136.stdout:3/464: dread d3/d14/f3a [0,4194304] 0 2024-09-18T12:51:13.794 INFO:tasks.workunit.client.1.smithi136.stdout:9/466: dwrite d6/db/d12/d62/f8e [0,4194304] 0 2024-09-18T12:51:13.794 INFO:tasks.workunit.client.1.smithi136.stdout:9/467: dread - d6/da/d3d/f6a zero size 2024-09-18T12:51:13.796 INFO:tasks.workunit.client.0.smithi081.stdout:3/216: rmdir d3/db 39 2024-09-18T12:51:13.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/152: mkdir d4/d12/d28/d2a/d2d 0 2024-09-18T12:51:13.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/153: write f0 [828999,8946] 0 2024-09-18T12:51:13.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/154: chown d4/d6/fc 1584099428 1 2024-09-18T12:51:13.799 INFO:tasks.workunit.client.1.smithi136.stdout:5/517: read d5/d1a/d2d/d34/f42 [1309047,37440] 0 2024-09-18T12:51:13.799 INFO:tasks.workunit.client.1.smithi136.stdout:5/518: fdatasync d5/d1a/d30/f80 0 2024-09-18T12:51:13.800 INFO:tasks.workunit.client.1.smithi136.stdout:6/444: mkdir d8/d9/de/d60/d94 0 2024-09-18T12:51:13.800 INFO:tasks.workunit.client.1.smithi136.stdout:6/445: write d8/d9/de/f40 [880149,93681] 0 2024-09-18T12:51:13.801 INFO:tasks.workunit.client.0.smithi081.stdout:3/217: rename d3/d23/f3e to d3/db/df/d29/d13/d17/f49 0 2024-09-18T12:51:13.801 INFO:tasks.workunit.client.0.smithi081.stdout:5/190: dwrite d2/dd/f21 [0,4194304] 0 2024-09-18T12:51:13.802 INFO:tasks.workunit.client.1.smithi136.stdout:9/468: symlink d6/da/d3d/d4d/d91/d25/d55/la4 0 2024-09-18T12:51:13.803 INFO:tasks.workunit.client.0.smithi081.stdout:6/155: symlink d4/d6/l2e 0 2024-09-18T12:51:13.803 INFO:tasks.workunit.client.1.smithi136.stdout:1/401: getdents d2/d5/d11/d1b 0 2024-09-18T12:51:13.803 INFO:tasks.workunit.client.1.smithi136.stdout:1/402: readlink d2/d5/d11/d1b/l21 0 2024-09-18T12:51:13.804 INFO:tasks.workunit.client.1.smithi136.stdout:8/563: dwrite d9/d14/d1a/d7f/fa0 [0,4194304] 0 2024-09-18T12:51:13.805 INFO:tasks.workunit.client.0.smithi081.stdout:5/191: dread d2/d14/d33/d37/d3b/d18/d20/f30 [0,4194304] 0 2024-09-18T12:51:13.805 INFO:tasks.workunit.client.1.smithi136.stdout:2/475: dread d5/d7/d17/d48/f4e [0,4194304] 0 2024-09-18T12:51:13.806 INFO:tasks.workunit.client.1.smithi136.stdout:2/476: readlink d5/d7/d17/l57 0 2024-09-18T12:51:13.806 INFO:tasks.workunit.client.1.smithi136.stdout:6/446: rename d8/dc/l1b to d8/d9/de/d60/l95 0 2024-09-18T12:51:13.806 INFO:tasks.workunit.client.0.smithi081.stdout:6/156: dread d4/d6/fb [0,4194304] 0 2024-09-18T12:51:13.808 INFO:tasks.workunit.client.0.smithi081.stdout:5/192: getdents d2/dd 0 2024-09-18T12:51:13.808 INFO:tasks.workunit.client.1.smithi136.stdout:9/469: unlink d6/df/d23/f66 0 2024-09-18T12:51:13.808 INFO:tasks.workunit.client.1.smithi136.stdout:9/470: write d6/da/d3d/d4d/d91/d25/d55/f5b [1554887,124811] 0 2024-09-18T12:51:13.809 INFO:tasks.workunit.client.1.smithi136.stdout:8/564: dread d9/d18/d34/d3d/f54 [0,4194304] 0 2024-09-18T12:51:13.810 INFO:tasks.workunit.client.1.smithi136.stdout:1/403: truncate d2/f16 212348 0 2024-09-18T12:51:13.810 INFO:tasks.workunit.client.1.smithi136.stdout:1/404: chown d2/d5/d11/c18 75 1 2024-09-18T12:51:13.815 INFO:tasks.workunit.client.1.smithi136.stdout:6/447: mkdir d8/d9/d56/d96 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/471: mknod d6/da/d3d/d4d/ca5 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/472: write d6/d59/f61 [930397,115143] 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/473: fdatasync d6/db/d12/f37 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/474: dread - d6/db/d12/d62/f74 zero size 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/475: chown d6/da/d3d/d4d/d91/d25/f27 81359 1 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/476: stat d6/da 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/477: chown d6/df/d23/l77 6 1 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/478: truncate d6/da/d3d/d4d/d91/d38/f81 681715 0 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/479: chown d6/d59/f68 49858 1 2024-09-18T12:51:13.818 INFO:tasks.workunit.client.1.smithi136.stdout:9/480: chown d6/db/d12/f33 25 1 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:2/477: dread d5/d7/fe [0,4194304] 0 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:1/405: dread - d2/d5/d11/d2e/d4c/f46 zero size 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:2/478: dread d5/d7/d11/d34/f50 [0,4194304] 0 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:2/479: dread - d5/d7/d17/f6b zero size 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:2/480: fsync d5/d7/d3b/f51 0 2024-09-18T12:51:13.819 INFO:tasks.workunit.client.1.smithi136.stdout:2/481: dread - d5/d7/f8b zero size 2024-09-18T12:51:13.820 INFO:tasks.workunit.client.1.smithi136.stdout:2/482: creat d5/d25/d2d/f8f x:0 0 0 2024-09-18T12:51:13.820 INFO:tasks.workunit.client.1.smithi136.stdout:1/406: unlink d2/d5/d2b/c44 0 2024-09-18T12:51:13.821 INFO:tasks.workunit.client.1.smithi136.stdout:8/565: creat d9/d18/d34/d3d/d47/d65/d93/d96/fc8 x:0 0 0 2024-09-18T12:51:13.821 INFO:tasks.workunit.client.1.smithi136.stdout:8/566: write d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 [3516153,32817] 0 2024-09-18T12:51:13.822 INFO:tasks.workunit.client.1.smithi136.stdout:4/373: sync 2024-09-18T12:51:13.824 INFO:tasks.workunit.client.1.smithi136.stdout:0/440: sync 2024-09-18T12:51:13.824 INFO:tasks.workunit.client.1.smithi136.stdout:0/441: chown d1/d17/d6d/d81/d35/d54/f89 1641890 1 2024-09-18T12:51:13.825 INFO:tasks.workunit.client.1.smithi136.stdout:2/483: symlink d5/d7/d11/l90 0 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:6/157: dread d4/f18 [0,4194304] 0 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/218: dwrite d3/db/d1b/f34 [0,4194304] 0 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/219: chown d3/db/df/d29/d13 1650297 1 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:6/158: getdents d4/d12/d28/d2a/d2d 0 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/220: chown d3/db/df/d29/d13/f14 13200303 1 2024-09-18T12:51:13.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/221: chown d3/db/dc 213 1 2024-09-18T12:51:13.827 INFO:tasks.workunit.client.1.smithi136.stdout:8/567: getdents d9/d14/d1a/d7f 0 2024-09-18T12:51:13.827 INFO:tasks.workunit.client.1.smithi136.stdout:8/568: readlink d9/d18/d34/l39 0 2024-09-18T12:51:13.829 INFO:tasks.workunit.client.1.smithi136.stdout:8/569: truncate d9/d14/f1d 1395444 0 2024-09-18T12:51:13.833 INFO:tasks.workunit.client.1.smithi136.stdout:5/519: dwrite d5/f1c [0,4194304] 0 2024-09-18T12:51:13.833 INFO:tasks.workunit.client.1.smithi136.stdout:8/570: rename d9/l2a to d9/d18/lc9 0 2024-09-18T12:51:13.834 INFO:tasks.workunit.client.1.smithi136.stdout:8/571: truncate d9/d14/d1a/d2b/f51 4765023 0 2024-09-18T12:51:13.834 INFO:tasks.workunit.client.1.smithi136.stdout:8/572: chown d9/d18/d34/d3d/d47/d65/c8e 43639 1 2024-09-18T12:51:13.835 INFO:tasks.workunit.client.1.smithi136.stdout:1/407: write d2/d5/d11/d1b/f25 [3401666,25491] 0 2024-09-18T12:51:13.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/193: dwrite d2/d14/d33/d37/d3b/d18/f25 [0,4194304] 0 2024-09-18T12:51:13.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/194: creat d2/d14/d31/f40 x:0 0 0 2024-09-18T12:51:13.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/195: write d2/ff [10224183,116560] 0 2024-09-18T12:51:13.839 INFO:tasks.workunit.client.0.smithi081.stdout:5/196: stat d2/d14/d31/f3c 0 2024-09-18T12:51:13.839 INFO:tasks.workunit.client.1.smithi136.stdout:1/408: read d2/d5/d9/f1a [1320451,36865] 0 2024-09-18T12:51:13.842 INFO:tasks.workunit.client.0.smithi081.stdout:6/159: dread d4/d6/fd [0,4194304] 0 2024-09-18T12:51:13.843 INFO:tasks.workunit.client.1.smithi136.stdout:8/573: symlink d9/d18/d34/d88/lca 0 2024-09-18T12:51:13.843 INFO:tasks.workunit.client.1.smithi136.stdout:8/574: chown d9/d18/dc5 449 1 2024-09-18T12:51:13.843 INFO:tasks.workunit.client.1.smithi136.stdout:8/575: write d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 [5229751,85410] 0 2024-09-18T12:51:13.845 INFO:tasks.workunit.client.0.smithi081.stdout:5/197: symlink d2/d14/d1d/d1a/l41 0 2024-09-18T12:51:13.845 INFO:tasks.workunit.client.0.smithi081.stdout:5/198: creat d2/d14/d31/f42 x:0 0 0 2024-09-18T12:51:13.846 INFO:tasks.workunit.client.0.smithi081.stdout:3/222: read d3/db/df/d29/d13/d17/f49 [2654013,126108] 0 2024-09-18T12:51:13.847 INFO:tasks.workunit.client.0.smithi081.stdout:6/160: rename d4/d6/l22 to d4/d12/d1c/l2f 0 2024-09-18T12:51:13.847 INFO:tasks.workunit.client.1.smithi136.stdout:5/520: read d5/d1a/d30/f4c [5008350,21998] 0 2024-09-18T12:51:13.849 INFO:tasks.workunit.client.0.smithi081.stdout:3/223: mknod d3/db/df/d29/d13/d3c/c4a 0 2024-09-18T12:51:13.850 INFO:tasks.workunit.client.1.smithi136.stdout:4/374: dwrite d0/d3/f53 [0,4194304] 0 2024-09-18T12:51:13.850 INFO:tasks.workunit.client.1.smithi136.stdout:8/576: truncate d9/d14/d1a/f4a 6505961 0 2024-09-18T12:51:13.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/161: unlink d4/f2c 0 2024-09-18T12:51:13.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/162: chown d4/d12/d1c/l2f 67 1 2024-09-18T12:51:13.851 INFO:tasks.workunit.client.1.smithi136.stdout:1/409: write d2/f6f [1073635,75335] 0 2024-09-18T12:51:13.851 INFO:tasks.workunit.client.1.smithi136.stdout:1/410: dread - d2/d5/f5a zero size 2024-09-18T12:51:13.851 INFO:tasks.workunit.client.1.smithi136.stdout:1/411: fdatasync d2/f3c 0 2024-09-18T12:51:13.852 INFO:tasks.workunit.client.1.smithi136.stdout:0/442: dwrite d1/d17/f6b [0,4194304] 0 2024-09-18T12:51:13.852 INFO:tasks.workunit.client.1.smithi136.stdout:5/521: mkdir d5/d1a/d2d/d34/d4e/d9b 0 2024-09-18T12:51:13.857 INFO:tasks.workunit.client.1.smithi136.stdout:4/375: mknod d0/d25/c6e 0 2024-09-18T12:51:13.858 INFO:tasks.workunit.client.1.smithi136.stdout:8/577: rmdir d9/d14/d1a/d7f/d8c 39 2024-09-18T12:51:13.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/412: dread d2/f6f [0,4194304] 0 2024-09-18T12:51:13.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/413: write d2/d5/d11/d2e/f33 [217167,62835] 0 2024-09-18T12:51:13.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/414: write d2/d5/d11/f58 [4928474,23432] 0 2024-09-18T12:51:13.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/415: fsync d2/d5/d9/d23/d50/f6d 0 2024-09-18T12:51:13.859 INFO:tasks.workunit.client.0.smithi081.stdout:5/199: read d2/d14/d33/d37/d3b/d18/f35 [161643,124261] 0 2024-09-18T12:51:13.860 INFO:tasks.workunit.client.1.smithi136.stdout:6/448: dwrite d8/d9/de/f40 [0,4194304] 0 2024-09-18T12:51:13.860 INFO:tasks.workunit.client.1.smithi136.stdout:6/449: chown d8/d9/de/d1c/l2a 303954114 1 2024-09-18T12:51:13.863 INFO:tasks.workunit.client.0.smithi081.stdout:6/163: dread d4/d6/f27 [0,4194304] 0 2024-09-18T12:51:13.864 INFO:tasks.workunit.client.1.smithi136.stdout:5/522: link f2 d5/d1a/d2d/d34/d4e/d9b/f9c 0 2024-09-18T12:51:13.864 INFO:tasks.workunit.client.0.smithi081.stdout:5/200: dread d2/fe [0,4194304] 0 2024-09-18T12:51:13.865 INFO:tasks.workunit.client.1.smithi136.stdout:8/578: mkdir d9/d14/d1a/d7f/d8c/dcb 0 2024-09-18T12:51:13.866 INFO:tasks.workunit.client.0.smithi081.stdout:6/164: dread d4/f21 [0,4194304] 0 2024-09-18T12:51:13.866 INFO:tasks.workunit.client.0.smithi081.stdout:6/165: fsync d4/f18 0 2024-09-18T12:51:13.866 INFO:tasks.workunit.client.0.smithi081.stdout:5/201: creat d2/d14/d33/d37/d3b/f43 x:0 0 0 2024-09-18T12:51:13.868 INFO:tasks.workunit.client.1.smithi136.stdout:1/416: unlink d2/d5/d11/d2e/d4c/f84 0 2024-09-18T12:51:13.868 INFO:tasks.workunit.client.1.smithi136.stdout:1/417: readlink d2/d5/d11/l7a 0 2024-09-18T12:51:13.868 INFO:tasks.workunit.client.1.smithi136.stdout:0/443: getdents d1/db/d76 0 2024-09-18T12:51:13.870 INFO:tasks.workunit.client.1.smithi136.stdout:4/376: getdents d0/d45 0 2024-09-18T12:51:13.870 INFO:tasks.workunit.client.1.smithi136.stdout:4/377: creat d0/d25/f6f x:0 0 0 2024-09-18T12:51:13.872 INFO:tasks.workunit.client.1.smithi136.stdout:8/579: link d9/d14/f11 d9/d18/dc5/fcc 0 2024-09-18T12:51:13.872 INFO:tasks.workunit.client.1.smithi136.stdout:6/450: read d8/f3b [4029013,120933] 0 2024-09-18T12:51:13.873 INFO:tasks.workunit.client.1.smithi136.stdout:6/451: truncate d8/d9/de/d1c/f2d 368577 0 2024-09-18T12:51:13.873 INFO:tasks.workunit.client.1.smithi136.stdout:6/452: dread - d8/d9/d56/f86 zero size 2024-09-18T12:51:13.873 INFO:tasks.workunit.client.1.smithi136.stdout:0/444: truncate d1/d17/d6d/d81/f55 580204 0 2024-09-18T12:51:13.876 INFO:tasks.workunit.client.1.smithi136.stdout:4/378: mknod d0/d45/d67/c70 0 2024-09-18T12:51:13.879 INFO:tasks.workunit.client.0.smithi081.stdout:3/224: dwrite d3/db/dc/d1a/f27 [0,4194304] 0 2024-09-18T12:51:13.879 INFO:tasks.workunit.client.1.smithi136.stdout:0/445: truncate d1/d17/d6d/d81/d35/f4a 571066 0 2024-09-18T12:51:13.880 INFO:tasks.workunit.client.1.smithi136.stdout:5/523: dwrite d5/d1a/d2d/d34/d88/f9a [0,4194304] 0 2024-09-18T12:51:13.880 INFO:tasks.workunit.client.0.smithi081.stdout:3/225: creat d3/db/f4b x:0 0 0 2024-09-18T12:51:13.882 INFO:tasks.workunit.client.1.smithi136.stdout:4/379: mknod d0/d45/c71 0 2024-09-18T12:51:13.882 INFO:tasks.workunit.client.1.smithi136.stdout:4/380: truncate d0/f58 479930 0 2024-09-18T12:51:13.882 INFO:tasks.workunit.client.1.smithi136.stdout:4/381: stat d0/d13/l51 0 2024-09-18T12:51:13.882 INFO:tasks.workunit.client.1.smithi136.stdout:4/382: chown d0/l2b 15672 1 2024-09-18T12:51:13.886 INFO:tasks.workunit.client.1.smithi136.stdout:0/446: mknod d1/c94 0 2024-09-18T12:51:13.887 INFO:tasks.workunit.client.0.smithi081.stdout:5/202: write d2/dd/f10 [3515000,125188] 0 2024-09-18T12:51:13.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/447: mkdir d1/d3/d1a/d95 0 2024-09-18T12:51:13.895 INFO:tasks.workunit.client.1.smithi136.stdout:4/383: dread d0/f4a [0,4194304] 0 2024-09-18T12:51:13.897 INFO:tasks.workunit.client.1.smithi136.stdout:4/384: creat d0/f72 x:0 0 0 2024-09-18T12:51:13.898 INFO:tasks.workunit.client.0.smithi081.stdout:5/203: rename d2/d14/d31 to d2/d14/d33/d37/d3b/d2a/d44 0 2024-09-18T12:51:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:6/166: rmdir d4 39 2024-09-18T12:51:13.901 INFO:tasks.workunit.client.1.smithi136.stdout:4/385: write d0/d2/f12 [1452550,106154] 0 2024-09-18T12:51:13.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/167: rename d4/d6/fc to d4/d12/d28/d2a/d2d/f30 0 2024-09-18T12:51:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:6/168: truncate d4/d6/fb 8682 0 2024-09-18T12:51:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:6/169: mkdir d4/d12/d28/d2a/d2d/d31 0 2024-09-18T12:51:13.907 INFO:tasks.workunit.client.1.smithi136.stdout:1/418: dwrite d2/d5/d9/d23/d50/f6d [0,4194304] 0 2024-09-18T12:51:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:2/209: sync 2024-09-18T12:51:13.909 INFO:tasks.workunit.client.1.smithi136.stdout:8/580: dwrite d9/d14/f63 [0,4194304] 0 2024-09-18T12:51:13.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/524: dwrite d5/f54 [0,4194304] 0 2024-09-18T12:51:13.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/525: chown d5/d1a/d2d/d3f/c97 108787732 1 2024-09-18T12:51:13.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/526: dread - d5/d1a/d2d/f99 zero size 2024-09-18T12:51:13.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/527: write d5/f11 [661926,6886] 0 2024-09-18T12:51:13.910 INFO:tasks.workunit.client.0.smithi081.stdout:3/226: dwrite d3/db/dc/f28 [0,4194304] 0 2024-09-18T12:51:13.913 INFO:tasks.workunit.client.1.smithi136.stdout:0/448: truncate d1/d17/d6d/d81/d35/f4a 1251518 0 2024-09-18T12:51:13.913 INFO:tasks.workunit.client.1.smithi136.stdout:1/419: read d2/d5/d11/f58 [4879205,109200] 0 2024-09-18T12:51:13.915 INFO:tasks.workunit.client.1.smithi136.stdout:5/528: mknod d5/d6b/c9d 0 2024-09-18T12:51:13.915 INFO:tasks.workunit.client.1.smithi136.stdout:5/529: dread - d5/d1a/d4a/d79/f94 zero size 2024-09-18T12:51:13.915 INFO:tasks.workunit.client.1.smithi136.stdout:1/420: chown d2/d5/d9/d23/d50 4 1 2024-09-18T12:51:13.916 INFO:tasks.workunit.client.1.smithi136.stdout:1/421: chown d2/d5/d11/d2e/f31 79 1 2024-09-18T12:51:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:2/210: rmdir d15 39 2024-09-18T12:51:13.916 INFO:tasks.workunit.client.1.smithi136.stdout:6/453: dwrite d8/d9/f34 [0,4194304] 0 2024-09-18T12:51:13.917 INFO:tasks.workunit.client.1.smithi136.stdout:5/530: mkdir d5/d1a/d2d/d34/d4e/d7a/d9e 0 2024-09-18T12:51:13.918 INFO:tasks.workunit.client.0.smithi081.stdout:2/211: creat d15/d16/d20/d31/f3e x:0 0 0 2024-09-18T12:51:13.919 INFO:tasks.workunit.client.1.smithi136.stdout:1/422: mknod d2/d5/d11/c85 0 2024-09-18T12:51:13.919 INFO:tasks.workunit.client.1.smithi136.stdout:1/423: chown d2/d5/d11/d2e/f6b 3 1 2024-09-18T12:51:13.919 INFO:tasks.workunit.client.1.smithi136.stdout:1/424: dread - d2/f42 zero size 2024-09-18T12:51:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:5/204: write d2/d14/f17 [2310758,72012] 0 2024-09-18T12:51:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:5/205: write d2/dd/f29 [763734,71466] 0 2024-09-18T12:51:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:5/206: link d2/d14/f1e d2/d14/d33/d37/d3b/d2a/f45 0 2024-09-18T12:51:13.922 INFO:tasks.workunit.client.1.smithi136.stdout:6/454: truncate d8/dc/f43 156874 0 2024-09-18T12:51:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:5/207: mknod d2/d14/d1d/c46 0 2024-09-18T12:51:13.924 INFO:tasks.workunit.client.1.smithi136.stdout:6/455: mkdir d8/d9/de/d60/d71/d76/d97 0 2024-09-18T12:51:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:5/208: getdents d2/d14/d33/d37/d3b/d16 0 2024-09-18T12:51:13.929 INFO:tasks.workunit.client.0.smithi081.stdout:3/227: dread d3/db/df/d29/f19 [0,4194304] 0 2024-09-18T12:51:13.931 INFO:tasks.workunit.client.0.smithi081.stdout:3/228: creat d3/db/df/d29/d13/f4c x:0 0 0 2024-09-18T12:51:13.931 INFO:tasks.workunit.client.0.smithi081.stdout:3/229: chown d3/db/df/d3b/d47/c3d 15003 1 2024-09-18T12:51:13.936 INFO:tasks.workunit.client.0.smithi081.stdout:6/170: dwrite d4/d12/d28/d2a/d2d/f30 [0,4194304] 0 2024-09-18T12:51:13.937 INFO:tasks.workunit.client.1.smithi136.stdout:1/425: rename d2/d5/d9/d23 to d2/d5/d2b/d34/d86 0 2024-09-18T12:51:13.937 INFO:tasks.workunit.client.1.smithi136.stdout:1/426: chown d2/d5/d2b/d34/d86/f2c 193449 1 2024-09-18T12:51:13.939 INFO:tasks.workunit.client.1.smithi136.stdout:8/581: dwrite d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:13.940 INFO:tasks.workunit.client.1.smithi136.stdout:8/582: readlink d9/d18/d34/d3d/d47/d65/d93/d96/d9b/la5 0 2024-09-18T12:51:13.940 INFO:tasks.workunit.client.1.smithi136.stdout:8/583: read - d9/d18/d34/d3d/d47/d65/d93/d96/fc8 zero size 2024-09-18T12:51:13.940 INFO:tasks.workunit.client.1.smithi136.stdout:1/427: mknod d2/c87 0 2024-09-18T12:51:13.940 INFO:tasks.workunit.client.1.smithi136.stdout:1/428: stat d2/d5/d2b/d34/d86/f48 0 2024-09-18T12:51:13.940 INFO:tasks.workunit.client.0.smithi081.stdout:6/171: creat d4/d12/f32 x:0 0 0 2024-09-18T12:51:13.942 INFO:tasks.workunit.client.0.smithi081.stdout:6/172: symlink d4/d6/l33 0 2024-09-18T12:51:13.947 INFO:tasks.workunit.client.0.smithi081.stdout:2/212: dwrite fe [4194304,4194304] 0 2024-09-18T12:51:13.947 INFO:tasks.workunit.client.1.smithi136.stdout:0/449: dwrite d1/d17/f6b [0,4194304] 0 2024-09-18T12:51:13.947 INFO:tasks.workunit.client.1.smithi136.stdout:0/450: stat d1/d3/l14 0 2024-09-18T12:51:13.948 INFO:tasks.workunit.client.1.smithi136.stdout:0/451: creat d1/d17/d6d/d81/d35/f96 x:0 0 0 2024-09-18T12:51:13.949 INFO:tasks.workunit.client.0.smithi081.stdout:2/213: dread f13 [0,4194304] 0 2024-09-18T12:51:13.951 INFO:tasks.workunit.client.1.smithi136.stdout:0/452: truncate d1/d3/f5c 573454 0 2024-09-18T12:51:13.951 INFO:tasks.workunit.client.1.smithi136.stdout:0/453: chown d1/d3 112219863 1 2024-09-18T12:51:13.951 INFO:tasks.workunit.client.1.smithi136.stdout:0/454: creat d1/d17/f97 x:0 0 0 2024-09-18T12:51:13.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/214: symlink d15/d16/d25/d32/l3f 0 2024-09-18T12:51:13.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/215: chown l2 0 1 2024-09-18T12:51:13.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/216: chown d15/d16/d25/d2f 7125 1 2024-09-18T12:51:13.958 INFO:tasks.workunit.client.0.smithi081.stdout:7/222: sync 2024-09-18T12:51:13.958 INFO:tasks.workunit.client.0.smithi081.stdout:9/128: sync 2024-09-18T12:51:13.958 INFO:tasks.workunit.client.0.smithi081.stdout:4/183: sync 2024-09-18T12:51:13.958 INFO:tasks.workunit.client.0.smithi081.stdout:4/184: chown d3/dd/f21 1087 1 2024-09-18T12:51:13.960 INFO:tasks.workunit.client.0.smithi081.stdout:4/185: link d3/dd/c26 d3/d20/c44 0 2024-09-18T12:51:13.961 INFO:tasks.workunit.client.0.smithi081.stdout:7/223: mkdir d2/d1d/d4e 0 2024-09-18T12:51:13.966 INFO:tasks.workunit.client.0.smithi081.stdout:2/217: write fc [1889380,11442] 0 2024-09-18T12:51:13.971 INFO:tasks.workunit.client.0.smithi081.stdout:9/129: write dd/d15/d1a/f22 [1944473,72864] 0 2024-09-18T12:51:13.971 INFO:tasks.workunit.client.0.smithi081.stdout:9/130: fdatasync dd/d1d/d1e/f29 0 2024-09-18T12:51:13.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/230: dwrite d3/f46 [0,4194304] 0 2024-09-18T12:51:13.977 INFO:tasks.workunit.client.0.smithi081.stdout:3/231: symlink d3/db/df/d29/l4d 0 2024-09-18T12:51:13.978 INFO:tasks.workunit.client.0.smithi081.stdout:3/232: truncate d3/db/d1b/f34 341582 0 2024-09-18T12:51:13.978 INFO:tasks.workunit.client.0.smithi081.stdout:2/218: dread d15/d16/d20/d31/f36 [0,4194304] 0 2024-09-18T12:51:13.978 INFO:tasks.workunit.client.0.smithi081.stdout:3/233: write d3/db/df/d29/d13/f2a [641233,14289] 0 2024-09-18T12:51:13.980 INFO:tasks.workunit.client.0.smithi081.stdout:2/219: rename d15/d16/d25/c3d to d15/d16/d20/c40 0 2024-09-18T12:51:13.981 INFO:tasks.workunit.client.1.smithi136.stdout:8/584: dwrite d9/d18/d34/d3d/f54 [0,4194304] 0 2024-09-18T12:51:13.981 INFO:tasks.workunit.client.1.smithi136.stdout:8/585: write d9/d18/d34/d3d/d47/d65/d93/d96/fc8 [183130,94952] 0 2024-09-18T12:51:13.981 INFO:tasks.workunit.client.1.smithi136.stdout:0/455: dwrite d1/d17/d6d/d81/d35/f49 [0,4194304] 0 2024-09-18T12:51:13.982 INFO:tasks.workunit.client.0.smithi081.stdout:3/234: link f1 d3/f4e 0 2024-09-18T12:51:13.982 INFO:tasks.workunit.client.0.smithi081.stdout:5/209: dwrite d2/d14/f17 [0,4194304] 0 2024-09-18T12:51:13.982 INFO:tasks.workunit.client.0.smithi081.stdout:5/210: fsync d2/ff 0 2024-09-18T12:51:13.983 INFO:tasks.workunit.client.0.smithi081.stdout:7/224: dwrite d2/f34 [0,4194304] 0 2024-09-18T12:51:13.985 INFO:tasks.workunit.client.0.smithi081.stdout:2/220: mknod d15/c41 0 2024-09-18T12:51:13.991 INFO:tasks.workunit.client.0.smithi081.stdout:7/225: symlink d2/d1b/l4f 0 2024-09-18T12:51:13.991 INFO:tasks.workunit.client.0.smithi081.stdout:7/226: truncate d2/f10 684450 0 2024-09-18T12:51:13.991 INFO:tasks.workunit.client.0.smithi081.stdout:5/211: dread d2/dd/f29 [0,4194304] 0 2024-09-18T12:51:13.994 INFO:tasks.workunit.client.0.smithi081.stdout:5/212: mkdir d2/d47 0 2024-09-18T12:51:13.997 INFO:tasks.workunit.client.0.smithi081.stdout:5/213: mknod d2/d14/d33/d37/d3b/d18/c48 0 2024-09-18T12:51:13.998 INFO:tasks.workunit.client.1.smithi136.stdout:0/456: rename d1/d17/d6d to d1/d3/d1a/d98 0 2024-09-18T12:51:13.999 INFO:tasks.workunit.client.1.smithi136.stdout:0/457: dread d1/d3/d1a/d98/d81/d35/d84/f8b [0,4194304] 0 2024-09-18T12:51:14.000 INFO:tasks.workunit.client.0.smithi081.stdout:5/214: getdents d2/d14/d33/d37/d3b/d2a 0 2024-09-18T12:51:14.001 INFO:tasks.workunit.client.1.smithi136.stdout:0/458: readlink d1/d3/d1a/d98/d81/l5b 0 2024-09-18T12:51:14.002 INFO:tasks.workunit.client.0.smithi081.stdout:5/215: rename d2/d14/d33/d37/d3b/d2a/c36 to d2/c49 0 2024-09-18T12:51:14.004 INFO:tasks.workunit.client.0.smithi081.stdout:1/220: sync 2024-09-18T12:51:14.004 INFO:tasks.workunit.client.0.smithi081.stdout:0/201: sync 2024-09-18T12:51:14.004 INFO:tasks.workunit.client.0.smithi081.stdout:8/193: sync 2024-09-18T12:51:14.004 INFO:tasks.workunit.client.0.smithi081.stdout:8/194: creat d3/d1d/f49 x:0 0 0 2024-09-18T12:51:14.005 INFO:tasks.workunit.client.0.smithi081.stdout:1/221: mkdir d0/db/d4f 0 2024-09-18T12:51:14.005 INFO:tasks.workunit.client.0.smithi081.stdout:8/195: write d3/d1e/f34 [311603,28929] 0 2024-09-18T12:51:14.005 INFO:tasks.workunit.client.0.smithi081.stdout:8/196: chown d3/d1d/c2e 417633189 1 2024-09-18T12:51:14.007 INFO:tasks.workunit.client.0.smithi081.stdout:0/202: rename d7/d9/cd to d7/d9/d12/d2b/d33/c47 0 2024-09-18T12:51:14.007 INFO:tasks.workunit.client.0.smithi081.stdout:0/203: fsync d7/f22 0 2024-09-18T12:51:14.008 INFO:tasks.workunit.client.0.smithi081.stdout:0/204: symlink d7/d9/d12/d2b/d33/d43/l48 0 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/459: write d1/d60/f6f [3862428,59714] 0 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/460: truncate d1/d3/d1a/d98/d81/d72/f78 352934 0 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/461: creat d1/d60/f99 x:0 0 0 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/462: dread - d1/d60/d82/f93 zero size 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/463: creat d1/d3/f9a x:0 0 0 2024-09-18T12:51:14.017 INFO:tasks.workunit.client.1.smithi136.stdout:0/464: fsync d1/d17/f4c 0 2024-09-18T12:51:14.018 INFO:tasks.workunit.client.0.smithi081.stdout:9/131: dwrite dd/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:51:14.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/197: dread d3/f32 [0,4194304] 0 2024-09-18T12:51:14.021 INFO:tasks.workunit.client.0.smithi081.stdout:2/221: dwrite d15/d16/d25/d32/f3c [0,4194304] 0 2024-09-18T12:51:14.021 INFO:tasks.workunit.client.0.smithi081.stdout:2/222: creat d15/d16/d20/d31/f42 x:0 0 0 2024-09-18T12:51:14.022 INFO:tasks.workunit.client.1.smithi136.stdout:8/586: dwrite d9/f6a [0,4194304] 0 2024-09-18T12:51:14.023 INFO:tasks.workunit.client.1.smithi136.stdout:3/465: sync 2024-09-18T12:51:14.023 INFO:tasks.workunit.client.1.smithi136.stdout:3/466: chown d3/d14/d22/d2c/d3d/l66 14165 1 2024-09-18T12:51:14.023 INFO:tasks.workunit.client.1.smithi136.stdout:7/560: sync 2024-09-18T12:51:14.025 INFO:tasks.workunit.client.0.smithi081.stdout:2/223: link d15/c35 d15/d16/d20/c43 0 2024-09-18T12:51:14.025 INFO:tasks.workunit.client.0.smithi081.stdout:2/224: truncate d15/d16/d20/d31/f42 566284 0 2024-09-18T12:51:14.026 INFO:tasks.workunit.client.1.smithi136.stdout:8/587: symlink d9/d14/d1a/d2b/d42/da4/lcd 0 2024-09-18T12:51:14.026 INFO:tasks.workunit.client.0.smithi081.stdout:8/198: unlink d3/d1e/c26 0 2024-09-18T12:51:14.026 INFO:tasks.workunit.client.0.smithi081.stdout:8/199: chown d3/d1d/l2c 108292481 1 2024-09-18T12:51:14.027 INFO:tasks.workunit.client.0.smithi081.stdout:2/225: creat d15/d16/f44 x:0 0 0 2024-09-18T12:51:14.028 INFO:tasks.workunit.client.1.smithi136.stdout:3/467: rename d3/d14/d18/f61 to d3/d14/d18/d7f/fa3 0 2024-09-18T12:51:14.028 INFO:tasks.workunit.client.1.smithi136.stdout:3/468: write d3/d2b/d6c/f6f [671182,119953] 0 2024-09-18T12:51:14.029 INFO:tasks.workunit.client.0.smithi081.stdout:9/132: write dd/d15/d1a/f22 [2990939,64207] 0 2024-09-18T12:51:14.029 INFO:tasks.workunit.client.0.smithi081.stdout:3/235: dwrite d3/db/f2c [0,4194304] 0 2024-09-18T12:51:14.029 INFO:tasks.workunit.client.0.smithi081.stdout:8/200: mkdir d3/d1d/d4a 0 2024-09-18T12:51:14.029 INFO:tasks.workunit.client.1.smithi136.stdout:0/465: truncate d1/d3/d1a/d98/d81/d51/f57 1732248 0 2024-09-18T12:51:14.030 INFO:tasks.workunit.client.1.smithi136.stdout:7/561: mknod d0/d35/d41/d50/d5a/d98/cc3 0 2024-09-18T12:51:14.030 INFO:tasks.workunit.client.1.smithi136.stdout:7/562: read d0/d2c/d2e/f3f [2453426,108726] 0 2024-09-18T12:51:14.030 INFO:tasks.workunit.client.1.smithi136.stdout:7/563: dread - d0/d2c/d85/fa6 zero size 2024-09-18T12:51:14.030 INFO:tasks.workunit.client.0.smithi081.stdout:2/226: rename d15/d16/d20/c2b to d15/d16/d25/d2f/c45 0 2024-09-18T12:51:14.031 INFO:tasks.workunit.client.0.smithi081.stdout:5/216: dread d2/dd/f21 [0,4194304] 0 2024-09-18T12:51:14.031 INFO:tasks.workunit.client.0.smithi081.stdout:2/227: dread d15/d16/d20/d31/f42 [0,4194304] 0 2024-09-18T12:51:14.031 INFO:tasks.workunit.client.0.smithi081.stdout:5/217: getdents d2/d14/d33/d37/d3b/d16 0 2024-09-18T12:51:14.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/218: write d2/d14/d1d/d1a/f34 [1318490,42077] 0 2024-09-18T12:51:14.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/219: getdents d2/d47 0 2024-09-18T12:51:14.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/220: creat d2/d14/d1d/d1a/f4a x:0 0 0 2024-09-18T12:51:14.033 INFO:tasks.workunit.client.1.smithi136.stdout:8/588: rename d9/d14/d1a/c23 to d9/d14/cce 0 2024-09-18T12:51:14.033 INFO:tasks.workunit.client.1.smithi136.stdout:0/466: stat d1/db/c15 0 2024-09-18T12:51:14.033 INFO:tasks.workunit.client.1.smithi136.stdout:0/467: chown d1/d3/d1a/f50 54647 1 2024-09-18T12:51:14.033 INFO:tasks.workunit.client.1.smithi136.stdout:0/468: chown d1/d3/f58 15 1 2024-09-18T12:51:14.034 INFO:tasks.workunit.client.0.smithi081.stdout:3/236: mknod d3/db/c4f 0 2024-09-18T12:51:14.034 INFO:tasks.workunit.client.0.smithi081.stdout:3/237: write d3/db/df/d29/d13/f2b [2293882,26572] 0 2024-09-18T12:51:14.034 INFO:tasks.workunit.client.0.smithi081.stdout:8/201: truncate d3/f2d 921135 0 2024-09-18T12:51:14.035 INFO:tasks.workunit.client.1.smithi136.stdout:8/589: mknod d9/d14/d1a/d7f/d8c/ccf 0 2024-09-18T12:51:14.035 INFO:tasks.workunit.client.1.smithi136.stdout:8/590: write d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 [2029395,32149] 0 2024-09-18T12:51:14.035 INFO:tasks.workunit.client.1.smithi136.stdout:0/469: getdents d1/d3/d1a/d62/d75 0 2024-09-18T12:51:14.035 INFO:tasks.workunit.client.1.smithi136.stdout:0/470: chown d1/d3/d1a/d98/d81/d72 1695497070 1 2024-09-18T12:51:14.036 INFO:tasks.workunit.client.0.smithi081.stdout:9/133: rmdir dd 39 2024-09-18T12:51:14.037 INFO:tasks.workunit.client.0.smithi081.stdout:7/227: dwrite d2/d1d/f36 [0,4194304] 0 2024-09-18T12:51:14.037 INFO:tasks.workunit.client.0.smithi081.stdout:1/222: dwrite d0/db/d12/d2d/f2f [0,4194304] 0 2024-09-18T12:51:14.037 INFO:tasks.workunit.client.0.smithi081.stdout:7/228: creat d2/d1d/d27/f50 x:0 0 0 2024-09-18T12:51:14.039 INFO:tasks.workunit.client.1.smithi136.stdout:3/469: dread d3/d14/f40 [0,4194304] 0 2024-09-18T12:51:14.042 INFO:tasks.workunit.client.0.smithi081.stdout:3/238: link d3/c4 d3/db/c50 0 2024-09-18T12:51:14.042 INFO:tasks.workunit.client.0.smithi081.stdout:0/205: dwrite d7/d9/d12/d2b/d33/f34 [0,4194304] 0 2024-09-18T12:51:14.042 INFO:tasks.workunit.client.0.smithi081.stdout:0/206: readlink d7/l2c 0 2024-09-18T12:51:14.042 INFO:tasks.workunit.client.0.smithi081.stdout:5/221: dread d2/fe [0,4194304] 0 2024-09-18T12:51:14.054 INFO:tasks.workunit.client.0.smithi081.stdout:3/239: read d3/db/dc/f15 [85628,86433] 0 2024-09-18T12:51:14.055 INFO:tasks.workunit.client.1.smithi136.stdout:3/470: dread d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:14.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/229: creat d2/d18/f51 x:0 0 0 2024-09-18T12:51:14.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/230: write d2/d1d/d27/f3d [605597,78081] 0 2024-09-18T12:51:14.058 INFO:tasks.workunit.client.0.smithi081.stdout:8/202: rmdir d3/d2f 39 2024-09-18T12:51:14.062 INFO:tasks.workunit.client.0.smithi081.stdout:0/207: rename d7/d9/cc to d7/d9/d12/d2b/c49 0 2024-09-18T12:51:14.063 INFO:tasks.workunit.client.0.smithi081.stdout:5/222: symlink d2/l4b 0 2024-09-18T12:51:14.063 INFO:tasks.workunit.client.0.smithi081.stdout:5/223: chown d2/d14 3842976 1 2024-09-18T12:51:14.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/240: mkdir d3/db/df/d29/d12/d44/d51 0 2024-09-18T12:51:14.065 INFO:tasks.workunit.client.0.smithi081.stdout:2/228: dwrite f9 [4194304,4194304] 0 2024-09-18T12:51:14.066 INFO:tasks.workunit.client.0.smithi081.stdout:8/203: mknod d3/d1d/d4a/c4b 0 2024-09-18T12:51:14.067 INFO:tasks.workunit.client.0.smithi081.stdout:5/224: rmdir d2/dd 39 2024-09-18T12:51:14.068 INFO:tasks.workunit.client.0.smithi081.stdout:3/241: link d3/db/l3f d3/db/df/d29/d13/d17/l52 0 2024-09-18T12:51:14.069 INFO:tasks.workunit.client.0.smithi081.stdout:3/242: stat d3/l6 0 2024-09-18T12:51:14.072 INFO:tasks.workunit.client.0.smithi081.stdout:5/225: dread d2/d14/d33/d37/d3b/d18/f35 [0,4194304] 0 2024-09-18T12:51:14.073 INFO:tasks.workunit.client.0.smithi081.stdout:1/223: dwrite d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:14.073 INFO:tasks.workunit.client.0.smithi081.stdout:1/224: write d0/f20 [1737520,86015] 0 2024-09-18T12:51:14.074 INFO:tasks.workunit.client.0.smithi081.stdout:5/226: write d2/dd/f29 [233105,88363] 0 2024-09-18T12:51:14.074 INFO:tasks.workunit.client.0.smithi081.stdout:5/227: write d2/d14/d33/d37/d3b/f38 [555202,56405] 0 2024-09-18T12:51:14.076 INFO:tasks.workunit.client.1.smithi136.stdout:0/471: dwrite d1/d3/d1a/d98/d81/d35/d54/f5f [0,4194304] 0 2024-09-18T12:51:14.076 INFO:tasks.workunit.client.1.smithi136.stdout:8/591: dwrite d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5/fba [0,4194304] 0 2024-09-18T12:51:14.076 INFO:tasks.workunit.client.1.smithi136.stdout:8/592: chown d9/d14/d1a/cc7 43987 1 2024-09-18T12:51:14.077 INFO:tasks.workunit.client.0.smithi081.stdout:9/134: dwrite dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:14.077 INFO:tasks.workunit.client.0.smithi081.stdout:2/229: write f9 [3824583,74445] 0 2024-09-18T12:51:14.077 INFO:tasks.workunit.client.0.smithi081.stdout:5/228: unlink d2/dd/f29 0 2024-09-18T12:51:14.077 INFO:tasks.workunit.client.0.smithi081.stdout:5/229: stat d2/d14/d1d/d1a/f4a 0 2024-09-18T12:51:14.078 INFO:tasks.workunit.client.0.smithi081.stdout:8/204: dread d3/d1e/f27 [0,4194304] 0 2024-09-18T12:51:14.078 INFO:tasks.workunit.client.1.smithi136.stdout:0/472: mknod d1/d3/d1a/c9b 0 2024-09-18T12:51:14.080 INFO:tasks.workunit.client.1.smithi136.stdout:8/593: symlink d9/d14/d1a/ld0 0 2024-09-18T12:51:14.080 INFO:tasks.workunit.client.1.smithi136.stdout:8/594: dread - d9/d14/f71 zero size 2024-09-18T12:51:14.081 INFO:tasks.workunit.client.0.smithi081.stdout:0/208: dwrite d7/d9/d12/d2b/d33/f34 [0,4194304] 0 2024-09-18T12:51:14.081 INFO:tasks.workunit.client.1.smithi136.stdout:0/473: rmdir d1/d3/d1a/d98 39 2024-09-18T12:51:14.082 INFO:tasks.workunit.client.1.smithi136.stdout:0/474: fsync d1/f31 0 2024-09-18T12:51:14.082 INFO:tasks.workunit.client.0.smithi081.stdout:3/243: dread d3/f46 [0,4194304] 0 2024-09-18T12:51:14.083 INFO:tasks.workunit.client.0.smithi081.stdout:2/230: creat d15/f46 x:0 0 0 2024-09-18T12:51:14.084 INFO:tasks.workunit.client.1.smithi136.stdout:8/595: dread d9/d18/f1c [0,4194304] 0 2024-09-18T12:51:14.086 INFO:tasks.workunit.client.1.smithi136.stdout:8/596: mkdir d9/d18/d34/d3d/d47/dbe/dd1 0 2024-09-18T12:51:14.086 INFO:tasks.workunit.client.1.smithi136.stdout:9/481: sync 2024-09-18T12:51:14.087 INFO:tasks.workunit.client.1.smithi136.stdout:9/482: stat d6/da/d3d/d4d/f9d 0 2024-09-18T12:51:14.087 INFO:tasks.workunit.client.1.smithi136.stdout:9/483: write d6/df/d23/d2b/f43 [158850,25274] 0 2024-09-18T12:51:14.088 INFO:tasks.workunit.client.0.smithi081.stdout:1/225: dread d0/d6/f3d [0,4194304] 0 2024-09-18T12:51:14.088 INFO:tasks.workunit.client.0.smithi081.stdout:1/226: chown d0/db/l48 111878023 1 2024-09-18T12:51:14.089 INFO:tasks.workunit.client.1.smithi136.stdout:9/484: creat d6/df/d23/d2b/fa6 x:0 0 0 2024-09-18T12:51:14.089 INFO:tasks.workunit.client.0.smithi081.stdout:9/135: read dd/d1b/f1f [536067,126431] 0 2024-09-18T12:51:14.089 INFO:tasks.workunit.client.0.smithi081.stdout:9/136: chown dd/de/c28 118 1 2024-09-18T12:51:14.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/244: write d3/db/f2c [456237,102549] 0 2024-09-18T12:51:14.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/245: stat d3/db/df/d29/f19 0 2024-09-18T12:51:14.091 INFO:tasks.workunit.client.1.smithi136.stdout:9/485: getdents d6/df/d23/d2b/d79/d53/d5c 0 2024-09-18T12:51:14.091 INFO:tasks.workunit.client.1.smithi136.stdout:9/486: chown d6/da/d3d/d4d/f9d 1 1 2024-09-18T12:51:14.092 INFO:tasks.workunit.client.0.smithi081.stdout:2/231: link d15/d16/d25/d2f/c30 d15/d16/d33/c47 0 2024-09-18T12:51:14.094 INFO:tasks.workunit.client.0.smithi081.stdout:5/230: link d2/d14/f17 d2/d14/d33/d37/d3b/d2a/f4c 0 2024-09-18T12:51:14.094 INFO:tasks.workunit.client.0.smithi081.stdout:5/231: write d2/d14/d33/d37/d3b/d18/d20/f22 [3656804,118820] 0 2024-09-18T12:51:14.094 INFO:tasks.workunit.client.0.smithi081.stdout:5/232: write d2/d14/d1d/d1a/f2b [544539,94183] 0 2024-09-18T12:51:14.095 INFO:tasks.workunit.client.0.smithi081.stdout:5/233: truncate d2/d14/d1d/d1a/f4a 815812 0 2024-09-18T12:51:14.095 INFO:tasks.workunit.client.1.smithi136.stdout:9/487: link d6/da/d3d/d4d/d91/d25/f71 d6/d13/d4c/fa7 0 2024-09-18T12:51:14.095 INFO:tasks.workunit.client.1.smithi136.stdout:9/488: stat d6/df/d23/d2b 0 2024-09-18T12:51:14.096 INFO:tasks.workunit.client.0.smithi081.stdout:0/209: write d7/d9/f10 [6957970,57892] 0 2024-09-18T12:51:14.097 INFO:tasks.workunit.client.0.smithi081.stdout:0/210: fdatasync d7/d9/f44 0 2024-09-18T12:51:14.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/205: mkdir d3/d1e/d4c 0 2024-09-18T12:51:14.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/206: write d3/f3c [834929,129137] 0 2024-09-18T12:51:14.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/207: creat d3/d1d/f4d x:0 0 0 2024-09-18T12:51:14.100 INFO:tasks.workunit.client.0.smithi081.stdout:1/227: mkdir d0/db/d4f/d50 0 2024-09-18T12:51:14.103 INFO:tasks.workunit.client.1.smithi136.stdout:9/489: dread d6/d13/d4c/f7e [0,4194304] 0 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/490: mknod d6/db/ca8 0 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/491: creat d6/df/d23/fa9 x:0 0 0 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/492: fdatasync d6/da/d3d/d4d/f84 0 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/493: fsync d6/da/d3d/d4d/d91/f16 0 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/494: chown d6/da/d3d/d4d/d91/d25/d55/la4 33536508 1 2024-09-18T12:51:14.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/495: stat d6/d13 0 2024-09-18T12:51:14.107 INFO:tasks.workunit.client.0.smithi081.stdout:3/246: dread f1 [0,4194304] 0 2024-09-18T12:51:14.109 INFO:tasks.workunit.client.0.smithi081.stdout:9/137: mkdir dd/d1d/d1e/d24/d2a 0 2024-09-18T12:51:14.110 INFO:tasks.workunit.client.1.smithi136.stdout:9/496: mkdir d6/db/d12/d62/daa 0 2024-09-18T12:51:14.110 INFO:tasks.workunit.client.1.smithi136.stdout:9/497: readlink d6/db/d12/l46 0 2024-09-18T12:51:14.111 INFO:tasks.workunit.client.1.smithi136.stdout:9/498: rmdir d6/da 39 2024-09-18T12:51:14.113 INFO:tasks.workunit.client.1.smithi136.stdout:9/499: link d6/db/d12/d62/c7f d6/da/d3d/cab 0 2024-09-18T12:51:14.114 INFO:tasks.workunit.client.0.smithi081.stdout:8/208: unlink d3/d1d/l3a 0 2024-09-18T12:51:14.117 INFO:tasks.workunit.client.0.smithi081.stdout:1/228: rename d0/d18/d1a/d1f to d0/d6/d7/d2e/d51 0 2024-09-18T12:51:14.120 INFO:tasks.workunit.client.0.smithi081.stdout:8/209: rename d3/f3c to d3/d1d/d4a/f4e 0 2024-09-18T12:51:14.122 INFO:tasks.workunit.client.0.smithi081.stdout:1/229: unlink d0/db/c49 0 2024-09-18T12:51:14.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/210: creat d3/d1d/d4a/f4f x:0 0 0 2024-09-18T12:51:14.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/211: read - d3/d2f/f40 zero size 2024-09-18T12:51:14.125 INFO:tasks.workunit.client.0.smithi081.stdout:1/230: creat d0/d6/d7/d8/f52 x:0 0 0 2024-09-18T12:51:14.126 INFO:tasks.workunit.client.0.smithi081.stdout:1/231: link d0/d6/d7/l19 d0/d6/d7/d2e/l53 0 2024-09-18T12:51:14.128 INFO:tasks.workunit.client.0.smithi081.stdout:1/232: mkdir d0/d54 0 2024-09-18T12:51:14.140 INFO:tasks.workunit.client.1.smithi136.stdout:0/475: dwrite d1/d3/d1a/d98/d81/d35/f49 [4194304,4194304] 0 2024-09-18T12:51:14.140 INFO:tasks.workunit.client.1.smithi136.stdout:9/500: write d6/da/d3d/d4d/d91/f6f [405815,355] 0 2024-09-18T12:51:14.143 INFO:tasks.workunit.client.1.smithi136.stdout:9/501: getdents d6/da/d3d/d4d/d91/d25 0 2024-09-18T12:51:14.144 INFO:tasks.workunit.client.0.smithi081.stdout:8/212: write d3/f3f [193440,43937] 0 2024-09-18T12:51:14.144 INFO:tasks.workunit.client.0.smithi081.stdout:8/213: fsync d3/d1e/f34 0 2024-09-18T12:51:14.144 INFO:tasks.workunit.client.0.smithi081.stdout:8/214: chown d3/c44 37392 1 2024-09-18T12:51:14.145 INFO:tasks.workunit.client.0.smithi081.stdout:8/215: symlink d3/l50 0 2024-09-18T12:51:14.145 INFO:tasks.workunit.client.0.smithi081.stdout:8/216: truncate d3/d1d/f4d 133274 0 2024-09-18T12:51:14.145 INFO:tasks.workunit.client.0.smithi081.stdout:8/217: creat d3/d1d/f51 x:0 0 0 2024-09-18T12:51:14.146 INFO:tasks.workunit.client.0.smithi081.stdout:8/218: rename d3/d1e/c48 to d3/d2f/c52 0 2024-09-18T12:51:14.146 INFO:tasks.workunit.client.0.smithi081.stdout:8/219: chown d3/d1e/f36 1 1 2024-09-18T12:51:14.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/220: mkdir d3/d1e/d4c/d53 0 2024-09-18T12:51:14.148 INFO:tasks.workunit.client.0.smithi081.stdout:8/221: symlink d3/d2f/l54 0 2024-09-18T12:51:14.149 INFO:tasks.workunit.client.1.smithi136.stdout:9/502: write d6/da/d3d/d4d/d91/f6c [3772775,42669] 0 2024-09-18T12:51:14.151 INFO:tasks.workunit.client.1.smithi136.stdout:9/503: mknod d6/d96/cac 0 2024-09-18T12:51:14.154 INFO:tasks.workunit.client.1.smithi136.stdout:0/476: read d1/fe [3119914,12948] 0 2024-09-18T12:51:14.154 INFO:tasks.workunit.client.1.smithi136.stdout:0/477: chown d1/d3/d1a/d62/c85 2034 1 2024-09-18T12:51:14.156 INFO:tasks.workunit.client.1.smithi136.stdout:0/478: link d1/d17/f47 d1/d60/f9c 0 2024-09-18T12:51:14.157 INFO:tasks.workunit.client.1.smithi136.stdout:0/479: symlink d1/d3/l9d 0 2024-09-18T12:51:14.157 INFO:tasks.workunit.client.0.smithi081.stdout:2/232: dwrite d15/f17 [0,4194304] 0 2024-09-18T12:51:14.157 INFO:tasks.workunit.client.0.smithi081.stdout:2/233: creat d15/d16/f48 x:0 0 0 2024-09-18T12:51:14.158 INFO:tasks.workunit.client.0.smithi081.stdout:2/234: read - d15/d16/d25/f38 zero size 2024-09-18T12:51:14.158 INFO:tasks.workunit.client.1.smithi136.stdout:0/480: symlink d1/d3/d1a/d98/d81/d35/l9e 0 2024-09-18T12:51:14.158 INFO:tasks.workunit.client.1.smithi136.stdout:0/481: write d1/d3/f5c [1254303,46684] 0 2024-09-18T12:51:14.159 INFO:tasks.workunit.client.1.smithi136.stdout:8/597: dwrite d9/d14/d1a/d2b/f4d [0,4194304] 0 2024-09-18T12:51:14.160 INFO:tasks.workunit.client.0.smithi081.stdout:0/211: dwrite d7/d13/f1b [4194304,4194304] 0 2024-09-18T12:51:14.160 INFO:tasks.workunit.client.0.smithi081.stdout:9/138: dwrite dd/d1b/f1f [4194304,4194304] 0 2024-09-18T12:51:14.161 INFO:tasks.workunit.client.0.smithi081.stdout:3/247: dwrite d3/db/df/d3b/d47/f2f [0,4194304] 0 2024-09-18T12:51:14.161 INFO:tasks.workunit.client.0.smithi081.stdout:1/233: dwrite d0/d6/d33/d42/f44 [0,4194304] 0 2024-09-18T12:51:14.161 INFO:tasks.workunit.client.0.smithi081.stdout:1/234: chown d0/d6/f3d 2 1 2024-09-18T12:51:14.161 INFO:tasks.workunit.client.1.smithi136.stdout:0/482: rename d1/d3/d1a/d98/d81/d35/d54/f5f to d1/d60/d82/f9f 0 2024-09-18T12:51:14.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/212: rename d7/d13 to d7/d9/d12/d2b/d4a 0 2024-09-18T12:51:14.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/213: fdatasync d7/d9/d12/f39 0 2024-09-18T12:51:14.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/214: fsync d7/f21 0 2024-09-18T12:51:14.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/215: write d7/d9/d12/d2b/d4a/f16 [5004943,43534] 0 2024-09-18T12:51:14.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/216: write d7/d9/d12/f39 [1028048,68312] 0 2024-09-18T12:51:14.166 INFO:tasks.workunit.client.0.smithi081.stdout:9/139: creat dd/de/f2b x:0 0 0 2024-09-18T12:51:14.166 INFO:tasks.workunit.client.0.smithi081.stdout:9/140: write dd/d1b/f1f [9104240,10771] 0 2024-09-18T12:51:14.167 INFO:tasks.workunit.client.1.smithi136.stdout:9/504: truncate d6/da/d3d/d4d/d91/f6f 2995910 0 2024-09-18T12:51:14.170 INFO:tasks.workunit.client.0.smithi081.stdout:3/248: rmdir d3/db/df 39 2024-09-18T12:51:14.170 INFO:tasks.workunit.client.0.smithi081.stdout:2/235: write d15/d16/f37 [3286225,44474] 0 2024-09-18T12:51:14.172 INFO:tasks.workunit.client.1.smithi136.stdout:0/483: symlink d1/la0 0 2024-09-18T12:51:14.174 INFO:tasks.workunit.client.1.smithi136.stdout:0/484: mknod d1/d46/ca1 0 2024-09-18T12:51:14.174 INFO:tasks.workunit.client.1.smithi136.stdout:0/485: creat d1/d60/d82/fa2 x:0 0 0 2024-09-18T12:51:14.175 INFO:tasks.workunit.client.0.smithi081.stdout:2/236: write f7 [3576941,74888] 0 2024-09-18T12:51:14.177 INFO:tasks.workunit.client.0.smithi081.stdout:1/235: mkdir d0/db/d12/d55 0 2024-09-18T12:51:14.177 INFO:tasks.workunit.client.1.smithi136.stdout:0/486: creat d1/d3/d1a/d95/fa3 x:0 0 0 2024-09-18T12:51:14.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/249: dread d3/db/f2c [0,4194304] 0 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:2/484: sync 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:4/386: sync 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:0/487: creat d1/d3/d1a/d62/fa4 x:0 0 0 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:0/488: write d1/d3/d1a/f6e [947761,63755] 0 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:0/489: creat d1/d3/d1a/d62/fa5 x:0 0 0 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:6/456: sync 2024-09-18T12:51:14.180 INFO:tasks.workunit.client.1.smithi136.stdout:1/429: sync 2024-09-18T12:51:14.181 INFO:tasks.workunit.client.1.smithi136.stdout:5/531: sync 2024-09-18T12:51:14.186 INFO:tasks.workunit.client.1.smithi136.stdout:8/598: dwrite d9/d14/d1a/d2b/f51 [0,4194304] 0 2024-09-18T12:51:14.186 INFO:tasks.workunit.client.1.smithi136.stdout:8/599: fdatasync d9/d18/f7a 0 2024-09-18T12:51:14.192 INFO:tasks.workunit.client.1.smithi136.stdout:9/505: dwrite d6/df/d23/fa9 [0,4194304] 0 2024-09-18T12:51:14.192 INFO:tasks.workunit.client.1.smithi136.stdout:9/506: creat d6/df/d75/fad x:0 0 0 2024-09-18T12:51:14.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/141: dread dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:14.196 INFO:tasks.workunit.client.1.smithi136.stdout:6/457: creat d8/d9/d64/f98 x:0 0 0 2024-09-18T12:51:14.196 INFO:tasks.workunit.client.1.smithi136.stdout:6/458: write d8/d9/de/f23 [1076548,28235] 0 2024-09-18T12:51:14.196 INFO:tasks.workunit.client.1.smithi136.stdout:6/459: chown d8/d9/de/f3d 15 1 2024-09-18T12:51:14.196 INFO:tasks.workunit.client.1.smithi136.stdout:5/532: truncate d5/d1a/f53 3628269 0 2024-09-18T12:51:14.196 INFO:tasks.workunit.client.1.smithi136.stdout:5/533: creat d5/d1a/d2d/d34/d4e/d7a/f9f x:0 0 0 2024-09-18T12:51:14.197 INFO:tasks.workunit.client.1.smithi136.stdout:5/534: write d5/d1a/d2d/d34/f95 [564366,53597] 0 2024-09-18T12:51:14.200 INFO:tasks.workunit.client.1.smithi136.stdout:9/507: mkdir d6/df/d23/dae 0 2024-09-18T12:51:14.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/234: dwrite d2/d14/d33/d37/d3b/f38 [0,4194304] 0 2024-09-18T12:51:14.202 INFO:tasks.workunit.client.0.smithi081.stdout:0/217: dwrite d7/d9/d12/f26 [0,4194304] 0 2024-09-18T12:51:14.202 INFO:tasks.workunit.client.0.smithi081.stdout:0/218: chown d7/d9/d12/d2b/d3d/c41 222 1 2024-09-18T12:51:14.202 INFO:tasks.workunit.client.0.smithi081.stdout:2/237: rename d15/d16/d20/d31/f36 to d15/d16/d20/d31/f49 0 2024-09-18T12:51:14.202 INFO:tasks.workunit.client.1.smithi136.stdout:0/490: creat d1/db/d77/fa6 x:0 0 0 2024-09-18T12:51:14.204 INFO:tasks.workunit.client.1.smithi136.stdout:5/535: symlink d5/d1a/d30/d7b/la0 0 2024-09-18T12:51:14.204 INFO:tasks.workunit.client.1.smithi136.stdout:2/485: dwrite d5/d7/d41/d53/f63 [0,4194304] 0 2024-09-18T12:51:14.205 INFO:tasks.workunit.client.1.smithi136.stdout:8/600: mknod d9/d18/d34/d3d/cd2 0 2024-09-18T12:51:14.205 INFO:tasks.workunit.client.0.smithi081.stdout:1/236: rename d0/f46 to d0/d6/d7/d2e/d51/f56 0 2024-09-18T12:51:14.205 INFO:tasks.workunit.client.0.smithi081.stdout:1/237: chown d0/d6/d33/d42/f44 1809 1 2024-09-18T12:51:14.207 INFO:tasks.workunit.client.1.smithi136.stdout:2/486: dread d5/d7/f5a [0,4194304] 0 2024-09-18T12:51:14.207 INFO:tasks.workunit.client.1.smithi136.stdout:1/430: dwrite d2/d5/d2b/d34/d86/f27 [0,4194304] 0 2024-09-18T12:51:14.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/142: unlink dd/d15/d1a/l1c 0 2024-09-18T12:51:14.210 INFO:tasks.workunit.client.1.smithi136.stdout:9/508: creat d6/da/d3d/d4d/d91/faf x:0 0 0 2024-09-18T12:51:14.211 INFO:tasks.workunit.client.1.smithi136.stdout:9/509: chown d6/da/d3d/d4d/d91/d25/f39 29141 1 2024-09-18T12:51:14.211 INFO:tasks.workunit.client.1.smithi136.stdout:9/510: fdatasync d6/da/d3d/d4d/d91/d25/f39 0 2024-09-18T12:51:14.211 INFO:tasks.workunit.client.0.smithi081.stdout:2/238: rmdir d15/d16/d25/d2f 39 2024-09-18T12:51:14.211 INFO:tasks.workunit.client.1.smithi136.stdout:6/460: dread d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:14.212 INFO:tasks.workunit.client.1.smithi136.stdout:0/491: rmdir d1/db 39 2024-09-18T12:51:14.212 INFO:tasks.workunit.client.1.smithi136.stdout:0/492: write d1/d3/d1a/d98/d81/d35/f40 [3061324,21879] 0 2024-09-18T12:51:14.212 INFO:tasks.workunit.client.1.smithi136.stdout:0/493: chown d1/db/d76/f92 1825219 1 2024-09-18T12:51:14.214 INFO:tasks.workunit.client.0.smithi081.stdout:1/238: symlink d0/d6/d33/d42/l57 0 2024-09-18T12:51:14.215 INFO:tasks.workunit.client.1.smithi136.stdout:9/511: dread d6/d13/d4c/f7e [0,4194304] 0 2024-09-18T12:51:14.215 INFO:tasks.workunit.client.1.smithi136.stdout:6/461: dread d8/f65 [0,4194304] 0 2024-09-18T12:51:14.217 INFO:tasks.workunit.client.0.smithi081.stdout:3/250: rename d3/c4 to d3/c53 0 2024-09-18T12:51:14.218 INFO:tasks.workunit.client.0.smithi081.stdout:9/143: read f7 [1260402,63402] 0 2024-09-18T12:51:14.223 INFO:tasks.workunit.client.0.smithi081.stdout:1/239: mknod d0/d6/d33/d37/c58 0 2024-09-18T12:51:14.224 INFO:tasks.workunit.client.1.smithi136.stdout:9/512: unlink d6/df/f1f 0 2024-09-18T12:51:14.225 INFO:tasks.workunit.client.1.smithi136.stdout:2/487: symlink d5/d25/l91 0 2024-09-18T12:51:14.225 INFO:tasks.workunit.client.1.smithi136.stdout:6/462: symlink d8/d9/de/d60/d94/l99 0 2024-09-18T12:51:14.226 INFO:tasks.workunit.client.1.smithi136.stdout:1/431: getdents d2/d5/d11/d2e/d4c 0 2024-09-18T12:51:14.226 INFO:tasks.workunit.client.1.smithi136.stdout:1/432: readlink d2/d5/d2b/d34/d86/d50/d65/l68 0 2024-09-18T12:51:14.226 INFO:tasks.workunit.client.1.smithi136.stdout:1/433: fsync d2/f78 0 2024-09-18T12:51:14.226 INFO:tasks.workunit.client.1.smithi136.stdout:1/434: readlink d2/d5/d11/d1b/l21 0 2024-09-18T12:51:14.226 INFO:tasks.workunit.client.0.smithi081.stdout:9/144: creat dd/d1d/d1e/d24/d2a/f2c x:0 0 0 2024-09-18T12:51:14.227 INFO:tasks.workunit.client.1.smithi136.stdout:6/463: symlink d8/d9/d56/l9a 0 2024-09-18T12:51:14.228 INFO:tasks.workunit.client.0.smithi081.stdout:9/145: unlink dd/de/f2b 0 2024-09-18T12:51:14.228 INFO:tasks.workunit.client.0.smithi081.stdout:2/239: dread f11 [0,4194304] 0 2024-09-18T12:51:14.229 INFO:tasks.workunit.client.0.smithi081.stdout:9/146: unlink dd/de/c17 0 2024-09-18T12:51:14.229 INFO:tasks.workunit.client.1.smithi136.stdout:1/435: truncate d2/d5/d11/f19 1440145 0 2024-09-18T12:51:14.231 INFO:tasks.workunit.client.1.smithi136.stdout:8/601: write f5 [105565,124762] 0 2024-09-18T12:51:14.231 INFO:tasks.workunit.client.1.smithi136.stdout:8/602: stat d9/d14/d1a/d2b/d42/d6e/d75 0 2024-09-18T12:51:14.231 INFO:tasks.workunit.client.0.smithi081.stdout:2/240: mknod d15/d26/c4a 0 2024-09-18T12:51:14.231 INFO:tasks.workunit.client.0.smithi081.stdout:2/241: truncate d15/d16/f19 1500246 0 2024-09-18T12:51:14.231 INFO:tasks.workunit.client.0.smithi081.stdout:9/147: symlink dd/d15/d1a/l2d 0 2024-09-18T12:51:14.232 INFO:tasks.workunit.client.1.smithi136.stdout:8/603: symlink d9/d18/d34/d3d/d47/d65/ld3 0 2024-09-18T12:51:14.233 INFO:tasks.workunit.client.0.smithi081.stdout:2/242: mknod d15/d16/d25/c4b 0 2024-09-18T12:51:14.234 INFO:tasks.workunit.client.1.smithi136.stdout:2/488: write d5/f65 [2868164,23047] 0 2024-09-18T12:51:14.235 INFO:tasks.workunit.client.1.smithi136.stdout:1/436: rename d2/d5/d9/f1a to d2/d5/d2b/f88 0 2024-09-18T12:51:14.235 INFO:tasks.workunit.client.1.smithi136.stdout:1/437: write d2/d5/d2b/d34/d86/f27 [4997829,112817] 0 2024-09-18T12:51:14.235 INFO:tasks.workunit.client.1.smithi136.stdout:8/604: rename d9/d14/d1a/d2b to d9/d14/d1a/d2b/d42/d9e/dd4 22 2024-09-18T12:51:14.235 INFO:tasks.workunit.client.1.smithi136.stdout:1/438: fsync d2/d5/d2b/f81 0 2024-09-18T12:51:14.235 INFO:tasks.workunit.client.1.smithi136.stdout:9/513: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:51:14.236 INFO:tasks.workunit.client.1.smithi136.stdout:0/494: write d1/f18 [722260,80561] 0 2024-09-18T12:51:14.238 INFO:tasks.workunit.client.1.smithi136.stdout:1/439: link d2/f42 d2/d5/d11/d2e/d4c/f89 0 2024-09-18T12:51:14.238 INFO:tasks.workunit.client.1.smithi136.stdout:1/440: chown d2/d5/d2b/d34/d86 120094 1 2024-09-18T12:51:14.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/240: dread d0/db/f2b [0,4194304] 0 2024-09-18T12:51:14.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/241: chown d0/db/d12/d2d 0 1 2024-09-18T12:51:14.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/242: fsync d0/db/f2b 0 2024-09-18T12:51:14.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/243: chown d0/db/d12/d2d/f2f 1240432 1 2024-09-18T12:51:14.242 INFO:tasks.workunit.client.1.smithi136.stdout:2/489: read d5/d25/f62 [597097,86009] 0 2024-09-18T12:51:14.242 INFO:tasks.workunit.client.1.smithi136.stdout:8/605: mkdir d9/d18/d34/d88/dd5 0 2024-09-18T12:51:14.242 INFO:tasks.workunit.client.1.smithi136.stdout:2/490: chown d5/d7/d17/l39 11694535 1 2024-09-18T12:51:14.243 INFO:tasks.workunit.client.1.smithi136.stdout:1/441: mknod d2/d5/d2b/d34/c8a 0 2024-09-18T12:51:14.244 INFO:tasks.workunit.client.1.smithi136.stdout:8/606: creat d9/d14/d1a/d7f/d8c/dcb/fd6 x:0 0 0 2024-09-18T12:51:14.245 INFO:tasks.workunit.client.0.smithi081.stdout:1/244: rmdir d0/db 39 2024-09-18T12:51:14.245 INFO:tasks.workunit.client.0.smithi081.stdout:1/245: truncate d0/d6/d33/d37/f3e 441772 0 2024-09-18T12:51:14.245 INFO:tasks.workunit.client.1.smithi136.stdout:1/442: symlink d2/d5/d2b/d34/d86/d50/d65/l8b 0 2024-09-18T12:51:14.247 INFO:tasks.workunit.client.0.smithi081.stdout:2/243: write d15/f17 [3739297,124911] 0 2024-09-18T12:51:14.250 INFO:tasks.workunit.client.0.smithi081.stdout:3/251: dwrite d3/db/df/d29/d13/f14 [0,4194304] 0 2024-09-18T12:51:14.250 INFO:tasks.workunit.client.0.smithi081.stdout:5/235: dwrite d2/d14/d1d/d1a/f4a [0,4194304] 0 2024-09-18T12:51:14.251 INFO:tasks.workunit.client.0.smithi081.stdout:3/252: getdents d3/db/dc 0 2024-09-18T12:51:14.254 INFO:tasks.workunit.client.0.smithi081.stdout:5/236: truncate d2/d14/d33/d37/d3b/f38 410198 0 2024-09-18T12:51:14.254 INFO:tasks.workunit.client.0.smithi081.stdout:5/237: dread - d2/d14/f32 zero size 2024-09-18T12:51:14.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/253: mknod d3/db/df/d29/d13/c54 0 2024-09-18T12:51:14.256 INFO:tasks.workunit.client.0.smithi081.stdout:3/254: fsync d3/db/dc/f22 0 2024-09-18T12:51:14.256 INFO:tasks.workunit.client.0.smithi081.stdout:3/255: creat d3/d23/f55 x:0 0 0 2024-09-18T12:51:14.256 INFO:tasks.workunit.client.0.smithi081.stdout:3/256: creat d3/db/f56 x:0 0 0 2024-09-18T12:51:14.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/491: write d5/d4a/d64/f7d [2449727,81872] 0 2024-09-18T12:51:14.257 INFO:tasks.workunit.client.1.smithi136.stdout:5/536: dwrite d5/d1a/d2d/d34/d88/f86 [0,4194304] 0 2024-09-18T12:51:14.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/492: chown d5/d25/f6c 25647028 1 2024-09-18T12:51:14.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/493: fdatasync d5/d7/d11/f32 0 2024-09-18T12:51:14.260 INFO:tasks.workunit.client.0.smithi081.stdout:3/257: rename d3/db/df/d29/d13/d17 to d3/db/d1b/d57 0 2024-09-18T12:51:14.260 INFO:tasks.workunit.client.0.smithi081.stdout:3/258: write d3/db/df/d29/d13/f1e [2637964,99788] 0 2024-09-18T12:51:14.260 INFO:tasks.workunit.client.0.smithi081.stdout:5/238: rmdir d2/d14/d1d/d1a 39 2024-09-18T12:51:14.261 INFO:tasks.workunit.client.1.smithi136.stdout:1/443: dread d2/d5/d9/f3b [8388608,4194304] 0 2024-09-18T12:51:14.262 INFO:tasks.workunit.client.0.smithi081.stdout:3/259: mkdir d3/db/df/d29/d13/d3c/d58 0 2024-09-18T12:51:14.263 INFO:tasks.workunit.client.0.smithi081.stdout:5/239: chown d2/d14/d33/d37/d3b/d2a/d44/f3a 0 1 2024-09-18T12:51:14.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/537: mkdir d5/d1a/d4a/da1 0 2024-09-18T12:51:14.263 INFO:tasks.workunit.client.0.smithi081.stdout:2/244: dread d15/d26/f29 [0,4194304] 0 2024-09-18T12:51:14.263 INFO:tasks.workunit.client.0.smithi081.stdout:2/245: chown d15/d16/f19 54270 1 2024-09-18T12:51:14.264 INFO:tasks.workunit.client.0.smithi081.stdout:3/260: mknod d3/db/df/d3b/d47/c59 0 2024-09-18T12:51:14.264 INFO:tasks.workunit.client.0.smithi081.stdout:3/261: getdents d3/db/dc 0 2024-09-18T12:51:14.265 INFO:tasks.workunit.client.1.smithi136.stdout:2/494: link d5/f65 d5/d4a/f92 0 2024-09-18T12:51:14.265 INFO:tasks.workunit.client.1.smithi136.stdout:2/495: dread - d5/d25/d43/d74/f76 zero size 2024-09-18T12:51:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:2/246: getdents d15/d16/d20/d31 0 2024-09-18T12:51:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:2/247: fdatasync fc 0 2024-09-18T12:51:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:2/248: dread f9 [0,4194304] 0 2024-09-18T12:51:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:2/249: chown d15/c35 0 1 2024-09-18T12:51:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:2/250: write d15/d16/d20/d31/f3e [48009,3947] 0 2024-09-18T12:51:14.273 INFO:tasks.workunit.client.1.smithi136.stdout:9/514: dwrite d6/da/d3d/d4d/d91/d25/d55/f5b [0,4194304] 0 2024-09-18T12:51:14.274 INFO:tasks.workunit.client.1.smithi136.stdout:0/495: dwrite d1/d17/f25 [0,4194304] 0 2024-09-18T12:51:14.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/464: dwrite d8/d9/d56/f72 [0,4194304] 0 2024-09-18T12:51:14.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/465: fsync d8/d9/d56/f72 0 2024-09-18T12:51:14.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/466: fsync d8/d9/d3c/f59 0 2024-09-18T12:51:14.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/467: fdatasync d8/d9/d3c/f68 0 2024-09-18T12:51:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:2/251: rename d15/d16/d20/d31/f3e to d15/d16/d20/f4c 0 2024-09-18T12:51:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:3/262: write d3/db/dc/f28 [652218,89320] 0 2024-09-18T12:51:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:3/263: chown f1 8449897 1 2024-09-18T12:51:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:3/264: chown d3/db/df/d29/d13/d3c/d58 30983375 1 2024-09-18T12:51:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:1/246: dwrite d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:5/240: write d2/d14/f17 [2464691,86719] 0 2024-09-18T12:51:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:2/252: mkdir d15/d26/d4d 0 2024-09-18T12:51:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:3/265: rename d3/db/df/d3b/l45 to d3/db/d1b/l5a 0 2024-09-18T12:51:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:1/247: symlink d0/d6/l59 0 2024-09-18T12:51:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:2/253: dread d15/d26/f29 [0,4194304] 0 2024-09-18T12:51:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:5/241: symlink d2/d47/l4d 0 2024-09-18T12:51:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:3/266: getdents d3/db/df/d29/d12 0 2024-09-18T12:51:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:2/254: rename d15/d16/d20/c43 to d15/d16/d25/c4e 0 2024-09-18T12:51:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:3/267: mknod d3/db/df/d3b/d47/c5b 0 2024-09-18T12:51:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:2/255: truncate fc 1743002 0 2024-09-18T12:51:14.299 INFO:tasks.workunit.client.1.smithi136.stdout:1/444: mknod d2/d5/d11/d2e/d4c/c8c 0 2024-09-18T12:51:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:3/268: rename d3/db/dc/f22 to d3/db/df/d29/d13/d3c/f5c 0 2024-09-18T12:51:14.301 INFO:tasks.workunit.client.1.smithi136.stdout:5/538: mknod d5/d1a/d2d/d3f/ca2 0 2024-09-18T12:51:14.301 INFO:tasks.workunit.client.1.smithi136.stdout:5/539: creat d5/d1a/d2d/d34/fa3 x:0 0 0 2024-09-18T12:51:14.302 INFO:tasks.workunit.client.1.smithi136.stdout:5/540: chown d5/d1a/c56 17837 1 2024-09-18T12:51:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:2/256: creat d15/d16/d20/f4f x:0 0 0 2024-09-18T12:51:14.303 INFO:tasks.workunit.client.1.smithi136.stdout:2/496: creat d5/d7/d17/d48/f93 x:0 0 0 2024-09-18T12:51:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:3/269: symlink d3/db/df/d29/d12/l5d 0 2024-09-18T12:51:14.305 INFO:tasks.workunit.client.0.smithi081.stdout:2/257: symlink d15/d16/d20/d22/l50 0 2024-09-18T12:51:14.306 INFO:tasks.workunit.client.0.smithi081.stdout:3/270: rename d3/db/df/d29/d13/f14 to d3/d23/f5e 0 2024-09-18T12:51:14.307 INFO:tasks.workunit.client.0.smithi081.stdout:2/258: truncate d15/d16/d20/d22/f34 203685 0 2024-09-18T12:51:14.308 INFO:tasks.workunit.client.0.smithi081.stdout:3/271: truncate d3/db/df/d29/d13/d3c/f5c 285269 0 2024-09-18T12:51:14.310 INFO:tasks.workunit.client.0.smithi081.stdout:5/242: dwrite d2/d14/d33/d37/d3b/f43 [0,4194304] 0 2024-09-18T12:51:14.311 INFO:tasks.workunit.client.0.smithi081.stdout:2/259: rename f13 to d15/d16/d25/d32/f51 0 2024-09-18T12:51:14.311 INFO:tasks.workunit.client.0.smithi081.stdout:1/248: dwrite d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:14.315 INFO:tasks.workunit.client.0.smithi081.stdout:1/249: rmdir d0/db/d4f 39 2024-09-18T12:51:14.315 INFO:tasks.workunit.client.0.smithi081.stdout:1/250: chown d0/db/l48 263847031 1 2024-09-18T12:51:14.317 INFO:tasks.workunit.client.0.smithi081.stdout:3/272: rename d3/db/dc/d1a/c42 to d3/db/df/d29/d12/d44/d51/c5f 0 2024-09-18T12:51:14.318 INFO:tasks.workunit.client.0.smithi081.stdout:1/251: symlink d0/db/d12/d2d/l5a 0 2024-09-18T12:51:14.319 INFO:tasks.workunit.client.1.smithi136.stdout:9/515: rename d6/db/d12/c8a to d6/da/cb0 0 2024-09-18T12:51:14.319 INFO:tasks.workunit.client.1.smithi136.stdout:9/516: fdatasync d6/da/d3d/d4d/d91/f6c 0 2024-09-18T12:51:14.319 INFO:tasks.workunit.client.1.smithi136.stdout:9/517: write d6/da/d3d/d4d/d91/d25/f3a [107716,126943] 0 2024-09-18T12:51:14.321 INFO:tasks.workunit.client.1.smithi136.stdout:6/468: truncate d8/d9/de/d1c/f2b 2307802 0 2024-09-18T12:51:14.330 INFO:tasks.workunit.client.0.smithi081.stdout:3/273: rename d3/db/df/d29/d13/d3c to d3/db/df/d60 0 2024-09-18T12:51:14.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/243: rename d2/d14/d33/d37/d3b/d18/d20/f22 to d2/d14/f4e 0 2024-09-18T12:51:14.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/244: readlink d2/l4b 0 2024-09-18T12:51:14.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/245: chown d2/dd/l2c 444167 1 2024-09-18T12:51:14.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/246: chown d2/dd/l2c 252890 1 2024-09-18T12:51:14.337 INFO:tasks.workunit.client.0.smithi081.stdout:5/247: symlink d2/l4f 0 2024-09-18T12:51:14.337 INFO:tasks.workunit.client.0.smithi081.stdout:5/248: chown d2/d47/l4d 6850 1 2024-09-18T12:51:14.340 INFO:tasks.workunit.client.0.smithi081.stdout:1/252: dwrite d0/d6/fe [8388608,4194304] 0 2024-09-18T12:51:14.341 INFO:tasks.workunit.client.0.smithi081.stdout:5/249: link d2/d14/d33/d37/d3b/d18/d20/f30 d2/d14/d33/d37/f50 0 2024-09-18T12:51:14.344 INFO:tasks.workunit.client.0.smithi081.stdout:1/253: creat d0/d6/d33/d42/f5b x:0 0 0 2024-09-18T12:51:14.344 INFO:tasks.workunit.client.0.smithi081.stdout:1/254: chown d0/db/l13 88 1 2024-09-18T12:51:14.344 INFO:tasks.workunit.client.0.smithi081.stdout:1/255: dread - d0/d6/d7/d2e/d51/f56 zero size 2024-09-18T12:51:14.347 INFO:tasks.workunit.client.0.smithi081.stdout:1/256: unlink d0/d6/d33/d37/f3e 0 2024-09-18T12:51:14.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/250: dread d2/d14/d33/d37/d3b/d18/f35 [0,4194304] 0 2024-09-18T12:51:14.356 INFO:tasks.workunit.client.0.smithi081.stdout:3/274: dwrite d3/db/df/d29/f3a [0,4194304] 0 2024-09-18T12:51:14.358 INFO:tasks.workunit.client.0.smithi081.stdout:2/260: dwrite fc [0,4194304] 0 2024-09-18T12:51:14.361 INFO:tasks.workunit.client.0.smithi081.stdout:3/275: fsync d3/db/dc/f28 0 2024-09-18T12:51:14.361 INFO:tasks.workunit.client.0.smithi081.stdout:3/276: creat d3/db/df/d29/d13/f61 x:0 0 0 2024-09-18T12:51:14.364 INFO:tasks.workunit.client.0.smithi081.stdout:1/257: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:14.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/261: creat d15/d16/d25/f52 x:0 0 0 2024-09-18T12:51:14.372 INFO:tasks.workunit.client.0.smithi081.stdout:7/231: sync 2024-09-18T12:51:14.372 INFO:tasks.workunit.client.0.smithi081.stdout:6/173: sync 2024-09-18T12:51:14.373 INFO:tasks.workunit.client.0.smithi081.stdout:4/186: sync 2024-09-18T12:51:14.374 INFO:tasks.workunit.client.0.smithi081.stdout:5/251: dwrite d2/d14/d33/d37/d3b/d2a/d44/f40 [0,4194304] 0 2024-09-18T12:51:14.374 INFO:tasks.workunit.client.0.smithi081.stdout:7/232: link d2/f4a d2/f52 0 2024-09-18T12:51:14.378 INFO:tasks.workunit.client.0.smithi081.stdout:5/252: symlink d2/d14/d33/d37/d3b/d16/l51 0 2024-09-18T12:51:14.380 INFO:tasks.workunit.client.0.smithi081.stdout:6/174: dread f0 [0,4194304] 0 2024-09-18T12:51:14.380 INFO:tasks.workunit.client.0.smithi081.stdout:6/175: dread - d4/d12/f32 zero size 2024-09-18T12:51:14.380 INFO:tasks.workunit.client.0.smithi081.stdout:7/233: mkdir d2/d14/d21/d53 0 2024-09-18T12:51:14.382 INFO:tasks.workunit.client.0.smithi081.stdout:5/253: mknod d2/d14/d33/d37/d3b/d2a/d44/c52 0 2024-09-18T12:51:14.383 INFO:tasks.workunit.client.0.smithi081.stdout:5/254: stat d2/d14/d33/d37/d3b/f13 0 2024-09-18T12:51:14.384 INFO:tasks.workunit.client.0.smithi081.stdout:7/234: creat d2/d14/d21/d49/f54 x:0 0 0 2024-09-18T12:51:14.387 INFO:tasks.workunit.client.1.smithi136.stdout:1/445: link d2/d5/d2b/d34/d86/d50/d65/l68 d2/d5/d2b/d63/l8d 0 2024-09-18T12:51:14.389 INFO:tasks.workunit.client.0.smithi081.stdout:3/277: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:14.392 INFO:tasks.workunit.client.1.smithi136.stdout:0/496: rename d1/d3/d1a/d98/d81/d35/d54/f5e to d1/d60/fa7 0 2024-09-18T12:51:14.394 INFO:tasks.workunit.client.1.smithi136.stdout:6/469: mknod d8/d9/d64/c9b 0 2024-09-18T12:51:14.398 INFO:tasks.workunit.client.1.smithi136.stdout:1/446: unlink d2/d5/d2b/f88 0 2024-09-18T12:51:14.401 INFO:tasks.workunit.client.0.smithi081.stdout:4/187: dwrite d3/f3c [0,4194304] 0 2024-09-18T12:51:14.402 INFO:tasks.workunit.client.1.smithi136.stdout:0/497: truncate d1/d3/d1a/f33 4290338 0 2024-09-18T12:51:14.403 INFO:tasks.workunit.client.1.smithi136.stdout:6/470: mkdir d8/d9/d56/d96/d9c 0 2024-09-18T12:51:14.403 INFO:tasks.workunit.client.0.smithi081.stdout:4/188: mkdir d3/dd/d45 0 2024-09-18T12:51:14.403 INFO:tasks.workunit.client.0.smithi081.stdout:4/189: chown d3/db/f18 1 1 2024-09-18T12:51:14.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/498: getdents d1/d3 0 2024-09-18T12:51:14.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/499: chown d1/d46/f66 2843 1 2024-09-18T12:51:14.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/500: creat d1/db/d77/fa8 x:0 0 0 2024-09-18T12:51:14.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/501: truncate d1/d17/f97 39120 0 2024-09-18T12:51:14.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/502: truncate d1/d60/f6f 1552863 0 2024-09-18T12:51:14.410 INFO:tasks.workunit.client.0.smithi081.stdout:1/258: dwrite d0/db/d12/f24 [4194304,4194304] 0 2024-09-18T12:51:14.413 INFO:tasks.workunit.client.1.smithi136.stdout:1/447: write d2/d5/d11/f19 [1327840,130140] 0 2024-09-18T12:51:14.416 INFO:tasks.workunit.client.0.smithi081.stdout:7/235: dread d2/d1d/f36 [0,4194304] 0 2024-09-18T12:51:14.416 INFO:tasks.workunit.client.0.smithi081.stdout:7/236: fsync d2/d14/f16 0 2024-09-18T12:51:14.416 INFO:tasks.workunit.client.0.smithi081.stdout:2/262: dwrite d15/d16/f18 [0,4194304] 0 2024-09-18T12:51:14.420 INFO:tasks.workunit.client.0.smithi081.stdout:3/278: dwrite d3/db/df/d60/f5c [0,4194304] 0 2024-09-18T12:51:14.420 INFO:tasks.workunit.client.0.smithi081.stdout:7/237: link d2/l1a d2/d42/l55 0 2024-09-18T12:51:14.420 INFO:tasks.workunit.client.0.smithi081.stdout:7/238: fdatasync d2/f52 0 2024-09-18T12:51:14.421 INFO:tasks.workunit.client.0.smithi081.stdout:6/176: dwrite d4/d6/fd [0,4194304] 0 2024-09-18T12:51:14.421 INFO:tasks.workunit.client.0.smithi081.stdout:6/177: fdatasync d4/f21 0 2024-09-18T12:51:14.422 INFO:tasks.workunit.client.0.smithi081.stdout:2/263: mkdir d15/d16/d33/d53 0 2024-09-18T12:51:14.424 INFO:tasks.workunit.client.1.smithi136.stdout:6/471: dread d8/d9/de/f70 [0,4194304] 0 2024-09-18T12:51:14.426 INFO:tasks.workunit.client.0.smithi081.stdout:7/239: rename d2/d14/d21/d53 to d2/d56 0 2024-09-18T12:51:14.426 INFO:tasks.workunit.client.0.smithi081.stdout:5/255: dwrite d2/dd/f21 [0,4194304] 0 2024-09-18T12:51:14.427 INFO:tasks.workunit.client.0.smithi081.stdout:2/264: mkdir d15/d16/d54 0 2024-09-18T12:51:14.427 INFO:tasks.workunit.client.0.smithi081.stdout:2/265: fdatasync d15/d16/d20/d22/f34 0 2024-09-18T12:51:14.427 INFO:tasks.workunit.client.0.smithi081.stdout:2/266: read - d15/d16/f44 zero size 2024-09-18T12:51:14.427 INFO:tasks.workunit.client.0.smithi081.stdout:2/267: creat d15/d16/d20/f55 x:0 0 0 2024-09-18T12:51:14.428 INFO:tasks.workunit.client.0.smithi081.stdout:7/240: symlink d2/d14/d21/l57 0 2024-09-18T12:51:14.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/256: mknod d2/d14/d33/d37/d3b/d18/c53 0 2024-09-18T12:51:14.431 INFO:tasks.workunit.client.0.smithi081.stdout:2/268: mknod d15/d16/d54/c56 0 2024-09-18T12:51:14.432 INFO:tasks.workunit.client.0.smithi081.stdout:7/241: link d2/l5 d2/l58 0 2024-09-18T12:51:14.432 INFO:tasks.workunit.client.0.smithi081.stdout:7/242: dread - d2/f52 zero size 2024-09-18T12:51:14.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/257: creat d2/d14/d33/d37/f54 x:0 0 0 2024-09-18T12:51:14.434 INFO:tasks.workunit.client.1.smithi136.stdout:7/564: sync 2024-09-18T12:51:14.434 INFO:tasks.workunit.client.1.smithi136.stdout:7/565: chown d0/d12/d5e/ca4 96 1 2024-09-18T12:51:14.435 INFO:tasks.workunit.client.0.smithi081.stdout:2/269: unlink d15/c3a 0 2024-09-18T12:51:14.436 INFO:tasks.workunit.client.1.smithi136.stdout:3/471: sync 2024-09-18T12:51:14.436 INFO:tasks.workunit.client.1.smithi136.stdout:4/387: sync 2024-09-18T12:51:14.437 INFO:tasks.workunit.client.0.smithi081.stdout:6/178: read d4/f7 [2115720,118639] 0 2024-09-18T12:51:14.437 INFO:tasks.workunit.client.0.smithi081.stdout:7/243: link d2/d18/l2b d2/d18/d22/d48/l59 0 2024-09-18T12:51:14.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/258: unlink d2/dd/l2c 0 2024-09-18T12:51:14.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/259: dread - d2/d14/d33/d37/d3b/d2a/d44/f42 zero size 2024-09-18T12:51:14.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/260: chown d2/d14/d1d/d1a/f4a 1392122699 1 2024-09-18T12:51:14.439 INFO:tasks.workunit.client.0.smithi081.stdout:5/261: fsync d2/d14/f27 0 2024-09-18T12:51:14.439 INFO:tasks.workunit.client.0.smithi081.stdout:3/279: dread d3/db/df/d60/f5c [0,4194304] 0 2024-09-18T12:51:14.439 INFO:tasks.workunit.client.1.smithi136.stdout:3/472: unlink d3/d14/d18/d7f/c4f 0 2024-09-18T12:51:14.439 INFO:tasks.workunit.client.1.smithi136.stdout:3/473: write d3/d14/d17/f4d [4550083,12131] 0 2024-09-18T12:51:14.440 INFO:tasks.workunit.client.1.smithi136.stdout:4/388: creat d0/d3/f73 x:0 0 0 2024-09-18T12:51:14.441 INFO:tasks.workunit.client.0.smithi081.stdout:2/270: symlink d15/d16/d33/d53/l57 0 2024-09-18T12:51:14.442 INFO:tasks.workunit.client.1.smithi136.stdout:4/389: creat d0/d3/d54/f74 x:0 0 0 2024-09-18T12:51:14.442 INFO:tasks.workunit.client.0.smithi081.stdout:7/244: link d2/d1d/l46 d2/d42/l5a 0 2024-09-18T12:51:14.444 INFO:tasks.workunit.client.1.smithi136.stdout:3/474: write d3/d14/d22/f37 [3277802,42960] 0 2024-09-18T12:51:14.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/262: symlink d2/d14/d33/d37/d3b/l55 0 2024-09-18T12:51:14.445 INFO:tasks.workunit.client.0.smithi081.stdout:1/259: dwrite d0/d6/f3d [0,4194304] 0 2024-09-18T12:51:14.445 INFO:tasks.workunit.client.0.smithi081.stdout:1/260: fsync d0/d6/d7/d8/f52 0 2024-09-18T12:51:14.446 INFO:tasks.workunit.client.0.smithi081.stdout:4/190: dwrite d3/f3c [0,4194304] 0 2024-09-18T12:51:14.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/280: creat d3/db/df/d29/d12/d44/f62 x:0 0 0 2024-09-18T12:51:14.447 INFO:tasks.workunit.client.1.smithi136.stdout:5/541: unlink d5/f62 0 2024-09-18T12:51:14.447 INFO:tasks.workunit.client.1.smithi136.stdout:5/542: chown d5/d1a/d2d/d34/f42 7845253 1 2024-09-18T12:51:14.447 INFO:tasks.workunit.client.1.smithi136.stdout:5/543: read d5/d1a/d30/f40 [38263,68048] 0 2024-09-18T12:51:14.447 INFO:tasks.workunit.client.1.smithi136.stdout:1/448: dwrite d2/d5/d2b/d34/d86/d50/f75 [0,4194304] 0 2024-09-18T12:51:14.448 INFO:tasks.workunit.client.0.smithi081.stdout:2/271: rmdir d15/d16/d20/d31 39 2024-09-18T12:51:14.448 INFO:tasks.workunit.client.0.smithi081.stdout:2/272: chown d15/d16/d20/f55 64309 1 2024-09-18T12:51:14.449 INFO:tasks.workunit.client.0.smithi081.stdout:5/263: mkdir d2/d14/d33/d37/d3b/d16/d56 0 2024-09-18T12:51:14.449 INFO:tasks.workunit.client.1.smithi136.stdout:0/503: dwrite d1/d17/f25 [0,4194304] 0 2024-09-18T12:51:14.450 INFO:tasks.workunit.client.0.smithi081.stdout:1/261: creat d0/d6/d7/d2e/d51/d2c/f5c x:0 0 0 2024-09-18T12:51:14.450 INFO:tasks.workunit.client.0.smithi081.stdout:1/262: write d0/d6/d7/d8/f29 [49090,77883] 0 2024-09-18T12:51:14.451 INFO:tasks.workunit.client.1.smithi136.stdout:5/544: link d5/d1a/d2d/c92 d5/d1a/d2d/d3f/d7f/ca4 0 2024-09-18T12:51:14.454 INFO:tasks.workunit.client.1.smithi136.stdout:7/566: dwrite d0/d12/d5e/d67/f68 [0,4194304] 0 2024-09-18T12:51:14.455 INFO:tasks.workunit.client.0.smithi081.stdout:4/191: mknod d3/dd/d45/c46 0 2024-09-18T12:51:14.456 INFO:tasks.workunit.client.0.smithi081.stdout:3/281: truncate d3/db/df/d29/f19 2360923 0 2024-09-18T12:51:14.456 INFO:tasks.workunit.client.0.smithi081.stdout:3/282: write d3/db/f2c [1023528,28563] 0 2024-09-18T12:51:14.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/179: write d4/fa [2262792,53340] 0 2024-09-18T12:51:14.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/180: fsync d4/f13 0 2024-09-18T12:51:14.458 INFO:tasks.workunit.client.0.smithi081.stdout:2/273: link f9 d15/d16/f58 0 2024-09-18T12:51:14.458 INFO:tasks.workunit.client.1.smithi136.stdout:1/449: mkdir d2/d5/d11/d2e/d4c/d8e 0 2024-09-18T12:51:14.459 INFO:tasks.workunit.client.0.smithi081.stdout:5/264: unlink d2/d14/f27 0 2024-09-18T12:51:14.460 INFO:tasks.workunit.client.1.smithi136.stdout:6/472: mkdir d8/d9d 0 2024-09-18T12:51:14.461 INFO:tasks.workunit.client.0.smithi081.stdout:1/263: symlink d0/d6/d7/d2e/d51/d2c/l5d 0 2024-09-18T12:51:14.461 INFO:tasks.workunit.client.1.smithi136.stdout:0/504: creat d1/d46/d6c/fa9 x:0 0 0 2024-09-18T12:51:14.461 INFO:tasks.workunit.client.1.smithi136.stdout:0/505: write d1/d17/f47 [10372848,99896] 0 2024-09-18T12:51:14.462 INFO:tasks.workunit.client.1.smithi136.stdout:5/545: creat d5/fa5 x:0 0 0 2024-09-18T12:51:14.462 INFO:tasks.workunit.client.1.smithi136.stdout:5/546: creat d5/d1a/d2d/fa6 x:0 0 0 2024-09-18T12:51:14.462 INFO:tasks.workunit.client.0.smithi081.stdout:4/192: symlink d3/d20/l47 0 2024-09-18T12:51:14.462 INFO:tasks.workunit.client.0.smithi081.stdout:4/193: write d3/f22 [4740499,84207] 0 2024-09-18T12:51:14.464 INFO:tasks.workunit.client.1.smithi136.stdout:0/506: creat d1/db/faa x:0 0 0 2024-09-18T12:51:14.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/283: creat d3/db/df/d29/d12/d44/d51/f63 x:0 0 0 2024-09-18T12:51:14.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/284: chown d3/db/df/d3b/d47/c3d 9886 1 2024-09-18T12:51:14.467 INFO:tasks.workunit.client.1.smithi136.stdout:0/507: rmdir d1/d3/d1a/d62/d75 39 2024-09-18T12:51:14.468 INFO:tasks.workunit.client.0.smithi081.stdout:6/181: creat d4/d12/d28/f34 x:0 0 0 2024-09-18T12:51:14.468 INFO:tasks.workunit.client.0.smithi081.stdout:6/182: write d4/d12/d28/f34 [916934,22757] 0 2024-09-18T12:51:14.469 INFO:tasks.workunit.client.0.smithi081.stdout:5/265: link d2/d14/d1d/c46 d2/d14/d33/c57 0 2024-09-18T12:51:14.469 INFO:tasks.workunit.client.0.smithi081.stdout:5/266: write d2/d14/d1d/d1a/f34 [1649784,15064] 0 2024-09-18T12:51:14.469 INFO:tasks.workunit.client.0.smithi081.stdout:5/267: write d2/d14/d33/d37/d3b/d2a/d44/f40 [4318707,27450] 0 2024-09-18T12:51:14.470 INFO:tasks.workunit.client.1.smithi136.stdout:1/450: dread d2/d5/d2b/d34/d86/f2c [0,4194304] 0 2024-09-18T12:51:14.470 INFO:tasks.workunit.client.1.smithi136.stdout:6/473: dread d8/d9/de/d1c/f42 [0,4194304] 0 2024-09-18T12:51:14.470 INFO:tasks.workunit.client.1.smithi136.stdout:0/508: truncate d1/f31 35261 0 2024-09-18T12:51:14.471 INFO:tasks.workunit.client.0.smithi081.stdout:1/264: rmdir d0/d6/d7 39 2024-09-18T12:51:14.471 INFO:tasks.workunit.client.0.smithi081.stdout:1/265: stat d0/d6/fe 0 2024-09-18T12:51:14.471 INFO:tasks.workunit.client.0.smithi081.stdout:1/266: stat d0/db/d4f 0 2024-09-18T12:51:14.471 INFO:tasks.workunit.client.0.smithi081.stdout:1/267: fdatasync d0/d6/d7/d2e/d51/f56 0 2024-09-18T12:51:14.471 INFO:tasks.workunit.client.0.smithi081.stdout:1/268: write d0/d6/d7/d2e/d51/f56 [438327,64213] 0 2024-09-18T12:51:14.473 INFO:tasks.workunit.client.0.smithi081.stdout:3/285: rename d3/db/df/d29/f3a to d3/db/df/d29/f64 0 2024-09-18T12:51:14.474 INFO:tasks.workunit.client.1.smithi136.stdout:3/475: dwrite d3/d10/f5e [4194304,4194304] 0 2024-09-18T12:51:14.474 INFO:tasks.workunit.client.1.smithi136.stdout:4/390: dwrite d0/f72 [0,4194304] 0 2024-09-18T12:51:14.476 INFO:tasks.workunit.client.1.smithi136.stdout:6/474: mknod d8/d9/d3c/d4a/c9e 0 2024-09-18T12:51:14.476 INFO:tasks.workunit.client.0.smithi081.stdout:7/245: dwrite d2/f4a [0,4194304] 0 2024-09-18T12:51:14.478 INFO:tasks.workunit.client.1.smithi136.stdout:3/476: write d3/d2b/f4b [1066633,76616] 0 2024-09-18T12:51:14.479 INFO:tasks.workunit.client.0.smithi081.stdout:4/194: dread d3/f1b [0,4194304] 0 2024-09-18T12:51:14.479 INFO:tasks.workunit.client.1.smithi136.stdout:0/509: dread d1/d17/f4c [0,4194304] 0 2024-09-18T12:51:14.483 INFO:tasks.workunit.client.1.smithi136.stdout:1/451: symlink d2/d5/d9/l8f 0 2024-09-18T12:51:14.485 INFO:tasks.workunit.client.1.smithi136.stdout:6/475: unlink d8/f26 0 2024-09-18T12:51:14.487 INFO:tasks.workunit.client.0.smithi081.stdout:5/268: rename d2/d14/d1d/d1a/f34 to d2/d47/f58 0 2024-09-18T12:51:14.487 INFO:tasks.workunit.client.0.smithi081.stdout:5/269: read - d2/d14/d33/d37/d3b/d2a/d44/f42 zero size 2024-09-18T12:51:14.487 INFO:tasks.workunit.client.1.smithi136.stdout:9/518: rename d6/da/d3d/d4d/d91/d25/c82 to d6/da/d3d/d4d/cb1 0 2024-09-18T12:51:14.490 INFO:tasks.workunit.client.1.smithi136.stdout:6/476: dread d8/d9/de/d1c/d50/f73 [0,4194304] 0 2024-09-18T12:51:14.490 INFO:tasks.workunit.client.0.smithi081.stdout:3/286: mkdir d3/db/df/d29/d13/d65 0 2024-09-18T12:51:14.490 INFO:tasks.workunit.client.0.smithi081.stdout:3/287: fsync d3/db/df/d29/f48 0 2024-09-18T12:51:14.493 INFO:tasks.workunit.client.1.smithi136.stdout:7/567: rename d0/c9d to d0/d35/d41/d50/d7b/cc4 0 2024-09-18T12:51:14.494 INFO:tasks.workunit.client.0.smithi081.stdout:7/246: symlink d2/d1d/l5b 0 2024-09-18T12:51:14.495 INFO:tasks.workunit.client.1.smithi136.stdout:6/477: mkdir d8/d9d/d9f 0 2024-09-18T12:51:14.495 INFO:tasks.workunit.client.1.smithi136.stdout:6/478: fsync d8/d9/de/d60/f81 0 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:0/219: sync 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:0/220: read f0 [2871980,76365] 0 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:9/148: sync 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:8/222: sync 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:8/223: chown d3/d1e/f2b 12440491 1 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:8/224: dread - d3/d1d/d4a/f4f zero size 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:4/195: mknod d3/db/c48 0 2024-09-18T12:51:14.498 INFO:tasks.workunit.client.0.smithi081.stdout:4/196: chown d3/d20/l47 164086 1 2024-09-18T12:51:14.499 INFO:tasks.workunit.client.0.smithi081.stdout:3/288: mknod d3/db/df/d29/c66 0 2024-09-18T12:51:14.499 INFO:tasks.workunit.client.0.smithi081.stdout:3/289: chown d3/l24 0 1 2024-09-18T12:51:14.502 INFO:tasks.workunit.client.0.smithi081.stdout:7/247: mknod d2/d1d/d4e/c5c 0 2024-09-18T12:51:14.503 INFO:tasks.workunit.client.0.smithi081.stdout:7/248: dread d2/d1d/d27/f47 [0,4194304] 0 2024-09-18T12:51:14.504 INFO:tasks.workunit.client.1.smithi136.stdout:1/452: symlink d2/l90 0 2024-09-18T12:51:14.505 INFO:tasks.workunit.client.1.smithi136.stdout:9/519: dread d6/d59/f2a [0,4194304] 0 2024-09-18T12:51:14.506 INFO:tasks.workunit.client.0.smithi081.stdout:5/270: truncate d2/dd/f21 3191928 0 2024-09-18T12:51:14.508 INFO:tasks.workunit.client.1.smithi136.stdout:1/453: unlink d2/d5/d11/d2e/f61 0 2024-09-18T12:51:14.508 INFO:tasks.workunit.client.1.smithi136.stdout:1/454: creat d2/d5/d2b/d34/f91 x:0 0 0 2024-09-18T12:51:14.509 INFO:tasks.workunit.client.0.smithi081.stdout:7/249: mknod d2/d18/c5d 0 2024-09-18T12:51:14.509 INFO:tasks.workunit.client.0.smithi081.stdout:7/250: chown d2/d18/f3f 5 1 2024-09-18T12:51:14.509 INFO:tasks.workunit.client.1.smithi136.stdout:9/520: getdents d6 0 2024-09-18T12:51:14.511 INFO:tasks.workunit.client.0.smithi081.stdout:9/149: dread f6 [0,4194304] 0 2024-09-18T12:51:14.511 INFO:tasks.workunit.client.0.smithi081.stdout:5/271: write d2/d47/f58 [1606461,104480] 0 2024-09-18T12:51:14.513 INFO:tasks.workunit.client.0.smithi081.stdout:8/225: write d3/f18 [3012429,32561] 0 2024-09-18T12:51:14.513 INFO:tasks.workunit.client.0.smithi081.stdout:8/226: creat d3/d1d/f55 x:0 0 0 2024-09-18T12:51:14.513 INFO:tasks.workunit.client.1.smithi136.stdout:9/521: getdents d6/da 0 2024-09-18T12:51:14.514 INFO:tasks.workunit.client.0.smithi081.stdout:7/251: mkdir d2/d14/d21/d49/d5e 0 2024-09-18T12:51:14.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/150: creat dd/d1d/f2e x:0 0 0 2024-09-18T12:51:14.517 INFO:tasks.workunit.client.0.smithi081.stdout:9/151: fsync f7 0 2024-09-18T12:51:14.517 INFO:tasks.workunit.client.1.smithi136.stdout:5/547: rmdir d5/d1a/d2d/d3f 39 2024-09-18T12:51:14.517 INFO:tasks.workunit.client.1.smithi136.stdout:5/548: write d5/f11 [716137,95035] 0 2024-09-18T12:51:14.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/227: write d3/f2d [800838,119725] 0 2024-09-18T12:51:14.518 INFO:tasks.workunit.client.0.smithi081.stdout:5/272: mknod d2/d14/d33/d37/d3b/d16/d56/c59 0 2024-09-18T12:51:14.519 INFO:tasks.workunit.client.1.smithi136.stdout:5/549: symlink d5/d1a/d4a/la7 0 2024-09-18T12:51:14.519 INFO:tasks.workunit.client.0.smithi081.stdout:0/221: rename d7/d9/d12/d2b to d7/d9/d4b 0 2024-09-18T12:51:14.521 INFO:tasks.workunit.client.1.smithi136.stdout:5/550: creat d5/d1a/d2d/d3f/fa8 x:0 0 0 2024-09-18T12:51:14.521 INFO:tasks.workunit.client.1.smithi136.stdout:5/551: chown d5/l8 7 1 2024-09-18T12:51:14.523 INFO:tasks.workunit.client.1.smithi136.stdout:2/497: sync 2024-09-18T12:51:14.523 INFO:tasks.workunit.client.0.smithi081.stdout:7/252: link d2/d1b/l4f d2/d18/d22/l5f 0 2024-09-18T12:51:14.525 INFO:tasks.workunit.client.0.smithi081.stdout:6/183: dwrite f1 [0,4194304] 0 2024-09-18T12:51:14.526 INFO:tasks.workunit.client.0.smithi081.stdout:9/152: truncate f6 6254732 0 2024-09-18T12:51:14.526 INFO:tasks.workunit.client.1.smithi136.stdout:2/498: getdents d5/d4a/d67 0 2024-09-18T12:51:14.526 INFO:tasks.workunit.client.1.smithi136.stdout:2/499: fdatasync d5/d4a/d67/f75 0 2024-09-18T12:51:14.526 INFO:tasks.workunit.client.0.smithi081.stdout:1/269: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-18T12:51:14.527 INFO:tasks.workunit.client.0.smithi081.stdout:1/270: write d0/d6/d7/d8/f29 [489031,20616] 0 2024-09-18T12:51:14.527 INFO:tasks.workunit.client.1.smithi136.stdout:4/391: dwrite d0/d2/f3e [0,4194304] 0 2024-09-18T12:51:14.527 INFO:tasks.workunit.client.1.smithi136.stdout:8/607: sync 2024-09-18T12:51:14.527 INFO:tasks.workunit.client.1.smithi136.stdout:6/479: dwrite d8/d9/d3c/f62 [0,4194304] 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:6/480: truncate d8/f92 343697 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:3/477: dwrite d3/d14/d17/d53/f89 [0,4194304] 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:5/552: dread d5/d1a/d30/f3b [0,4194304] 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:7/568: dwrite d0/d39/d4d/d9a/fb9 [0,4194304] 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:7/569: write d0/d35/d41/d50/d7b/f90 [1047920,128383] 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:2/500: mknod d5/d7/d17/c94 0 2024-09-18T12:51:14.528 INFO:tasks.workunit.client.1.smithi136.stdout:2/501: chown d5/d4a/d64 54234552 1 2024-09-18T12:51:14.530 INFO:tasks.workunit.client.0.smithi081.stdout:8/228: symlink d3/l56 0 2024-09-18T12:51:14.530 INFO:tasks.workunit.client.0.smithi081.stdout:8/229: fdatasync d3/d1d/f21 0 2024-09-18T12:51:14.532 INFO:tasks.workunit.client.0.smithi081.stdout:5/273: mknod d2/d14/d33/d37/d3b/c5a 0 2024-09-18T12:51:14.533 INFO:tasks.workunit.client.1.smithi136.stdout:0/510: unlink d1/d3/f5c 0 2024-09-18T12:51:14.533 INFO:tasks.workunit.client.1.smithi136.stdout:0/511: write d1/d3/d1a/d98/d81/d35/d84/f8b [771404,55699] 0 2024-09-18T12:51:14.534 INFO:tasks.workunit.client.0.smithi081.stdout:4/197: rename d3/dd/l15 to d3/d20/d3d/l49 0 2024-09-18T12:51:14.534 INFO:tasks.workunit.client.0.smithi081.stdout:4/198: chown d3/db 6 1 2024-09-18T12:51:14.535 INFO:tasks.workunit.client.0.smithi081.stdout:8/230: dread d3/d1e/f34 [0,4194304] 0 2024-09-18T12:51:14.535 INFO:tasks.workunit.client.0.smithi081.stdout:8/231: creat d3/f57 x:0 0 0 2024-09-18T12:51:14.537 INFO:tasks.workunit.client.1.smithi136.stdout:4/392: dread d0/d3/f29 [0,4194304] 0 2024-09-18T12:51:14.537 INFO:tasks.workunit.client.1.smithi136.stdout:9/522: dwrite d6/da/d3d/d4d/d91/d25/f71 [0,4194304] 0 2024-09-18T12:51:14.538 INFO:tasks.workunit.client.0.smithi081.stdout:7/253: unlink d2/ca 0 2024-09-18T12:51:14.541 INFO:tasks.workunit.client.0.smithi081.stdout:1/271: creat d0/d54/f5e x:0 0 0 2024-09-18T12:51:14.542 INFO:tasks.workunit.client.1.smithi136.stdout:6/481: symlink d8/d9/d3c/d45/la0 0 2024-09-18T12:51:14.545 INFO:tasks.workunit.client.1.smithi136.stdout:5/553: mkdir d5/d1a/d2d/d34/d4e/d7a/d9e/da9 0 2024-09-18T12:51:14.547 INFO:tasks.workunit.client.0.smithi081.stdout:1/272: dread d0/d6/d7/d2e/d51/f56 [0,4194304] 0 2024-09-18T12:51:14.547 INFO:tasks.workunit.client.1.smithi136.stdout:7/570: mkdir d0/d2c/d2e/dc5 0 2024-09-18T12:51:14.548 INFO:tasks.workunit.client.1.smithi136.stdout:7/571: write d0/d35/d4f/f82 [5324739,15803] 0 2024-09-18T12:51:14.549 INFO:tasks.workunit.client.1.smithi136.stdout:2/502: symlink d5/d25/d43/l95 0 2024-09-18T12:51:14.550 INFO:tasks.workunit.client.0.smithi081.stdout:9/153: write f6 [6699109,35657] 0 2024-09-18T12:51:14.551 INFO:tasks.workunit.client.0.smithi081.stdout:5/274: symlink d2/d14/l5b 0 2024-09-18T12:51:14.552 INFO:tasks.workunit.client.1.smithi136.stdout:0/512: mknod d1/d3/d1a/d98/d81/d35/cab 0 2024-09-18T12:51:14.552 INFO:tasks.workunit.client.1.smithi136.stdout:0/513: chown d1/d3/f8 414342191 1 2024-09-18T12:51:14.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/154: dread dd/d1b/f1f [8388608,4194304] 0 2024-09-18T12:51:14.555 INFO:tasks.workunit.client.0.smithi081.stdout:4/199: rmdir d3/dd/d14/d27/d2b 0 2024-09-18T12:51:14.555 INFO:tasks.workunit.client.0.smithi081.stdout:7/254: write d2/d14/f44 [3106563,45957] 0 2024-09-18T12:51:14.556 INFO:tasks.workunit.client.0.smithi081.stdout:6/184: dwrite d4/d6/fd [0,4194304] 0 2024-09-18T12:51:14.557 INFO:tasks.workunit.client.1.smithi136.stdout:3/478: dwrite d3/d5/d3c/f4c [0,4194304] 0 2024-09-18T12:51:14.557 INFO:tasks.workunit.client.1.smithi136.stdout:3/479: write d3/d14/d22/d2c/d3d/f93 [4400806,29235] 0 2024-09-18T12:51:14.557 INFO:tasks.workunit.client.1.smithi136.stdout:8/608: rmdir d9/d14/d1a/d2b/d42/d6e/d75 39 2024-09-18T12:51:14.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/232: mknod d3/d2f/c58 0 2024-09-18T12:51:14.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/233: fsync d3/d1e/f34 0 2024-09-18T12:51:14.561 INFO:tasks.workunit.client.1.smithi136.stdout:4/393: getdents d0/d45/d67 0 2024-09-18T12:51:14.561 INFO:tasks.workunit.client.0.smithi081.stdout:9/155: mkdir dd/d1d/d1e/d2f 0 2024-09-18T12:51:14.562 INFO:tasks.workunit.client.1.smithi136.stdout:9/523: truncate d6/df/d23/d2b/fa6 239992 0 2024-09-18T12:51:14.564 INFO:tasks.workunit.client.1.smithi136.stdout:5/554: symlink d5/d1a/d2d/d34/d74/laa 0 2024-09-18T12:51:14.565 INFO:tasks.workunit.client.0.smithi081.stdout:3/290: rename d3/db/df/d29/d12/l36 to d3/db/dc/d1a/l67 0 2024-09-18T12:51:14.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/455: getdents d2/d5/d11/d2e 0 2024-09-18T12:51:14.566 INFO:tasks.workunit.client.1.smithi136.stdout:1/456: write d2/d5/d11/d2e/d4c/f45 [1016339,62323] 0 2024-09-18T12:51:14.566 INFO:tasks.workunit.client.0.smithi081.stdout:7/255: rmdir d2/d18 39 2024-09-18T12:51:14.566 INFO:tasks.workunit.client.0.smithi081.stdout:9/156: getdents dd/d1d/d1e/d24/d2a 0 2024-09-18T12:51:14.567 INFO:tasks.workunit.client.1.smithi136.stdout:7/572: creat d0/d39/d4d/d55/fc6 x:0 0 0 2024-09-18T12:51:14.569 INFO:tasks.workunit.client.0.smithi081.stdout:3/291: mkdir d3/db/df/d29/d13/d68 0 2024-09-18T12:51:14.569 INFO:tasks.workunit.client.1.smithi136.stdout:2/503: creat d5/d7/d41/f96 x:0 0 0 2024-09-18T12:51:14.572 INFO:tasks.workunit.client.0.smithi081.stdout:6/185: dread d4/d6/f27 [0,4194304] 0 2024-09-18T12:51:14.572 INFO:tasks.workunit.client.0.smithi081.stdout:5/275: rename d2/d14/d33/d37/d3b/d2a/d44/c52 to d2/d14/d1d/d1a/c5c 0 2024-09-18T12:51:14.572 INFO:tasks.workunit.client.0.smithi081.stdout:5/276: write d2/d14/d33/d37/d3b/f38 [1244699,22610] 0 2024-09-18T12:51:14.572 INFO:tasks.workunit.client.0.smithi081.stdout:5/277: chown d2/d14/d1d/d1a 119 1 2024-09-18T12:51:14.573 INFO:tasks.workunit.client.1.smithi136.stdout:0/514: mknod d1/d3/d1a/d98/d81/d72/cac 0 2024-09-18T12:51:14.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/256: rmdir d2/d14/d21/d49/d5e 0 2024-09-18T12:51:14.577 INFO:tasks.workunit.client.1.smithi136.stdout:3/480: dread d3/d14/d18/f7d [0,4194304] 0 2024-09-18T12:51:14.578 INFO:tasks.workunit.client.1.smithi136.stdout:3/481: fdatasync d3/d10/d4a/f8b 0 2024-09-18T12:51:14.578 INFO:tasks.workunit.client.1.smithi136.stdout:3/482: creat d3/d14/d17/d8c/d96/fa4 x:0 0 0 2024-09-18T12:51:14.578 INFO:tasks.workunit.client.1.smithi136.stdout:3/483: getdents d3/d14/d22/d2c/d3d 0 2024-09-18T12:51:14.578 INFO:tasks.workunit.client.0.smithi081.stdout:8/234: write d3/f15 [2045266,47394] 0 2024-09-18T12:51:14.579 INFO:tasks.workunit.client.0.smithi081.stdout:9/157: link dd/de/f13 dd/d1d/d1e/d24/d2a/f30 0 2024-09-18T12:51:14.579 INFO:tasks.workunit.client.1.smithi136.stdout:8/609: mknod d9/d18/d34/d3d/d47/d65/d93/d96/d9b/cd7 0 2024-09-18T12:51:14.580 INFO:tasks.workunit.client.0.smithi081.stdout:9/158: chown dd/c19 3 1 2024-09-18T12:51:14.580 INFO:tasks.workunit.client.0.smithi081.stdout:6/186: rmdir d4/d6 39 2024-09-18T12:51:14.582 INFO:tasks.workunit.client.0.smithi081.stdout:5/278: symlink d2/d47/l5d 0 2024-09-18T12:51:14.582 INFO:tasks.workunit.client.0.smithi081.stdout:5/279: readlink d2/l4f 0 2024-09-18T12:51:14.582 INFO:tasks.workunit.client.0.smithi081.stdout:5/280: truncate d2/d14/f32 24862 0 2024-09-18T12:51:14.583 INFO:tasks.workunit.client.0.smithi081.stdout:7/257: truncate d2/d18/d22/f25 2409233 0 2024-09-18T12:51:14.583 INFO:tasks.workunit.client.0.smithi081.stdout:7/258: chown d2/d18/d22/f2a 1 1 2024-09-18T12:51:14.583 INFO:tasks.workunit.client.1.smithi136.stdout:9/524: creat d6/df/d75/fb2 x:0 0 0 2024-09-18T12:51:14.584 INFO:tasks.workunit.client.1.smithi136.stdout:5/555: mknod d5/d1a/d2d/d34/d74/cab 0 2024-09-18T12:51:14.584 INFO:tasks.workunit.client.1.smithi136.stdout:5/556: write d5/f4f [4584893,7712] 0 2024-09-18T12:51:14.586 INFO:tasks.workunit.client.1.smithi136.stdout:1/457: symlink d2/d5/d2b/d34/d86/d50/d65/l92 0 2024-09-18T12:51:14.586 INFO:tasks.workunit.client.1.smithi136.stdout:1/458: chown d2/d5/l8 865658672 1 2024-09-18T12:51:14.587 INFO:tasks.workunit.client.1.smithi136.stdout:3/484: dread d3/d14/d18/d7f/f7a [0,4194304] 0 2024-09-18T12:51:14.588 INFO:tasks.workunit.client.1.smithi136.stdout:7/573: unlink d0/d35/d41/d50/d7f/d3b/f51 0 2024-09-18T12:51:14.588 INFO:tasks.workunit.client.0.smithi081.stdout:8/235: getdents d3/d2f 0 2024-09-18T12:51:14.588 INFO:tasks.workunit.client.0.smithi081.stdout:8/236: write d3/d1e/f27 [1549794,100385] 0 2024-09-18T12:51:14.590 INFO:tasks.workunit.client.0.smithi081.stdout:7/259: unlink d2/d14/f29 0 2024-09-18T12:51:14.591 INFO:tasks.workunit.client.1.smithi136.stdout:2/504: link d5/f9 d5/d7/d17/d48/f97 0 2024-09-18T12:51:14.591 INFO:tasks.workunit.client.0.smithi081.stdout:6/187: truncate d4/fe 1694156 0 2024-09-18T12:51:14.592 INFO:tasks.workunit.client.1.smithi136.stdout:0/515: rmdir d1/db/d76 39 2024-09-18T12:51:14.593 INFO:tasks.workunit.client.0.smithi081.stdout:4/200: dwrite d3/db/f39 [0,4194304] 0 2024-09-18T12:51:14.595 INFO:tasks.workunit.client.0.smithi081.stdout:7/260: unlink d2/d18/f51 0 2024-09-18T12:51:14.596 INFO:tasks.workunit.client.1.smithi136.stdout:5/557: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:14.597 INFO:tasks.workunit.client.0.smithi081.stdout:6/188: symlink d4/d12/l35 0 2024-09-18T12:51:14.599 INFO:tasks.workunit.client.0.smithi081.stdout:8/237: rmdir d3/d1d/d4a 39 2024-09-18T12:51:14.599 INFO:tasks.workunit.client.0.smithi081.stdout:8/238: write d3/d1d/f21 [1669947,7077] 0 2024-09-18T12:51:14.599 INFO:tasks.workunit.client.1.smithi136.stdout:8/610: creat d9/fd8 x:0 0 0 2024-09-18T12:51:14.602 INFO:tasks.workunit.client.0.smithi081.stdout:5/281: rename d2/d14/d33/d37/d3b/d2a/d44 to d2/dd/d5e 0 2024-09-18T12:51:14.603 INFO:tasks.workunit.client.1.smithi136.stdout:7/574: symlink d0/d35/d41/d50/d9b/lc7 0 2024-09-18T12:51:14.605 INFO:tasks.workunit.client.1.smithi136.stdout:2/505: truncate d5/d25/f36 3011507 0 2024-09-18T12:51:14.606 INFO:tasks.workunit.client.1.smithi136.stdout:0/516: mknod d1/d3/d1a/d98/d81/d51/cad 0 2024-09-18T12:51:14.607 INFO:tasks.workunit.client.0.smithi081.stdout:1/273: dwrite d0/db/d12/f47 [0,4194304] 0 2024-09-18T12:51:14.608 INFO:tasks.workunit.client.1.smithi136.stdout:6/482: dwrite d8/d9/de/f23 [0,4194304] 0 2024-09-18T12:51:14.608 INFO:tasks.workunit.client.1.smithi136.stdout:6/483: read d8/f19 [3634389,18602] 0 2024-09-18T12:51:14.609 INFO:tasks.workunit.client.1.smithi136.stdout:6/484: write d8/f6c [1977982,128226] 0 2024-09-18T12:51:14.610 INFO:tasks.workunit.client.0.smithi081.stdout:7/261: rename d2/d1b to d2/d18/d60 0 2024-09-18T12:51:14.611 INFO:tasks.workunit.client.1.smithi136.stdout:5/558: mkdir d5/d6b/dac 0 2024-09-18T12:51:14.612 INFO:tasks.workunit.client.0.smithi081.stdout:4/201: getdents d3/dd/d14/d27 0 2024-09-18T12:51:14.612 INFO:tasks.workunit.client.0.smithi081.stdout:4/202: write d3/db/fe [2533403,120628] 0 2024-09-18T12:51:14.612 INFO:tasks.workunit.client.0.smithi081.stdout:4/203: chown d3/db/c11 5 1 2024-09-18T12:51:14.612 INFO:tasks.workunit.client.1.smithi136.stdout:2/506: dread d5/d25/f62 [0,4194304] 0 2024-09-18T12:51:14.612 INFO:tasks.workunit.client.1.smithi136.stdout:2/507: truncate d5/d25/f8d 758710 0 2024-09-18T12:51:14.613 INFO:tasks.workunit.client.1.smithi136.stdout:8/611: fdatasync d9/d18/d34/d3d/f78 0 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:6/189: read d4/d6/f27 [5760343,121923] 0 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:6/190: creat d4/d12/d28/f36 x:0 0 0 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:6/191: chown d4/d12/d28/d2a 781713861 1 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/282: dread d2/d47/f58 [0,4194304] 0 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:3/292: dwrite d3/db/d1b/f34 [0,4194304] 0 2024-09-18T12:51:14.614 INFO:tasks.workunit.client.0.smithi081.stdout:3/293: truncate d3/db/df/d29/d13/f4c 960733 0 2024-09-18T12:51:14.615 INFO:tasks.workunit.client.1.smithi136.stdout:9/525: link d6/df/f3b d6/db/d72/fb3 0 2024-09-18T12:51:14.616 INFO:tasks.workunit.client.1.smithi136.stdout:3/485: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:14.616 INFO:tasks.workunit.client.1.smithi136.stdout:7/575: truncate d0/d35/d41/d50/d5a/fa7 441444 0 2024-09-18T12:51:14.617 INFO:tasks.workunit.client.1.smithi136.stdout:0/517: symlink d1/d3/d1a/d98/d81/d51/lae 0 2024-09-18T12:51:14.618 INFO:tasks.workunit.client.0.smithi081.stdout:1/274: mknod d0/d6/d7/c5f 0 2024-09-18T12:51:14.619 INFO:tasks.workunit.client.0.smithi081.stdout:4/204: creat d3/dd/d45/f4a x:0 0 0 2024-09-18T12:51:14.620 INFO:tasks.workunit.client.0.smithi081.stdout:4/205: write d3/dd/d14/d27/f37 [4291960,43806] 0 2024-09-18T12:51:14.621 INFO:tasks.workunit.client.0.smithi081.stdout:6/192: mknod d4/d12/c37 0 2024-09-18T12:51:14.622 INFO:tasks.workunit.client.1.smithi136.stdout:1/459: dwrite d2/d5/d2b/d34/d86/d50/f6d [0,4194304] 0 2024-09-18T12:51:14.623 INFO:tasks.workunit.client.1.smithi136.stdout:2/508: read d5/d7/d17/d48/f97 [551330,41044] 0 2024-09-18T12:51:14.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/283: mkdir d2/d14/d33/d37/d3b/d5f 0 2024-09-18T12:51:14.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/284: chown d2/d14/d33/d37/d3b/d18/f25 3072683 1 2024-09-18T12:51:14.626 INFO:tasks.workunit.client.0.smithi081.stdout:7/262: dread d2/f4a [0,4194304] 0 2024-09-18T12:51:14.626 INFO:tasks.workunit.client.0.smithi081.stdout:9/159: dwrite dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:14.627 INFO:tasks.workunit.client.0.smithi081.stdout:3/294: mknod d3/db/df/d3b/c69 0 2024-09-18T12:51:14.627 INFO:tasks.workunit.client.0.smithi081.stdout:7/263: write d2/d14/f16 [647711,101604] 0 2024-09-18T12:51:14.627 INFO:tasks.workunit.client.1.smithi136.stdout:8/612: stat d9/d14/d1a/c64 0 2024-09-18T12:51:14.629 INFO:tasks.workunit.client.0.smithi081.stdout:8/239: dwrite d3/f2d [0,4194304] 0 2024-09-18T12:51:14.629 INFO:tasks.workunit.client.1.smithi136.stdout:9/526: creat d6/df/d23/dae/fb4 x:0 0 0 2024-09-18T12:51:14.630 INFO:tasks.workunit.client.0.smithi081.stdout:1/275: creat d0/db/d12/f60 x:0 0 0 2024-09-18T12:51:14.631 INFO:tasks.workunit.client.1.smithi136.stdout:3/486: link d3/d14/d17/f62 d3/d14/d17/d53/d73/fa5 0 2024-09-18T12:51:14.632 INFO:tasks.workunit.client.0.smithi081.stdout:4/206: mkdir d3/dd/d14/d4b 0 2024-09-18T12:51:14.632 INFO:tasks.workunit.client.1.smithi136.stdout:6/485: dwrite d8/d9/d56/f86 [0,4194304] 0 2024-09-18T12:51:14.632 INFO:tasks.workunit.client.1.smithi136.stdout:6/486: getdents d8/d9/d56/d96/d9c 0 2024-09-18T12:51:14.633 INFO:tasks.workunit.client.0.smithi081.stdout:5/285: dread d2/d14/d33/d37/d3b/f13 [0,4194304] 0 2024-09-18T12:51:14.633 INFO:tasks.workunit.client.0.smithi081.stdout:6/193: truncate d4/f21 754200 0 2024-09-18T12:51:14.633 INFO:tasks.workunit.client.1.smithi136.stdout:1/460: mknod d2/d5/c93 0 2024-09-18T12:51:14.633 INFO:tasks.workunit.client.1.smithi136.stdout:1/461: write d2/d5/d11/d1b/f25 [3426442,23715] 0 2024-09-18T12:51:14.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/160: write dd/d1d/d1e/d24/d2a/f2c [247203,26862] 0 2024-09-18T12:51:14.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/161: fdatasync dd/d1d/d1e/f29 0 2024-09-18T12:51:14.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/162: readlink dd/de/l23 0 2024-09-18T12:51:14.637 INFO:tasks.workunit.client.0.smithi081.stdout:3/295: creat d3/db/dc/d1a/f6a x:0 0 0 2024-09-18T12:51:14.637 INFO:tasks.workunit.client.1.smithi136.stdout:9/527: symlink d6/d13/lb5 0 2024-09-18T12:51:14.639 INFO:tasks.workunit.client.1.smithi136.stdout:7/576: write d0/d39/f7e [1820624,21111] 0 2024-09-18T12:51:14.640 INFO:tasks.workunit.client.1.smithi136.stdout:3/487: mknod d3/d14/d17/ca6 0 2024-09-18T12:51:14.645 INFO:tasks.workunit.client.1.smithi136.stdout:6/487: unlink d8/d9/de/d60/f84 0 2024-09-18T12:51:14.647 INFO:tasks.workunit.client.1.smithi136.stdout:1/462: mkdir d2/d5/d2b/d34/d86/d94 0 2024-09-18T12:51:14.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/194: dread d4/d6/f27 [4194304,4194304] 0 2024-09-18T12:51:14.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/195: creat d4/d12/d28/f38 x:0 0 0 2024-09-18T12:51:14.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/196: write d4/fa [2175784,103145] 0 2024-09-18T12:51:14.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/197: chown d4/d6/lf 3 1 2024-09-18T12:51:14.650 INFO:tasks.workunit.client.1.smithi136.stdout:5/559: rename d5/d1a/d2d/d34/d74 to d5/d1a/d2d/d34/d4e/d7a/d9e/dad 0 2024-09-18T12:51:14.653 INFO:tasks.workunit.client.1.smithi136.stdout:0/518: dwrite d1/d3/d1a/d98/d81/d35/d84/f91 [0,4194304] 0 2024-09-18T12:51:14.653 INFO:tasks.workunit.client.1.smithi136.stdout:0/519: write d1/d60/f99 [755758,53905] 0 2024-09-18T12:51:14.653 INFO:tasks.workunit.client.1.smithi136.stdout:2/509: dwrite d5/d25/f2e [0,4194304] 0 2024-09-18T12:51:14.653 INFO:tasks.workunit.client.1.smithi136.stdout:2/510: read d5/d4a/d64/f7d [1679644,46126] 0 2024-09-18T12:51:14.654 INFO:tasks.workunit.client.1.smithi136.stdout:7/577: link d0/d2c/d2e/f3f d0/d39/dbf/fc8 0 2024-09-18T12:51:14.654 INFO:tasks.workunit.client.1.smithi136.stdout:7/578: creat d0/d39/d4d/fc9 x:0 0 0 2024-09-18T12:51:14.657 INFO:tasks.workunit.client.1.smithi136.stdout:3/488: mkdir d3/d14/d17/d75/d86/da7 0 2024-09-18T12:51:14.658 INFO:tasks.workunit.client.0.smithi081.stdout:9/163: dwrite dd/d15/f16 [0,4194304] 0 2024-09-18T12:51:14.658 INFO:tasks.workunit.client.0.smithi081.stdout:9/164: dread - dd/d1d/f2e zero size 2024-09-18T12:51:14.658 INFO:tasks.workunit.client.0.smithi081.stdout:9/165: readlink dd/de/l18 0 2024-09-18T12:51:14.658 INFO:tasks.workunit.client.0.smithi081.stdout:9/166: chown f0 30727 1 2024-09-18T12:51:14.659 INFO:tasks.workunit.client.1.smithi136.stdout:6/488: creat d8/d9/de/d60/d94/fa1 x:0 0 0 2024-09-18T12:51:14.659 INFO:tasks.workunit.client.0.smithi081.stdout:4/207: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:14.662 INFO:tasks.workunit.client.1.smithi136.stdout:8/613: dwrite d9/d14/d1a/f4a [4194304,4194304] 0 2024-09-18T12:51:14.662 INFO:tasks.workunit.client.1.smithi136.stdout:1/463: mknod d2/d5/d11/c95 0 2024-09-18T12:51:14.664 INFO:tasks.workunit.client.1.smithi136.stdout:9/528: getdents d6/da/d3d/d4d/d91/d38 0 2024-09-18T12:51:14.667 INFO:tasks.workunit.client.1.smithi136.stdout:8/614: write d9/d14/f1d [262341,63095] 0 2024-09-18T12:51:14.670 INFO:tasks.workunit.client.0.smithi081.stdout:8/240: symlink d3/d1e/d4c/l59 0 2024-09-18T12:51:14.670 INFO:tasks.workunit.client.0.smithi081.stdout:8/241: chown d3/lf 6 1 2024-09-18T12:51:14.670 INFO:tasks.workunit.client.0.smithi081.stdout:8/242: chown d3/f2d 15 1 2024-09-18T12:51:14.671 INFO:tasks.workunit.client.1.smithi136.stdout:5/560: link d5/d1a/d2d/f8e d5/d1a/d2d/d34/d4e/d7a/d9e/fae 0 2024-09-18T12:51:14.672 INFO:tasks.workunit.client.0.smithi081.stdout:1/276: creat d0/d6/d33/f61 x:0 0 0 2024-09-18T12:51:14.675 INFO:tasks.workunit.client.1.smithi136.stdout:0/520: truncate d1/d60/d82/f9f 4120275 0 2024-09-18T12:51:14.677 INFO:tasks.workunit.client.0.smithi081.stdout:3/296: creat d3/db/df/d29/d13/d68/f6b x:0 0 0 2024-09-18T12:51:14.677 INFO:tasks.workunit.client.0.smithi081.stdout:3/297: truncate d3/db/df/d29/f30 801585 0 2024-09-18T12:51:14.678 INFO:tasks.workunit.client.1.smithi136.stdout:2/511: rename d5/d7/d17/l39 to d5/d7/d41/d53/l98 0 2024-09-18T12:51:14.683 INFO:tasks.workunit.client.0.smithi081.stdout:6/198: mkdir d4/d12/d1c/d39 0 2024-09-18T12:51:14.684 INFO:tasks.workunit.client.1.smithi136.stdout:3/489: dwrite d3/d14/d18/d7f/f56 [0,4194304] 0 2024-09-18T12:51:14.684 INFO:tasks.workunit.client.1.smithi136.stdout:6/489: unlink d8/d9/de/d1c/f2d 0 2024-09-18T12:51:14.693 INFO:tasks.workunit.client.1.smithi136.stdout:9/529: symlink d6/d59/lb6 0 2024-09-18T12:51:14.695 INFO:tasks.workunit.client.1.smithi136.stdout:5/561: dwrite d5/d1a/d30/f60 [0,4194304] 0 2024-09-18T12:51:14.695 INFO:tasks.workunit.client.1.smithi136.stdout:5/562: readlink d5/d1a/l1e 0 2024-09-18T12:51:14.696 INFO:tasks.workunit.client.1.smithi136.stdout:8/615: mkdir d9/d14/d1a/d2b/d42/da4/dd9 0 2024-09-18T12:51:14.699 INFO:tasks.workunit.client.1.smithi136.stdout:7/579: rename d0/d12/l61 to d0/d39/lca 0 2024-09-18T12:51:14.699 INFO:tasks.workunit.client.1.smithi136.stdout:7/580: dread - d0/d35/d41/d50/faf zero size 2024-09-18T12:51:14.700 INFO:tasks.workunit.client.1.smithi136.stdout:2/512: link d5/d7/d17/l57 d5/d7/d17/d48/l99 0 2024-09-18T12:51:14.702 INFO:tasks.workunit.client.1.smithi136.stdout:1/464: dwrite d2/f36 [0,4194304] 0 2024-09-18T12:51:14.702 INFO:tasks.workunit.client.1.smithi136.stdout:1/465: readlink d2/d5/d2b/d34/d86/l62 0 2024-09-18T12:51:14.702 INFO:tasks.workunit.client.1.smithi136.stdout:2/513: dread d5/f22 [0,4194304] 0 2024-09-18T12:51:14.702 INFO:tasks.workunit.client.1.smithi136.stdout:2/514: fsync d5/d25/f62 0 2024-09-18T12:51:14.703 INFO:tasks.workunit.client.1.smithi136.stdout:3/490: mkdir d3/d5/da8 0 2024-09-18T12:51:14.704 INFO:tasks.workunit.client.1.smithi136.stdout:3/491: write d3/d14/d17/d8c/d96/f9c [108119,16547] 0 2024-09-18T12:51:14.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/243: rename d3/d2f/c58 to d3/d1d/c5a 0 2024-09-18T12:51:14.704 INFO:tasks.workunit.client.1.smithi136.stdout:6/490: creat d8/d9/d3c/fa2 x:0 0 0 2024-09-18T12:51:14.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/277: mknod d0/db/d12/d55/c62 0 2024-09-18T12:51:14.706 INFO:tasks.workunit.client.0.smithi081.stdout:3/298: dwrite d3/d23/f5e [0,4194304] 0 2024-09-18T12:51:14.706 INFO:tasks.workunit.client.0.smithi081.stdout:5/286: truncate d2/d14/d33/d37/d3b/d2a/f45 1789423 0 2024-09-18T12:51:14.707 INFO:tasks.workunit.client.0.smithi081.stdout:5/287: write d2/dd/d5e/f3a [244148,22087] 0 2024-09-18T12:51:14.707 INFO:tasks.workunit.client.0.smithi081.stdout:5/288: truncate d2/dd/d5e/f42 936844 0 2024-09-18T12:51:14.709 INFO:tasks.workunit.client.0.smithi081.stdout:4/208: dwrite d3/dd/d14/f29 [0,4194304] 0 2024-09-18T12:51:14.710 INFO:tasks.workunit.client.0.smithi081.stdout:8/244: mknod d3/c5b 0 2024-09-18T12:51:14.711 INFO:tasks.workunit.client.1.smithi136.stdout:5/563: creat d5/d1a/d2d/d3f/d7f/faf x:0 0 0 2024-09-18T12:51:14.711 INFO:tasks.workunit.client.1.smithi136.stdout:5/564: creat d5/d1a/d2d/fb0 x:0 0 0 2024-09-18T12:51:14.711 INFO:tasks.workunit.client.1.smithi136.stdout:8/616: rmdir d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5 39 2024-09-18T12:51:14.711 INFO:tasks.workunit.client.1.smithi136.stdout:8/617: fsync d9/d18/f41 0 2024-09-18T12:51:14.715 INFO:tasks.workunit.client.0.smithi081.stdout:4/209: creat d3/dd/d14/d4b/f4c x:0 0 0 2024-09-18T12:51:14.716 INFO:tasks.workunit.client.0.smithi081.stdout:8/245: mknod d3/c5c 0 2024-09-18T12:51:14.717 INFO:tasks.workunit.client.1.smithi136.stdout:3/492: unlink d3/d14/d17/d53/c63 0 2024-09-18T12:51:14.718 INFO:tasks.workunit.client.0.smithi081.stdout:4/210: rename d3/d20/d3d/l49 to d3/db/d2d/l4d 0 2024-09-18T12:51:14.718 INFO:tasks.workunit.client.0.smithi081.stdout:4/211: read - d3/dd/d14/d4b/f4c zero size 2024-09-18T12:51:14.718 INFO:tasks.workunit.client.0.smithi081.stdout:4/212: readlink d3/lf 0 2024-09-18T12:51:14.719 INFO:tasks.workunit.client.1.smithi136.stdout:1/466: mkdir d2/d5/d2b/d34/d5c/d96 0 2024-09-18T12:51:14.719 INFO:tasks.workunit.client.0.smithi081.stdout:8/246: mknod d3/d1e/d4c/c5d 0 2024-09-18T12:51:14.719 INFO:tasks.workunit.client.0.smithi081.stdout:8/247: stat d3/f15 0 2024-09-18T12:51:14.719 INFO:tasks.workunit.client.0.smithi081.stdout:8/248: creat d3/d1d/f5e x:0 0 0 2024-09-18T12:51:14.721 INFO:tasks.workunit.client.1.smithi136.stdout:8/618: mkdir d9/d14/d1a/d2b/d42/d9e/dda 0 2024-09-18T12:51:14.721 INFO:tasks.workunit.client.0.smithi081.stdout:4/213: mkdir d3/db/d2d/d4e 0 2024-09-18T12:51:14.721 INFO:tasks.workunit.client.0.smithi081.stdout:4/214: dread - d3/dd/d2f/f33 zero size 2024-09-18T12:51:14.721 INFO:tasks.workunit.client.1.smithi136.stdout:0/521: dwrite d1/db/d76/f92 [0,4194304] 0 2024-09-18T12:51:14.723 INFO:tasks.workunit.client.0.smithi081.stdout:1/278: dread d0/db/d12/f24 [4194304,4194304] 0 2024-09-18T12:51:14.725 INFO:tasks.workunit.client.0.smithi081.stdout:4/215: getdents d3/db 0 2024-09-18T12:51:14.725 INFO:tasks.workunit.client.0.smithi081.stdout:4/216: dread - d3/dd/d45/f4a zero size 2024-09-18T12:51:14.726 INFO:tasks.workunit.client.1.smithi136.stdout:9/530: rename d6/df/f95 to d6/df/d23/d2b/d79/d53/fb7 0 2024-09-18T12:51:14.726 INFO:tasks.workunit.client.1.smithi136.stdout:9/531: truncate d6/df/d75/fb2 12052 0 2024-09-18T12:51:14.726 INFO:tasks.workunit.client.1.smithi136.stdout:9/532: creat d6/da/d3d/d41/fb8 x:0 0 0 2024-09-18T12:51:14.726 INFO:tasks.workunit.client.1.smithi136.stdout:9/533: getdents d6/db/d12/d62/daa 0 2024-09-18T12:51:14.727 INFO:tasks.workunit.client.1.smithi136.stdout:7/581: rmdir d0/d35/d41/d50/d5a 39 2024-09-18T12:51:14.730 INFO:tasks.workunit.client.1.smithi136.stdout:3/493: creat d3/d5/d3c/fa9 x:0 0 0 2024-09-18T12:51:14.730 INFO:tasks.workunit.client.1.smithi136.stdout:3/494: read d3/d14/d17/d8c/d96/f9c [109270,32823] 0 2024-09-18T12:51:14.732 INFO:tasks.workunit.client.1.smithi136.stdout:8/619: link d9/d18/l29 d9/d14/ldb 0 2024-09-18T12:51:14.735 INFO:tasks.workunit.client.0.smithi081.stdout:1/279: rename d0/db/d12/f23 to d0/d6/d7/d2e/f63 0 2024-09-18T12:51:14.738 INFO:tasks.workunit.client.0.smithi081.stdout:1/280: unlink d0/d6/d33/d37/l3f 0 2024-09-18T12:51:14.740 INFO:tasks.workunit.client.1.smithi136.stdout:2/515: rename d5/d7/d17/f77 to d5/d7/f9a 0 2024-09-18T12:51:14.741 INFO:tasks.workunit.client.0.smithi081.stdout:8/249: write d3/f2d [3729864,6985] 0 2024-09-18T12:51:14.741 INFO:tasks.workunit.client.0.smithi081.stdout:8/250: chown d3/l22 53398876 1 2024-09-18T12:51:14.741 INFO:tasks.workunit.client.0.smithi081.stdout:3/299: dwrite d3/f46 [0,4194304] 0 2024-09-18T12:51:14.744 INFO:tasks.workunit.client.1.smithi136.stdout:9/534: symlink d6/d59/lb9 0 2024-09-18T12:51:14.744 INFO:tasks.workunit.client.1.smithi136.stdout:7/582: getdents d0/d12/d5e 0 2024-09-18T12:51:14.744 INFO:tasks.workunit.client.1.smithi136.stdout:9/535: write d6/da/d3d/d41/fb8 [383857,103851] 0 2024-09-18T12:51:14.746 INFO:tasks.workunit.client.0.smithi081.stdout:3/300: rename d3/db/l11 to d3/db/dc/l6c 0 2024-09-18T12:51:14.748 INFO:tasks.workunit.client.1.smithi136.stdout:1/467: mknod d2/d5/d9/c97 0 2024-09-18T12:51:14.749 INFO:tasks.workunit.client.0.smithi081.stdout:3/301: creat d3/db/df/f6d x:0 0 0 2024-09-18T12:51:14.749 INFO:tasks.workunit.client.0.smithi081.stdout:3/302: truncate d3/db/df/d29/f64 4618542 0 2024-09-18T12:51:14.749 INFO:tasks.workunit.client.0.smithi081.stdout:3/303: getdents d3/db/df/d60/d58 0 2024-09-18T12:51:14.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/304: write d3/db/f56 [987144,19405] 0 2024-09-18T12:51:14.752 INFO:tasks.workunit.client.1.smithi136.stdout:8/620: unlink d9/d14/d1a/d2b/d42/d6e/d75/d9a/db5/fba 0 2024-09-18T12:51:14.753 INFO:tasks.workunit.client.0.smithi081.stdout:3/305: mknod d3/c6e 0 2024-09-18T12:51:14.753 INFO:tasks.workunit.client.0.smithi081.stdout:6/199: getdents d4/d12/d28 0 2024-09-18T12:51:14.754 INFO:tasks.workunit.client.0.smithi081.stdout:1/281: dread d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:14.756 INFO:tasks.workunit.client.0.smithi081.stdout:3/306: mkdir d3/db/df/d29/d12/d44/d6f 0 2024-09-18T12:51:14.756 INFO:tasks.workunit.client.0.smithi081.stdout:3/307: creat d3/d23/f70 x:0 0 0 2024-09-18T12:51:14.759 INFO:tasks.workunit.client.0.smithi081.stdout:3/308: symlink d3/db/df/d29/d12/d44/d6f/l71 0 2024-09-18T12:51:14.761 INFO:tasks.workunit.client.0.smithi081.stdout:7/264: truncate d2/f10 625514 0 2024-09-18T12:51:14.762 INFO:tasks.workunit.client.1.smithi136.stdout:0/522: dwrite d1/db/d76/f92 [0,4194304] 0 2024-09-18T12:51:14.763 INFO:tasks.workunit.client.1.smithi136.stdout:5/565: rename d5/d1a/d2d/d3f/l8f to d5/d1a/d4a/d79/lb1 0 2024-09-18T12:51:14.764 INFO:tasks.workunit.client.0.smithi081.stdout:7/265: mkdir d2/d56/d61 0 2024-09-18T12:51:14.767 INFO:tasks.workunit.client.1.smithi136.stdout:7/583: creat d0/d12/d5e/d67/fcb x:0 0 0 2024-09-18T12:51:14.769 INFO:tasks.workunit.client.1.smithi136.stdout:1/468: getdents d2 0 2024-09-18T12:51:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:7/266: dread d2/d18/f3b [0,4194304] 0 2024-09-18T12:51:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:7/267: write d2/d1d/f45 [158372,95629] 0 2024-09-18T12:51:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:7/268: truncate d2/d14/f24 4994714 0 2024-09-18T12:51:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:7/269: write d2/f11 [2132659,12533] 0 2024-09-18T12:51:14.773 INFO:tasks.workunit.client.1.smithi136.stdout:8/621: mknod d9/d14/d1a/d7f/d8c/dcb/cdc 0 2024-09-18T12:51:14.773 INFO:tasks.workunit.client.1.smithi136.stdout:0/523: mkdir d1/d3/d1a/d98/d81/d51/daf 0 2024-09-18T12:51:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:7/270: mkdir d2/d14/d21/d62 0 2024-09-18T12:51:14.775 INFO:tasks.workunit.client.1.smithi136.stdout:8/622: read d9/d14/d1a/d2b/f33 [976302,18450] 0 2024-09-18T12:51:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:7/271: link d2/d42/f43 d2/d56/d61/f63 0 2024-09-18T12:51:14.776 INFO:tasks.workunit.client.1.smithi136.stdout:5/566: symlink d5/d1a/d2d/d34/d88/lb2 0 2024-09-18T12:51:14.778 INFO:tasks.workunit.client.1.smithi136.stdout:7/584: mkdir d0/da8/dcc 0 2024-09-18T12:51:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:7/272: rmdir d2/d14/d21 39 2024-09-18T12:51:14.779 INFO:tasks.workunit.client.1.smithi136.stdout:1/469: rename d2/d5/d2b/d34/f35 to d2/d5/d11/d1b/f98 0 2024-09-18T12:51:14.780 INFO:tasks.workunit.client.0.smithi081.stdout:4/217: dwrite d3/dd/d14/d27/f3a [0,4194304] 0 2024-09-18T12:51:14.780 INFO:tasks.workunit.client.0.smithi081.stdout:4/218: write d3/dd/f19 [397855,39904] 0 2024-09-18T12:51:14.780 INFO:tasks.workunit.client.1.smithi136.stdout:3/495: dwrite d3/d5/d3c/fa9 [0,4194304] 0 2024-09-18T12:51:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:7/273: creat d2/d14/d21/d62/f64 x:0 0 0 2024-09-18T12:51:14.782 INFO:tasks.workunit.client.1.smithi136.stdout:0/524: creat d1/d46/fb0 x:0 0 0 2024-09-18T12:51:14.782 INFO:tasks.workunit.client.1.smithi136.stdout:0/525: readlink d1/d3/l14 0 2024-09-18T12:51:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:4/219: unlink d3/c6 0 2024-09-18T12:51:14.785 INFO:tasks.workunit.client.1.smithi136.stdout:5/567: mknod d5/d1a/d2d/d34/d4e/cb3 0 2024-09-18T12:51:14.785 INFO:tasks.workunit.client.1.smithi136.stdout:5/568: fsync d5/d1a/d2d/fa6 0 2024-09-18T12:51:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:7/274: creat d2/d18/d3c/f65 x:0 0 0 2024-09-18T12:51:14.787 INFO:tasks.workunit.client.1.smithi136.stdout:7/585: symlink d0/lcd 0 2024-09-18T12:51:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:4/220: mkdir d3/dd/d45/d4f 0 2024-09-18T12:51:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:7/275: mkdir d2/d14/d66 0 2024-09-18T12:51:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:7/276: stat d2/d14/d21/d62/f64 0 2024-09-18T12:51:14.791 INFO:tasks.workunit.client.1.smithi136.stdout:5/569: mkdir d5/db4 0 2024-09-18T12:51:14.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/221: getdents d3/dd 0 2024-09-18T12:51:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:7/277: symlink d2/d1d/l67 0 2024-09-18T12:51:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:7/278: write d2/d1d/f36 [5023953,99154] 0 2024-09-18T12:51:14.793 INFO:tasks.workunit.client.1.smithi136.stdout:5/570: mkdir d5/d1a/d2d/d34/d4e/db5 0 2024-09-18T12:51:14.793 INFO:tasks.workunit.client.1.smithi136.stdout:5/571: write d5/d1a/d2d/d3f/d7f/faf [820634,112815] 0 2024-09-18T12:51:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:4/222: mknod d3/dd/d2f/c50 0 2024-09-18T12:51:14.795 INFO:tasks.workunit.client.1.smithi136.stdout:1/470: dread d2/f6c [0,4194304] 0 2024-09-18T12:51:14.795 INFO:tasks.workunit.client.1.smithi136.stdout:1/471: chown d2/lf 0 1 2024-09-18T12:51:14.795 INFO:tasks.workunit.client.1.smithi136.stdout:0/526: dread d1/d60/f99 [0,4194304] 0 2024-09-18T12:51:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:7/279: symlink d2/d42/l68 0 2024-09-18T12:51:14.798 INFO:tasks.workunit.client.1.smithi136.stdout:0/527: symlink d1/d3/d1a/d95/lb1 0 2024-09-18T12:51:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:8/251: dwrite d3/d1d/d4a/f4f [0,4194304] 0 2024-09-18T12:51:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:8/252: chown d3/d1e/d4c/d53 11738228 1 2024-09-18T12:51:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:4/223: creat d3/dd/d14/d3e/f51 x:0 0 0 2024-09-18T12:51:14.799 INFO:tasks.workunit.client.1.smithi136.stdout:2/516: dwrite d5/d7/d17/f3c [0,4194304] 0 2024-09-18T12:51:14.799 INFO:tasks.workunit.client.1.smithi136.stdout:5/572: dread d5/f11 [0,4194304] 0 2024-09-18T12:51:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:5/289: dread d2/d14/f1e [0,4194304] 0 2024-09-18T12:51:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:5/290: chown d2/l4f 1009965088 1 2024-09-18T12:51:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:6/200: dwrite f0 [4194304,4194304] 0 2024-09-18T12:51:14.802 INFO:tasks.workunit.client.1.smithi136.stdout:0/528: creat d1/d3/d1a/d98/d81/d72/fb2 x:0 0 0 2024-09-18T12:51:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/280: link d2/f34 d2/d14/d66/f69 0 2024-09-18T12:51:14.804 INFO:tasks.workunit.client.1.smithi136.stdout:2/517: rmdir d5 39 2024-09-18T12:51:14.805 INFO:tasks.workunit.client.1.smithi136.stdout:5/573: creat d5/d1a/d2d/d34/d4e/d7a/d9e/fb6 x:0 0 0 2024-09-18T12:51:14.806 INFO:tasks.workunit.client.1.smithi136.stdout:0/529: rmdir d1/db/d76 39 2024-09-18T12:51:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:8/253: creat d3/d1e/d4c/d53/f5f x:0 0 0 2024-09-18T12:51:14.807 INFO:tasks.workunit.client.1.smithi136.stdout:2/518: link f3 d5/d7/d11/d34/f9b 0 2024-09-18T12:51:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/282: dwrite d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:1/283: chown d0/db/d12/d55/c62 2759484 1 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:1/284: dread - d0/d6/d33/f61 zero size 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/309: dwrite d3/db/df/d29/d12/d44/f62 [0,4194304] 0 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/310: chown d3/db/df/d60/c4a 0 1 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:4/224: mknod d3/c52 0 2024-09-18T12:51:14.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/536: dwrite d6/df/d75/fad [0,4194304] 0 2024-09-18T12:51:14.810 INFO:tasks.workunit.client.1.smithi136.stdout:0/530: mkdir d1/d3/d1a/d98/d81/d51/db3 0 2024-09-18T12:51:14.810 INFO:tasks.workunit.client.1.smithi136.stdout:8/623: dwrite d9/d18/d34/d3d/d47/d65/d92/f99 [0,4194304] 0 2024-09-18T12:51:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:5/291: creat d2/d14/d33/d37/d3b/d5f/f60 x:0 0 0 2024-09-18T12:51:14.811 INFO:tasks.workunit.client.1.smithi136.stdout:2/519: symlink d5/d7/d17/l9c 0 2024-09-18T12:51:14.811 INFO:tasks.workunit.client.1.smithi136.stdout:2/520: write d5/d7/d41/d53/f6f [147811,62464] 0 2024-09-18T12:51:14.811 INFO:tasks.workunit.client.1.smithi136.stdout:2/521: chown d5/d7/d11/c83 3871117 1 2024-09-18T12:51:14.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/201: creat d4/d12/d28/d2a/d2d/f3a x:0 0 0 2024-09-18T12:51:14.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/202: chown f1 4393 1 2024-09-18T12:51:14.815 INFO:tasks.workunit.client.1.smithi136.stdout:9/537: creat d6/da/fba x:0 0 0 2024-09-18T12:51:14.815 INFO:tasks.workunit.client.0.smithi081.stdout:7/281: link d2/d14/d21/c35 d2/d14/d21/c6a 0 2024-09-18T12:51:14.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/538: read d6/db/d12/f37 [36704,61948] 0 2024-09-18T12:51:14.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/539: readlink d6/db/l93 0 2024-09-18T12:51:14.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/540: write d6/da/fba [519341,60990] 0 2024-09-18T12:51:14.816 INFO:tasks.workunit.client.1.smithi136.stdout:9/541: dread - d6/df/d75/f98 zero size 2024-09-18T12:51:14.817 INFO:tasks.workunit.client.1.smithi136.stdout:0/531: creat d1/d3/d1a/d98/d81/d51/fb4 x:0 0 0 2024-09-18T12:51:14.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/225: dread d3/db/d2d/f3b [0,4194304] 0 2024-09-18T12:51:14.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/226: creat d3/dd/d45/f53 x:0 0 0 2024-09-18T12:51:14.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/227: readlink d3/d20/l47 0 2024-09-18T12:51:14.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/228: chown d3/dd/l41 14997 1 2024-09-18T12:51:14.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/229: dread - d3/dd/d14/d4b/f4c zero size 2024-09-18T12:51:14.819 INFO:tasks.workunit.client.0.smithi081.stdout:8/254: symlink d3/l60 0 2024-09-18T12:51:14.819 INFO:tasks.workunit.client.1.smithi136.stdout:1/472: dwrite d2/d5/d2b/d34/f4b [0,4194304] 0 2024-09-18T12:51:14.819 INFO:tasks.workunit.client.1.smithi136.stdout:3/496: dwrite d3/d14/d22/d2c/f68 [0,4194304] 0 2024-09-18T12:51:14.822 INFO:tasks.workunit.client.1.smithi136.stdout:8/624: creat d9/d14/d1a/d2b/fdd x:0 0 0 2024-09-18T12:51:14.823 INFO:tasks.workunit.client.1.smithi136.stdout:7/586: dwrite d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:51:14.823 INFO:tasks.workunit.client.1.smithi136.stdout:7/587: chown d0/f29 1593 1 2024-09-18T12:51:14.824 INFO:tasks.workunit.client.1.smithi136.stdout:9/542: truncate d6/da/d3d/d4d/d91/d25/f27 1328400 0 2024-09-18T12:51:14.824 INFO:tasks.workunit.client.0.smithi081.stdout:3/311: write f1 [3810497,12764] 0 2024-09-18T12:51:14.825 INFO:tasks.workunit.client.1.smithi136.stdout:9/543: read d6/df/d23/d2b/fa6 [32713,25884] 0 2024-09-18T12:51:14.825 INFO:tasks.workunit.client.1.smithi136.stdout:9/544: chown d6/d59/c6b 32109 1 2024-09-18T12:51:14.825 INFO:tasks.workunit.client.0.smithi081.stdout:1/285: mknod d0/d6/c64 0 2024-09-18T12:51:14.826 INFO:tasks.workunit.client.1.smithi136.stdout:0/532: mkdir d1/d3/d1a/d98/d81/d51/daf/db5 0 2024-09-18T12:51:14.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/312: dread d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:14.831 INFO:tasks.workunit.client.1.smithi136.stdout:1/473: mknod d2/d5/d2b/d34/d86/c99 0 2024-09-18T12:51:14.834 INFO:tasks.workunit.client.1.smithi136.stdout:8/625: write d9/d18/f5c [1962036,91519] 0 2024-09-18T12:51:14.834 INFO:tasks.workunit.client.1.smithi136.stdout:8/626: chown d9/d14/f79 37431 1 2024-09-18T12:51:14.835 INFO:tasks.workunit.client.1.smithi136.stdout:7/588: symlink d0/d12/d1a/dac/lce 0 2024-09-18T12:51:14.837 INFO:tasks.workunit.client.1.smithi136.stdout:9/545: mkdir d6/d96/dbb 0 2024-09-18T12:51:14.838 INFO:tasks.workunit.client.1.smithi136.stdout:0/533: getdents d1/d3/d1a/d98/d81/d35/d54 0 2024-09-18T12:51:14.840 INFO:tasks.workunit.client.1.smithi136.stdout:1/474: mkdir d2/d5/d11/d2e/d9a 0 2024-09-18T12:51:14.840 INFO:tasks.workunit.client.0.smithi081.stdout:7/282: dwrite d2/d1d/d27/f47 [0,4194304] 0 2024-09-18T12:51:14.841 INFO:tasks.workunit.client.1.smithi136.stdout:3/497: getdents d3/d14/d17/d75/d86 0 2024-09-18T12:51:14.842 INFO:tasks.workunit.client.1.smithi136.stdout:2/522: dwrite d5/d7/d17/d48/f4e [4194304,4194304] 0 2024-09-18T12:51:14.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/292: rmdir d2/dd/d5e 39 2024-09-18T12:51:14.845 INFO:tasks.workunit.client.1.smithi136.stdout:7/589: mkdir d0/d39/dbf/dcf 0 2024-09-18T12:51:14.847 INFO:tasks.workunit.client.1.smithi136.stdout:9/546: mkdir d6/da/d3d/d4d/d91/d38/dbc 0 2024-09-18T12:51:14.847 INFO:tasks.workunit.client.1.smithi136.stdout:9/547: truncate d6/da/d3d/d4d/d91/d25/f39 666662 0 2024-09-18T12:51:14.847 INFO:tasks.workunit.client.1.smithi136.stdout:4/394: sync 2024-09-18T12:51:14.847 INFO:tasks.workunit.client.1.smithi136.stdout:9/548: read d6/da/fba [176768,68016] 0 2024-09-18T12:51:14.848 INFO:tasks.workunit.client.1.smithi136.stdout:0/534: mknod d1/d3/cb6 0 2024-09-18T12:51:14.848 INFO:tasks.workunit.client.1.smithi136.stdout:0/535: chown d1/d3/d1a/d98 941899 1 2024-09-18T12:51:14.850 INFO:tasks.workunit.client.1.smithi136.stdout:3/498: mknod d3/d10/caa 0 2024-09-18T12:51:14.850 INFO:tasks.workunit.client.1.smithi136.stdout:3/499: write d3/d14/f9d [798253,129258] 0 2024-09-18T12:51:14.852 INFO:tasks.workunit.client.1.smithi136.stdout:7/590: write d0/d35/d41/d50/d5a/f86 [2005733,83248] 0 2024-09-18T12:51:14.853 INFO:tasks.workunit.client.0.smithi081.stdout:8/255: dwrite d3/d1d/d4a/f4f [4194304,4194304] 0 2024-09-18T12:51:14.854 INFO:tasks.workunit.client.1.smithi136.stdout:2/523: mkdir d5/d25/d2d/d9d 0 2024-09-18T12:51:14.855 INFO:tasks.workunit.client.1.smithi136.stdout:8/627: mknod d9/d18/d34/d3d/d8b/cde 0 2024-09-18T12:51:14.855 INFO:tasks.workunit.client.1.smithi136.stdout:8/628: creat d9/d14/d1a/d2b/d42/d9e/fdf x:0 0 0 2024-09-18T12:51:14.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/536: symlink d1/db/d76/lb7 0 2024-09-18T12:51:14.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/537: creat d1/d3/d1a/d98/d81/d72/fb8 x:0 0 0 2024-09-18T12:51:14.857 INFO:tasks.workunit.client.0.smithi081.stdout:6/203: link d4/d6/fd d4/d12/d28/d2a/d2d/d31/f3b 0 2024-09-18T12:51:14.858 INFO:tasks.workunit.client.1.smithi136.stdout:3/500: unlink d3/d2b/l70 0 2024-09-18T12:51:14.859 INFO:tasks.workunit.client.1.smithi136.stdout:9/549: write d6/d13/d4c/fa7 [1309958,51905] 0 2024-09-18T12:51:14.859 INFO:tasks.workunit.client.1.smithi136.stdout:9/550: write d6/da/d3d/d4d/d91/f6c [367419,58272] 0 2024-09-18T12:51:14.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/230: mkdir d3/dd/d14/d54 0 2024-09-18T12:51:14.860 INFO:tasks.workunit.client.1.smithi136.stdout:2/524: creat d5/d7/d11/d34/f9e x:0 0 0 2024-09-18T12:51:14.865 INFO:tasks.workunit.client.1.smithi136.stdout:7/591: write d0/d39/f43 [1518174,86184] 0 2024-09-18T12:51:14.867 INFO:tasks.workunit.client.0.smithi081.stdout:7/283: mknod d2/d18/d3c/c6b 0 2024-09-18T12:51:14.870 INFO:tasks.workunit.client.1.smithi136.stdout:0/538: write d1/d3/d1a/d98/d81/d35/d84/f91 [2997504,16777] 0 2024-09-18T12:51:14.870 INFO:tasks.workunit.client.1.smithi136.stdout:0/539: write d1/d3/d1a/d98/d81/f53 [224406,16697] 0 2024-09-18T12:51:14.870 INFO:tasks.workunit.client.1.smithi136.stdout:0/540: stat d1/d3/d1a/d62/c85 0 2024-09-18T12:51:14.870 INFO:tasks.workunit.client.1.smithi136.stdout:0/541: getdents d1/d3/d1a/d98/d81/d51/daf/db5 0 2024-09-18T12:51:14.871 INFO:tasks.workunit.client.0.smithi081.stdout:5/293: unlink d2/ff 0 2024-09-18T12:51:14.871 INFO:tasks.workunit.client.1.smithi136.stdout:3/501: mknod d3/d14/d18/d7f/cab 0 2024-09-18T12:51:14.872 INFO:tasks.workunit.client.0.smithi081.stdout:8/256: symlink d3/d2f/l61 0 2024-09-18T12:51:14.875 INFO:tasks.workunit.client.1.smithi136.stdout:9/551: unlink d6/db/la0 0 2024-09-18T12:51:14.876 INFO:tasks.workunit.client.0.smithi081.stdout:6/204: creat d4/d12/d28/f3c x:0 0 0 2024-09-18T12:51:14.876 INFO:tasks.workunit.client.0.smithi081.stdout:6/205: read - d4/d12/d28/d2a/d2d/f3a zero size 2024-09-18T12:51:14.876 INFO:tasks.workunit.client.0.smithi081.stdout:6/206: write d4/d12/d28/d2a/d2d/d31/f3b [1844347,40493] 0 2024-09-18T12:51:14.876 INFO:tasks.workunit.client.0.smithi081.stdout:4/231: chown d3/db/d2d 1161419 1 2024-09-18T12:51:14.877 INFO:tasks.workunit.client.1.smithi136.stdout:2/525: mknod d5/d4a/d7a/c9f 0 2024-09-18T12:51:14.879 INFO:tasks.workunit.client.0.smithi081.stdout:1/286: getdents d0/d18/d1a 0 2024-09-18T12:51:14.879 INFO:tasks.workunit.client.0.smithi081.stdout:1/287: stat d0/db/d12 0 2024-09-18T12:51:14.880 INFO:tasks.workunit.client.0.smithi081.stdout:5/294: rename d2/d14/d33/d37/d3b/c5a to d2/d14/d1d/d1a/c61 0 2024-09-18T12:51:14.880 INFO:tasks.workunit.client.1.smithi136.stdout:1/475: rename d2/d5/d11 to d2/d5/d2b/d9b 0 2024-09-18T12:51:14.881 INFO:tasks.workunit.client.0.smithi081.stdout:8/257: symlink d3/d1e/d4c/l62 0 2024-09-18T12:51:14.885 INFO:tasks.workunit.client.0.smithi081.stdout:5/295: dread d2/d14/d1d/d1a/f2b [0,4194304] 0 2024-09-18T12:51:14.887 INFO:tasks.workunit.client.0.smithi081.stdout:1/288: creat d0/db/f65 x:0 0 0 2024-09-18T12:51:14.888 INFO:tasks.workunit.client.0.smithi081.stdout:6/207: getdents d4/d12/d28/d2a/d2d/d31 0 2024-09-18T12:51:14.888 INFO:tasks.workunit.client.0.smithi081.stdout:6/208: fsync f1 0 2024-09-18T12:51:14.889 INFO:tasks.workunit.client.1.smithi136.stdout:0/542: mkdir d1/db/d76/db9 0 2024-09-18T12:51:14.889 INFO:tasks.workunit.client.1.smithi136.stdout:3/502: link d3/d14/d22/d2c/d3d/f91 d3/d14/d22/fac 0 2024-09-18T12:51:14.890 INFO:tasks.workunit.client.1.smithi136.stdout:9/552: truncate d6/da/d3d/d4d/d91/d25/d55/f8d 862582 0 2024-09-18T12:51:14.891 INFO:tasks.workunit.client.0.smithi081.stdout:4/232: rename d3/d20/l47 to d3/dd/d14/d4b/l55 0 2024-09-18T12:51:14.891 INFO:tasks.workunit.client.0.smithi081.stdout:4/233: read d3/dd/f21 [1544416,37770] 0 2024-09-18T12:51:14.891 INFO:tasks.workunit.client.0.smithi081.stdout:4/234: fdatasync d3/dd/d14/f1e 0 2024-09-18T12:51:14.892 INFO:tasks.workunit.client.0.smithi081.stdout:1/289: mkdir d0/d6/d66 0 2024-09-18T12:51:14.893 INFO:tasks.workunit.client.1.smithi136.stdout:4/395: rename d0/d2/f3d to d0/d5f/f75 0 2024-09-18T12:51:14.894 INFO:tasks.workunit.client.0.smithi081.stdout:6/209: creat d4/d12/d28/d2a/d2d/d31/f3d x:0 0 0 2024-09-18T12:51:14.895 INFO:tasks.workunit.client.1.smithi136.stdout:1/476: write d2/d5/d2b/d34/f4b [1691010,44536] 0 2024-09-18T12:51:14.897 INFO:tasks.workunit.client.1.smithi136.stdout:7/592: dwrite d0/d35/d4f/f78 [0,4194304] 0 2024-09-18T12:51:14.897 INFO:tasks.workunit.client.0.smithi081.stdout:7/284: dwrite d2/d14/f44 [0,4194304] 0 2024-09-18T12:51:14.898 INFO:tasks.workunit.client.0.smithi081.stdout:7/285: write d2/d14/d21/d49/f54 [275280,23608] 0 2024-09-18T12:51:14.898 INFO:tasks.workunit.client.0.smithi081.stdout:5/296: dread d2/d47/f58 [0,4194304] 0 2024-09-18T12:51:14.898 INFO:tasks.workunit.client.0.smithi081.stdout:5/297: write d2/d14/d33/d37/f50 [1055628,584] 0 2024-09-18T12:51:14.899 INFO:tasks.workunit.client.1.smithi136.stdout:4/396: rename d0/d45/d67/c70 to d0/d5f/c76 0 2024-09-18T12:51:14.899 INFO:tasks.workunit.client.1.smithi136.stdout:0/543: rename d1/d3/d1a/d98/d81 to d1/d3/d1a/d98/d81/d72/dba 22 2024-09-18T12:51:14.899 INFO:tasks.workunit.client.1.smithi136.stdout:0/544: write d1/d60/d82/f93 [376695,128423] 0 2024-09-18T12:51:14.900 INFO:tasks.workunit.client.0.smithi081.stdout:7/286: dread d2/d14/f16 [0,4194304] 0 2024-09-18T12:51:14.900 INFO:tasks.workunit.client.0.smithi081.stdout:4/235: unlink d3/f3c 0 2024-09-18T12:51:14.900 INFO:tasks.workunit.client.0.smithi081.stdout:4/236: read d3/dd/f2c [2909728,100595] 0 2024-09-18T12:51:14.900 INFO:tasks.workunit.client.0.smithi081.stdout:5/298: symlink d2/d14/d1d/l62 0 2024-09-18T12:51:14.902 INFO:tasks.workunit.client.1.smithi136.stdout:1/477: mknod d2/d5/d2b/d9b/d2e/c9c 0 2024-09-18T12:51:14.903 INFO:tasks.workunit.client.0.smithi081.stdout:8/258: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:14.903 INFO:tasks.workunit.client.0.smithi081.stdout:4/237: rename d3/d20/c44 to d3/dd/d2f/c56 0 2024-09-18T12:51:14.903 INFO:tasks.workunit.client.0.smithi081.stdout:4/238: getdents d3/db/d2d/d4e 0 2024-09-18T12:51:14.905 INFO:tasks.workunit.client.0.smithi081.stdout:5/299: mknod d2/dd/c63 0 2024-09-18T12:51:14.910 INFO:tasks.workunit.client.1.smithi136.stdout:7/593: unlink d0/d12/d1a/d46/c4a 0 2024-09-18T12:51:14.913 INFO:tasks.workunit.client.1.smithi136.stdout:4/397: creat d0/d2/f77 x:0 0 0 2024-09-18T12:51:14.914 INFO:tasks.workunit.client.1.smithi136.stdout:1/478: symlink d2/d5/d2b/d34/d5c/l9d 0 2024-09-18T12:51:14.915 INFO:tasks.workunit.client.1.smithi136.stdout:0/545: write d1/d17/f6b [1934804,28924] 0 2024-09-18T12:51:14.915 INFO:tasks.workunit.client.1.smithi136.stdout:0/546: write d1/d3/d1a/d98/d81/d35/f40 [2163057,27877] 0 2024-09-18T12:51:14.915 INFO:tasks.workunit.client.1.smithi136.stdout:0/547: chown d1/d46/d6c 9284 1 2024-09-18T12:51:14.917 INFO:tasks.workunit.client.1.smithi136.stdout:1/479: rename d2/d5/d2b/d34/d86/f27 to d2/d5/d2b/d34/d5c/f9e 0 2024-09-18T12:51:14.920 INFO:tasks.workunit.client.1.smithi136.stdout:1/480: symlink d2/d5/d2b/d9b/l9f 0 2024-09-18T12:51:14.920 INFO:tasks.workunit.client.1.smithi136.stdout:1/481: stat d2/d5/d2b/d9b/d2e 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.0.smithi081.stdout:7/287: dread d2/d1d/d27/f2e [0,4194304] 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.0.smithi081.stdout:1/290: dwrite d0/d6/d33/f61 [0,4194304] 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.0.smithi081.stdout:1/291: truncate d0/d6/d7/d2e/d51/f56 905600 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.1.smithi136.stdout:0/548: getdents d1/d3/d1a/d98/d81/d72 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.1.smithi136.stdout:0/549: stat d1/d3/d1a/d62/d75/l7d 0 2024-09-18T12:51:14.921 INFO:tasks.workunit.client.1.smithi136.stdout:0/550: truncate d1/d60/f99 1032702 0 2024-09-18T12:51:14.922 INFO:tasks.workunit.client.1.smithi136.stdout:7/594: dread d0/d35/d36/fb3 [0,4194304] 0 2024-09-18T12:51:14.922 INFO:tasks.workunit.client.0.smithi081.stdout:7/288: symlink d2/d14/d21/l6c 0 2024-09-18T12:51:14.922 INFO:tasks.workunit.client.0.smithi081.stdout:7/289: fsync d2/d1d/f45 0 2024-09-18T12:51:14.922 INFO:tasks.workunit.client.0.smithi081.stdout:7/290: dread - d2/d42/f41 zero size 2024-09-18T12:51:14.923 INFO:tasks.workunit.client.1.smithi136.stdout:1/482: rmdir d2/d5/d2b/d63 39 2024-09-18T12:51:14.923 INFO:tasks.workunit.client.1.smithi136.stdout:1/483: write d2/f6c [3830922,4035] 0 2024-09-18T12:51:14.924 INFO:tasks.workunit.client.1.smithi136.stdout:0/551: truncate d1/f18 1306275 0 2024-09-18T12:51:14.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/292: rename d0/d6/d7/d2e/d51/l27 to d0/d54/l67 0 2024-09-18T12:51:14.925 INFO:tasks.workunit.client.0.smithi081.stdout:1/293: readlink d0/d6/d7/d2e/l53 0 2024-09-18T12:51:14.925 INFO:tasks.workunit.client.0.smithi081.stdout:1/294: stat d0/d6/d7/d2e/d51 0 2024-09-18T12:51:14.926 INFO:tasks.workunit.client.0.smithi081.stdout:6/210: dwrite d4/d6/fb [0,4194304] 0 2024-09-18T12:51:14.926 INFO:tasks.workunit.client.0.smithi081.stdout:6/211: truncate d4/d12/d28/f36 683604 0 2024-09-18T12:51:14.927 INFO:tasks.workunit.client.0.smithi081.stdout:7/291: unlink d2/d18/f3f 0 2024-09-18T12:51:14.927 INFO:tasks.workunit.client.1.smithi136.stdout:1/484: creat d2/d5/d2b/d9b/d2e/d9a/fa0 x:0 0 0 2024-09-18T12:51:14.927 INFO:tasks.workunit.client.1.smithi136.stdout:1/485: write d2/f78 [67792,83278] 0 2024-09-18T12:51:14.927 INFO:tasks.workunit.client.1.smithi136.stdout:1/486: readlink d2/d5/d2b/d9b/d2e/d4c/l53 0 2024-09-18T12:51:14.929 INFO:tasks.workunit.client.0.smithi081.stdout:6/212: symlink d4/l3e 0 2024-09-18T12:51:14.930 INFO:tasks.workunit.client.0.smithi081.stdout:7/292: symlink d2/d56/d61/l6d 0 2024-09-18T12:51:14.930 INFO:tasks.workunit.client.1.smithi136.stdout:7/595: dread d0/d35/d41/d50/d5a/fa7 [0,4194304] 0 2024-09-18T12:51:14.930 INFO:tasks.workunit.client.1.smithi136.stdout:0/552: rmdir d1 39 2024-09-18T12:51:14.932 INFO:tasks.workunit.client.0.smithi081.stdout:6/213: unlink d4/l1e 0 2024-09-18T12:51:14.932 INFO:tasks.workunit.client.0.smithi081.stdout:6/214: fdatasync d4/fa 0 2024-09-18T12:51:14.933 INFO:tasks.workunit.client.1.smithi136.stdout:0/553: mkdir d1/d17/dbb 0 2024-09-18T12:51:14.933 INFO:tasks.workunit.client.0.smithi081.stdout:5/300: dread d2/d14/d33/d37/d3b/f43 [0,4194304] 0 2024-09-18T12:51:14.934 INFO:tasks.workunit.client.0.smithi081.stdout:5/301: fdatasync d2/d14/d33/d37/d3b/f13 0 2024-09-18T12:51:14.934 INFO:tasks.workunit.client.0.smithi081.stdout:5/302: stat d2/d14/d33/d37/d3b/d16/d56/c59 0 2024-09-18T12:51:14.934 INFO:tasks.workunit.client.0.smithi081.stdout:5/303: truncate d2/d14/f32 795622 0 2024-09-18T12:51:14.934 INFO:tasks.workunit.client.0.smithi081.stdout:7/293: creat d2/d18/d22/f6e x:0 0 0 2024-09-18T12:51:14.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/215: symlink d4/d12/d28/d2a/l3f 0 2024-09-18T12:51:14.936 INFO:tasks.workunit.client.1.smithi136.stdout:4/398: dread d0/d5f/f75 [0,4194304] 0 2024-09-18T12:51:14.938 INFO:tasks.workunit.client.1.smithi136.stdout:0/554: mkdir d1/d3/d1a/d98/d81/d70/dbc 0 2024-09-18T12:51:14.941 INFO:tasks.workunit.client.0.smithi081.stdout:8/259: dwrite d3/d1e/f27 [4194304,4194304] 0 2024-09-18T12:51:14.944 INFO:tasks.workunit.client.0.smithi081.stdout:8/260: mknod d3/d1e/d4c/d53/c63 0 2024-09-18T12:51:14.947 INFO:tasks.workunit.client.0.smithi081.stdout:8/261: creat d3/d1e/d4c/f64 x:0 0 0 2024-09-18T12:51:14.949 INFO:tasks.workunit.client.0.smithi081.stdout:5/304: dread d2/d14/f4e [0,4194304] 0 2024-09-18T12:51:14.949 INFO:tasks.workunit.client.0.smithi081.stdout:5/305: write d2/d14/d33/d37/d3b/d18/f35 [4223873,1517] 0 2024-09-18T12:51:14.949 INFO:tasks.workunit.client.0.smithi081.stdout:5/306: write d2/d14/d33/d37/d3b/d18/d20/f30 [1321409,81576] 0 2024-09-18T12:51:14.949 INFO:tasks.workunit.client.0.smithi081.stdout:5/307: stat d2/dd/d5e/f40 0 2024-09-18T12:51:14.950 INFO:tasks.workunit.client.1.smithi136.stdout:0/555: rmdir d1/d60 39 2024-09-18T12:51:14.953 INFO:tasks.workunit.client.0.smithi081.stdout:4/239: dwrite d3/db/f23 [0,4194304] 0 2024-09-18T12:51:14.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/491: sync 2024-09-18T12:51:14.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/492: chown d8/d9/d3c/d45/la0 24 1 2024-09-18T12:51:14.954 INFO:tasks.workunit.client.0.smithi081.stdout:5/308: symlink d2/d14/d1d/d1a/l64 0 2024-09-18T12:51:14.954 INFO:tasks.workunit.client.0.smithi081.stdout:5/309: fdatasync d2/d14/d33/d37/d3b/f13 0 2024-09-18T12:51:14.957 INFO:tasks.workunit.client.1.smithi136.stdout:0/556: rmdir d1/d60 39 2024-09-18T12:51:14.957 INFO:tasks.workunit.client.1.smithi136.stdout:0/557: chown d1/f31 2 1 2024-09-18T12:51:14.957 INFO:tasks.workunit.client.1.smithi136.stdout:0/558: write d1/d60/f68 [698262,46046] 0 2024-09-18T12:51:14.957 INFO:tasks.workunit.client.0.smithi081.stdout:8/262: read d3/d1e/f2b [1131611,67612] 0 2024-09-18T12:51:14.959 INFO:tasks.workunit.client.1.smithi136.stdout:6/493: symlink d8/d9/de/d60/d71/d76/la3 0 2024-09-18T12:51:14.960 INFO:tasks.workunit.client.1.smithi136.stdout:0/559: symlink d1/db/d76/lbd 0 2024-09-18T12:51:14.961 INFO:tasks.workunit.client.0.smithi081.stdout:4/240: link d3/dd/d45/f53 d3/dd/d14/d54/f57 0 2024-09-18T12:51:14.963 INFO:tasks.workunit.client.1.smithi136.stdout:0/560: rename d1/d3/d1a/d98/d81/d72/f78 to d1/d3/d1a/d98/d81/d35/d84/fbe 0 2024-09-18T12:51:14.963 INFO:tasks.workunit.client.1.smithi136.stdout:0/561: chown d1/d17/f34 2 1 2024-09-18T12:51:14.963 INFO:tasks.workunit.client.0.smithi081.stdout:8/263: rename d3/c8 to d3/d1d/d4a/c65 0 2024-09-18T12:51:14.963 INFO:tasks.workunit.client.0.smithi081.stdout:8/264: dread - d3/f57 zero size 2024-09-18T12:51:14.963 INFO:tasks.workunit.client.0.smithi081.stdout:8/265: creat d3/d1e/d4c/d53/f66 x:0 0 0 2024-09-18T12:51:14.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/241: read d3/db/fc [2222531,23125] 0 2024-09-18T12:51:14.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/242: dread - d3/dd/d14/d4b/f4c zero size 2024-09-18T12:51:14.964 INFO:tasks.workunit.client.1.smithi136.stdout:0/562: rmdir d1/d3/d1a/d62/d75 39 2024-09-18T12:51:14.965 INFO:tasks.workunit.client.1.smithi136.stdout:4/399: read d0/f15 [7187283,3519] 0 2024-09-18T12:51:14.965 INFO:tasks.workunit.client.1.smithi136.stdout:4/400: chown d0/d25/f39 22 1 2024-09-18T12:51:14.966 INFO:tasks.workunit.client.1.smithi136.stdout:7/596: dwrite d0/d35/d36/fb3 [0,4194304] 0 2024-09-18T12:51:14.967 INFO:tasks.workunit.client.0.smithi081.stdout:8/266: unlink d3/d1d/c2e 0 2024-09-18T12:51:14.967 INFO:tasks.workunit.client.1.smithi136.stdout:4/401: symlink d0/l78 0 2024-09-18T12:51:14.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/243: mkdir d3/db/d58 0 2024-09-18T12:51:14.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/244: truncate d3/dd/d14/d4b/f4c 347915 0 2024-09-18T12:51:14.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/245: chown d3/db/d2d 29 1 2024-09-18T12:51:14.970 INFO:tasks.workunit.client.1.smithi136.stdout:7/597: mkdir d0/d35/d41/d50/d5a/d98/dd0 0 2024-09-18T12:51:14.971 INFO:tasks.workunit.client.1.smithi136.stdout:4/402: mkdir d0/d25/d79 0 2024-09-18T12:51:14.972 INFO:tasks.workunit.client.1.smithi136.stdout:7/598: chown d0/d2c/d2e/l63 82748 1 2024-09-18T12:51:14.973 INFO:tasks.workunit.client.0.smithi081.stdout:1/295: link d0/d54/l67 d0/d6/d7/d2e/d4e/l68 0 2024-09-18T12:51:14.973 INFO:tasks.workunit.client.1.smithi136.stdout:7/599: mkdir d0/d39/d4d/d69/dd1 0 2024-09-18T12:51:14.974 INFO:tasks.workunit.client.0.smithi081.stdout:8/267: dread d3/f11 [0,4194304] 0 2024-09-18T12:51:14.974 INFO:tasks.workunit.client.0.smithi081.stdout:8/268: stat d3/f25 0 2024-09-18T12:51:14.974 INFO:tasks.workunit.client.1.smithi136.stdout:7/600: stat d0/d2c/d85/l99 0 2024-09-18T12:51:14.974 INFO:tasks.workunit.client.1.smithi136.stdout:7/601: truncate d0/f62 5055162 0 2024-09-18T12:51:14.977 INFO:tasks.workunit.client.1.smithi136.stdout:7/602: getdents d0/d39/d4d/d9a 0 2024-09-18T12:51:14.978 INFO:tasks.workunit.client.0.smithi081.stdout:1/296: symlink d0/d6/l69 0 2024-09-18T12:51:14.979 INFO:tasks.workunit.client.0.smithi081.stdout:5/310: dread d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:14.979 INFO:tasks.workunit.client.0.smithi081.stdout:6/216: dwrite f1 [4194304,4194304] 0 2024-09-18T12:51:14.979 INFO:tasks.workunit.client.0.smithi081.stdout:6/217: readlink d4/d12/d1c/l2f 0 2024-09-18T12:51:14.980 INFO:tasks.workunit.client.0.smithi081.stdout:8/269: mknod d3/c67 0 2024-09-18T12:51:14.980 INFO:tasks.workunit.client.1.smithi136.stdout:7/603: rename d0/d12/c15 to d0/d2c/cd2 0 2024-09-18T12:51:14.981 INFO:tasks.workunit.client.1.smithi136.stdout:6/494: dread d8/dc/f31 [0,4194304] 0 2024-09-18T12:51:14.981 INFO:tasks.workunit.client.1.smithi136.stdout:6/495: truncate d8/d9/de/d1c/d50/f73 1062973 0 2024-09-18T12:51:14.981 INFO:tasks.workunit.client.1.smithi136.stdout:6/496: chown d8/d9/de/d1c/c88 0 1 2024-09-18T12:51:14.981 INFO:tasks.workunit.client.1.smithi136.stdout:6/497: dread - d8/d9/de/d1c/d50/f85 zero size 2024-09-18T12:51:14.981 INFO:tasks.workunit.client.1.smithi136.stdout:0/563: dread d1/d3/d1a/d98/d81/d35/f49 [0,4194304] 0 2024-09-18T12:51:14.982 INFO:tasks.workunit.client.0.smithi081.stdout:5/311: creat d2/d14/d33/d37/d3b/d16/d56/f65 x:0 0 0 2024-09-18T12:51:14.982 INFO:tasks.workunit.client.0.smithi081.stdout:7/294: dwrite d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:14.982 INFO:tasks.workunit.client.1.smithi136.stdout:1/487: dwrite d2/d5/fd [0,4194304] 0 2024-09-18T12:51:14.982 INFO:tasks.workunit.client.1.smithi136.stdout:1/488: fsync d2/f17 0 2024-09-18T12:51:14.983 INFO:tasks.workunit.client.1.smithi136.stdout:4/403: write d0/d45/f63 [1445932,101818] 0 2024-09-18T12:51:14.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/270: dread d3/d2f/f31 [0,4194304] 0 2024-09-18T12:51:14.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/271: readlink d3/d1d/l2c 0 2024-09-18T12:51:14.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/272: chown d3/f3f 200014387 1 2024-09-18T12:51:14.985 INFO:tasks.workunit.client.0.smithi081.stdout:6/218: mkdir d4/d12/d1c/d39/d40 0 2024-09-18T12:51:14.985 INFO:tasks.workunit.client.0.smithi081.stdout:6/219: creat d4/d12/d28/f41 x:0 0 0 2024-09-18T12:51:14.985 INFO:tasks.workunit.client.0.smithi081.stdout:6/220: readlink d4/d6/lf 0 2024-09-18T12:51:14.985 INFO:tasks.workunit.client.1.smithi136.stdout:6/498: truncate d8/d9/d56/f78 546770 0 2024-09-18T12:51:14.994 INFO:tasks.workunit.client.0.smithi081.stdout:5/312: dread d2/d14/d1d/d1a/f4a [0,4194304] 0 2024-09-18T12:51:14.996 INFO:tasks.workunit.client.1.smithi136.stdout:4/404: mkdir d0/d3/d54/d5c/d7a 0 2024-09-18T12:51:14.996 INFO:tasks.workunit.client.1.smithi136.stdout:4/405: fsync d0/d3/f48 0 2024-09-18T12:51:14.998 INFO:tasks.workunit.client.0.smithi081.stdout:7/295: rename d2/d56/d61/l6d to d2/d42/l6f 0 2024-09-18T12:51:14.999 INFO:tasks.workunit.client.0.smithi081.stdout:7/296: creat d2/d14/d21/d62/f70 x:0 0 0 2024-09-18T12:51:14.999 INFO:tasks.workunit.client.1.smithi136.stdout:1/489: write d2/d5/d2b/d9b/f58 [1019590,7746] 0 2024-09-18T12:51:14.999 INFO:tasks.workunit.client.1.smithi136.stdout:1/490: chown d2/d5/d2b/d9b/f71 258820 1 2024-09-18T12:51:15.000 INFO:tasks.workunit.client.1.smithi136.stdout:7/604: write d0/d2c/f48 [1525413,34693] 0 2024-09-18T12:51:15.000 INFO:tasks.workunit.client.1.smithi136.stdout:6/499: getdents d8/d9 0 2024-09-18T12:51:15.003 INFO:tasks.workunit.client.1.smithi136.stdout:0/564: rename d1/d3/d1a/d98/d81/c3a to d1/d3/d1a/cbf 0 2024-09-18T12:51:15.003 INFO:tasks.workunit.client.1.smithi136.stdout:1/491: creat d2/d5/fa1 x:0 0 0 2024-09-18T12:51:15.003 INFO:tasks.workunit.client.1.smithi136.stdout:1/492: fsync d2/d5/d2b/d9b/d1b/f77 0 2024-09-18T12:51:15.004 INFO:tasks.workunit.client.1.smithi136.stdout:1/493: fdatasync d2/f6f 0 2024-09-18T12:51:15.006 INFO:tasks.workunit.client.1.smithi136.stdout:7/605: rename d0/d35/d41/d50/d7f/d3c/f65 to d0/fd3 0 2024-09-18T12:51:15.008 INFO:tasks.workunit.client.0.smithi081.stdout:4/246: rename d3/dd to d3/d59 0 2024-09-18T12:51:15.010 INFO:tasks.workunit.client.1.smithi136.stdout:1/494: rmdir d2/d5/d2b/d34/d86/d94 0 2024-09-18T12:51:15.012 INFO:tasks.workunit.client.0.smithi081.stdout:8/273: dwrite d3/d1d/d4a/f4f [8388608,4194304] 0 2024-09-18T12:51:15.013 INFO:tasks.workunit.client.1.smithi136.stdout:7/606: symlink d0/d39/d4d/d69/dd1/ld4 0 2024-09-18T12:51:15.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/313: creat d2/f66 x:0 0 0 2024-09-18T12:51:15.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/314: readlink d2/d14/d33/d37/d3b/l55 0 2024-09-18T12:51:15.019 INFO:tasks.workunit.client.0.smithi081.stdout:7/297: creat d2/d18/f71 x:0 0 0 2024-09-18T12:51:15.020 INFO:tasks.workunit.client.0.smithi081.stdout:4/247: creat d3/d59/d45/d4f/f5a x:0 0 0 2024-09-18T12:51:15.021 INFO:tasks.workunit.client.0.smithi081.stdout:8/274: mkdir d3/d1e/d4c/d68 0 2024-09-18T12:51:15.021 INFO:tasks.workunit.client.0.smithi081.stdout:8/275: chown d3 251110 1 2024-09-18T12:51:15.021 INFO:tasks.workunit.client.0.smithi081.stdout:8/276: fsync d3/d1e/f36 0 2024-09-18T12:51:15.021 INFO:tasks.workunit.client.0.smithi081.stdout:8/277: read - d3/d1e/f36 zero size 2024-09-18T12:51:15.021 INFO:tasks.workunit.client.0.smithi081.stdout:8/278: dread - d3/d1d/f41 zero size 2024-09-18T12:51:15.022 INFO:tasks.workunit.client.1.smithi136.stdout:5/574: sync 2024-09-18T12:51:15.022 INFO:tasks.workunit.client.1.smithi136.stdout:5/575: truncate d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 790306 0 2024-09-18T12:51:15.022 INFO:tasks.workunit.client.0.smithi081.stdout:5/315: rmdir d2/d14/d33/d37/d3b/d16 39 2024-09-18T12:51:15.023 INFO:tasks.workunit.client.0.smithi081.stdout:7/298: creat d2/d14/d21/f72 x:0 0 0 2024-09-18T12:51:15.023 INFO:tasks.workunit.client.0.smithi081.stdout:7/299: stat d2/d18/d3c/f65 0 2024-09-18T12:51:15.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/248: mkdir d3/d20/d5b 0 2024-09-18T12:51:15.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/249: write d3/d59/f21 [2241952,35933] 0 2024-09-18T12:51:15.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/250: readlink l1 0 2024-09-18T12:51:15.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/251: fsync d3/d59/d14/d27/f3a 0 2024-09-18T12:51:15.026 INFO:tasks.workunit.client.0.smithi081.stdout:8/279: unlink d3/f24 0 2024-09-18T12:51:15.026 INFO:tasks.workunit.client.0.smithi081.stdout:8/280: creat d3/d1e/d4c/f69 x:0 0 0 2024-09-18T12:51:15.027 INFO:tasks.workunit.client.0.smithi081.stdout:5/316: mknod d2/d14/d1d/c67 0 2024-09-18T12:51:15.029 INFO:tasks.workunit.client.1.smithi136.stdout:6/500: dwrite d8/d9/de/f40 [0,4194304] 0 2024-09-18T12:51:15.029 INFO:tasks.workunit.client.0.smithi081.stdout:8/281: symlink d3/d1d/d4a/l6a 0 2024-09-18T12:51:15.031 INFO:tasks.workunit.client.1.smithi136.stdout:6/501: mknod d8/d9/de/d60/d94/ca4 0 2024-09-18T12:51:15.033 INFO:tasks.workunit.client.1.smithi136.stdout:6/502: creat d8/d9/de/d60/fa5 x:0 0 0 2024-09-18T12:51:15.034 INFO:tasks.workunit.client.1.smithi136.stdout:6/503: getdents d8/d9/de/d1c/d50 0 2024-09-18T12:51:15.036 INFO:tasks.workunit.client.1.smithi136.stdout:6/504: rename d8/d9/de/f70 to d8/d9/d56/d96/fa6 0 2024-09-18T12:51:15.036 INFO:tasks.workunit.client.1.smithi136.stdout:7/607: dread d0/d35/d36/fc1 [0,4194304] 0 2024-09-18T12:51:15.037 INFO:tasks.workunit.client.1.smithi136.stdout:4/406: dwrite d0/d13/f69 [0,4194304] 0 2024-09-18T12:51:15.041 INFO:tasks.workunit.client.1.smithi136.stdout:4/407: unlink d0/d13/l1f 0 2024-09-18T12:51:15.042 INFO:tasks.workunit.client.1.smithi136.stdout:7/608: dread d0/d35/f6c [0,4194304] 0 2024-09-18T12:51:15.042 INFO:tasks.workunit.client.1.smithi136.stdout:4/408: mkdir d0/d45/d67/d7b 0 2024-09-18T12:51:15.045 INFO:tasks.workunit.client.1.smithi136.stdout:0/565: dwrite d1/d3/d1a/d98/d81/d35/d54/f89 [0,4194304] 0 2024-09-18T12:51:15.045 INFO:tasks.workunit.client.0.smithi081.stdout:7/300: dread d2/d14/f44 [0,4194304] 0 2024-09-18T12:51:15.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/301: mkdir d2/d56/d73 0 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.0.smithi081.stdout:7/302: truncate d2/f13 5177036 0 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.1.smithi136.stdout:1/495: dwrite d2/d5/d2b/d34/d86/f2c [4194304,4194304] 0 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.1.smithi136.stdout:1/496: write d2/f42 [332753,130731] 0 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.1.smithi136.stdout:7/609: rename d0/d35/d41/d50/d7f/d3c to d0/d35/d4f/dd5 0 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.1.smithi136.stdout:7/610: chown d0/fd3 232738 1 2024-09-18T12:51:15.048 INFO:tasks.workunit.client.1.smithi136.stdout:6/505: write d8/dc/f15 [1782024,65099] 0 2024-09-18T12:51:15.050 INFO:tasks.workunit.client.0.smithi081.stdout:7/303: mkdir d2/d18/d60/d74 0 2024-09-18T12:51:15.050 INFO:tasks.workunit.client.1.smithi136.stdout:6/506: read d8/d9/d56/f67 [73931,123239] 0 2024-09-18T12:51:15.053 INFO:tasks.workunit.client.0.smithi081.stdout:6/221: truncate d4/d6/f27 4371725 0 2024-09-18T12:51:15.055 INFO:tasks.workunit.client.0.smithi081.stdout:6/222: creat d4/d6/f42 x:0 0 0 2024-09-18T12:51:15.055 INFO:tasks.workunit.client.1.smithi136.stdout:5/576: dwrite d5/d1a/d2d/d34/d88/f9a [0,4194304] 0 2024-09-18T12:51:15.056 INFO:tasks.workunit.client.0.smithi081.stdout:6/223: symlink d4/l43 0 2024-09-18T12:51:15.056 INFO:tasks.workunit.client.1.smithi136.stdout:0/566: rmdir d1/d3/d1a/d98/d81/d35/d84 39 2024-09-18T12:51:15.057 INFO:tasks.workunit.client.1.smithi136.stdout:0/567: creat d1/d3/d1a/d98/d81/d51/fc0 x:0 0 0 2024-09-18T12:51:15.058 INFO:tasks.workunit.client.0.smithi081.stdout:6/224: truncate d4/fa 739119 0 2024-09-18T12:51:15.058 INFO:tasks.workunit.client.0.smithi081.stdout:6/225: chown d4/d12/f32 421 1 2024-09-18T12:51:15.059 INFO:tasks.workunit.client.1.smithi136.stdout:1/497: symlink d2/d5/d2b/d34/d5c/d96/la2 0 2024-09-18T12:51:15.060 INFO:tasks.workunit.client.1.smithi136.stdout:6/507: getdents d8/d9/d3c/d45 0 2024-09-18T12:51:15.060 INFO:tasks.workunit.client.0.smithi081.stdout:6/226: read d4/d12/d28/f36 [65044,110297] 0 2024-09-18T12:51:15.063 INFO:tasks.workunit.client.1.smithi136.stdout:0/568: truncate d1/d3/f58 3894738 0 2024-09-18T12:51:15.063 INFO:tasks.workunit.client.1.smithi136.stdout:0/569: getdents d1/d3/d1a/d98/d81/d51/daf/db5 0 2024-09-18T12:51:15.064 INFO:tasks.workunit.client.0.smithi081.stdout:5/317: dwrite d2/d14/d33/d37/d3b/d18/f35 [4194304,4194304] 0 2024-09-18T12:51:15.064 INFO:tasks.workunit.client.0.smithi081.stdout:5/318: write d2/d14/f4e [1475864,85513] 0 2024-09-18T12:51:15.065 INFO:tasks.workunit.client.1.smithi136.stdout:0/570: symlink d1/d60/lc1 0 2024-09-18T12:51:15.067 INFO:tasks.workunit.client.0.smithi081.stdout:5/319: getdents d2/dd/d5e 0 2024-09-18T12:51:15.067 INFO:tasks.workunit.client.0.smithi081.stdout:5/320: chown d2/d14/d1d/c46 22558 1 2024-09-18T12:51:15.067 INFO:tasks.workunit.client.1.smithi136.stdout:0/571: symlink d1/db/d76/db9/lc2 0 2024-09-18T12:51:15.068 INFO:tasks.workunit.client.1.smithi136.stdout:0/572: creat d1/d3/d1a/d95/fc3 x:0 0 0 2024-09-18T12:51:15.068 INFO:tasks.workunit.client.0.smithi081.stdout:5/321: readlink d2/d14/d33/d37/d3b/d2a/l3e 0 2024-09-18T12:51:15.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/304: dread d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:15.069 INFO:tasks.workunit.client.1.smithi136.stdout:0/573: write d1/d60/f68 [454893,104716] 0 2024-09-18T12:51:15.069 INFO:tasks.workunit.client.1.smithi136.stdout:0/574: write d1/d60/d82/f8f [872780,12685] 0 2024-09-18T12:51:15.071 INFO:tasks.workunit.client.0.smithi081.stdout:5/322: mknod d2/d14/d33/d37/d3b/d18/d20/c68 0 2024-09-18T12:51:15.071 INFO:tasks.workunit.client.1.smithi136.stdout:0/575: mknod d1/d3/d1a/d98/d81/d35/cc4 0 2024-09-18T12:51:15.072 INFO:tasks.workunit.client.1.smithi136.stdout:0/576: stat d1/d46/d6c/f8a 0 2024-09-18T12:51:15.072 INFO:tasks.workunit.client.1.smithi136.stdout:6/508: dread d8/d9/de/d1c/f38 [0,4194304] 0 2024-09-18T12:51:15.073 INFO:tasks.workunit.client.1.smithi136.stdout:0/577: mknod d1/db/d76/db9/cc5 0 2024-09-18T12:51:15.073 INFO:tasks.workunit.client.1.smithi136.stdout:0/578: write d1/d3/d1a/f50 [631944,36039] 0 2024-09-18T12:51:15.074 INFO:tasks.workunit.client.0.smithi081.stdout:7/305: creat d2/d18/d22/d48/f75 x:0 0 0 2024-09-18T12:51:15.074 INFO:tasks.workunit.client.0.smithi081.stdout:7/306: stat d2/d18/d22/l5f 0 2024-09-18T12:51:15.074 INFO:tasks.workunit.client.1.smithi136.stdout:6/509: getdents d8/d9/d3c/d4a 0 2024-09-18T12:51:15.074 INFO:tasks.workunit.client.1.smithi136.stdout:6/510: write d8/f92 [609769,68815] 0 2024-09-18T12:51:15.076 INFO:tasks.workunit.client.1.smithi136.stdout:6/511: creat d8/d9d/d9f/fa7 x:0 0 0 2024-09-18T12:51:15.076 INFO:tasks.workunit.client.1.smithi136.stdout:5/577: read d5/d1a/f68 [789593,25036] 0 2024-09-18T12:51:15.080 INFO:tasks.workunit.client.1.smithi136.stdout:6/512: mkdir d8/d9/de/d1c/d50/da8 0 2024-09-18T12:51:15.082 INFO:tasks.workunit.client.1.smithi136.stdout:0/579: dread d1/f18 [0,4194304] 0 2024-09-18T12:51:15.082 INFO:tasks.workunit.client.1.smithi136.stdout:0/580: read - d1/db/faa zero size 2024-09-18T12:51:15.082 INFO:tasks.workunit.client.1.smithi136.stdout:0/581: dread - d1/d3/d1a/d98/d81/d35/f4d zero size 2024-09-18T12:51:15.084 INFO:tasks.workunit.client.0.smithi081.stdout:4/252: dwrite d3/d59/f2c [4194304,4194304] 0 2024-09-18T12:51:15.084 INFO:tasks.workunit.client.1.smithi136.stdout:6/513: mkdir d8/d9/da9 0 2024-09-18T12:51:15.085 INFO:tasks.workunit.client.1.smithi136.stdout:1/498: write d2/d5/d2b/d9b/d2e/f79 [2672040,120507] 0 2024-09-18T12:51:15.086 INFO:tasks.workunit.client.1.smithi136.stdout:5/578: getdents d5/d1a/d2d 0 2024-09-18T12:51:15.088 INFO:tasks.workunit.client.1.smithi136.stdout:0/582: link d1/d17/f25 d1/d3/d1a/d98/d81/d51/fc6 0 2024-09-18T12:51:15.089 INFO:tasks.workunit.client.1.smithi136.stdout:6/514: mkdir d8/daa 0 2024-09-18T12:51:15.091 INFO:tasks.workunit.client.1.smithi136.stdout:5/579: truncate d5/d1a/f27 1227356 0 2024-09-18T12:51:15.091 INFO:tasks.workunit.client.1.smithi136.stdout:5/580: getdents d5/d1a/d2d/d34/d4e/d7a/d9e/da9 0 2024-09-18T12:51:15.092 INFO:tasks.workunit.client.1.smithi136.stdout:0/583: symlink d1/d3/d1a/lc7 0 2024-09-18T12:51:15.093 INFO:tasks.workunit.client.1.smithi136.stdout:3/503: sync 2024-09-18T12:51:15.093 INFO:tasks.workunit.client.1.smithi136.stdout:9/553: sync 2024-09-18T12:51:15.093 INFO:tasks.workunit.client.1.smithi136.stdout:3/504: chown d3/d2b/d6c 74316 1 2024-09-18T12:51:15.093 INFO:tasks.workunit.client.1.smithi136.stdout:2/526: sync 2024-09-18T12:51:15.094 INFO:tasks.workunit.client.1.smithi136.stdout:2/527: write d5/d7/f12 [2813149,47178] 0 2024-09-18T12:51:15.094 INFO:tasks.workunit.client.1.smithi136.stdout:8/629: sync 2024-09-18T12:51:15.095 INFO:tasks.workunit.client.1.smithi136.stdout:6/515: creat d8/d9/d56/d96/fab x:0 0 0 2024-09-18T12:51:15.095 INFO:tasks.workunit.client.1.smithi136.stdout:6/516: fsync d8/d9/d64/f98 0 2024-09-18T12:51:15.096 INFO:tasks.workunit.client.1.smithi136.stdout:1/499: dread d2/d5/d9/f3b [0,4194304] 0 2024-09-18T12:51:15.096 INFO:tasks.workunit.client.1.smithi136.stdout:0/584: getdents d1 0 2024-09-18T12:51:15.096 INFO:tasks.workunit.client.1.smithi136.stdout:0/585: chown d1/d3/d1a/d98/d81/d35/d84/f8b 0 1 2024-09-18T12:51:15.096 INFO:tasks.workunit.client.1.smithi136.stdout:0/586: creat d1/d3/d1a/d62/fc8 x:0 0 0 2024-09-18T12:51:15.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/282: dwrite d3/f57 [0,4194304] 0 2024-09-18T12:51:15.097 INFO:tasks.workunit.client.1.smithi136.stdout:9/554: symlink d6/da/d3d/d4d/d91/d38/dbc/lbd 0 2024-09-18T12:51:15.098 INFO:tasks.workunit.client.1.smithi136.stdout:3/505: creat d3/d14/d22/d2c/d3d/fad x:0 0 0 2024-09-18T12:51:15.100 INFO:tasks.workunit.client.0.smithi081.stdout:5/323: dwrite d2/d14/d33/d37/d3b/d18/d20/f30 [0,4194304] 0 2024-09-18T12:51:15.100 INFO:tasks.workunit.client.0.smithi081.stdout:5/324: read - d2/f66 zero size 2024-09-18T12:51:15.101 INFO:tasks.workunit.client.0.smithi081.stdout:7/307: dwrite d2/d14/f2f [0,4194304] 0 2024-09-18T12:51:15.101 INFO:tasks.workunit.client.0.smithi081.stdout:7/308: write d2/d14/d21/d62/f64 [760283,76168] 0 2024-09-18T12:51:15.102 INFO:tasks.workunit.client.1.smithi136.stdout:9/555: symlink d6/db/d12/d62/lbe 0 2024-09-18T12:51:15.102 INFO:tasks.workunit.client.1.smithi136.stdout:7/611: dwrite d0/d39/d4d/d69/f88 [0,4194304] 0 2024-09-18T12:51:15.102 INFO:tasks.workunit.client.1.smithi136.stdout:4/409: dwrite d0/d3/d54/f74 [0,4194304] 0 2024-09-18T12:51:15.102 INFO:tasks.workunit.client.1.smithi136.stdout:4/410: fdatasync d0/d3/f4 0 2024-09-18T12:51:15.103 INFO:tasks.workunit.client.0.smithi081.stdout:8/283: dread d3/d1d/d4a/f4e [0,4194304] 0 2024-09-18T12:51:15.103 INFO:tasks.workunit.client.0.smithi081.stdout:8/284: readlink d3/d2f/l3e 0 2024-09-18T12:51:15.103 INFO:tasks.workunit.client.0.smithi081.stdout:8/285: write d3/d1e/f2b [3763723,113465] 0 2024-09-18T12:51:15.103 INFO:tasks.workunit.client.1.smithi136.stdout:3/506: mknod d3/d5/d31/cae 0 2024-09-18T12:51:15.105 INFO:tasks.workunit.client.0.smithi081.stdout:5/325: creat d2/d14/d33/d37/d3b/d16/f69 x:0 0 0 2024-09-18T12:51:15.107 INFO:tasks.workunit.client.0.smithi081.stdout:7/309: mknod d2/d56/d73/c76 0 2024-09-18T12:51:15.109 INFO:tasks.workunit.client.1.smithi136.stdout:0/587: write d1/d3/d1a/d98/d81/d51/fc6 [2106727,117805] 0 2024-09-18T12:51:15.109 INFO:tasks.workunit.client.1.smithi136.stdout:0/588: write d1/d3/d1a/d98/d81/d35/d84/f91 [2513082,26165] 0 2024-09-18T12:51:15.109 INFO:tasks.workunit.client.1.smithi136.stdout:0/589: chown d1/d3/d1a/d98/d81/d35/f96 220564 1 2024-09-18T12:51:15.109 INFO:tasks.workunit.client.1.smithi136.stdout:0/590: write d1/f1f [1756526,66132] 0 2024-09-18T12:51:15.109 INFO:tasks.workunit.client.1.smithi136.stdout:8/630: rename d9/d18/d34/d3d/f50 to d9/d18/d34/d3d/d47/d65/fe0 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.1.smithi136.stdout:2/528: dread d5/d25/f2e [0,4194304] 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.0.smithi081.stdout:6/227: dread d4/fa [0,4194304] 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.0.smithi081.stdout:6/228: write d4/f18 [98724,123925] 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.0.smithi081.stdout:6/229: creat d4/d12/f44 x:0 0 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.0.smithi081.stdout:5/326: rename d2/d14/d33/d37/d3b/d18 to d2/d14/d33/d37/d3b/d6a 0 2024-09-18T12:51:15.110 INFO:tasks.workunit.client.0.smithi081.stdout:5/327: truncate d2/dd/d5e/f3c 299150 0 2024-09-18T12:51:15.111 INFO:tasks.workunit.client.1.smithi136.stdout:1/500: getdents d2/d5/d2b/d34 0 2024-09-18T12:51:15.111 INFO:tasks.workunit.client.1.smithi136.stdout:1/501: write d2/d5/d2b/d9b/d1b/f77 [1111699,11656] 0 2024-09-18T12:51:15.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/328: creat d2/d14/d33/f6b x:0 0 0 2024-09-18T12:51:15.113 INFO:tasks.workunit.client.1.smithi136.stdout:9/556: getdents d6/d59 0 2024-09-18T12:51:15.113 INFO:tasks.workunit.client.1.smithi136.stdout:9/557: dread - d6/df/d75/f98 zero size 2024-09-18T12:51:15.113 INFO:tasks.workunit.client.1.smithi136.stdout:9/558: readlink d6/d13/l1b 0 2024-09-18T12:51:15.118 INFO:tasks.workunit.client.1.smithi136.stdout:7/612: rmdir d0/d2c/d85 39 2024-09-18T12:51:15.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/230: write d4/f18 [5361195,36313] 0 2024-09-18T12:51:15.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/231: fsync d4/d6/f42 0 2024-09-18T12:51:15.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/232: readlink d4/d6/l2e 0 2024-09-18T12:51:15.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/233: fsync d4/f21 0 2024-09-18T12:51:15.126 INFO:tasks.workunit.client.0.smithi081.stdout:6/234: creat d4/d12/d28/d2a/f45 x:0 0 0 2024-09-18T12:51:15.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/235: rmdir d4/d12/d28/d2a/d2d 39 2024-09-18T12:51:15.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/236: truncate d4/d12/d28/f3c 237908 0 2024-09-18T12:51:15.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/237: stat d4/f18 0 2024-09-18T12:51:15.129 INFO:tasks.workunit.client.1.smithi136.stdout:0/591: symlink d1/d3/d1a/d98/d81/d51/daf/lc9 0 2024-09-18T12:51:15.130 INFO:tasks.workunit.client.1.smithi136.stdout:6/517: dwrite d8/d9/d64/f98 [0,4194304] 0 2024-09-18T12:51:15.130 INFO:tasks.workunit.client.1.smithi136.stdout:6/518: creat d8/d9/d64/fac x:0 0 0 2024-09-18T12:51:15.130 INFO:tasks.workunit.client.1.smithi136.stdout:6/519: write d8/d9/de/d60/f81 [152532,23973] 0 2024-09-18T12:51:15.130 INFO:tasks.workunit.client.1.smithi136.stdout:6/520: write d8/d9/d64/fac [256002,74790] 0 2024-09-18T12:51:15.132 INFO:tasks.workunit.client.1.smithi136.stdout:4/411: rename d0/d2/c20 to d0/d3/d54/d5c/c7c 0 2024-09-18T12:51:15.132 INFO:tasks.workunit.client.1.smithi136.stdout:4/412: creat d0/d3/f7d x:0 0 0 2024-09-18T12:51:15.132 INFO:tasks.workunit.client.0.smithi081.stdout:6/238: rename d4/l43 to d4/d12/d28/d2a/l46 0 2024-09-18T12:51:15.132 INFO:tasks.workunit.client.0.smithi081.stdout:6/239: mknod d4/d12/d28/d2a/d2d/c47 0 2024-09-18T12:51:15.134 INFO:tasks.workunit.client.0.smithi081.stdout:6/240: creat d4/d12/d1c/f48 x:0 0 0 2024-09-18T12:51:15.134 INFO:tasks.workunit.client.0.smithi081.stdout:6/241: creat d4/d12/d28/d2a/f49 x:0 0 0 2024-09-18T12:51:15.134 INFO:tasks.workunit.client.0.smithi081.stdout:6/242: fsync d4/d6/f26 0 2024-09-18T12:51:15.134 INFO:tasks.workunit.client.0.smithi081.stdout:6/243: write d4/d12/d28/d2a/d2d/d31/f3d [492010,51502] 0 2024-09-18T12:51:15.134 INFO:tasks.workunit.client.0.smithi081.stdout:6/244: truncate d4/d12/d28/f3c 912727 0 2024-09-18T12:51:15.135 INFO:tasks.workunit.client.0.smithi081.stdout:5/329: getdents d2/d14/d33/d37/d3b/d16 0 2024-09-18T12:51:15.137 INFO:tasks.workunit.client.1.smithi136.stdout:9/559: link d6/d13/d4c/f50 d6/da/d3d/d4d/d91/fbf 0 2024-09-18T12:51:15.138 INFO:tasks.workunit.client.0.smithi081.stdout:5/330: dread d2/d14/f1e [0,4194304] 0 2024-09-18T12:51:15.138 INFO:tasks.workunit.client.0.smithi081.stdout:5/331: write d2/d14/d33/d37/d3b/f38 [2009867,40114] 0 2024-09-18T12:51:15.138 INFO:tasks.workunit.client.0.smithi081.stdout:5/332: chown d2/d14/f17 11612 1 2024-09-18T12:51:15.139 INFO:tasks.workunit.client.1.smithi136.stdout:7/613: mknod d0/d35/d41/d50/d5a/d98/dd0/cd6 0 2024-09-18T12:51:15.140 INFO:tasks.workunit.client.1.smithi136.stdout:7/614: chown d0/d2c/d85/fa6 3131 1 2024-09-18T12:51:15.140 INFO:tasks.workunit.client.1.smithi136.stdout:7/615: chown d0/d35/d41/d50/d7f/c38 3678 1 2024-09-18T12:51:15.140 INFO:tasks.workunit.client.0.smithi081.stdout:4/253: dwrite d3/db/fe [0,4194304] 0 2024-09-18T12:51:15.140 INFO:tasks.workunit.client.0.smithi081.stdout:4/254: chown d3/d59/d14/f29 11052 1 2024-09-18T12:51:15.140 INFO:tasks.workunit.client.0.smithi081.stdout:5/333: mknod d2/d14/d33/d37/d3b/d2a/c6c 0 2024-09-18T12:51:15.141 INFO:tasks.workunit.client.1.smithi136.stdout:0/592: symlink d1/d3/d1a/d98/d81/d51/daf/lca 0 2024-09-18T12:51:15.144 INFO:tasks.workunit.client.0.smithi081.stdout:7/310: dwrite d2/f39 [0,4194304] 0 2024-09-18T12:51:15.145 INFO:tasks.workunit.client.1.smithi136.stdout:6/521: symlink d8/lad 0 2024-09-18T12:51:15.147 INFO:tasks.workunit.client.1.smithi136.stdout:8/631: dwrite d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:15.147 INFO:tasks.workunit.client.1.smithi136.stdout:8/632: getdents d9/d14/d1a/d2b/d42/d9e/dda 0 2024-09-18T12:51:15.148 INFO:tasks.workunit.client.1.smithi136.stdout:8/633: fdatasync d9/d14/d1a/d2b/f2e 0 2024-09-18T12:51:15.150 INFO:tasks.workunit.client.1.smithi136.stdout:4/413: rename d0/f58 to d0/d3/d54/d5c/f7e 0 2024-09-18T12:51:15.153 INFO:tasks.workunit.client.0.smithi081.stdout:4/255: write d3/db/fe [3444579,42395] 0 2024-09-18T12:51:15.154 INFO:tasks.workunit.client.0.smithi081.stdout:4/256: mknod d3/db/d58/c5c 0 2024-09-18T12:51:15.154 INFO:tasks.workunit.client.0.smithi081.stdout:4/257: fsync d3/d59/d14/d3e/f51 0 2024-09-18T12:51:15.154 INFO:tasks.workunit.client.0.smithi081.stdout:4/258: read - d3/d59/d45/d4f/f5a zero size 2024-09-18T12:51:15.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/259: creat d3/d20/d3d/f5d x:0 0 0 2024-09-18T12:51:15.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/260: readlink d3/d59/l41 0 2024-09-18T12:51:15.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/261: truncate d3/d59/d2f/f33 122145 0 2024-09-18T12:51:15.158 INFO:tasks.workunit.client.0.smithi081.stdout:4/262: mknod d3/db/d2d/d4e/c5e 0 2024-09-18T12:51:15.158 INFO:tasks.workunit.client.0.smithi081.stdout:4/263: write d3/db/fe [5743096,124707] 0 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.1.smithi136.stdout:1/502: mknod d2/d5/d9/ca3 0 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.1.smithi136.stdout:1/503: readlink d2/d5/d2b/d34/d5c/l76 0 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.1.smithi136.stdout:2/529: rmdir d5/d7/d41/d53 39 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.1.smithi136.stdout:0/593: mkdir d1/d60/dcb 0 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.1.smithi136.stdout:0/594: fsync d1/d17/f45 0 2024-09-18T12:51:15.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/286: dwrite d3/f11 [0,4194304] 0 2024-09-18T12:51:15.160 INFO:tasks.workunit.client.1.smithi136.stdout:6/522: unlink d8/d9/fa 0 2024-09-18T12:51:15.160 INFO:tasks.workunit.client.1.smithi136.stdout:6/523: chown d8/d9/d56/f86 1323902174 1 2024-09-18T12:51:15.163 INFO:tasks.workunit.client.1.smithi136.stdout:2/530: creat d5/d7/d11/fa0 x:0 0 0 2024-09-18T12:51:15.164 INFO:tasks.workunit.client.1.smithi136.stdout:7/616: dread d0/d35/d41/f5c [0,4194304] 0 2024-09-18T12:51:15.165 INFO:tasks.workunit.client.1.smithi136.stdout:0/595: creat d1/d3/d1a/d62/d75/fcc x:0 0 0 2024-09-18T12:51:15.165 INFO:tasks.workunit.client.1.smithi136.stdout:3/507: dwrite d3/d14/d22/fac [0,4194304] 0 2024-09-18T12:51:15.167 INFO:tasks.workunit.client.1.smithi136.stdout:6/524: mknod d8/d9/d56/d96/cae 0 2024-09-18T12:51:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:8/287: rename d3/d2f/l54 to d3/d1e/d4c/d53/l6b 0 2024-09-18T12:51:15.171 INFO:tasks.workunit.client.1.smithi136.stdout:0/596: link d1/d3/d1a/d98/d81/d35/d84/f8b d1/d60/d82/fcd 0 2024-09-18T12:51:15.171 INFO:tasks.workunit.client.1.smithi136.stdout:2/531: getdents d5/d25 0 2024-09-18T12:51:15.171 INFO:tasks.workunit.client.1.smithi136.stdout:2/532: fsync d5/d4a/f92 0 2024-09-18T12:51:15.171 INFO:tasks.workunit.client.1.smithi136.stdout:0/597: creat d1/d3/d1a/fce x:0 0 0 2024-09-18T12:51:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:8/288: truncate d3/d2f/f31 172470 0 2024-09-18T12:51:15.176 INFO:tasks.workunit.client.1.smithi136.stdout:0/598: rename d1/d17/f25 to d1/d3/d1a/d62/d75/fcf 0 2024-09-18T12:51:15.178 INFO:tasks.workunit.client.1.smithi136.stdout:0/599: mknod d1/d3/d1a/d98/d81/d70/cd0 0 2024-09-18T12:51:15.180 INFO:tasks.workunit.client.1.smithi136.stdout:3/508: dread d3/d14/d22/d2c/d3d/f80 [0,4194304] 0 2024-09-18T12:51:15.182 INFO:tasks.workunit.client.1.smithi136.stdout:0/600: write d1/f1f [1171311,54875] 0 2024-09-18T12:51:15.185 INFO:tasks.workunit.client.1.smithi136.stdout:0/601: mkdir d1/d17/dd1 0 2024-09-18T12:51:15.186 INFO:tasks.workunit.client.1.smithi136.stdout:0/602: symlink d1/d3/d1a/d98/d81/d51/daf/db5/ld2 0 2024-09-18T12:51:15.186 INFO:tasks.workunit.client.1.smithi136.stdout:0/603: getdents d1/d60/dcb 0 2024-09-18T12:51:15.187 INFO:tasks.workunit.client.1.smithi136.stdout:0/604: truncate d1/d46/f66 1211626 0 2024-09-18T12:51:15.188 INFO:tasks.workunit.client.1.smithi136.stdout:0/605: mknod d1/d3/cd3 0 2024-09-18T12:51:15.189 INFO:tasks.workunit.client.1.smithi136.stdout:7/617: dread d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:51:15.189 INFO:tasks.workunit.client.1.smithi136.stdout:7/618: write d0/d2c/f48 [2963945,6955] 0 2024-09-18T12:51:15.189 INFO:tasks.workunit.client.1.smithi136.stdout:7/619: fdatasync d0/d12/d5e/d67/fcb 0 2024-09-18T12:51:15.189 INFO:tasks.workunit.client.1.smithi136.stdout:0/606: mknod d1/d3/d1a/d98/d81/d51/daf/cd4 0 2024-09-18T12:51:15.190 INFO:tasks.workunit.client.1.smithi136.stdout:7/620: rmdir d0/d12/d1a/dac 39 2024-09-18T12:51:15.190 INFO:tasks.workunit.client.1.smithi136.stdout:7/621: write d0/d35/fa0 [913353,121428] 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:7/622: readlink d0/d35/d4f/dd5/l8f 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:7/623: chown d0/d39/lca 125405184 1 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:7/624: creat d0/d35/d41/d50/fd7 x:0 0 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:7/625: write d0/d39/d4d/d9a/fb1 [815503,38962] 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:7/626: truncate d0/d39/d4d/d9a/fb1 1251185 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:0/607: getdents d1/d3/d1a/d98/d81/d72 0 2024-09-18T12:51:15.191 INFO:tasks.workunit.client.1.smithi136.stdout:0/608: write d1/d3/d1a/d98/d81/f53 [1028206,62207] 0 2024-09-18T12:51:15.192 INFO:tasks.workunit.client.1.smithi136.stdout:7/627: creat d0/da8/fd8 x:0 0 0 2024-09-18T12:51:15.192 INFO:tasks.workunit.client.1.smithi136.stdout:7/628: write d0/d12/d1a/f20 [17673,21122] 0 2024-09-18T12:51:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:7/311: dwrite d2/d1d/d27/f50 [0,4194304] 0 2024-09-18T12:51:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:2/274: sync 2024-09-18T12:51:15.194 INFO:tasks.workunit.client.1.smithi136.stdout:0/609: mknod d1/d60/dcb/cd5 0 2024-09-18T12:51:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:6/245: dwrite d4/d12/d28/d2a/d2d/f30 [0,4194304] 0 2024-09-18T12:51:15.195 INFO:tasks.workunit.client.1.smithi136.stdout:7/629: mkdir d0/d35/dd9 0 2024-09-18T12:51:15.195 INFO:tasks.workunit.client.1.smithi136.stdout:8/634: dwrite d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:15.195 INFO:tasks.workunit.client.1.smithi136.stdout:8/635: dread - d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 zero size 2024-09-18T12:51:15.196 INFO:tasks.workunit.client.1.smithi136.stdout:7/630: dread - d0/d2c/d2e/fb5 zero size 2024-09-18T12:51:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/312: mknod d2/d14/d21/d62/c77 0 2024-09-18T12:51:15.198 INFO:tasks.workunit.client.1.smithi136.stdout:1/504: dwrite d2/d5/f5a [0,4194304] 0 2024-09-18T12:51:15.198 INFO:tasks.workunit.client.1.smithi136.stdout:9/560: dwrite d6/da/d3d/d4d/d91/d25/f71 [0,4194304] 0 2024-09-18T12:51:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:5/334: dwrite d2/d14/d33/d37/d3b/f13 [0,4194304] 0 2024-09-18T12:51:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:2/275: mkdir d15/d16/d20/d59 0 2024-09-18T12:51:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/276: chown d15/f17 19052412 1 2024-09-18T12:51:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/277: chown d15/d16/d20/l21 211384889 1 2024-09-18T12:51:15.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/414: dwrite d0/d2/f12 [0,4194304] 0 2024-09-18T12:51:15.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/415: fdatasync d0/d25/f6f 0 2024-09-18T12:51:15.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/416: chown d0/d3/f4 16746440 1 2024-09-18T12:51:15.202 INFO:tasks.workunit.client.1.smithi136.stdout:7/631: creat d0/d35/d4f/dd5/fda x:0 0 0 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:7/632: creat d0/d35/d4f/dd5/fdb x:0 0 0 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:7/633: truncate d0/d39/d4d/f9c 139812 0 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:7/634: read - d0/fd3 zero size 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:9/561: dread d6/da/d3d/d4d/d91/d25/f3a [0,4194304] 0 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:6/525: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:6/526: dread - d8/d9/d3c/f7a zero size 2024-09-18T12:51:15.203 INFO:tasks.workunit.client.1.smithi136.stdout:9/562: write d6/da/d3d/d4d/d91/f6f [2275327,110253] 0 2024-09-18T12:51:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:6/246: creat d4/d12/d1c/d39/f4a x:0 0 0 2024-09-18T12:51:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:6/247: write d4/fe [2300580,9733] 0 2024-09-18T12:51:15.206 INFO:tasks.workunit.client.1.smithi136.stdout:1/505: unlink d2/d5/d2b/d9b/c18 0 2024-09-18T12:51:15.207 INFO:tasks.workunit.client.0.smithi081.stdout:2/278: unlink d15/d16/d20/c2d 0 2024-09-18T12:51:15.209 INFO:tasks.workunit.client.0.smithi081.stdout:6/248: link d4/f13 d4/d12/d28/d2a/f4b 0 2024-09-18T12:51:15.211 INFO:tasks.workunit.client.0.smithi081.stdout:2/279: getdents d15/d16/d25 0 2024-09-18T12:51:15.213 INFO:tasks.workunit.client.0.smithi081.stdout:5/335: write d2/d14/d33/d37/d3b/d6a/f25 [348357,113204] 0 2024-09-18T12:51:15.213 INFO:tasks.workunit.client.0.smithi081.stdout:5/336: write d2/d14/d33/d37/d3b/d5f/f60 [695207,92344] 0 2024-09-18T12:51:15.213 INFO:tasks.workunit.client.0.smithi081.stdout:5/337: readlink d2/d14/d1d/d1a/l41 0 2024-09-18T12:51:15.214 INFO:tasks.workunit.client.0.smithi081.stdout:5/338: fdatasync d2/d14/f1e 0 2024-09-18T12:51:15.214 INFO:tasks.workunit.client.0.smithi081.stdout:2/280: mkdir d15/d16/d20/d22/d5a 0 2024-09-18T12:51:15.214 INFO:tasks.workunit.client.1.smithi136.stdout:7/635: unlink d0/d35/d4f/c73 0 2024-09-18T12:51:15.215 INFO:tasks.workunit.client.1.smithi136.stdout:4/417: dread d0/d2/f17 [0,4194304] 0 2024-09-18T12:51:15.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/339: mkdir d2/d14/d33/d37/d3b/d16/d56/d6d 0 2024-09-18T12:51:15.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/340: truncate d2/d14/d33/d37/d3b/d6a/d20/f30 4934844 0 2024-09-18T12:51:15.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/289: dwrite d3/d1d/f49 [0,4194304] 0 2024-09-18T12:51:15.218 INFO:tasks.workunit.client.0.smithi081.stdout:5/341: rmdir d2/d14/d33/d37/d3b/d16/d56/d6d 0 2024-09-18T12:51:15.219 INFO:tasks.workunit.client.0.smithi081.stdout:6/249: dread d4/f18 [0,4194304] 0 2024-09-18T12:51:15.220 INFO:tasks.workunit.client.1.smithi136.stdout:3/509: truncate d3/d14/d22/d2c/d3d/f91 3574892 0 2024-09-18T12:51:15.220 INFO:tasks.workunit.client.1.smithi136.stdout:3/510: fdatasync d3/d10/f5e 0 2024-09-18T12:51:15.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/250: symlink d4/d12/d1c/l4c 0 2024-09-18T12:51:15.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/251: fsync d4/d6/fb 0 2024-09-18T12:51:15.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/252: write d4/fa [437498,121743] 0 2024-09-18T12:51:15.223 INFO:tasks.workunit.client.1.smithi136.stdout:9/563: creat d6/df/d23/d2b/d79/d53/d5c/fc0 x:0 0 0 2024-09-18T12:51:15.224 INFO:tasks.workunit.client.0.smithi081.stdout:5/342: dread d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:15.224 INFO:tasks.workunit.client.0.smithi081.stdout:8/290: getdents d3/d1d 0 2024-09-18T12:51:15.224 INFO:tasks.workunit.client.0.smithi081.stdout:8/291: creat d3/f6c x:0 0 0 2024-09-18T12:51:15.226 INFO:tasks.workunit.client.0.smithi081.stdout:5/343: getdents d2/d47 0 2024-09-18T12:51:15.226 INFO:tasks.workunit.client.1.smithi136.stdout:0/610: dwrite d1/d46/d6c/f8a [0,4194304] 0 2024-09-18T12:51:15.226 INFO:tasks.workunit.client.1.smithi136.stdout:0/611: write d1/d46/d6c/fa9 [116642,45527] 0 2024-09-18T12:51:15.226 INFO:tasks.workunit.client.1.smithi136.stdout:0/612: dread - d1/d3/d1a/d98/d81/d35/f96 zero size 2024-09-18T12:51:15.227 INFO:tasks.workunit.client.0.smithi081.stdout:7/313: dwrite d2/d18/f20 [0,4194304] 0 2024-09-18T12:51:15.227 INFO:tasks.workunit.client.0.smithi081.stdout:7/314: write d2/d14/f16 [510574,109431] 0 2024-09-18T12:51:15.227 INFO:tasks.workunit.client.1.smithi136.stdout:1/506: unlink d2/d5/d2b/d9b/d1b/f98 0 2024-09-18T12:51:15.227 INFO:tasks.workunit.client.1.smithi136.stdout:1/507: chown d2/d5/d2b/d9b/d2e/d4c/c29 0 1 2024-09-18T12:51:15.228 INFO:tasks.workunit.client.1.smithi136.stdout:8/636: dwrite d9/d18/d34/d88/fbb [0,4194304] 0 2024-09-18T12:51:15.228 INFO:tasks.workunit.client.1.smithi136.stdout:6/527: dread f5 [0,4194304] 0 2024-09-18T12:51:15.228 INFO:tasks.workunit.client.1.smithi136.stdout:8/637: readlink d9/d18/d34/laf 0 2024-09-18T12:51:15.230 INFO:tasks.workunit.client.0.smithi081.stdout:5/344: link d2/d14/f32 d2/d14/d33/d37/d3b/d5f/f6e 0 2024-09-18T12:51:15.230 INFO:tasks.workunit.client.1.smithi136.stdout:7/636: link d0/d35/d41/d50/d7f/f42 d0/d35/dd9/fdc 0 2024-09-18T12:51:15.230 INFO:tasks.workunit.client.1.smithi136.stdout:7/637: write d0/d39/d4d/fc9 [117397,83530] 0 2024-09-18T12:51:15.232 INFO:tasks.workunit.client.1.smithi136.stdout:4/418: link d0/f1 d0/d13/f7f 0 2024-09-18T12:51:15.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/315: rename d2/f52 to d2/d14/d21/f78 0 2024-09-18T12:51:15.239 INFO:tasks.workunit.client.1.smithi136.stdout:0/613: link d1/d3/d1a/f33 d1/db/d76/db9/fd6 0 2024-09-18T12:51:15.239 INFO:tasks.workunit.client.1.smithi136.stdout:0/614: stat d1/d3/d1a/d98/d81/d35/d84/f91 0 2024-09-18T12:51:15.239 INFO:tasks.workunit.client.1.smithi136.stdout:0/615: creat d1/d3/d1a/d98/d81/d51/fd7 x:0 0 0 2024-09-18T12:51:15.240 INFO:tasks.workunit.client.1.smithi136.stdout:1/508: symlink d2/d5/d2b/d9b/d2e/d4c/la4 0 2024-09-18T12:51:15.240 INFO:tasks.workunit.client.0.smithi081.stdout:5/345: unlink d2/l4b 0 2024-09-18T12:51:15.241 INFO:tasks.workunit.client.0.smithi081.stdout:7/316: mknod d2/d56/c79 0 2024-09-18T12:51:15.245 INFO:tasks.workunit.client.0.smithi081.stdout:7/317: rmdir d2/d14/d66 39 2024-09-18T12:51:15.245 INFO:tasks.workunit.client.0.smithi081.stdout:7/318: creat d2/d18/d3c/f7a x:0 0 0 2024-09-18T12:51:15.248 INFO:tasks.workunit.client.1.smithi136.stdout:8/638: mkdir d9/d14/d1a/d2b/d42/da4/dd9/de1 0 2024-09-18T12:51:15.248 INFO:tasks.workunit.client.0.smithi081.stdout:5/346: rename d2/d14/d33/c57 to d2/d14/d33/d37/d3b/d2a/c6f 0 2024-09-18T12:51:15.251 INFO:tasks.workunit.client.0.smithi081.stdout:7/319: symlink d2/d1d/d27/l7b 0 2024-09-18T12:51:15.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/281: getdents d15/d16/d20/d22 0 2024-09-18T12:51:15.253 INFO:tasks.workunit.client.1.smithi136.stdout:4/419: write d0/d2/f3e [4043870,11664] 0 2024-09-18T12:51:15.253 INFO:tasks.workunit.client.1.smithi136.stdout:4/420: chown d0/l2a 54792157 1 2024-09-18T12:51:15.254 INFO:tasks.workunit.client.0.smithi081.stdout:5/347: truncate d2/d14/d33/d37/d3b/d2a/f45 1069233 0 2024-09-18T12:51:15.255 INFO:tasks.workunit.client.1.smithi136.stdout:9/564: dwrite d6/df/d75/f98 [0,4194304] 0 2024-09-18T12:51:15.255 INFO:tasks.workunit.client.1.smithi136.stdout:5/581: sync 2024-09-18T12:51:15.255 INFO:tasks.workunit.client.1.smithi136.stdout:5/582: chown d5/f18 621 1 2024-09-18T12:51:15.256 INFO:tasks.workunit.client.1.smithi136.stdout:5/583: fdatasync d5/d1a/d2d/d34/d4e/d7a/f89 0 2024-09-18T12:51:15.256 INFO:tasks.workunit.client.1.smithi136.stdout:9/565: write d6/da/d3d/d4d/d91/d38/f81 [413387,35718] 0 2024-09-18T12:51:15.256 INFO:tasks.workunit.client.0.smithi081.stdout:2/282: rename fc to d15/d16/d33/f5b 0 2024-09-18T12:51:15.259 INFO:tasks.workunit.client.0.smithi081.stdout:5/348: creat d2/dd/d5e/f70 x:0 0 0 2024-09-18T12:51:15.259 INFO:tasks.workunit.client.1.smithi136.stdout:5/584: dread d5/d1a/d2d/f87 [0,4194304] 0 2024-09-18T12:51:15.259 INFO:tasks.workunit.client.0.smithi081.stdout:2/283: dread fb [0,4194304] 0 2024-09-18T12:51:15.260 INFO:tasks.workunit.client.0.smithi081.stdout:7/320: dread d2/d14/f44 [0,4194304] 0 2024-09-18T12:51:15.262 INFO:tasks.workunit.client.0.smithi081.stdout:5/349: creat d2/d14/d33/d37/d3b/d6a/f71 x:0 0 0 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/585: rename d5/d1a/d2d/d34/d4e/c8b to d5/d1a/d2d/d34/d4e/d7a/d9e/cb7 0 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/586: readlink d5/d1a/d30/d7b/la0 0 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/587: truncate d5/d1a/f8d 188771 0 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/588: dread - d5/d1a/f85 zero size 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/589: chown d5/d1a/f27 6485251 1 2024-09-18T12:51:15.263 INFO:tasks.workunit.client.1.smithi136.stdout:4/421: dread d0/d45/f63 [0,4194304] 0 2024-09-18T12:51:15.265 INFO:tasks.workunit.client.0.smithi081.stdout:5/350: link d2/d14/d33/d37/d3b/d2a/c6c d2/d14/d33/d37/d3b/c72 0 2024-09-18T12:51:15.265 INFO:tasks.workunit.client.0.smithi081.stdout:6/253: dwrite d4/d12/d28/d2a/f4b [0,4194304] 0 2024-09-18T12:51:15.265 INFO:tasks.workunit.client.0.smithi081.stdout:6/254: readlink d4/d12/d1c/l4c 0 2024-09-18T12:51:15.266 INFO:tasks.workunit.client.0.smithi081.stdout:7/321: rmdir d2/d14/d21/d49 39 2024-09-18T12:51:15.269 INFO:tasks.workunit.client.0.smithi081.stdout:8/292: getdents d3 0 2024-09-18T12:51:15.270 INFO:tasks.workunit.client.1.smithi136.stdout:7/638: dwrite d0/d39/d4d/d9a/fb1 [0,4194304] 0 2024-09-18T12:51:15.270 INFO:tasks.workunit.client.1.smithi136.stdout:7/639: chown d0/d12/d1a/f3e 8 1 2024-09-18T12:51:15.271 INFO:tasks.workunit.client.1.smithi136.stdout:6/528: dwrite d8/d9/de/f40 [4194304,4194304] 0 2024-09-18T12:51:15.271 INFO:tasks.workunit.client.1.smithi136.stdout:6/529: chown d8/d9/d3c/d4a/f53 122 1 2024-09-18T12:51:15.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/351: creat d2/d14/d33/d37/d3b/d16/f73 x:0 0 0 2024-09-18T12:51:15.274 INFO:tasks.workunit.client.1.smithi136.stdout:9/566: dread d6/df/d75/f98 [0,4194304] 0 2024-09-18T12:51:15.274 INFO:tasks.workunit.client.1.smithi136.stdout:9/567: dread - d6/da/d3d/d4d/f9d zero size 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/255: rename d4/d12/d28/f41 to d4/f4d 0 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/256: write d4/d12/d28/f34 [1677235,130314] 0 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/257: creat d4/d12/d28/f4e x:0 0 0 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/258: chown d4/c9 5908 1 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/259: stat d4/d6/lf 0 2024-09-18T12:51:15.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/260: write d4/f24 [1044837,92582] 0 2024-09-18T12:51:15.278 INFO:tasks.workunit.client.0.smithi081.stdout:8/293: truncate d3/d1d/f49 3014737 0 2024-09-18T12:51:15.279 INFO:tasks.workunit.client.0.smithi081.stdout:5/352: mknod d2/d14/d33/d37/d3b/d5f/c74 0 2024-09-18T12:51:15.280 INFO:tasks.workunit.client.1.smithi136.stdout:9/568: creat d6/d13/fc1 x:0 0 0 2024-09-18T12:51:15.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/322: rename d2/d56/d61 to d2/d56/d73/d7c 0 2024-09-18T12:51:15.283 INFO:tasks.workunit.client.1.smithi136.stdout:7/640: rename d0/f29 to d0/d2c/d2e/fdd 0 2024-09-18T12:51:15.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/261: creat d4/d12/d28/d2a/d2d/f4f x:0 0 0 2024-09-18T12:51:15.284 INFO:tasks.workunit.client.0.smithi081.stdout:8/294: mknod d3/d1e/d4c/d53/c6d 0 2024-09-18T12:51:15.284 INFO:tasks.workunit.client.0.smithi081.stdout:8/295: fsync d3/d1d/d4a/f4e 0 2024-09-18T12:51:15.287 INFO:tasks.workunit.client.0.smithi081.stdout:7/323: link d2/d18/d22/f2a d2/d1d/d27/f7d 0 2024-09-18T12:51:15.287 INFO:tasks.workunit.client.1.smithi136.stdout:7/641: rename d0/d39/d4d/l87 to d0/d35/d41/d50/d5a/d98/dd0/lde 0 2024-09-18T12:51:15.287 INFO:tasks.workunit.client.1.smithi136.stdout:7/642: dread - d0/d39/d4d/d69/f6e zero size 2024-09-18T12:51:15.287 INFO:tasks.workunit.client.1.smithi136.stdout:5/590: dwrite d5/d1a/d2d/d34/fa3 [0,4194304] 0 2024-09-18T12:51:15.287 INFO:tasks.workunit.client.0.smithi081.stdout:6/262: mkdir d4/d12/d1c/d50 0 2024-09-18T12:51:15.289 INFO:tasks.workunit.client.0.smithi081.stdout:7/324: unlink d2/d1d/d27/c30 0 2024-09-18T12:51:15.290 INFO:tasks.workunit.client.0.smithi081.stdout:6/263: rmdir d4/d12/d1c/d50 0 2024-09-18T12:51:15.291 INFO:tasks.workunit.client.1.smithi136.stdout:8/639: dwrite d9/d14/d1a/d7f/f8f [0,4194304] 0 2024-09-18T12:51:15.294 INFO:tasks.workunit.client.1.smithi136.stdout:8/640: creat d9/d14/d1a/d2b/d42/da4/dd9/de1/fe2 x:0 0 0 2024-09-18T12:51:15.296 INFO:tasks.workunit.client.1.smithi136.stdout:8/641: mkdir d9/d18/d34/d3d/d47/dbe/de3 0 2024-09-18T12:51:15.296 INFO:tasks.workunit.client.1.smithi136.stdout:8/642: chown d9/d14/d1a/d2b/cb0 48310823 1 2024-09-18T12:51:15.297 INFO:tasks.workunit.client.1.smithi136.stdout:4/422: dwrite d0/d13/f34 [4194304,4194304] 0 2024-09-18T12:51:15.298 INFO:tasks.workunit.client.1.smithi136.stdout:4/423: write d0/d2/f3e [4164900,106428] 0 2024-09-18T12:51:15.298 INFO:tasks.workunit.client.1.smithi136.stdout:4/424: fsync d0/d3/d54/f74 0 2024-09-18T12:51:15.298 INFO:tasks.workunit.client.1.smithi136.stdout:4/425: creat d0/d3/f80 x:0 0 0 2024-09-18T12:51:15.299 INFO:tasks.workunit.client.1.smithi136.stdout:9/569: dread d6/db/d72/fb3 [0,4194304] 0 2024-09-18T12:51:15.299 INFO:tasks.workunit.client.1.smithi136.stdout:9/570: chown d6/df/d23/d2b/c9c 6326 1 2024-09-18T12:51:15.299 INFO:tasks.workunit.client.1.smithi136.stdout:6/530: dwrite d8/dc/f15 [4194304,4194304] 0 2024-09-18T12:51:15.299 INFO:tasks.workunit.client.1.smithi136.stdout:6/531: getdents d8/d9/d56/d96/d9c 0 2024-09-18T12:51:15.299 INFO:tasks.workunit.client.0.smithi081.stdout:2/284: dwrite d15/d16/d20/d31/f42 [0,4194304] 0 2024-09-18T12:51:15.301 INFO:tasks.workunit.client.1.smithi136.stdout:6/532: write d8/d9/d64/f69 [267601,87059] 0 2024-09-18T12:51:15.304 INFO:tasks.workunit.client.1.smithi136.stdout:9/571: creat d6/da/d3d/d4d/d91/fc2 x:0 0 0 2024-09-18T12:51:15.304 INFO:tasks.workunit.client.1.smithi136.stdout:9/572: chown d6/d13/d4c/f7e 0 1 2024-09-18T12:51:15.305 INFO:tasks.workunit.client.0.smithi081.stdout:2/285: truncate d15/f17 4116002 0 2024-09-18T12:51:15.306 INFO:tasks.workunit.client.1.smithi136.stdout:8/643: dread d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:15.306 INFO:tasks.workunit.client.1.smithi136.stdout:8/644: read d9/d14/d1a/d2b/f91 [2280968,46124] 0 2024-09-18T12:51:15.306 INFO:tasks.workunit.client.1.smithi136.stdout:8/645: readlink l7 0 2024-09-18T12:51:15.306 INFO:tasks.workunit.client.1.smithi136.stdout:8/646: creat d9/d14/d1a/d2b/d42/fe4 x:0 0 0 2024-09-18T12:51:15.307 INFO:tasks.workunit.client.0.smithi081.stdout:7/325: write d2/d1d/f36 [620189,63053] 0 2024-09-18T12:51:15.307 INFO:tasks.workunit.client.0.smithi081.stdout:7/326: write d2/d18/d22/f2a [1022082,89579] 0 2024-09-18T12:51:15.308 INFO:tasks.workunit.client.1.smithi136.stdout:6/533: creat d8/d9/de/d60/d71/d76/d97/faf x:0 0 0 2024-09-18T12:51:15.308 INFO:tasks.workunit.client.1.smithi136.stdout:6/534: truncate d8/d9/d3c/f3f 169735 0 2024-09-18T12:51:15.309 INFO:tasks.workunit.client.1.smithi136.stdout:4/426: unlink d0/d3/f80 0 2024-09-18T12:51:15.311 INFO:tasks.workunit.client.0.smithi081.stdout:2/286: creat d15/d16/d25/d2f/f5c x:0 0 0 2024-09-18T12:51:15.311 INFO:tasks.workunit.client.0.smithi081.stdout:2/287: readlink d15/d16/d33/d53/l57 0 2024-09-18T12:51:15.311 INFO:tasks.workunit.client.0.smithi081.stdout:2/288: write d15/d16/f48 [835691,9234] 0 2024-09-18T12:51:15.311 INFO:tasks.workunit.client.0.smithi081.stdout:5/353: truncate d2/fe 1078264 0 2024-09-18T12:51:15.312 INFO:tasks.workunit.client.1.smithi136.stdout:7/643: dwrite d0/fd3 [0,4194304] 0 2024-09-18T12:51:15.312 INFO:tasks.workunit.client.1.smithi136.stdout:7/644: dread - d0/d2c/d85/fa6 zero size 2024-09-18T12:51:15.312 INFO:tasks.workunit.client.1.smithi136.stdout:7/645: truncate d0/d35/d36/d7c/f7d 508932 0 2024-09-18T12:51:15.312 INFO:tasks.workunit.client.1.smithi136.stdout:8/647: mkdir d9/d14/d1a/d2b/d42/da4/de5 0 2024-09-18T12:51:15.313 INFO:tasks.workunit.client.0.smithi081.stdout:7/327: write d2/d14/d21/f78 [1611836,23039] 0 2024-09-18T12:51:15.313 INFO:tasks.workunit.client.1.smithi136.stdout:5/591: dwrite d5/d1a/d2d/d34/d88/f75 [0,4194304] 0 2024-09-18T12:51:15.313 INFO:tasks.workunit.client.1.smithi136.stdout:5/592: write d5/f18 [5119954,65052] 0 2024-09-18T12:51:15.314 INFO:tasks.workunit.client.1.smithi136.stdout:4/427: creat d0/d5f/f81 x:0 0 0 2024-09-18T12:51:15.315 INFO:tasks.workunit.client.0.smithi081.stdout:2/289: mknod d15/d16/d25/c5d 0 2024-09-18T12:51:15.317 INFO:tasks.workunit.client.0.smithi081.stdout:5/354: creat d2/dd/f75 x:0 0 0 2024-09-18T12:51:15.319 INFO:tasks.workunit.client.1.smithi136.stdout:8/648: creat d9/d14/d1a/d7f/fe6 x:0 0 0 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/535: getdents d8/d9/de/d1c 0 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/536: chown d8/dc/f14 2646 1 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/537: getdents d8/d9/de/d1c 0 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/538: write d8/d9/d3c/fa2 [105947,71817] 0 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/539: chown d8/d9/de/d60/l95 13646181 1 2024-09-18T12:51:15.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/540: fdatasync d8/d9/d3c/d4a/f54 0 2024-09-18T12:51:15.321 INFO:tasks.workunit.client.0.smithi081.stdout:7/328: link d2/d1d/f28 d2/d14/d21/f7e 0 2024-09-18T12:51:15.324 INFO:tasks.workunit.client.1.smithi136.stdout:7/646: mknod d0/d2c/d2e/cdf 0 2024-09-18T12:51:15.325 INFO:tasks.workunit.client.0.smithi081.stdout:2/290: link f11 d15/d16/d20/d31/f5e 0 2024-09-18T12:51:15.327 INFO:tasks.workunit.client.0.smithi081.stdout:5/355: truncate d2/d14/d33/d37/d3b/d2a/f4c 1102321 0 2024-09-18T12:51:15.329 INFO:tasks.workunit.client.0.smithi081.stdout:2/291: truncate fe 1541959 0 2024-09-18T12:51:15.329 INFO:tasks.workunit.client.0.smithi081.stdout:2/292: rename d15 to d15/d26/d5f 22 2024-09-18T12:51:15.331 INFO:tasks.workunit.client.1.smithi136.stdout:8/649: symlink d9/d14/d1a/d2b/d42/d6e/d75/d9a/le7 0 2024-09-18T12:51:15.331 INFO:tasks.workunit.client.1.smithi136.stdout:8/650: fsync d9/d14/d1a/d7f/fa0 0 2024-09-18T12:51:15.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/356: truncate d2/d14/f4e 79471 0 2024-09-18T12:51:15.337 INFO:tasks.workunit.client.0.smithi081.stdout:6/264: truncate d4/f24 647791 0 2024-09-18T12:51:15.338 INFO:tasks.workunit.client.0.smithi081.stdout:6/265: write d4/fa [20604,116051] 0 2024-09-18T12:51:15.338 INFO:tasks.workunit.client.0.smithi081.stdout:6/266: chown d4/c17 49755 1 2024-09-18T12:51:15.339 INFO:tasks.workunit.client.1.smithi136.stdout:8/651: mknod d9/ce8 0 2024-09-18T12:51:15.340 INFO:tasks.workunit.client.0.smithi081.stdout:6/267: creat d4/d12/d28/d2a/d2d/d31/f51 x:0 0 0 2024-09-18T12:51:15.340 INFO:tasks.workunit.client.0.smithi081.stdout:6/268: creat d4/d12/d28/d2a/d2d/f52 x:0 0 0 2024-09-18T12:51:15.340 INFO:tasks.workunit.client.0.smithi081.stdout:6/269: chown d4/d12/c25 512089 1 2024-09-18T12:51:15.342 INFO:tasks.workunit.client.0.smithi081.stdout:6/270: creat d4/d12/d1c/d39/d40/f53 x:0 0 0 2024-09-18T12:51:15.343 INFO:tasks.workunit.client.0.smithi081.stdout:2/293: write d15/d16/f58 [5192449,75239] 0 2024-09-18T12:51:15.360 INFO:tasks.workunit.client.0.smithi081.stdout:2/294: dread d15/d26/f29 [0,4194304] 0 2024-09-18T12:51:15.366 INFO:tasks.workunit.client.1.smithi136.stdout:5/593: dwrite d5/d1a/d30/f3c [0,4194304] 0 2024-09-18T12:51:15.366 INFO:tasks.workunit.client.1.smithi136.stdout:5/594: stat d5/d6b/f8c 0 2024-09-18T12:51:15.366 INFO:tasks.workunit.client.1.smithi136.stdout:5/595: readlink d5/d1a/d2d/d34/d4e/d7a/l7d 0 2024-09-18T12:51:15.371 INFO:tasks.workunit.client.0.smithi081.stdout:7/329: dwrite d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:15.371 INFO:tasks.workunit.client.0.smithi081.stdout:7/330: write d2/f12 [2648631,52082] 0 2024-09-18T12:51:15.374 INFO:tasks.workunit.client.1.smithi136.stdout:4/428: dwrite d0/d2/f17 [4194304,4194304] 0 2024-09-18T12:51:15.374 INFO:tasks.workunit.client.0.smithi081.stdout:6/271: dwrite d4/d12/f44 [0,4194304] 0 2024-09-18T12:51:15.375 INFO:tasks.workunit.client.0.smithi081.stdout:5/357: dwrite d2/d14/d33/d37/d3b/d2a/f4c [0,4194304] 0 2024-09-18T12:51:15.375 INFO:tasks.workunit.client.1.smithi136.stdout:7/647: dwrite d0/d35/d41/d50/d7b/fb6 [0,4194304] 0 2024-09-18T12:51:15.375 INFO:tasks.workunit.client.1.smithi136.stdout:8/652: dwrite d9/d14/d1a/d2b/f91 [4194304,4194304] 0 2024-09-18T12:51:15.378 INFO:tasks.workunit.client.0.smithi081.stdout:2/295: dread d15/d16/f18 [0,4194304] 0 2024-09-18T12:51:15.380 INFO:tasks.workunit.client.1.smithi136.stdout:8/653: creat d9/d18/d34/d3d/d47/dbe/dd1/fe9 x:0 0 0 2024-09-18T12:51:15.381 INFO:tasks.workunit.client.1.smithi136.stdout:7/648: dread d0/d35/f6c [0,4194304] 0 2024-09-18T12:51:15.381 INFO:tasks.workunit.client.1.smithi136.stdout:7/649: stat d0/d35/d36/c5b 0 2024-09-18T12:51:15.383 INFO:tasks.workunit.client.1.smithi136.stdout:7/650: mkdir d0/d35/d41/d50/d9b/dc2/de0 0 2024-09-18T12:51:15.384 INFO:tasks.workunit.client.0.smithi081.stdout:2/296: rename d15/d16/d25/c5d to d15/d16/d20/d59/c60 0 2024-09-18T12:51:15.386 INFO:tasks.workunit.client.0.smithi081.stdout:2/297: mkdir d15/d16/d25/d2f/d61 0 2024-09-18T12:51:15.388 INFO:tasks.workunit.client.0.smithi081.stdout:2/298: mknod d15/d26/c62 0 2024-09-18T12:51:15.389 INFO:tasks.workunit.client.0.smithi081.stdout:2/299: creat d15/d16/d25/f63 x:0 0 0 2024-09-18T12:51:15.390 INFO:tasks.workunit.client.1.smithi136.stdout:4/429: dread d0/d2/f50 [0,4194304] 0 2024-09-18T12:51:15.390 INFO:tasks.workunit.client.1.smithi136.stdout:4/430: write d0/fc [1484252,122333] 0 2024-09-18T12:51:15.391 INFO:tasks.workunit.client.0.smithi081.stdout:2/300: mknod d15/d26/c64 0 2024-09-18T12:51:15.391 INFO:tasks.workunit.client.0.smithi081.stdout:6/272: dread d4/fa [0,4194304] 0 2024-09-18T12:51:15.392 INFO:tasks.workunit.client.1.smithi136.stdout:4/431: creat d0/f82 x:0 0 0 2024-09-18T12:51:15.392 INFO:tasks.workunit.client.1.smithi136.stdout:7/651: dread d0/d35/d41/f5c [0,4194304] 0 2024-09-18T12:51:15.393 INFO:tasks.workunit.client.1.smithi136.stdout:4/432: fdatasync d0/d5f/f75 0 2024-09-18T12:51:15.393 INFO:tasks.workunit.client.1.smithi136.stdout:7/652: write d0/d39/dbf/fc8 [4170545,10014] 0 2024-09-18T12:51:15.396 INFO:tasks.workunit.client.1.smithi136.stdout:4/433: getdents d0/d2 0 2024-09-18T12:51:15.396 INFO:tasks.workunit.client.1.smithi136.stdout:4/434: chown d0/d13/l56 140024494 1 2024-09-18T12:51:15.396 INFO:tasks.workunit.client.1.smithi136.stdout:4/435: write d0/d45/f63 [325160,59289] 0 2024-09-18T12:51:15.398 INFO:tasks.workunit.client.0.smithi081.stdout:2/301: getdents d15/d16/d25 0 2024-09-18T12:51:15.398 INFO:tasks.workunit.client.0.smithi081.stdout:2/302: chown d15/d16/d20/c28 13365057 1 2024-09-18T12:51:15.400 INFO:tasks.workunit.client.0.smithi081.stdout:2/303: getdents d15/d16 0 2024-09-18T12:51:15.400 INFO:tasks.workunit.client.0.smithi081.stdout:2/304: write d15/d16/d20/d22/f2e [4695452,119813] 0 2024-09-18T12:51:15.407 INFO:tasks.workunit.client.1.smithi136.stdout:5/596: dwrite d5/d1a/d30/f80 [0,4194304] 0 2024-09-18T12:51:15.407 INFO:tasks.workunit.client.1.smithi136.stdout:5/597: fsync d5/f54 0 2024-09-18T12:51:15.409 INFO:tasks.workunit.client.1.smithi136.stdout:7/653: write d0/d2c/d2e/f32 [3547968,122418] 0 2024-09-18T12:51:15.410 INFO:tasks.workunit.client.0.smithi081.stdout:7/331: dwrite d2/d18/d22/f2a [0,4194304] 0 2024-09-18T12:51:15.410 INFO:tasks.workunit.client.0.smithi081.stdout:7/332: stat d2/d18/d3c 0 2024-09-18T12:51:15.411 INFO:tasks.workunit.client.1.smithi136.stdout:5/598: mknod d5/d1a/d2d/d34/d88/cb8 0 2024-09-18T12:51:15.411 INFO:tasks.workunit.client.1.smithi136.stdout:4/436: dwrite d0/d2/f3e [4194304,4194304] 0 2024-09-18T12:51:15.411 INFO:tasks.workunit.client.1.smithi136.stdout:8/654: dwrite d9/d14/f1f [0,4194304] 0 2024-09-18T12:51:15.412 INFO:tasks.workunit.client.1.smithi136.stdout:8/655: write d9/d14/d1a/d2b/d42/fe4 [167793,49714] 0 2024-09-18T12:51:15.413 INFO:tasks.workunit.client.1.smithi136.stdout:5/599: creat d5/d1a/d2d/fb9 x:0 0 0 2024-09-18T12:51:15.416 INFO:tasks.workunit.client.1.smithi136.stdout:8/656: symlink d9/d18/d34/d3d/d47/d65/d92/lea 0 2024-09-18T12:51:15.417 INFO:tasks.workunit.client.1.smithi136.stdout:5/600: unlink d5/d1a/d2d/d34/d4e/c6e 0 2024-09-18T12:51:15.420 INFO:tasks.workunit.client.1.smithi136.stdout:5/601: rename d5/d1a/d2d/d34/f2e to d5/d1a/d2d/d34/d88/fba 0 2024-09-18T12:51:15.420 INFO:tasks.workunit.client.1.smithi136.stdout:5/602: read - d5/d1a/d2d/fb0 zero size 2024-09-18T12:51:15.420 INFO:tasks.workunit.client.1.smithi136.stdout:5/603: chown d5/d1a/d4a/da1 22 1 2024-09-18T12:51:15.421 INFO:tasks.workunit.client.1.smithi136.stdout:5/604: mknod d5/d1a/d2d/d34/d4e/d7a/cbb 0 2024-09-18T12:51:15.421 INFO:tasks.workunit.client.1.smithi136.stdout:7/654: write d0/d35/d36/d7c/f9e [465538,33655] 0 2024-09-18T12:51:15.421 INFO:tasks.workunit.client.1.smithi136.stdout:7/655: creat d0/d35/d4f/dd5/fe1 x:0 0 0 2024-09-18T12:51:15.422 INFO:tasks.workunit.client.1.smithi136.stdout:5/605: mkdir d5/d1a/d2d/d3f/d7f/dbc 0 2024-09-18T12:51:15.425 INFO:tasks.workunit.client.1.smithi136.stdout:7/656: link d0/d35/d41/d50/d7f/c38 d0/d35/d41/d50/d5a/ce2 0 2024-09-18T12:51:15.425 INFO:tasks.workunit.client.1.smithi136.stdout:7/657: chown d0/d35/d36/d7c 1 1 2024-09-18T12:51:15.426 INFO:tasks.workunit.client.1.smithi136.stdout:5/606: symlink d5/d1a/d4a/da1/lbd 0 2024-09-18T12:51:15.426 INFO:tasks.workunit.client.1.smithi136.stdout:5/607: fdatasync d5/d1a/d2d/d34/d88/f86 0 2024-09-18T12:51:15.427 INFO:tasks.workunit.client.1.smithi136.stdout:5/608: chown d5/d1a/d2d/d3f/c5c 55196 1 2024-09-18T12:51:15.427 INFO:tasks.workunit.client.1.smithi136.stdout:5/609: dread - d5/d1a/f93 zero size 2024-09-18T12:51:15.427 INFO:tasks.workunit.client.1.smithi136.stdout:7/658: truncate d0/d35/d4f/f82 5225513 0 2024-09-18T12:51:15.427 INFO:tasks.workunit.client.1.smithi136.stdout:7/659: creat d0/d35/d41/d50/d7b/fe3 x:0 0 0 2024-09-18T12:51:15.428 INFO:tasks.workunit.client.1.smithi136.stdout:5/610: rmdir d5/d1a/d30/d7b 39 2024-09-18T12:51:15.429 INFO:tasks.workunit.client.1.smithi136.stdout:7/660: mknod d0/da8/ce4 0 2024-09-18T12:51:15.430 INFO:tasks.workunit.client.1.smithi136.stdout:5/611: symlink d5/d1a/d4a/d79/lbe 0 2024-09-18T12:51:15.431 INFO:tasks.workunit.client.0.smithi081.stdout:2/305: dwrite d15/d16/f19 [0,4194304] 0 2024-09-18T12:51:15.431 INFO:tasks.workunit.client.0.smithi081.stdout:2/306: dread - d15/f46 zero size 2024-09-18T12:51:15.432 INFO:tasks.workunit.client.1.smithi136.stdout:7/661: symlink d0/d35/d41/d50/d9b/dc2/de0/le5 0 2024-09-18T12:51:15.433 INFO:tasks.workunit.client.0.smithi081.stdout:2/307: creat d15/d26/f65 x:0 0 0 2024-09-18T12:51:15.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/308: readlink l1 0 2024-09-18T12:51:15.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/309: fsync f11 0 2024-09-18T12:51:15.436 INFO:tasks.workunit.client.0.smithi081.stdout:7/333: dwrite d2/d18/d3c/f7a [0,4194304] 0 2024-09-18T12:51:15.437 INFO:tasks.workunit.client.1.smithi136.stdout:2/533: sync 2024-09-18T12:51:15.437 INFO:tasks.workunit.client.1.smithi136.stdout:3/511: sync 2024-09-18T12:51:15.437 INFO:tasks.workunit.client.1.smithi136.stdout:2/534: fdatasync d5/d7/d17/f27 0 2024-09-18T12:51:15.437 INFO:tasks.workunit.client.1.smithi136.stdout:0/616: sync 2024-09-18T12:51:15.438 INFO:tasks.workunit.client.0.smithi081.stdout:3/313: sync 2024-09-18T12:51:15.438 INFO:tasks.workunit.client.0.smithi081.stdout:9/167: sync 2024-09-18T12:51:15.438 INFO:tasks.workunit.client.0.smithi081.stdout:0/222: sync 2024-09-18T12:51:15.438 INFO:tasks.workunit.client.0.smithi081.stdout:0/223: readlink l2 0 2024-09-18T12:51:15.439 INFO:tasks.workunit.client.1.smithi136.stdout:4/437: dwrite d0/d13/f7f [4194304,4194304] 0 2024-09-18T12:51:15.439 INFO:tasks.workunit.client.1.smithi136.stdout:4/438: write d0/d2/f77 [925126,24714] 0 2024-09-18T12:51:15.439 INFO:tasks.workunit.client.1.smithi136.stdout:4/439: stat d0/l22 0 2024-09-18T12:51:15.440 INFO:tasks.workunit.client.1.smithi136.stdout:3/512: truncate d3/d14/f3a 2050897 0 2024-09-18T12:51:15.440 INFO:tasks.workunit.client.1.smithi136.stdout:3/513: readlink d3/d14/d17/d53/l81 0 2024-09-18T12:51:15.440 INFO:tasks.workunit.client.1.smithi136.stdout:3/514: fdatasync d3/d14/d18/f8d 0 2024-09-18T12:51:15.440 INFO:tasks.workunit.client.1.smithi136.stdout:8/657: dwrite d9/d18/d34/f67 [0,4194304] 0 2024-09-18T12:51:15.440 INFO:tasks.workunit.client.1.smithi136.stdout:2/535: rename d5/f8a to d5/fa1 0 2024-09-18T12:51:15.441 INFO:tasks.workunit.client.0.smithi081.stdout:0/224: creat d7/d9/d4b/d4a/f4c x:0 0 0 2024-09-18T12:51:15.441 INFO:tasks.workunit.client.0.smithi081.stdout:0/225: readlink d7/d9/d4b/d4a/l28 0 2024-09-18T12:51:15.441 INFO:tasks.workunit.client.0.smithi081.stdout:9/168: rmdir dd/d1d 39 2024-09-18T12:51:15.442 INFO:tasks.workunit.client.0.smithi081.stdout:0/226: dread d7/d9/f44 [0,4194304] 0 2024-09-18T12:51:15.442 INFO:tasks.workunit.client.0.smithi081.stdout:0/227: read - d7/d9/d4b/f3f zero size 2024-09-18T12:51:15.442 INFO:tasks.workunit.client.1.smithi136.stdout:0/617: creat d1/d3/d1a/d98/d81/fd8 x:0 0 0 2024-09-18T12:51:15.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/169: mkdir dd/d31 0 2024-09-18T12:51:15.445 INFO:tasks.workunit.client.0.smithi081.stdout:0/228: link d7/d9/d4b/d4a/l28 d7/d9/d4b/d4a/l4d 0 2024-09-18T12:51:15.446 INFO:tasks.workunit.client.1.smithi136.stdout:4/440: mkdir d0/d25/d83 0 2024-09-18T12:51:15.446 INFO:tasks.workunit.client.0.smithi081.stdout:9/170: stat dd/de/l18 0 2024-09-18T12:51:15.448 INFO:tasks.workunit.client.0.smithi081.stdout:0/229: rename d7/d9/d12/l1f to d7/d9/d4b/d33/l4e 0 2024-09-18T12:51:15.448 INFO:tasks.workunit.client.0.smithi081.stdout:0/230: dread - d7/d9/d4b/d4a/f4c zero size 2024-09-18T12:51:15.448 INFO:tasks.workunit.client.1.smithi136.stdout:2/536: mkdir d5/d25/d2d/d9d/da2 0 2024-09-18T12:51:15.449 INFO:tasks.workunit.client.1.smithi136.stdout:2/537: write d5/d25/d43/d74/f88 [637897,12114] 0 2024-09-18T12:51:15.449 INFO:tasks.workunit.client.0.smithi081.stdout:9/171: symlink dd/d15/l32 0 2024-09-18T12:51:15.449 INFO:tasks.workunit.client.1.smithi136.stdout:0/618: truncate d1/d3/f58 699847 0 2024-09-18T12:51:15.450 INFO:tasks.workunit.client.0.smithi081.stdout:0/231: mkdir d7/d4f 0 2024-09-18T12:51:15.451 INFO:tasks.workunit.client.1.smithi136.stdout:4/441: creat d0/d45/f84 x:0 0 0 2024-09-18T12:51:15.451 INFO:tasks.workunit.client.0.smithi081.stdout:0/232: mknod d7/d9/d4b/c50 0 2024-09-18T12:51:15.453 INFO:tasks.workunit.client.1.smithi136.stdout:0/619: mknod d1/d3/d1a/d62/d75/cd9 0 2024-09-18T12:51:15.453 INFO:tasks.workunit.client.0.smithi081.stdout:0/233: mknod d7/c51 0 2024-09-18T12:51:15.453 INFO:tasks.workunit.client.0.smithi081.stdout:0/234: truncate d7/d9/d4b/d4a/f1e 1529213 0 2024-09-18T12:51:15.454 INFO:tasks.workunit.client.1.smithi136.stdout:3/515: read d3/d14/d22/d2c/f68 [3216239,94905] 0 2024-09-18T12:51:15.454 INFO:tasks.workunit.client.1.smithi136.stdout:3/516: stat d3/d14/f71 0 2024-09-18T12:51:15.455 INFO:tasks.workunit.client.0.smithi081.stdout:0/235: creat d7/d9/d4b/d33/f52 x:0 0 0 2024-09-18T12:51:15.455 INFO:tasks.workunit.client.0.smithi081.stdout:0/236: fsync d7/d9/d12/f26 0 2024-09-18T12:51:15.455 INFO:tasks.workunit.client.0.smithi081.stdout:0/237: getdents d7/d4f 0 2024-09-18T12:51:15.455 INFO:tasks.workunit.client.1.smithi136.stdout:5/612: dwrite d5/d1a/f37 [0,4194304] 0 2024-09-18T12:51:15.456 INFO:tasks.workunit.client.1.smithi136.stdout:4/442: unlink d0/d3/d54/d5c/f7e 0 2024-09-18T12:51:15.457 INFO:tasks.workunit.client.1.smithi136.stdout:0/620: rmdir d1/d17/dbb 0 2024-09-18T12:51:15.459 INFO:tasks.workunit.client.1.smithi136.stdout:0/621: dread d1/d3/d1a/d98/d81/d35/d84/fbe [0,4194304] 0 2024-09-18T12:51:15.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/172: dread dd/d1b/f1f [4194304,4194304] 0 2024-09-18T12:51:15.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/173: chown f6 6574 1 2024-09-18T12:51:15.460 INFO:tasks.workunit.client.1.smithi136.stdout:3/517: rename d3/d14/c59 to d3/d14/d18/d7f/caf 0 2024-09-18T12:51:15.461 INFO:tasks.workunit.client.1.smithi136.stdout:2/538: dread d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:15.461 INFO:tasks.workunit.client.0.smithi081.stdout:9/174: getdents dd/d1d/d1e 0 2024-09-18T12:51:15.462 INFO:tasks.workunit.client.0.smithi081.stdout:9/175: creat dd/d1d/d1e/d24/f33 x:0 0 0 2024-09-18T12:51:15.465 INFO:tasks.workunit.client.0.smithi081.stdout:2/310: dwrite d15/d16/f37 [0,4194304] 0 2024-09-18T12:51:15.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/314: dwrite d3/db/f4b [0,4194304] 0 2024-09-18T12:51:15.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/315: fsync d3/d23/f70 0 2024-09-18T12:51:15.468 INFO:tasks.workunit.client.0.smithi081.stdout:3/316: dread d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:15.469 INFO:tasks.workunit.client.0.smithi081.stdout:3/317: symlink d3/d23/l72 0 2024-09-18T12:51:15.471 INFO:tasks.workunit.client.1.smithi136.stdout:5/613: read d5/d1a/d30/f81 [2407746,18228] 0 2024-09-18T12:51:15.472 INFO:tasks.workunit.client.1.smithi136.stdout:4/443: mkdir d0/d2/d85 0 2024-09-18T12:51:15.472 INFO:tasks.workunit.client.1.smithi136.stdout:4/444: creat d0/d13/f86 x:0 0 0 2024-09-18T12:51:15.473 INFO:tasks.workunit.client.0.smithi081.stdout:0/238: dread d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:15.473 INFO:tasks.workunit.client.0.smithi081.stdout:0/239: rmdir d7/d9/d4b 39 2024-09-18T12:51:15.474 INFO:tasks.workunit.client.1.smithi136.stdout:3/518: unlink d3/d10/d84/l95 0 2024-09-18T12:51:15.475 INFO:tasks.workunit.client.1.smithi136.stdout:3/519: read d3/d2b/d6c/f6f [308119,69115] 0 2024-09-18T12:51:15.475 INFO:tasks.workunit.client.0.smithi081.stdout:0/240: mkdir d7/d9/d4b/d53 0 2024-09-18T12:51:15.475 INFO:tasks.workunit.client.0.smithi081.stdout:0/241: fsync d7/d9/f25 0 2024-09-18T12:51:15.475 INFO:tasks.workunit.client.1.smithi136.stdout:2/539: truncate d5/d25/f36 1226521 0 2024-09-18T12:51:15.477 INFO:tasks.workunit.client.1.smithi136.stdout:4/445: dread d0/d25/f2d [0,4194304] 0 2024-09-18T12:51:15.477 INFO:tasks.workunit.client.1.smithi136.stdout:5/614: unlink d5/d1a/d2d/d34/l41 0 2024-09-18T12:51:15.478 INFO:tasks.workunit.client.0.smithi081.stdout:9/176: getdents dd/d15 0 2024-09-18T12:51:15.481 INFO:tasks.workunit.client.0.smithi081.stdout:2/311: dwrite d15/d26/f65 [0,4194304] 0 2024-09-18T12:51:15.481 INFO:tasks.workunit.client.0.smithi081.stdout:2/312: chown d15/d16/d25/d2f/f5c 3584255 1 2024-09-18T12:51:15.481 INFO:tasks.workunit.client.0.smithi081.stdout:9/177: rename dd/d1b/f1f to dd/d1b/f34 0 2024-09-18T12:51:15.482 INFO:tasks.workunit.client.1.smithi136.stdout:2/540: link d5/d7/d17/d48/l99 d5/d25/d2d/d9d/la3 0 2024-09-18T12:51:15.483 INFO:tasks.workunit.client.1.smithi136.stdout:5/615: creat d5/d1a/d2d/d34/d4e/fbf x:0 0 0 2024-09-18T12:51:15.485 INFO:tasks.workunit.client.1.smithi136.stdout:0/622: dwrite d1/d60/d82/f93 [0,4194304] 0 2024-09-18T12:51:15.485 INFO:tasks.workunit.client.1.smithi136.stdout:0/623: creat d1/d3/d1a/d98/d81/d51/fda x:0 0 0 2024-09-18T12:51:15.486 INFO:tasks.workunit.client.0.smithi081.stdout:2/313: symlink d15/d16/d20/d31/l66 0 2024-09-18T12:51:15.486 INFO:tasks.workunit.client.1.smithi136.stdout:5/616: unlink d5/d1a/d2d/d34/c17 0 2024-09-18T12:51:15.486 INFO:tasks.workunit.client.1.smithi136.stdout:2/541: dread d5/d7/d41/d53/f6f [0,4194304] 0 2024-09-18T12:51:15.486 INFO:tasks.workunit.client.1.smithi136.stdout:2/542: fsync d5/d25/f62 0 2024-09-18T12:51:15.487 INFO:tasks.workunit.client.0.smithi081.stdout:9/178: mkdir dd/d15/d1a/d35 0 2024-09-18T12:51:15.493 INFO:tasks.workunit.client.0.smithi081.stdout:9/179: creat dd/d15/d1a/d35/f36 x:0 0 0 2024-09-18T12:51:15.495 INFO:tasks.workunit.client.0.smithi081.stdout:9/180: symlink dd/de/l37 0 2024-09-18T12:51:15.496 INFO:tasks.workunit.client.1.smithi136.stdout:3/520: dwrite d3/d14/d18/d7f/fa3 [0,4194304] 0 2024-09-18T12:51:15.496 INFO:tasks.workunit.client.1.smithi136.stdout:3/521: fdatasync d3/d14/d22/d2c/d3d/f93 0 2024-09-18T12:51:15.499 INFO:tasks.workunit.client.0.smithi081.stdout:9/181: symlink dd/d1d/d1e/d24/d2a/l38 0 2024-09-18T12:51:15.500 INFO:tasks.workunit.client.1.smithi136.stdout:6/541: sync 2024-09-18T12:51:15.500 INFO:tasks.workunit.client.1.smithi136.stdout:1/509: sync 2024-09-18T12:51:15.500 INFO:tasks.workunit.client.1.smithi136.stdout:9/573: sync 2024-09-18T12:51:15.500 INFO:tasks.workunit.client.1.smithi136.stdout:9/574: creat d6/da/d3d/fc3 x:0 0 0 2024-09-18T12:51:15.500 INFO:tasks.workunit.client.1.smithi136.stdout:9/575: readlink d6/d13/l1b 0 2024-09-18T12:51:15.502 INFO:tasks.workunit.client.1.smithi136.stdout:1/510: write d2/d5/d2b/d34/d86/f48 [531356,110069] 0 2024-09-18T12:51:15.504 INFO:tasks.workunit.client.0.smithi081.stdout:9/182: dread dd/d1b/f34 [4194304,4194304] 0 2024-09-18T12:51:15.505 INFO:tasks.workunit.client.0.smithi081.stdout:9/183: chown dd/d31 181104702 1 2024-09-18T12:51:15.505 INFO:tasks.workunit.client.0.smithi081.stdout:9/184: truncate dd/d1d/f2e 795762 0 2024-09-18T12:51:15.505 INFO:tasks.workunit.client.1.smithi136.stdout:3/522: creat d3/d14/d17/d75/d86/fb0 x:0 0 0 2024-09-18T12:51:15.505 INFO:tasks.workunit.client.1.smithi136.stdout:6/542: creat d8/daa/fb0 x:0 0 0 2024-09-18T12:51:15.505 INFO:tasks.workunit.client.0.smithi081.stdout:9/185: mkdir dd/d1d/d1e/d39 0 2024-09-18T12:51:15.513 INFO:tasks.workunit.client.1.smithi136.stdout:9/576: symlink d6/d13/lc4 0 2024-09-18T12:51:15.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/543: dread d8/dc/f6e [0,4194304] 0 2024-09-18T12:51:15.516 INFO:tasks.workunit.client.1.smithi136.stdout:0/624: write d1/d46/d6c/f8a [2757684,63252] 0 2024-09-18T12:51:15.516 INFO:tasks.workunit.client.1.smithi136.stdout:0/625: fdatasync d1/d3/f7b 0 2024-09-18T12:51:15.516 INFO:tasks.workunit.client.1.smithi136.stdout:0/626: chown d1/d60/d82/fa2 3194 1 2024-09-18T12:51:15.520 INFO:tasks.workunit.client.1.smithi136.stdout:9/577: mknod d6/da/d3d/d41/cc5 0 2024-09-18T12:51:15.522 INFO:tasks.workunit.client.1.smithi136.stdout:9/578: read d6/d59/f61 [367436,6471] 0 2024-09-18T12:51:15.524 INFO:tasks.workunit.client.1.smithi136.stdout:9/579: creat d6/df/fc6 x:0 0 0 2024-09-18T12:51:15.526 INFO:tasks.workunit.client.1.smithi136.stdout:9/580: symlink d6/d96/dbb/lc7 0 2024-09-18T12:51:15.529 INFO:tasks.workunit.client.0.smithi081.stdout:2/314: dwrite d15/d16/d20/d22/f2a [0,4194304] 0 2024-09-18T12:51:15.538 INFO:tasks.workunit.client.0.smithi081.stdout:2/315: dread fe [0,4194304] 0 2024-09-18T12:51:15.538 INFO:tasks.workunit.client.0.smithi081.stdout:2/316: symlink d15/d16/d20/l67 0 2024-09-18T12:51:15.540 INFO:tasks.workunit.client.0.smithi081.stdout:2/317: rename d15/d16/d20/d22/f2e to d15/d16/d25/d32/f68 0 2024-09-18T12:51:15.540 INFO:tasks.workunit.client.0.smithi081.stdout:2/318: truncate d15/d16/d25/f27 3708598 0 2024-09-18T12:51:15.542 INFO:tasks.workunit.client.0.smithi081.stdout:2/319: symlink d15/l69 0 2024-09-18T12:51:15.542 INFO:tasks.workunit.client.0.smithi081.stdout:2/320: write d15/d16/d25/d32/f51 [975481,116092] 0 2024-09-18T12:51:15.542 INFO:tasks.workunit.client.0.smithi081.stdout:2/321: write d15/d16/d20/f4c [143912,5716] 0 2024-09-18T12:51:15.542 INFO:tasks.workunit.client.0.smithi081.stdout:2/322: symlink d15/d16/d20/d31/l6a 0 2024-09-18T12:51:15.543 INFO:tasks.workunit.client.0.smithi081.stdout:2/323: stat d15/d16/l24 0 2024-09-18T12:51:15.543 INFO:tasks.workunit.client.0.smithi081.stdout:2/324: chown d15/d16/d25/f52 308485 1 2024-09-18T12:51:15.543 INFO:tasks.workunit.client.0.smithi081.stdout:2/325: fsync d15/d16/d20/d22/f2a 0 2024-09-18T12:51:15.543 INFO:tasks.workunit.client.0.smithi081.stdout:2/326: mkdir d15/d26/d4d/d6b 0 2024-09-18T12:51:15.543 INFO:tasks.workunit.client.0.smithi081.stdout:2/327: read - d15/d16/d20/f4f zero size 2024-09-18T12:51:15.545 INFO:tasks.workunit.client.0.smithi081.stdout:2/328: rename d15/d16/d25/c4b to d15/d16/d25/c6c 0 2024-09-18T12:51:15.545 INFO:tasks.workunit.client.0.smithi081.stdout:2/329: getdents d15/d16/d20/d59 0 2024-09-18T12:51:15.547 INFO:tasks.workunit.client.0.smithi081.stdout:2/330: mkdir d15/d16/d25/d32/d6d 0 2024-09-18T12:51:15.554 INFO:tasks.workunit.client.0.smithi081.stdout:0/242: dwrite d7/d9/d4b/d4a/f1a [4194304,4194304] 0 2024-09-18T12:51:15.554 INFO:tasks.workunit.client.0.smithi081.stdout:0/243: write d7/d9/d4b/d33/f52 [878934,5692] 0 2024-09-18T12:51:15.554 INFO:tasks.workunit.client.1.smithi136.stdout:4/446: dwrite d0/d2/f3e [0,4194304] 0 2024-09-18T12:51:15.556 INFO:tasks.workunit.client.1.smithi136.stdout:4/447: mknod d0/d25/d79/c87 0 2024-09-18T12:51:15.557 INFO:tasks.workunit.client.1.smithi136.stdout:3/523: dwrite d3/d5/f9f [0,4194304] 0 2024-09-18T12:51:15.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/511: dwrite d2/f16 [0,4194304] 0 2024-09-18T12:51:15.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/512: readlink d2/d5/d2b/d34/d5c/l9d 0 2024-09-18T12:51:15.559 INFO:tasks.workunit.client.0.smithi081.stdout:2/331: dread d15/d16/d20/d22/f2a [0,4194304] 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:5/617: dwrite d5/d1a/f85 [0,4194304] 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:6/544: dwrite d8/d9/d3c/d4a/f54 [0,4194304] 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:6/545: write d8/d9/d56/f7e [384342,24013] 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:6/546: readlink d8/d9/de/d1c/l36 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:0/627: dwrite d1/d17/f6b [0,4194304] 0 2024-09-18T12:51:15.560 INFO:tasks.workunit.client.1.smithi136.stdout:0/628: chown d1/d3/cd3 1497368 1 2024-09-18T12:51:15.561 INFO:tasks.workunit.client.0.smithi081.stdout:2/332: mkdir d15/d6e 0 2024-09-18T12:51:15.561 INFO:tasks.workunit.client.1.smithi136.stdout:3/524: rmdir d3/d5/da8 0 2024-09-18T12:51:15.562 INFO:tasks.workunit.client.0.smithi081.stdout:2/333: rename fb to d15/d26/d4d/d6b/f6f 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/543: dwrite d5/d7/f1e [4194304,4194304] 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:4/448: dread d0/d2/f50 [0,4194304] 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/544: write d5/d7/d11/f32 [794563,110662] 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/545: write d5/d7/f8b [162234,112087] 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/546: read d5/d7/d11/f31 [4035456,79158] 0 2024-09-18T12:51:15.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/547: write d5/d25/f28 [1083289,97787] 0 2024-09-18T12:51:15.564 INFO:tasks.workunit.client.0.smithi081.stdout:9/186: dwrite dd/d1d/f2e [0,4194304] 0 2024-09-18T12:51:15.565 INFO:tasks.workunit.client.1.smithi136.stdout:6/547: mkdir d8/d9/db1 0 2024-09-18T12:51:15.565 INFO:tasks.workunit.client.0.smithi081.stdout:0/244: dread d7/d9/d12/f26 [0,4194304] 0 2024-09-18T12:51:15.568 INFO:tasks.workunit.client.0.smithi081.stdout:0/245: rename d7/d9/f25 to d7/d9/d4b/f54 0 2024-09-18T12:51:15.568 INFO:tasks.workunit.client.1.smithi136.stdout:4/449: mkdir d0/d3/d54/d88 0 2024-09-18T12:51:15.568 INFO:tasks.workunit.client.1.smithi136.stdout:3/525: truncate d3/d14/d22/d2c/d3d/f93 154684 0 2024-09-18T12:51:15.569 INFO:tasks.workunit.client.1.smithi136.stdout:2/548: creat d5/d25/d2d/d9d/da2/fa4 x:0 0 0 2024-09-18T12:51:15.569 INFO:tasks.workunit.client.1.smithi136.stdout:2/549: write d5/d7/f9a [176248,33882] 0 2024-09-18T12:51:15.570 INFO:tasks.workunit.client.1.smithi136.stdout:5/618: write d5/d1a/f53 [1216570,55681] 0 2024-09-18T12:51:15.570 INFO:tasks.workunit.client.1.smithi136.stdout:5/619: creat d5/d1a/fc0 x:0 0 0 2024-09-18T12:51:15.570 INFO:tasks.workunit.client.0.smithi081.stdout:0/246: truncate d7/d9/d12/f31 5990302 0 2024-09-18T12:51:15.571 INFO:tasks.workunit.client.1.smithi136.stdout:4/450: link d0/d2/f23 d0/d3/f89 0 2024-09-18T12:51:15.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/334: dread d15/f17 [0,4194304] 0 2024-09-18T12:51:15.576 INFO:tasks.workunit.client.1.smithi136.stdout:1/513: dread d2/d5/d2b/d34/d86/d50/f75 [0,4194304] 0 2024-09-18T12:51:15.576 INFO:tasks.workunit.client.1.smithi136.stdout:1/514: write d2/f74 [893864,5705] 0 2024-09-18T12:51:15.576 INFO:tasks.workunit.client.1.smithi136.stdout:3/526: unlink d3/d10/d4a/f8b 0 2024-09-18T12:51:15.576 INFO:tasks.workunit.client.1.smithi136.stdout:3/527: write d3/d14/d17/d75/d86/fb0 [1032934,86479] 0 2024-09-18T12:51:15.578 INFO:tasks.workunit.client.0.smithi081.stdout:2/335: unlink d15/d16/d20/d31/l66 0 2024-09-18T12:51:15.579 INFO:tasks.workunit.client.1.smithi136.stdout:2/550: rename d5/d7/d41/d53/c84 to d5/d25/d43/ca5 0 2024-09-18T12:51:15.584 INFO:tasks.workunit.client.0.smithi081.stdout:2/336: read d15/d16/f48 [355575,70799] 0 2024-09-18T12:51:15.586 INFO:tasks.workunit.client.1.smithi136.stdout:1/515: write d2/d5/d2b/d34/d5c/f9e [2631005,50981] 0 2024-09-18T12:51:15.587 INFO:tasks.workunit.client.1.smithi136.stdout:3/528: rmdir d3/d14/d17/d75/d86/da7 0 2024-09-18T12:51:15.588 INFO:tasks.workunit.client.0.smithi081.stdout:1/297: sync 2024-09-18T12:51:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:2/337: write d15/d16/d20/d22/f2a [1414138,80240] 0 2024-09-18T12:51:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:2/338: read d15/d16/d20/d22/f2a [3107725,10850] 0 2024-09-18T12:51:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:2/339: write d15/d16/d33/f5b [4495396,125726] 0 2024-09-18T12:51:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:1/298: mkdir d0/d18/d6a 0 2024-09-18T12:51:15.594 INFO:tasks.workunit.client.1.smithi136.stdout:2/551: mknod d5/d7/d17/d48/ca6 0 2024-09-18T12:51:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:0/247: dwrite d7/d9/f44 [0,4194304] 0 2024-09-18T12:51:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:2/340: creat d15/d16/d20/d22/f70 x:0 0 0 2024-09-18T12:51:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/299: creat d0/d6/d66/f6b x:0 0 0 2024-09-18T12:51:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:9/187: dwrite dd/d15/f16 [0,4194304] 0 2024-09-18T12:51:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:9/188: write dd/d1b/f34 [907564,42739] 0 2024-09-18T12:51:15.597 INFO:tasks.workunit.client.1.smithi136.stdout:1/516: link d2/d5/d2b/d34/c7c d2/d5/d2b/d9b/d1b/ca5 0 2024-09-18T12:51:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:0/248: symlink d7/d9/d4b/d53/l55 0 2024-09-18T12:51:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:1/300: dread d0/db/f14 [0,4194304] 0 2024-09-18T12:51:15.600 INFO:tasks.workunit.client.1.smithi136.stdout:3/529: unlink d3/d10/f5e 0 2024-09-18T12:51:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/341: creat d15/d16/d20/d22/d5a/f71 x:0 0 0 2024-09-18T12:51:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/342: write d15/d16/f19 [4234070,997] 0 2024-09-18T12:51:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/249: rename d7/d9/d4b/d4a/l4d to d7/d9/d4b/d33/l56 0 2024-09-18T12:51:15.602 INFO:tasks.workunit.client.1.smithi136.stdout:1/517: rename d2/d5/d2b/d9b/d2e/d9a/fa0 to d2/d5/d2b/d9b/d2e/d4c/d8e/fa6 0 2024-09-18T12:51:15.602 INFO:tasks.workunit.client.1.smithi136.stdout:1/518: write d2/d5/d2b/d9b/f19 [1283832,12795] 0 2024-09-18T12:51:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/343: write fe [450583,83712] 0 2024-09-18T12:51:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/344: write d15/d16/d20/d22/d5a/f71 [65244,120130] 0 2024-09-18T12:51:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/345: creat d15/d26/f72 x:0 0 0 2024-09-18T12:51:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:1/301: mknod d0/d18/d6a/c6c 0 2024-09-18T12:51:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:1/302: creat d0/d6/d33/d37/f6d x:0 0 0 2024-09-18T12:51:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/250: symlink d7/d4f/l57 0 2024-09-18T12:51:15.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/519: symlink d2/d5/d2b/d34/d5c/la7 0 2024-09-18T12:51:15.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/520: fdatasync d2/f36 0 2024-09-18T12:51:15.607 INFO:tasks.workunit.client.1.smithi136.stdout:1/521: symlink d2/d5/d2b/d9b/d2e/d4c/d8e/la8 0 2024-09-18T12:51:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/346: rename d15/d26/c4a to d15/d16/d54/c73 0 2024-09-18T12:51:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/347: creat d15/d16/d20/d22/d5a/f74 x:0 0 0 2024-09-18T12:51:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/348: chown c8 28398095 1 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/349: dread - d15/f46 zero size 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/350: write fd [5403274,39066] 0 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/351: chown d15/d16/d20/d22/d5a 833789053 1 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/352: chown d15/d16/d20/d59 0 1 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/353: readlink l1 0 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.1.smithi136.stdout:1/522: mkdir d2/d5/d2b/da9 0 2024-09-18T12:51:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:9/189: write dd/d1d/f2e [1848697,114787] 0 2024-09-18T12:51:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:2/354: symlink d15/d16/d25/d32/l75 0 2024-09-18T12:51:15.612 INFO:tasks.workunit.client.1.smithi136.stdout:3/530: write d3/d14/d22/d2c/d3d/f93 [88622,91135] 0 2024-09-18T12:51:15.614 INFO:tasks.workunit.client.1.smithi136.stdout:1/523: dread d2/d5/d2b/d9b/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:15.615 INFO:tasks.workunit.client.1.smithi136.stdout:3/531: symlink d3/d14/d22/lb1 0 2024-09-18T12:51:15.615 INFO:tasks.workunit.client.1.smithi136.stdout:3/532: read - d3/d5/fa1 zero size 2024-09-18T12:51:15.617 INFO:tasks.workunit.client.1.smithi136.stdout:1/524: mknod d2/d5/d2b/d34/d5c/caa 0 2024-09-18T12:51:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:0/251: rmdir d7/d9/d4b/d33 39 2024-09-18T12:51:15.618 INFO:tasks.workunit.client.1.smithi136.stdout:3/533: mknod d3/d14/cb2 0 2024-09-18T12:51:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/252: unlink d7/d9/f45 0 2024-09-18T12:51:15.620 INFO:tasks.workunit.client.1.smithi136.stdout:2/552: write d5/d7/d3b/f51 [1451983,17106] 0 2024-09-18T12:51:15.620 INFO:tasks.workunit.client.1.smithi136.stdout:3/534: getdents d3/d2b 0 2024-09-18T12:51:15.621 INFO:tasks.workunit.client.1.smithi136.stdout:3/535: fsync d3/d14/d17/d53/f89 0 2024-09-18T12:51:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/355: read d15/d16/d25/f27 [1285526,115948] 0 2024-09-18T12:51:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/356: creat d15/d16/d20/f76 x:0 0 0 2024-09-18T12:51:15.622 INFO:tasks.workunit.client.1.smithi136.stdout:2/553: rename d5/d7/d3b/f69 to d5/d7/d11/d34/fa7 0 2024-09-18T12:51:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:2/357: link d15/d16/d20/f76 d15/d16/d20/d59/f77 0 2024-09-18T12:51:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:2/358: symlink d15/d16/d20/l78 0 2024-09-18T12:51:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:2/359: stat d15/d16/f23 0 2024-09-18T12:51:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:2/360: getdents d15/d16/d25 0 2024-09-18T12:51:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:2/361: chown d15/f17 0 1 2024-09-18T12:51:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:2/362: truncate d15/d16/f37 5230875 0 2024-09-18T12:51:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:9/190: dread dd/d1b/f34 [8388608,4194304] 0 2024-09-18T12:51:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:9/191: write dd/d1d/d1e/d24/f33 [605725,39788] 0 2024-09-18T12:51:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/303: dwrite d0/db/f39 [4194304,4194304] 0 2024-09-18T12:51:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/304: chown d0/d6/d7/d8/fc 1688 1 2024-09-18T12:51:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/305: fsync d0/d54/f5e 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:1/525: dread d2/d5/d2b/d9b/d2e/f31 [0,4194304] 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:5/620: dwrite d5/d1a/d30/f57 [0,4194304] 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:5/621: readlink d5/l20 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:5/622: fdatasync d5/d1a/d30/f40 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:5/623: creat d5/d1a/fc1 x:0 0 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.1.smithi136.stdout:1/526: mknod d2/d5/d2b/d9b/d2e/d9a/cab 0 2024-09-18T12:51:15.630 INFO:tasks.workunit.client.0.smithi081.stdout:2/363: rename d15/d16/d25/d32/f51 to d15/d16/d33/d53/f79 0 2024-09-18T12:51:15.631 INFO:tasks.workunit.client.1.smithi136.stdout:4/451: dwrite d0/d13/f6c [0,4194304] 0 2024-09-18T12:51:15.631 INFO:tasks.workunit.client.1.smithi136.stdout:4/452: chown d0/d13/f69 1524531 1 2024-09-18T12:51:15.631 INFO:tasks.workunit.client.0.smithi081.stdout:9/192: creat dd/d15/f3a x:0 0 0 2024-09-18T12:51:15.631 INFO:tasks.workunit.client.0.smithi081.stdout:9/193: fsync dd/d15/d1a/f22 0 2024-09-18T12:51:15.632 INFO:tasks.workunit.client.1.smithi136.stdout:0/629: dwrite d1/d46/f66 [0,4194304] 0 2024-09-18T12:51:15.632 INFO:tasks.workunit.client.0.smithi081.stdout:1/306: creat d0/db/d4f/f6e x:0 0 0 2024-09-18T12:51:15.633 INFO:tasks.workunit.client.0.smithi081.stdout:2/364: getdents d15/d26/d4d/d6b 0 2024-09-18T12:51:15.634 INFO:tasks.workunit.client.1.smithi136.stdout:1/527: dread d2/d5/d2b/d9b/d2e/d4c/f89 [0,4194304] 0 2024-09-18T12:51:15.634 INFO:tasks.workunit.client.1.smithi136.stdout:5/624: rmdir d5/d1a/d4a 39 2024-09-18T12:51:15.635 INFO:tasks.workunit.client.1.smithi136.stdout:6/548: dwrite d8/f3b [0,4194304] 0 2024-09-18T12:51:15.636 INFO:tasks.workunit.client.0.smithi081.stdout:9/194: creat dd/d31/f3b x:0 0 0 2024-09-18T12:51:15.638 INFO:tasks.workunit.client.1.smithi136.stdout:1/528: link d2/d5/f5a d2/d5/d2b/d63/fac 0 2024-09-18T12:51:15.638 INFO:tasks.workunit.client.1.smithi136.stdout:1/529: chown d2 156 1 2024-09-18T12:51:15.639 INFO:tasks.workunit.client.1.smithi136.stdout:5/625: unlink d5/d1a/d30/f60 0 2024-09-18T12:51:15.643 INFO:tasks.workunit.client.1.smithi136.stdout:4/453: fsync d0/d3/f89 0 2024-09-18T12:51:15.646 INFO:tasks.workunit.client.0.smithi081.stdout:0/253: dwrite d7/d9/d4b/f54 [0,4194304] 0 2024-09-18T12:51:15.648 INFO:tasks.workunit.client.0.smithi081.stdout:0/254: link d7/d9/d4b/d4a/c1c d7/c58 0 2024-09-18T12:51:15.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/536: dwrite d3/d14/d22/d2c/d3d/f91 [0,4194304] 0 2024-09-18T12:51:15.654 INFO:tasks.workunit.client.1.smithi136.stdout:6/549: dread d8/dc/f31 [0,4194304] 0 2024-09-18T12:51:15.655 INFO:tasks.workunit.client.0.smithi081.stdout:9/195: dread dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:15.655 INFO:tasks.workunit.client.0.smithi081.stdout:9/196: dread - dd/d15/f3a zero size 2024-09-18T12:51:15.659 INFO:tasks.workunit.client.1.smithi136.stdout:0/630: getdents d1/d3/d1a/d62 0 2024-09-18T12:51:15.659 INFO:tasks.workunit.client.1.smithi136.stdout:0/631: chown d1/d3/d1a/d62/d75/fcf 16588947 1 2024-09-18T12:51:15.660 INFO:tasks.workunit.client.1.smithi136.stdout:1/530: creat d2/d5/d2b/d9b/d2e/d9a/fad x:0 0 0 2024-09-18T12:51:15.660 INFO:tasks.workunit.client.1.smithi136.stdout:1/531: chown d2/d5/d2b/d9b/d1b/c7d 8 1 2024-09-18T12:51:15.660 INFO:tasks.workunit.client.1.smithi136.stdout:1/532: write d2/d5/d2b/d9b/d2e/f33 [310565,61054] 0 2024-09-18T12:51:15.661 INFO:tasks.workunit.client.0.smithi081.stdout:0/255: dread d7/d9/d4b/f54 [0,4194304] 0 2024-09-18T12:51:15.662 INFO:tasks.workunit.client.0.smithi081.stdout:2/365: dwrite d15/d16/d20/d31/f49 [0,4194304] 0 2024-09-18T12:51:15.662 INFO:tasks.workunit.client.0.smithi081.stdout:2/366: write d15/d16/d20/d31/f5e [73966,54098] 0 2024-09-18T12:51:15.662 INFO:tasks.workunit.client.1.smithi136.stdout:4/454: mkdir d0/d3/d54/d8a 0 2024-09-18T12:51:15.662 INFO:tasks.workunit.client.1.smithi136.stdout:4/455: truncate d0/d13/f86 799802 0 2024-09-18T12:51:15.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/256: rename l1 to d7/d9/l59 0 2024-09-18T12:51:15.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/257: fsync d7/f3c 0 2024-09-18T12:51:15.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/258: fdatasync d7/f21 0 2024-09-18T12:51:15.665 INFO:tasks.workunit.client.1.smithi136.stdout:0/632: write d1/d17/f4c [1856037,8788] 0 2024-09-18T12:51:15.665 INFO:tasks.workunit.client.1.smithi136.stdout:0/633: dread - d1/d3/d1a/d62/d75/fcc zero size 2024-09-18T12:51:15.665 INFO:tasks.workunit.client.1.smithi136.stdout:2/554: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:15.665 INFO:tasks.workunit.client.1.smithi136.stdout:6/550: link d8/dc/f43 d8/d9/d3c/d4a/fb2 0 2024-09-18T12:51:15.666 INFO:tasks.workunit.client.1.smithi136.stdout:1/533: symlink d2/d5/d2b/d34/d86/d50/lae 0 2024-09-18T12:51:15.666 INFO:tasks.workunit.client.1.smithi136.stdout:1/534: fdatasync d2/d5/d2b/d34/d86/d50/f57 0 2024-09-18T12:51:15.667 INFO:tasks.workunit.client.1.smithi136.stdout:5/626: dread d5/d1a/f53 [0,4194304] 0 2024-09-18T12:51:15.667 INFO:tasks.workunit.client.1.smithi136.stdout:4/456: mkdir d0/d3/d54/d5c/d8b 0 2024-09-18T12:51:15.668 INFO:tasks.workunit.client.1.smithi136.stdout:4/457: dread - d0/d45/f84 zero size 2024-09-18T12:51:15.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/259: creat d7/d4f/f5a x:0 0 0 2024-09-18T12:51:15.669 INFO:tasks.workunit.client.0.smithi081.stdout:0/260: stat d7/d9/d4b/d4a/c17 0 2024-09-18T12:51:15.669 INFO:tasks.workunit.client.1.smithi136.stdout:3/537: dread d3/d14/d17/d75/d86/fb0 [0,4194304] 0 2024-09-18T12:51:15.669 INFO:tasks.workunit.client.1.smithi136.stdout:3/538: stat d3/d14/d17/l82 0 2024-09-18T12:51:15.669 INFO:tasks.workunit.client.0.smithi081.stdout:2/367: rename d15/d16/d25 to d15/d16/d33/d53/d7a 0 2024-09-18T12:51:15.670 INFO:tasks.workunit.client.1.smithi136.stdout:0/634: symlink d1/d17/dd1/ldb 0 2024-09-18T12:51:15.670 INFO:tasks.workunit.client.0.smithi081.stdout:0/261: mknod d7/d4f/c5b 0 2024-09-18T12:51:15.671 INFO:tasks.workunit.client.1.smithi136.stdout:2/555: creat d5/d4a/d67/fa8 x:0 0 0 2024-09-18T12:51:15.671 INFO:tasks.workunit.client.1.smithi136.stdout:2/556: creat d5/d25/d43/d74/fa9 x:0 0 0 2024-09-18T12:51:15.672 INFO:tasks.workunit.client.0.smithi081.stdout:2/368: mkdir d15/d16/d33/d53/d7a/d2f/d61/d7b 0 2024-09-18T12:51:15.672 INFO:tasks.workunit.client.1.smithi136.stdout:6/551: symlink d8/d9/d3c/d4a/lb3 0 2024-09-18T12:51:15.672 INFO:tasks.workunit.client.1.smithi136.stdout:6/552: readlink d8/d9/d3c/l44 0 2024-09-18T12:51:15.674 INFO:tasks.workunit.client.1.smithi136.stdout:1/535: getdents d2/d5/d2b/d63 0 2024-09-18T12:51:15.677 INFO:tasks.workunit.client.1.smithi136.stdout:5/627: unlink d5/d1a/d30/c50 0 2024-09-18T12:51:15.677 INFO:tasks.workunit.client.1.smithi136.stdout:5/628: truncate d5/d6b/f6c 427862 0 2024-09-18T12:51:15.680 INFO:tasks.workunit.client.0.smithi081.stdout:0/262: dread d7/d9/d12/f31 [0,4194304] 0 2024-09-18T12:51:15.681 INFO:tasks.workunit.client.1.smithi136.stdout:4/458: unlink d0/d5f/c60 0 2024-09-18T12:51:15.682 INFO:tasks.workunit.client.1.smithi136.stdout:4/459: write d0/d25/f5a [817851,55083] 0 2024-09-18T12:51:15.682 INFO:tasks.workunit.client.1.smithi136.stdout:4/460: fsync d0/fc 0 2024-09-18T12:51:15.682 INFO:tasks.workunit.client.1.smithi136.stdout:3/539: creat d3/d14/d17/d53/fb3 x:0 0 0 2024-09-18T12:51:15.683 INFO:tasks.workunit.client.1.smithi136.stdout:0/635: mkdir d1/d3/d1a/d98/d81/d35/ddc 0 2024-09-18T12:51:15.683 INFO:tasks.workunit.client.1.smithi136.stdout:0/636: stat d1/d60/f6f 0 2024-09-18T12:51:15.683 INFO:tasks.workunit.client.1.smithi136.stdout:0/637: chown d1/d3/f7b 3669 1 2024-09-18T12:51:15.684 INFO:tasks.workunit.client.1.smithi136.stdout:6/553: mkdir d8/d9d/db4 0 2024-09-18T12:51:15.684 INFO:tasks.workunit.client.1.smithi136.stdout:6/554: creat d8/d9/d3c/fb5 x:0 0 0 2024-09-18T12:51:15.686 INFO:tasks.workunit.client.1.smithi136.stdout:5/629: rename d5/c96 to d5/d1a/d2d/d34/d88/cc2 0 2024-09-18T12:51:15.688 INFO:tasks.workunit.client.1.smithi136.stdout:6/555: mkdir d8/d9/d56/db6 0 2024-09-18T12:51:15.689 INFO:tasks.workunit.client.1.smithi136.stdout:5/630: mkdir d5/d6b/dc3 0 2024-09-18T12:51:15.691 INFO:tasks.workunit.client.1.smithi136.stdout:5/631: mkdir d5/d1a/d2d/dc4 0 2024-09-18T12:51:15.691 INFO:tasks.workunit.client.1.smithi136.stdout:5/632: truncate d5/d1a/d2d/d34/f45 258484 0 2024-09-18T12:51:15.695 INFO:tasks.workunit.client.1.smithi136.stdout:4/461: write d0/d5f/f75 [2548278,71259] 0 2024-09-18T12:51:15.695 INFO:tasks.workunit.client.1.smithi136.stdout:4/462: fsync d0/d2/f16 0 2024-09-18T12:51:15.697 INFO:tasks.workunit.client.1.smithi136.stdout:4/463: creat d0/d2/f8c x:0 0 0 2024-09-18T12:51:15.699 INFO:tasks.workunit.client.1.smithi136.stdout:9/581: sync 2024-09-18T12:51:15.699 INFO:tasks.workunit.client.1.smithi136.stdout:8/658: sync 2024-09-18T12:51:15.699 INFO:tasks.workunit.client.1.smithi136.stdout:4/464: rename d0/d3/d54/d5c/d7a to d0/d8d 0 2024-09-18T12:51:15.701 INFO:tasks.workunit.client.1.smithi136.stdout:3/540: dread d3/f9 [0,4194304] 0 2024-09-18T12:51:15.701 INFO:tasks.workunit.client.1.smithi136.stdout:2/557: dwrite d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:15.701 INFO:tasks.workunit.client.1.smithi136.stdout:7/662: sync 2024-09-18T12:51:15.701 INFO:tasks.workunit.client.1.smithi136.stdout:7/663: creat d0/d35/d41/d50/fe6 x:0 0 0 2024-09-18T12:51:15.702 INFO:tasks.workunit.client.1.smithi136.stdout:9/582: dread d6/df/d23/d2b/fa6 [0,4194304] 0 2024-09-18T12:51:15.704 INFO:tasks.workunit.client.1.smithi136.stdout:3/541: mkdir d3/d2b/d6c/db4 0 2024-09-18T12:51:15.704 INFO:tasks.workunit.client.1.smithi136.stdout:3/542: creat d3/d14/d17/d8c/d96/fb5 x:0 0 0 2024-09-18T12:51:15.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/264: sync 2024-09-18T12:51:15.706 INFO:tasks.workunit.client.0.smithi081.stdout:4/265: rename d3/d59/d14/d4b/f4c to d3/db/d2d/d4e/f5f 0 2024-09-18T12:51:15.707 INFO:tasks.workunit.client.1.smithi136.stdout:2/558: creat d5/d7/faa x:0 0 0 2024-09-18T12:51:15.709 INFO:tasks.workunit.client.1.smithi136.stdout:0/638: dread d1/d60/d82/f9f [0,4194304] 0 2024-09-18T12:51:15.709 INFO:tasks.workunit.client.1.smithi136.stdout:3/543: rename d3/d14/d18/d7f/cab to d3/d10/d4a/cb6 0 2024-09-18T12:51:15.711 INFO:tasks.workunit.client.1.smithi136.stdout:3/544: creat d3/d5/fb7 x:0 0 0 2024-09-18T12:51:15.711 INFO:tasks.workunit.client.1.smithi136.stdout:7/664: creat d0/d35/d41/d50/d5a/d98/fe7 x:0 0 0 2024-09-18T12:51:15.714 INFO:tasks.workunit.client.1.smithi136.stdout:7/665: symlink d0/d35/d41/d50/le8 0 2024-09-18T12:51:15.714 INFO:tasks.workunit.client.1.smithi136.stdout:0/639: symlink d1/d3/d1a/d62/d75/ldd 0 2024-09-18T12:51:15.714 INFO:tasks.workunit.client.1.smithi136.stdout:1/536: dwrite d2/d5/fd [0,4194304] 0 2024-09-18T12:51:15.714 INFO:tasks.workunit.client.1.smithi136.stdout:7/666: chown d0/d35/d36/fb3 985 1 2024-09-18T12:51:15.716 INFO:tasks.workunit.client.1.smithi136.stdout:1/537: creat d2/d5/d2b/d34/d5c/faf x:0 0 0 2024-09-18T12:51:15.717 INFO:tasks.workunit.client.1.smithi136.stdout:7/667: symlink d0/d39/dbf/dcf/le9 0 2024-09-18T12:51:15.718 INFO:tasks.workunit.client.1.smithi136.stdout:1/538: link d2/d5/d2b/d34/f4b d2/d5/d2b/d9b/d2e/fb0 0 2024-09-18T12:51:15.722 INFO:tasks.workunit.client.1.smithi136.stdout:4/465: dread d0/d13/f6c [0,4194304] 0 2024-09-18T12:51:15.722 INFO:tasks.workunit.client.1.smithi136.stdout:7/668: truncate d0/d39/dbf/fc8 3690984 0 2024-09-18T12:51:15.723 INFO:tasks.workunit.client.1.smithi136.stdout:1/539: unlink d2/d5/d2b/d34/d5c/d96/la2 0 2024-09-18T12:51:15.725 INFO:tasks.workunit.client.1.smithi136.stdout:4/466: rename d0/d2/f12 to d0/d8d/f8e 0 2024-09-18T12:51:15.725 INFO:tasks.workunit.client.1.smithi136.stdout:4/467: readlink d0/d45/d67/l6b 0 2024-09-18T12:51:15.725 INFO:tasks.workunit.client.1.smithi136.stdout:4/468: fsync d0/d2/f17 0 2024-09-18T12:51:15.725 INFO:tasks.workunit.client.1.smithi136.stdout:1/540: write d2/d5/d2b/d9b/d2e/d4c/f89 [90977,92089] 0 2024-09-18T12:51:15.725 INFO:tasks.workunit.client.1.smithi136.stdout:6/556: read d8/d9/de/f23 [951838,49453] 0 2024-09-18T12:51:15.728 INFO:tasks.workunit.client.1.smithi136.stdout:1/541: symlink d2/d5/d2b/d63/lb1 0 2024-09-18T12:51:15.728 INFO:tasks.workunit.client.1.smithi136.stdout:7/669: symlink d0/d39/d4d/d69/dd1/lea 0 2024-09-18T12:51:15.728 INFO:tasks.workunit.client.1.smithi136.stdout:3/545: write d3/d14/d17/f4d [1245185,109639] 0 2024-09-18T12:51:15.731 INFO:tasks.workunit.client.1.smithi136.stdout:0/640: dread d1/d3/d1a/d98/d81/d35/d84/f91 [0,4194304] 0 2024-09-18T12:51:15.731 INFO:tasks.workunit.client.1.smithi136.stdout:0/641: fsync d1/db/d77/fa8 0 2024-09-18T12:51:15.731 INFO:tasks.workunit.client.1.smithi136.stdout:0/642: write d1/d3/d1a/d98/d81/d72/f8e [784085,86138] 0 2024-09-18T12:51:15.731 INFO:tasks.workunit.client.1.smithi136.stdout:3/546: unlink d3/d14/d22/d2c/d3d/c94 0 2024-09-18T12:51:15.731 INFO:tasks.workunit.client.1.smithi136.stdout:1/542: rename d2/d5/d9/c97 to d2/d5/d2b/d9b/d1b/cb2 0 2024-09-18T12:51:15.732 INFO:tasks.workunit.client.1.smithi136.stdout:1/543: truncate f1 886217 0 2024-09-18T12:51:15.732 INFO:tasks.workunit.client.1.smithi136.stdout:0/643: symlink d1/db/d77/lde 0 2024-09-18T12:51:15.734 INFO:tasks.workunit.client.1.smithi136.stdout:1/544: unlink d2/d5/d2b/d34/f91 0 2024-09-18T12:51:15.734 INFO:tasks.workunit.client.1.smithi136.stdout:1/545: stat d2/d5/d2b/d9b/l9f 0 2024-09-18T12:51:15.735 INFO:tasks.workunit.client.1.smithi136.stdout:1/546: chown d2/f42 59690 1 2024-09-18T12:51:15.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/547: creat d2/fb3 x:0 0 0 2024-09-18T12:51:15.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/548: write d2/d5/d2b/d63/fac [5240886,13853] 0 2024-09-18T12:51:15.738 INFO:tasks.workunit.client.1.smithi136.stdout:5/633: dwrite d5/d1a/d2d/fb0 [0,4194304] 0 2024-09-18T12:51:15.738 INFO:tasks.workunit.client.1.smithi136.stdout:5/634: creat d5/d6b/fc5 x:0 0 0 2024-09-18T12:51:15.738 INFO:tasks.workunit.client.1.smithi136.stdout:5/635: creat d5/d1a/d2d/d3f/fc6 x:0 0 0 2024-09-18T12:51:15.738 INFO:tasks.workunit.client.1.smithi136.stdout:1/549: mkdir d2/d5/d9/db4 0 2024-09-18T12:51:15.739 INFO:tasks.workunit.client.1.smithi136.stdout:1/550: readlink d2/d5/l8 0 2024-09-18T12:51:15.741 INFO:tasks.workunit.client.1.smithi136.stdout:9/583: dwrite d6/d13/f22 [0,4194304] 0 2024-09-18T12:51:15.742 INFO:tasks.workunit.client.0.smithi081.stdout:0/263: dwrite d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:15.743 INFO:tasks.workunit.client.1.smithi136.stdout:0/644: dread d1/d3/f58 [0,4194304] 0 2024-09-18T12:51:15.744 INFO:tasks.workunit.client.1.smithi136.stdout:5/636: symlink d5/d1a/d2d/d34/d4e/d7a/d9e/dad/lc7 0 2024-09-18T12:51:15.746 INFO:tasks.workunit.client.1.smithi136.stdout:9/584: getdents d6/d13 0 2024-09-18T12:51:15.746 INFO:tasks.workunit.client.1.smithi136.stdout:9/585: creat d6/df/d23/d2b/d79/d53/d5c/fc8 x:0 0 0 2024-09-18T12:51:15.746 INFO:tasks.workunit.client.1.smithi136.stdout:3/547: dread d3/d14/d18/f7d [0,4194304] 0 2024-09-18T12:51:15.748 INFO:tasks.workunit.client.1.smithi136.stdout:5/637: mkdir d5/d1a/d2d/d3f/d7f/dbc/dc8 0 2024-09-18T12:51:15.748 INFO:tasks.workunit.client.1.smithi136.stdout:5/638: chown d5/d1a/f1b 3647925 1 2024-09-18T12:51:15.748 INFO:tasks.workunit.client.1.smithi136.stdout:2/559: dwrite d5/d25/d43/d74/f8e [0,4194304] 0 2024-09-18T12:51:15.748 INFO:tasks.workunit.client.1.smithi136.stdout:2/560: fdatasync d5/d7/d11/d34/f50 0 2024-09-18T12:51:15.748 INFO:tasks.workunit.client.1.smithi136.stdout:2/561: write d5/d25/f6c [3897632,127144] 0 2024-09-18T12:51:15.749 INFO:tasks.workunit.client.1.smithi136.stdout:9/586: mknod d6/d96/dbb/cc9 0 2024-09-18T12:51:15.750 INFO:tasks.workunit.client.1.smithi136.stdout:9/587: fdatasync d6/df/d75/fad 0 2024-09-18T12:51:15.754 INFO:tasks.workunit.client.1.smithi136.stdout:9/588: mknod d6/df/d23/cca 0 2024-09-18T12:51:15.755 INFO:tasks.workunit.client.1.smithi136.stdout:8/659: dwrite d9/d14/d1a/d2b/d42/f49 [4194304,4194304] 0 2024-09-18T12:51:15.755 INFO:tasks.workunit.client.1.smithi136.stdout:1/551: dread d2/d5/d2b/d34/d86/d50/f6d [0,4194304] 0 2024-09-18T12:51:15.755 INFO:tasks.workunit.client.1.smithi136.stdout:8/660: truncate d9/d14/d1a/d7f/d8c/dcb/fd6 76943 0 2024-09-18T12:51:15.757 INFO:tasks.workunit.client.0.smithi081.stdout:4/266: dwrite d3/db/d2d/d4e/f5f [0,4194304] 0 2024-09-18T12:51:15.757 INFO:tasks.workunit.client.1.smithi136.stdout:8/661: rmdir d9/d14/d1a/d2b/d42/da4/dd9 39 2024-09-18T12:51:15.758 INFO:tasks.workunit.client.1.smithi136.stdout:8/662: fsync d9/d18/d34/d3d/d47/d65/fab 0 2024-09-18T12:51:15.758 INFO:tasks.workunit.client.1.smithi136.stdout:1/552: link d2/d5/d2b/d34/f47 d2/d5/d2b/d9b/d2e/fb5 0 2024-09-18T12:51:15.759 INFO:tasks.workunit.client.1.smithi136.stdout:4/469: dwrite d0/d3/f43 [0,4194304] 0 2024-09-18T12:51:15.759 INFO:tasks.workunit.client.1.smithi136.stdout:8/663: rmdir d9/d18/d34 39 2024-09-18T12:51:15.759 INFO:tasks.workunit.client.1.smithi136.stdout:8/664: truncate d9/fd8 604610 0 2024-09-18T12:51:15.761 INFO:tasks.workunit.client.0.smithi081.stdout:4/267: chown d3/db/c16 29762 1 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/268: symlink d3/l60 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/269: write d3/d59/f19 [1339749,36532] 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/645: dread d1/d3/d1a/d98/d81/d35/f49 [0,4194304] 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:3/548: dread d3/d14/d17/d53/f89 [0,4194304] 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:0/646: read - d1/d3/f9a zero size 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:3/549: dread - d3/d14/d18/f8d zero size 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:4/470: creat d0/d3/d54/d88/f8f x:0 0 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:7/670: dwrite d0/d35/d41/d50/fd7 [0,4194304] 0 2024-09-18T12:51:15.765 INFO:tasks.workunit.client.1.smithi136.stdout:7/671: chown d0/d39/d4d/d69/f6e 1 1 2024-09-18T12:51:15.767 INFO:tasks.workunit.client.1.smithi136.stdout:8/665: mkdir d9/d14/d1a/d2b/deb 0 2024-09-18T12:51:15.768 INFO:tasks.workunit.client.1.smithi136.stdout:4/471: mkdir d0/d3/d90 0 2024-09-18T12:51:15.768 INFO:tasks.workunit.client.1.smithi136.stdout:2/562: getdents d5/d4a/d67 0 2024-09-18T12:51:15.774 INFO:tasks.workunit.client.1.smithi136.stdout:6/557: dwrite d8/d9/de/f23 [0,4194304] 0 2024-09-18T12:51:15.774 INFO:tasks.workunit.client.1.smithi136.stdout:7/672: creat d0/d35/feb x:0 0 0 2024-09-18T12:51:15.775 INFO:tasks.workunit.client.1.smithi136.stdout:4/472: symlink d0/d2/d85/l91 0 2024-09-18T12:51:15.775 INFO:tasks.workunit.client.1.smithi136.stdout:4/473: creat d0/d3/d54/f92 x:0 0 0 2024-09-18T12:51:15.775 INFO:tasks.workunit.client.1.smithi136.stdout:0/647: write d1/d3/d1a/d98/d81/d35/d54/f89 [2096254,122883] 0 2024-09-18T12:51:15.776 INFO:tasks.workunit.client.1.smithi136.stdout:2/563: symlink d5/d25/d2d/d9d/lab 0 2024-09-18T12:51:15.777 INFO:tasks.workunit.client.1.smithi136.stdout:7/673: rename d0/d35/d41/d50/d5a/d98/dd0/lde to d0/d35/d41/lec 0 2024-09-18T12:51:15.780 INFO:tasks.workunit.client.1.smithi136.stdout:8/666: dread d9/d18/f5a [0,4194304] 0 2024-09-18T12:51:15.780 INFO:tasks.workunit.client.1.smithi136.stdout:8/667: stat d9/d14/d1a/d2b/cb0 0 2024-09-18T12:51:15.783 INFO:tasks.workunit.client.1.smithi136.stdout:2/564: mknod d5/d4a/cac 0 2024-09-18T12:51:15.785 INFO:tasks.workunit.client.0.smithi081.stdout:0/264: dwrite d7/d9/d4b/d4a/f29 [0,4194304] 0 2024-09-18T12:51:15.786 INFO:tasks.workunit.client.1.smithi136.stdout:5/639: dwrite d5/d1a/f1b [0,4194304] 0 2024-09-18T12:51:15.786 INFO:tasks.workunit.client.1.smithi136.stdout:5/640: chown d5/d1a/d2d/d3f/fa8 54 1 2024-09-18T12:51:15.786 INFO:tasks.workunit.client.1.smithi136.stdout:7/674: creat d0/d35/d41/d50/d5a/d98/dd0/fed x:0 0 0 2024-09-18T12:51:15.788 INFO:tasks.workunit.client.1.smithi136.stdout:8/668: symlink d9/d14/d1a/d2b/d42/d6e/d75/d9a/lec 0 2024-09-18T12:51:15.788 INFO:tasks.workunit.client.1.smithi136.stdout:6/558: write d8/d9/de/d1c/f2b [4190435,88234] 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/648: symlink d1/d3/d1a/d98/d81/ldf 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/649: write d1/d3/d1a/d98/d81/d72/f8e [1617218,65589] 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/650: creat d1/d46/fe0 x:0 0 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/651: chown d1/d60/f6f 12900 1 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/652: truncate d1/d60/f6f 2202686 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/653: readlink d1/db/d77/lde 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:0/654: truncate d1/d17/f37 3568638 0 2024-09-18T12:51:15.791 INFO:tasks.workunit.client.1.smithi136.stdout:2/565: truncate d5/d7/f12 791898 0 2024-09-18T12:51:15.792 INFO:tasks.workunit.client.1.smithi136.stdout:5/641: rename d5/d1a/d30/f57 to d5/fc9 0 2024-09-18T12:51:15.794 INFO:tasks.workunit.client.1.smithi136.stdout:7/675: truncate d0/d35/d36/fc1 4130403 0 2024-09-18T12:51:15.794 INFO:tasks.workunit.client.1.smithi136.stdout:8/669: creat d9/d18/d34/fed x:0 0 0 2024-09-18T12:51:15.797 INFO:tasks.workunit.client.1.smithi136.stdout:0/655: mknod d1/d3/d1a/d98/d81/d35/d84/ce1 0 2024-09-18T12:51:15.799 INFO:tasks.workunit.client.1.smithi136.stdout:2/566: rename d5/c13 to d5/d7/d41/d53/cad 0 2024-09-18T12:51:15.801 INFO:tasks.workunit.client.1.smithi136.stdout:5/642: creat d5/d1a/d30/d7b/fca x:0 0 0 2024-09-18T12:51:15.801 INFO:tasks.workunit.client.1.smithi136.stdout:5/643: getdents d5/d6b/dc3 0 2024-09-18T12:51:15.801 INFO:tasks.workunit.client.1.smithi136.stdout:5/644: fsync d5/d1a/d2d/d34/f35 0 2024-09-18T12:51:15.802 INFO:tasks.workunit.client.1.smithi136.stdout:7/676: mkdir d0/d39/d4d/d9a/dee 0 2024-09-18T12:51:15.804 INFO:tasks.workunit.client.1.smithi136.stdout:8/670: mknod d9/d18/d34/d3d/d47/d65/d93/d96/cee 0 2024-09-18T12:51:15.805 INFO:tasks.workunit.client.1.smithi136.stdout:8/671: chown d9/d18/d34/d3d/d47/fb7 1887 1 2024-09-18T12:51:15.805 INFO:tasks.workunit.client.1.smithi136.stdout:2/567: symlink d5/d4a/d64/lae 0 2024-09-18T12:51:15.805 INFO:tasks.workunit.client.1.smithi136.stdout:2/568: read - d5/d25/d43/f89 zero size 2024-09-18T12:51:15.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/265: write d7/d9/f44 [1999673,99990] 0 2024-09-18T12:51:15.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/266: chown d7/d9/d4b 845 1 2024-09-18T12:51:15.806 INFO:tasks.workunit.client.0.smithi081.stdout:0/267: creat d7/d9/d4b/f5c x:0 0 0 2024-09-18T12:51:15.807 INFO:tasks.workunit.client.1.smithi136.stdout:8/672: creat d9/d14/d1a/d2b/d42/d6e/d75/d9a/fef x:0 0 0 2024-09-18T12:51:15.808 INFO:tasks.workunit.client.1.smithi136.stdout:1/553: dwrite d2/d5/d2b/d9b/d2e/f6b [0,4194304] 0 2024-09-18T12:51:15.808 INFO:tasks.workunit.client.1.smithi136.stdout:1/554: chown l0 198 1 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:3/550: dwrite d3/d14/d17/d53/fb3 [0,4194304] 0 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/589: dwrite d6/da/d3d/d4d/d91/d25/d55/f8d [0,4194304] 0 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:8/673: rmdir d9/d14/d1a/d2b/d42/d6e 39 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/590: creat d6/db/d12/d62/fcb x:0 0 0 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/591: creat d6/df/d23/d2b/fcc x:0 0 0 2024-09-18T12:51:15.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/592: chown d6/df/d75 377313 1 2024-09-18T12:51:15.814 INFO:tasks.workunit.client.1.smithi136.stdout:7/677: dread d0/d39/f7e [0,4194304] 0 2024-09-18T12:51:15.815 INFO:tasks.workunit.client.1.smithi136.stdout:7/678: write d0/d35/d41/d50/d5a/f86 [3582473,99058] 0 2024-09-18T12:51:15.815 INFO:tasks.workunit.client.1.smithi136.stdout:7/679: creat d0/d39/d4d/d55/fef x:0 0 0 2024-09-18T12:51:15.815 INFO:tasks.workunit.client.1.smithi136.stdout:3/551: mkdir d3/d14/d17/db8 0 2024-09-18T12:51:15.815 INFO:tasks.workunit.client.1.smithi136.stdout:3/552: dread - d3/d14/d18/f8d zero size 2024-09-18T12:51:15.815 INFO:tasks.workunit.client.1.smithi136.stdout:3/553: fdatasync d3/d14/d18/d7f/f6d 0 2024-09-18T12:51:15.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/674: mkdir d9/d18/d34/d3d/d8b/df0 0 2024-09-18T12:51:15.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/675: fsync f5 0 2024-09-18T12:51:15.820 INFO:tasks.workunit.client.1.smithi136.stdout:9/593: mknod d6/da/d3d/d4d/ccd 0 2024-09-18T12:51:15.820 INFO:tasks.workunit.client.1.smithi136.stdout:9/594: readlink d6/da/d3d/d4d/d91/d38/dbc/lbd 0 2024-09-18T12:51:15.820 INFO:tasks.workunit.client.1.smithi136.stdout:9/595: creat d6/df/d23/d2b/d79/d53/d5c/fce x:0 0 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/596: readlink d6/da/d3d/d4d/d91/d25/d55/la4 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/597: chown d6/da/fd 3 1 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/598: stat d6/da/d3d/d4d/d91/d25/f27 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/599: creat d6/df/d23/d2b/fcf x:0 0 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.1.smithi136.stdout:9/600: truncate d6/d59/f2a 4295661 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/268: dread d7/d9/d4b/d4a/f16 [0,4194304] 0 2024-09-18T12:51:15.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/269: dread d7/d9/d4b/d4a/f1e [0,4194304] 0 2024-09-18T12:51:15.823 INFO:tasks.workunit.client.0.smithi081.stdout:0/270: truncate d7/d9/d4b/d4a/f1a 5907873 0 2024-09-18T12:51:15.824 INFO:tasks.workunit.client.1.smithi136.stdout:6/559: dwrite d8/d9/de/d60/d71/d76/d97/faf [0,4194304] 0 2024-09-18T12:51:15.824 INFO:tasks.workunit.client.1.smithi136.stdout:3/554: creat d3/d14/fb9 x:0 0 0 2024-09-18T12:51:15.825 INFO:tasks.workunit.client.1.smithi136.stdout:6/560: readlink d8/l6f 0 2024-09-18T12:51:15.825 INFO:tasks.workunit.client.1.smithi136.stdout:0/656: dwrite d1/d3/d1a/d98/d81/f55 [0,4194304] 0 2024-09-18T12:51:15.827 INFO:tasks.workunit.client.1.smithi136.stdout:8/676: symlink d9/d14/d1a/d2b/deb/lf1 0 2024-09-18T12:51:15.827 INFO:tasks.workunit.client.1.smithi136.stdout:8/677: chown d9/d18/d34/d3d/d47/l5b 165 1 2024-09-18T12:51:15.828 INFO:tasks.workunit.client.1.smithi136.stdout:2/569: dread d5/d7/d17/f27 [0,4194304] 0 2024-09-18T12:51:15.829 INFO:tasks.workunit.client.1.smithi136.stdout:4/474: dwrite d0/d3/f89 [0,4194304] 0 2024-09-18T12:51:15.829 INFO:tasks.workunit.client.1.smithi136.stdout:4/475: chown d0/d3/d54/d5c/c5e 5609917 1 2024-09-18T12:51:15.829 INFO:tasks.workunit.client.1.smithi136.stdout:4/476: creat d0/d5f/f93 x:0 0 0 2024-09-18T12:51:15.830 INFO:tasks.workunit.client.1.smithi136.stdout:1/555: read d2/f60 [1914747,69753] 0 2024-09-18T12:51:15.831 INFO:tasks.workunit.client.1.smithi136.stdout:1/556: dread - d2/d5/f1e zero size 2024-09-18T12:51:15.832 INFO:tasks.workunit.client.1.smithi136.stdout:5/645: dwrite d5/d1a/f3a [4194304,4194304] 0 2024-09-18T12:51:15.832 INFO:tasks.workunit.client.1.smithi136.stdout:5/646: fdatasync f2 0 2024-09-18T12:51:15.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/570: rmdir d5/d4a/d67 39 2024-09-18T12:51:15.843 INFO:tasks.workunit.client.0.smithi081.stdout:0/271: dwrite d7/d9/d4b/d4a/f29 [4194304,4194304] 0 2024-09-18T12:51:15.844 INFO:tasks.workunit.client.1.smithi136.stdout:3/555: dread d3/d5/f9f [0,4194304] 0 2024-09-18T12:51:15.844 INFO:tasks.workunit.client.1.smithi136.stdout:4/477: symlink d0/d25/d79/l94 0 2024-09-18T12:51:15.845 INFO:tasks.workunit.client.0.smithi081.stdout:0/272: mkdir d7/d5d 0 2024-09-18T12:51:15.846 INFO:tasks.workunit.client.1.smithi136.stdout:1/557: unlink d2/d5/d2b/d34/d86/l55 0 2024-09-18T12:51:15.846 INFO:tasks.workunit.client.0.smithi081.stdout:0/273: creat d7/d9/d4b/d3d/f5e x:0 0 0 2024-09-18T12:51:15.847 INFO:tasks.workunit.client.1.smithi136.stdout:5/647: rename d5/d1a/d2d/d34/d88/l76 to d5/d1a/d2d/d34/d4e/d9b/lcb 0 2024-09-18T12:51:15.849 INFO:tasks.workunit.client.1.smithi136.stdout:0/657: symlink d1/db/le2 0 2024-09-18T12:51:15.849 INFO:tasks.workunit.client.1.smithi136.stdout:0/658: fsync d1/f18 0 2024-09-18T12:51:15.849 INFO:tasks.workunit.client.1.smithi136.stdout:0/659: chown d1/db/d77/fa6 5 1 2024-09-18T12:51:15.857 INFO:tasks.workunit.client.1.smithi136.stdout:6/561: dwrite d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:15.858 INFO:tasks.workunit.client.1.smithi136.stdout:3/556: unlink d3/d2b/c38 0 2024-09-18T12:51:15.858 INFO:tasks.workunit.client.1.smithi136.stdout:3/557: chown d3/d2b 0 1 2024-09-18T12:51:15.858 INFO:tasks.workunit.client.1.smithi136.stdout:0/660: creat d1/d3/d1a/d98/d81/d70/dbc/fe3 x:0 0 0 2024-09-18T12:51:15.860 INFO:tasks.workunit.client.0.smithi081.stdout:0/274: write d7/d9/d4b/d4a/f29 [7447667,7144] 0 2024-09-18T12:51:15.860 INFO:tasks.workunit.client.1.smithi136.stdout:8/678: dwrite d9/d14/d1a/d2b/d42/f6d [0,4194304] 0 2024-09-18T12:51:15.861 INFO:tasks.workunit.client.1.smithi136.stdout:2/571: getdents d5/d7 0 2024-09-18T12:51:15.862 INFO:tasks.workunit.client.0.smithi081.stdout:0/275: mknod d7/d5d/c5f 0 2024-09-18T12:51:15.863 INFO:tasks.workunit.client.0.smithi081.stdout:0/276: truncate d7/d9/d4b/d4a/f1a 3478097 0 2024-09-18T12:51:15.864 INFO:tasks.workunit.client.1.smithi136.stdout:4/478: dwrite d0/d13/f7f [0,4194304] 0 2024-09-18T12:51:15.865 INFO:tasks.workunit.client.1.smithi136.stdout:5/648: read d5/d1a/f27 [874838,32309] 0 2024-09-18T12:51:15.865 INFO:tasks.workunit.client.1.smithi136.stdout:5/649: chown d5/d1a/d2d/d34/d4e/db5 4119 1 2024-09-18T12:51:15.865 INFO:tasks.workunit.client.1.smithi136.stdout:5/650: chown d5/d1a/d2d/d34/d4e/d7a/d9e/dad/c83 7 1 2024-09-18T12:51:15.865 INFO:tasks.workunit.client.1.smithi136.stdout:6/562: link d8/d9/d3c/d4a/c55 d8/d9/d3c/d45/cb7 0 2024-09-18T12:51:15.865 INFO:tasks.workunit.client.1.smithi136.stdout:6/563: stat d8/d9/d3c/d4a 0 2024-09-18T12:51:15.869 INFO:tasks.workunit.client.1.smithi136.stdout:3/558: creat d3/d2b/fba x:0 0 0 2024-09-18T12:51:15.872 INFO:tasks.workunit.client.1.smithi136.stdout:0/661: symlink d1/d3/d1a/d95/le4 0 2024-09-18T12:51:15.873 INFO:tasks.workunit.client.1.smithi136.stdout:8/679: rename d9/d18/f5c to d9/d18/d34/d3d/d47/dbe/de3/ff2 0 2024-09-18T12:51:15.874 INFO:tasks.workunit.client.1.smithi136.stdout:4/479: dread d0/f4a [0,4194304] 0 2024-09-18T12:51:15.877 INFO:tasks.workunit.client.1.smithi136.stdout:2/572: symlink d5/d7/d3b/laf 0 2024-09-18T12:51:15.878 INFO:tasks.workunit.client.1.smithi136.stdout:6/564: dread d8/d9/de/d1c/f20 [0,4194304] 0 2024-09-18T12:51:15.880 INFO:tasks.workunit.client.1.smithi136.stdout:2/573: dread d5/d7/f8b [0,4194304] 0 2024-09-18T12:51:15.880 INFO:tasks.workunit.client.1.smithi136.stdout:2/574: write d5/d7/d17/f24 [770916,77346] 0 2024-09-18T12:51:15.882 INFO:tasks.workunit.client.0.smithi081.stdout:0/277: dwrite d7/f3c [0,4194304] 0 2024-09-18T12:51:15.882 INFO:tasks.workunit.client.1.smithi136.stdout:3/559: mknod d3/d14/d18/cbb 0 2024-09-18T12:51:15.882 INFO:tasks.workunit.client.1.smithi136.stdout:3/560: write d3/d2b/f4b [662508,124269] 0 2024-09-18T12:51:15.888 INFO:tasks.workunit.client.1.smithi136.stdout:2/575: dread d5/d25/f62 [0,4194304] 0 2024-09-18T12:51:15.888 INFO:tasks.workunit.client.1.smithi136.stdout:2/576: creat d5/d25/d43/d74/fb0 x:0 0 0 2024-09-18T12:51:15.888 INFO:tasks.workunit.client.1.smithi136.stdout:2/577: truncate d5/d7/fe 1693717 0 2024-09-18T12:51:15.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/278: write d7/d9/d4b/d4a/f1a [1745460,66630] 0 2024-09-18T12:51:15.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/279: write d7/d9/d4b/d4a/f16 [5313779,116318] 0 2024-09-18T12:51:15.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/280: write d7/d9/d4b/f54 [5107578,46150] 0 2024-09-18T12:51:15.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/281: truncate d7/d9/d4b/f38 29566 0 2024-09-18T12:51:15.892 INFO:tasks.workunit.client.0.smithi081.stdout:0/282: chown d7/d9/d4b/c49 214880909 1 2024-09-18T12:51:15.894 INFO:tasks.workunit.client.1.smithi136.stdout:9/601: rmdir d6/db/d12/d62 39 2024-09-18T12:51:15.898 INFO:tasks.workunit.client.1.smithi136.stdout:7/680: truncate d0/d35/d41/d50/d5a/f86 891765 0 2024-09-18T12:51:15.899 INFO:tasks.workunit.client.1.smithi136.stdout:7/681: chown d0/d12/d1a/dac 7392 1 2024-09-18T12:51:15.899 INFO:tasks.workunit.client.1.smithi136.stdout:6/565: dwrite d8/d9/d3c/f59 [0,4194304] 0 2024-09-18T12:51:15.899 INFO:tasks.workunit.client.1.smithi136.stdout:6/566: chown d8/d9/d56/f78 5453612 1 2024-09-18T12:51:15.899 INFO:tasks.workunit.client.1.smithi136.stdout:6/567: write d8/d9/d3c/d4a/fb2 [846356,109027] 0 2024-09-18T12:51:15.899 INFO:tasks.workunit.client.1.smithi136.stdout:6/568: dread - d8/d9/d56/d96/fab zero size 2024-09-18T12:51:15.903 INFO:tasks.workunit.client.1.smithi136.stdout:3/561: dwrite d3/d14/d17/f4d [4194304,4194304] 0 2024-09-18T12:51:15.906 INFO:tasks.workunit.client.1.smithi136.stdout:0/662: rename d1/d3/d1a/d98/d81/d51/daf to d1/db/d76/db9/de5 0 2024-09-18T12:51:15.908 INFO:tasks.workunit.client.1.smithi136.stdout:8/680: getdents d9/d18/d34/d3d/d47/d65 0 2024-09-18T12:51:15.908 INFO:tasks.workunit.client.1.smithi136.stdout:8/681: fsync d9/d18/f7a 0 2024-09-18T12:51:15.909 INFO:tasks.workunit.client.1.smithi136.stdout:4/480: rmdir d0/d45/d67 39 2024-09-18T12:51:15.911 INFO:tasks.workunit.client.1.smithi136.stdout:2/578: mkdir d5/d7/d17/d48/db1 0 2024-09-18T12:51:15.915 INFO:tasks.workunit.client.1.smithi136.stdout:6/569: symlink d8/d9/d64/lb8 0 2024-09-18T12:51:15.915 INFO:tasks.workunit.client.1.smithi136.stdout:6/570: chown d8/d9/de/d60/f81 151 1 2024-09-18T12:51:15.915 INFO:tasks.workunit.client.1.smithi136.stdout:6/571: dread - d8/d9/d64/f82 zero size 2024-09-18T12:51:15.915 INFO:tasks.workunit.client.1.smithi136.stdout:6/572: truncate d8/d9/de/d1c/f46 9262293 0 2024-09-18T12:51:15.916 INFO:tasks.workunit.client.1.smithi136.stdout:3/562: mkdir d3/d2b/d6c/db4/dbc 0 2024-09-18T12:51:15.917 INFO:tasks.workunit.client.1.smithi136.stdout:2/579: mkdir d5/d7/d17/d48/db2 0 2024-09-18T12:51:15.918 INFO:tasks.workunit.client.1.smithi136.stdout:6/573: mkdir d8/d9/de/d1c/db9 0 2024-09-18T12:51:15.919 INFO:tasks.workunit.client.1.smithi136.stdout:3/563: mknod d3/d10/d84/cbd 0 2024-09-18T12:51:15.921 INFO:tasks.workunit.client.0.smithi081.stdout:0/283: dwrite d7/d9/d12/f31 [4194304,4194304] 0 2024-09-18T12:51:15.922 INFO:tasks.workunit.client.1.smithi136.stdout:8/682: dread d9/d18/d34/f3e [0,4194304] 0 2024-09-18T12:51:15.922 INFO:tasks.workunit.client.1.smithi136.stdout:3/564: link d3/d2b/l74 d3/d14/d18/lbe 0 2024-09-18T12:51:15.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/284: write d7/d9/d4b/d4a/f16 [4728169,109200] 0 2024-09-18T12:51:15.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/285: chown d7/d9/f3e 4 1 2024-09-18T12:51:15.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/286: stat d7/d4f/f5a 0 2024-09-18T12:51:15.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/287: stat d7/d9/d4b/d53 0 2024-09-18T12:51:15.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/288: stat d7/d9/f23 0 2024-09-18T12:51:15.927 INFO:tasks.workunit.client.1.smithi136.stdout:4/481: dwrite d0/d3/f73 [0,4194304] 0 2024-09-18T12:51:15.927 INFO:tasks.workunit.client.1.smithi136.stdout:7/682: dwrite d0/d35/d41/d50/d7b/f90 [0,4194304] 0 2024-09-18T12:51:15.927 INFO:tasks.workunit.client.1.smithi136.stdout:2/580: rmdir d5/d25/d2d 39 2024-09-18T12:51:15.927 INFO:tasks.workunit.client.1.smithi136.stdout:2/581: dread - d5/d7/f78 zero size 2024-09-18T12:51:15.927 INFO:tasks.workunit.client.1.smithi136.stdout:9/602: dwrite d6/d13/fc1 [0,4194304] 0 2024-09-18T12:51:15.928 INFO:tasks.workunit.client.1.smithi136.stdout:9/603: write d6/df/d75/fb2 [1011170,13034] 0 2024-09-18T12:51:15.928 INFO:tasks.workunit.client.1.smithi136.stdout:9/604: truncate d6/df/d23/d2b/fcc 411294 0 2024-09-18T12:51:15.928 INFO:tasks.workunit.client.1.smithi136.stdout:9/605: chown d6/f42 1058384547 1 2024-09-18T12:51:15.932 INFO:tasks.workunit.client.1.smithi136.stdout:4/482: chown d0/cd 15070 1 2024-09-18T12:51:15.934 INFO:tasks.workunit.client.0.smithi081.stdout:8/296: sync 2024-09-18T12:51:15.935 INFO:tasks.workunit.client.0.smithi081.stdout:8/297: mknod d3/d1e/d4c/d53/c6e 0 2024-09-18T12:51:15.935 INFO:tasks.workunit.client.0.smithi081.stdout:8/298: truncate d3/d1d/f55 97603 0 2024-09-18T12:51:15.937 INFO:tasks.workunit.client.0.smithi081.stdout:8/299: symlink d3/d1e/d4c/l6f 0 2024-09-18T12:51:15.937 INFO:tasks.workunit.client.1.smithi136.stdout:7/683: rename d0/d39/d4d/l81 to d0/d35/d4f/dd5/d94/lf0 0 2024-09-18T12:51:15.937 INFO:tasks.workunit.client.1.smithi136.stdout:7/684: readlink d0/d35/d36/l30 0 2024-09-18T12:51:15.939 INFO:tasks.workunit.client.1.smithi136.stdout:2/582: truncate d5/f22 827319 0 2024-09-18T12:51:15.941 INFO:tasks.workunit.client.1.smithi136.stdout:2/583: dread d5/d25/f62 [0,4194304] 0 2024-09-18T12:51:15.942 INFO:tasks.workunit.client.1.smithi136.stdout:8/683: dwrite d9/d18/d34/d3d/d47/d65/f66 [4194304,4194304] 0 2024-09-18T12:51:15.947 INFO:tasks.workunit.client.1.smithi136.stdout:4/483: symlink d0/d13/l95 0 2024-09-18T12:51:15.949 INFO:tasks.workunit.client.1.smithi136.stdout:7/685: link d0/fa d0/da8/ff1 0 2024-09-18T12:51:15.949 INFO:tasks.workunit.client.1.smithi136.stdout:7/686: chown d0/d2c/d2e/f32 45829 1 2024-09-18T12:51:15.949 INFO:tasks.workunit.client.1.smithi136.stdout:7/687: fdatasync d0/d2c/d2e/fb5 0 2024-09-18T12:51:15.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/584: mknod d5/d7/d41/d53/cb3 0 2024-09-18T12:51:15.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/585: fdatasync d5/d25/d43/d74/f8e 0 2024-09-18T12:51:15.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/586: fdatasync d5/d25/f40 0 2024-09-18T12:51:15.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/587: chown d5/d7/d17/d48/ca6 29825097 1 2024-09-18T12:51:15.951 INFO:tasks.workunit.client.1.smithi136.stdout:8/684: symlink d9/d14/d1a/d2b/d42/lf3 0 2024-09-18T12:51:15.952 INFO:tasks.workunit.client.1.smithi136.stdout:4/484: symlink d0/d5f/l96 0 2024-09-18T12:51:15.953 INFO:tasks.workunit.client.1.smithi136.stdout:4/485: creat d0/d3/f97 x:0 0 0 2024-09-18T12:51:15.953 INFO:tasks.workunit.client.1.smithi136.stdout:4/486: fdatasync d0/f1 0 2024-09-18T12:51:15.954 INFO:tasks.workunit.client.1.smithi136.stdout:7/688: symlink d0/da8/dcc/lf2 0 2024-09-18T12:51:15.955 INFO:tasks.workunit.client.1.smithi136.stdout:2/588: creat d5/d4a/d67/fb4 x:0 0 0 2024-09-18T12:51:15.956 INFO:tasks.workunit.client.1.smithi136.stdout:8/685: mknod d9/d14/d1a/d2b/cf4 0 2024-09-18T12:51:15.957 INFO:tasks.workunit.client.1.smithi136.stdout:3/565: truncate d3/d14/d22/d2c/d3d/f91 3171142 0 2024-09-18T12:51:15.958 INFO:tasks.workunit.client.0.smithi081.stdout:8/300: dwrite d3/f25 [0,4194304] 0 2024-09-18T12:51:15.958 INFO:tasks.workunit.client.0.smithi081.stdout:8/301: truncate d3/f25 4487951 0 2024-09-18T12:51:15.959 INFO:tasks.workunit.client.1.smithi136.stdout:4/487: link d0/d13/l57 d0/d13/l98 0 2024-09-18T12:51:15.959 INFO:tasks.workunit.client.1.smithi136.stdout:4/488: truncate d0/d3/f4 8518045 0 2024-09-18T12:51:15.959 INFO:tasks.workunit.client.1.smithi136.stdout:4/489: write d0/d2/f3e [8660977,44990] 0 2024-09-18T12:51:15.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/302: mknod d3/d1e/d4c/d53/c70 0 2024-09-18T12:51:15.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/303: dread - d3/f6c zero size 2024-09-18T12:51:15.961 INFO:tasks.workunit.client.1.smithi136.stdout:2/589: creat d5/d7/d3b/fb5 x:0 0 0 2024-09-18T12:51:15.961 INFO:tasks.workunit.client.1.smithi136.stdout:2/590: write d5/d7/d3b/fb5 [93234,73863] 0 2024-09-18T12:51:15.962 INFO:tasks.workunit.client.1.smithi136.stdout:8/686: link d9/d14/d1a/d7f/d8c/dcb/fd6 d9/d18/d34/d3d/d47/d65/d92/ff5 0 2024-09-18T12:51:15.964 INFO:tasks.workunit.client.1.smithi136.stdout:3/566: mkdir d3/d14/d17/d53/d73/dbf 0 2024-09-18T12:51:15.965 INFO:tasks.workunit.client.1.smithi136.stdout:2/591: creat d5/d7/fb6 x:0 0 0 2024-09-18T12:51:15.966 INFO:tasks.workunit.client.1.smithi136.stdout:8/687: rmdir d9/d18/d34/d3d/d47/d65/d92 39 2024-09-18T12:51:15.968 INFO:tasks.workunit.client.1.smithi136.stdout:3/567: truncate d3/d14/d22/f1f 1863664 0 2024-09-18T12:51:15.969 INFO:tasks.workunit.client.0.smithi081.stdout:8/304: dread d3/d1d/d4a/f4f [4194304,4194304] 0 2024-09-18T12:51:15.970 INFO:tasks.workunit.client.0.smithi081.stdout:8/305: symlink d3/d1d/d4a/l71 0 2024-09-18T12:51:15.970 INFO:tasks.workunit.client.1.smithi136.stdout:8/688: mkdir d9/d18/d34/d3d/d47/d65/d93/df6 0 2024-09-18T12:51:15.970 INFO:tasks.workunit.client.1.smithi136.stdout:8/689: stat d9/d14/d1a/d7f/d8c/dcb/fd6 0 2024-09-18T12:51:15.972 INFO:tasks.workunit.client.1.smithi136.stdout:2/592: getdents d5/d7/d11 0 2024-09-18T12:51:15.972 INFO:tasks.workunit.client.1.smithi136.stdout:2/593: truncate d5/d25/d43/d74/fb0 851000 0 2024-09-18T12:51:15.973 INFO:tasks.workunit.client.1.smithi136.stdout:4/490: dwrite d0/d25/f6f [0,4194304] 0 2024-09-18T12:51:15.974 INFO:tasks.workunit.client.1.smithi136.stdout:2/594: creat d5/d25/d2d/d9d/da2/fb7 x:0 0 0 2024-09-18T12:51:15.974 INFO:tasks.workunit.client.1.smithi136.stdout:2/595: readlink d5/d25/l26 0 2024-09-18T12:51:15.975 INFO:tasks.workunit.client.1.smithi136.stdout:2/596: dread - d5/d7/d11/d34/f9e zero size 2024-09-18T12:51:15.975 INFO:tasks.workunit.client.1.smithi136.stdout:6/574: truncate d8/d9/de/d1c/f46 8186398 0 2024-09-18T12:51:15.979 INFO:tasks.workunit.client.1.smithi136.stdout:2/597: mkdir d5/d7/d17/d48/db2/db8 0 2024-09-18T12:51:15.982 INFO:tasks.workunit.client.1.smithi136.stdout:2/598: rename d5/l14 to d5/d4a/d64/lb9 0 2024-09-18T12:51:15.983 INFO:tasks.workunit.client.1.smithi136.stdout:8/690: write d9/d14/d1a/d2b/f4d [3970970,65120] 0 2024-09-18T12:51:15.983 INFO:tasks.workunit.client.1.smithi136.stdout:8/691: write d9/d14/fe [2711167,96158] 0 2024-09-18T12:51:15.985 INFO:tasks.workunit.client.0.smithi081.stdout:8/306: write d3/d1e/f33 [3320491,96199] 0 2024-09-18T12:51:15.985 INFO:tasks.workunit.client.0.smithi081.stdout:8/307: dread - d3/f6c zero size 2024-09-18T12:51:15.988 INFO:tasks.workunit.client.1.smithi136.stdout:8/692: unlink d9/d18/d34/c3b 0 2024-09-18T12:51:15.989 INFO:tasks.workunit.client.1.smithi136.stdout:8/693: symlink d9/d14/d1a/lf7 0 2024-09-18T12:51:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:8/308: fdatasync d3/d1e/f33 0 2024-09-18T12:51:16.003 INFO:tasks.workunit.client.1.smithi136.stdout:6/575: dwrite d8/d9/de/d1c/d50/f7c [0,4194304] 0 2024-09-18T12:51:16.003 INFO:tasks.workunit.client.1.smithi136.stdout:6/576: creat d8/d9/d3c/fba x:0 0 0 2024-09-18T12:51:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:8/309: rmdir d3 39 2024-09-18T12:51:16.004 INFO:tasks.workunit.client.1.smithi136.stdout:3/568: dwrite d3/d14/d18/f50 [0,4194304] 0 2024-09-18T12:51:16.004 INFO:tasks.workunit.client.1.smithi136.stdout:3/569: dread - d3/d14/d17/d53/d73/fa5 zero size 2024-09-18T12:51:16.005 INFO:tasks.workunit.client.1.smithi136.stdout:6/577: truncate d8/d9/de/d1c/d50/f73 1042407 0 2024-09-18T12:51:16.005 INFO:tasks.workunit.client.1.smithi136.stdout:6/578: readlink d8/d9/d3c/l52 0 2024-09-18T12:51:16.006 INFO:tasks.workunit.client.1.smithi136.stdout:3/570: rmdir d3/d14/d17/d8c 39 2024-09-18T12:51:16.006 INFO:tasks.workunit.client.1.smithi136.stdout:3/571: creat d3/d14/d17/d8c/d96/fc0 x:0 0 0 2024-09-18T12:51:16.007 INFO:tasks.workunit.client.1.smithi136.stdout:6/579: mkdir d8/d9/d64/dbb 0 2024-09-18T12:51:16.010 INFO:tasks.workunit.client.1.smithi136.stdout:3/572: creat d3/d14/d22/fc1 x:0 0 0 2024-09-18T12:51:16.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/573: fdatasync d3/d14/d22/d2c/d3d/fad 0 2024-09-18T12:51:16.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/574: chown d3/d5/d3c/fa9 21 1 2024-09-18T12:51:16.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/575: write d3/d14/d18/f8d [106979,36821] 0 2024-09-18T12:51:16.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/576: creat d3/d14/d17/fc2 x:0 0 0 2024-09-18T12:51:16.014 INFO:tasks.workunit.client.1.smithi136.stdout:2/599: dwrite d5/d25/d2d/d9d/da2/fb7 [0,4194304] 0 2024-09-18T12:51:16.015 INFO:tasks.workunit.client.1.smithi136.stdout:2/600: fsync d5/d7/d11/f32 0 2024-09-18T12:51:16.015 INFO:tasks.workunit.client.1.smithi136.stdout:4/491: dwrite d0/d5f/f93 [0,4194304] 0 2024-09-18T12:51:16.015 INFO:tasks.workunit.client.1.smithi136.stdout:8/694: dwrite d9/d14/f1d [0,4194304] 0 2024-09-18T12:51:16.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/601: dread d5/d7/d11/f32 [0,4194304] 0 2024-09-18T12:51:16.019 INFO:tasks.workunit.client.1.smithi136.stdout:4/492: creat d0/d45/d67/f99 x:0 0 0 2024-09-18T12:51:16.023 INFO:tasks.workunit.client.1.smithi136.stdout:8/695: creat d9/d18/d34/d3d/d47/dbe/ff8 x:0 0 0 2024-09-18T12:51:16.023 INFO:tasks.workunit.client.1.smithi136.stdout:8/696: truncate d9/d14/d1a/d2b/d42/d9e/fdf 963231 0 2024-09-18T12:51:16.023 INFO:tasks.workunit.client.1.smithi136.stdout:8/697: creat d9/d14/d1a/d2b/ff9 x:0 0 0 2024-09-18T12:51:16.024 INFO:tasks.workunit.client.1.smithi136.stdout:3/577: write d3/d2b/f92 [3987544,12848] 0 2024-09-18T12:51:16.026 INFO:tasks.workunit.client.1.smithi136.stdout:8/698: mkdir d9/d14/d1a/d2b/d42/d9e/dda/dfa 0 2024-09-18T12:51:16.029 INFO:tasks.workunit.client.1.smithi136.stdout:3/578: rename d3/d14/d22/d2c/f98 to d3/d14/d17/d75/d87/fc3 0 2024-09-18T12:51:16.030 INFO:tasks.workunit.client.1.smithi136.stdout:8/699: symlink d9/d14/d1a/d2b/d42/d6e/d75/d9a/lfb 0 2024-09-18T12:51:16.030 INFO:tasks.workunit.client.1.smithi136.stdout:8/700: chown d9/d14/d1a/l6c 1066 1 2024-09-18T12:51:16.031 INFO:tasks.workunit.client.1.smithi136.stdout:3/579: creat d3/d2b/d6c/db4/fc4 x:0 0 0 2024-09-18T12:51:16.032 INFO:tasks.workunit.client.1.smithi136.stdout:3/580: chown d3/d14/d18/f8d 3266629 1 2024-09-18T12:51:16.032 INFO:tasks.workunit.client.1.smithi136.stdout:3/581: truncate d3/d14/d22/fc1 1028189 0 2024-09-18T12:51:16.032 INFO:tasks.workunit.client.1.smithi136.stdout:8/701: mkdir d9/d18/d34/d88/dd5/dfc 0 2024-09-18T12:51:16.032 INFO:tasks.workunit.client.1.smithi136.stdout:2/602: dwrite d5/d7/d17/d48/f93 [0,4194304] 0 2024-09-18T12:51:16.033 INFO:tasks.workunit.client.1.smithi136.stdout:2/603: fsync d5/d25/d43/d74/fa9 0 2024-09-18T12:51:16.034 INFO:tasks.workunit.client.1.smithi136.stdout:8/702: creat d9/d18/d34/d88/dd5/ffd x:0 0 0 2024-09-18T12:51:16.034 INFO:tasks.workunit.client.1.smithi136.stdout:8/703: creat d9/d14/d1a/d7f/ffe x:0 0 0 2024-09-18T12:51:16.036 INFO:tasks.workunit.client.1.smithi136.stdout:2/604: creat d5/d7/d41/d53/fba x:0 0 0 2024-09-18T12:51:16.039 INFO:tasks.workunit.client.1.smithi136.stdout:8/704: symlink d9/d14/d1a/lff 0 2024-09-18T12:51:16.040 INFO:tasks.workunit.client.1.smithi136.stdout:3/582: rename d3/d14/d22/d2c/d3d to d3/d14/dc5 0 2024-09-18T12:51:16.040 INFO:tasks.workunit.client.1.smithi136.stdout:3/583: chown d3/d2b 126155118 1 2024-09-18T12:51:16.040 INFO:tasks.workunit.client.1.smithi136.stdout:3/584: creat d3/d14/d22/fc6 x:0 0 0 2024-09-18T12:51:16.041 INFO:tasks.workunit.client.1.smithi136.stdout:8/705: symlink d9/d18/dc5/l100 0 2024-09-18T12:51:16.043 INFO:tasks.workunit.client.1.smithi136.stdout:3/585: rename d3/d14/d17/f62 to d3/d10/d4a/d51/fc7 0 2024-09-18T12:51:16.045 INFO:tasks.workunit.client.1.smithi136.stdout:4/493: truncate d0/d3/f4 7172204 0 2024-09-18T12:51:16.045 INFO:tasks.workunit.client.1.smithi136.stdout:4/494: write d0/d2/f16 [2087473,39254] 0 2024-09-18T12:51:16.047 INFO:tasks.workunit.client.1.smithi136.stdout:3/586: mknod d3/d14/cc8 0 2024-09-18T12:51:16.047 INFO:tasks.workunit.client.1.smithi136.stdout:3/587: stat d3/d2b/d6c/db4/dbc 0 2024-09-18T12:51:16.047 INFO:tasks.workunit.client.1.smithi136.stdout:4/495: symlink d0/d3/d54/l9a 0 2024-09-18T12:51:16.049 INFO:tasks.workunit.client.1.smithi136.stdout:3/588: unlink d3/d14/d22/lb1 0 2024-09-18T12:51:16.050 INFO:tasks.workunit.client.1.smithi136.stdout:4/496: symlink d0/d3/d54/d5c/l9b 0 2024-09-18T12:51:16.055 INFO:tasks.workunit.client.1.smithi136.stdout:3/589: dread d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:16.059 INFO:tasks.workunit.client.1.smithi136.stdout:2/605: dwrite d5/d25/d43/d74/f88 [0,4194304] 0 2024-09-18T12:51:16.061 INFO:tasks.workunit.client.1.smithi136.stdout:3/590: dread d3/d14/d17/d8c/d96/f9c [0,4194304] 0 2024-09-18T12:51:16.063 INFO:tasks.workunit.client.1.smithi136.stdout:2/606: rename d5/d7/l16 to d5/d7/d17/d48/db1/lbb 0 2024-09-18T12:51:16.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:15 smithi136 ceph-mon[35363]: pgmap v280: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 139 MiB/s rd, 183 MiB/s wr, 599 op/s 2024-09-18T12:51:16.064 INFO:tasks.workunit.client.1.smithi136.stdout:3/591: rmdir d3/d14/d17/d75 39 2024-09-18T12:51:16.066 INFO:tasks.workunit.client.1.smithi136.stdout:2/607: mknod d5/d7/d11/d34/cbc 0 2024-09-18T12:51:16.066 INFO:tasks.workunit.client.1.smithi136.stdout:4/497: dread d0/f72 [0,4194304] 0 2024-09-18T12:51:16.066 INFO:tasks.workunit.client.1.smithi136.stdout:4/498: write d0/d45/f63 [2149896,70993] 0 2024-09-18T12:51:16.066 INFO:tasks.workunit.client.1.smithi136.stdout:8/706: dwrite d9/fd8 [0,4194304] 0 2024-09-18T12:51:16.066 INFO:tasks.workunit.client.1.smithi136.stdout:8/707: chown d9/d14/d1a/d2b/d42/d6e/f84 83 1 2024-09-18T12:51:16.067 INFO:tasks.workunit.client.1.smithi136.stdout:3/592: truncate d3/d14/d18/f50 2421066 0 2024-09-18T12:51:16.067 INFO:tasks.workunit.client.1.smithi136.stdout:3/593: creat d3/d2b/d6c/db4/fc9 x:0 0 0 2024-09-18T12:51:16.068 INFO:tasks.workunit.client.1.smithi136.stdout:2/608: stat d5/d7/d11/d34/l73 0 2024-09-18T12:51:16.068 INFO:tasks.workunit.client.1.smithi136.stdout:2/609: fsync d5/d4a/d64/f7d 0 2024-09-18T12:51:16.068 INFO:tasks.workunit.client.1.smithi136.stdout:2/610: write d5/d4a/d67/fa8 [305574,21349] 0 2024-09-18T12:51:16.070 INFO:tasks.workunit.client.1.smithi136.stdout:4/499: creat d0/d8d/f9c x:0 0 0 2024-09-18T12:51:16.072 INFO:tasks.workunit.client.1.smithi136.stdout:8/708: mkdir d9/d18/d34/d3d/d47/dbe/de3/d101 0 2024-09-18T12:51:16.073 INFO:tasks.workunit.client.1.smithi136.stdout:8/709: read d9/d14/d1a/d7f/d8c/fac [660531,106899] 0 2024-09-18T12:51:16.077 INFO:tasks.workunit.client.1.smithi136.stdout:2/611: link d5/d7/d3b/l49 d5/d4a/d67/lbd 0 2024-09-18T12:51:16.077 INFO:tasks.workunit.client.1.smithi136.stdout:2/612: truncate d5/fa1 842566 0 2024-09-18T12:51:16.078 INFO:tasks.workunit.client.1.smithi136.stdout:8/710: mknod d9/d18/d34/d3d/d47/d65/c102 0 2024-09-18T12:51:16.078 INFO:tasks.workunit.client.1.smithi136.stdout:8/711: write d9/d18/d34/d3d/f78 [530474,56210] 0 2024-09-18T12:51:16.079 INFO:tasks.workunit.client.1.smithi136.stdout:3/594: getdents d3/d5 0 2024-09-18T12:51:16.080 INFO:tasks.workunit.client.1.smithi136.stdout:3/595: dread - d3/d2b/d6c/db4/fc4 zero size 2024-09-18T12:51:16.080 INFO:tasks.workunit.client.1.smithi136.stdout:3/596: read - d3/d14/d17/d75/d86/f9a zero size 2024-09-18T12:51:16.080 INFO:tasks.workunit.client.1.smithi136.stdout:3/597: readlink d3/d14/d17/l82 0 2024-09-18T12:51:16.080 INFO:tasks.workunit.client.1.smithi136.stdout:3/598: chown d3/d14/d22/f42 345939365 1 2024-09-18T12:51:16.080 INFO:tasks.workunit.client.1.smithi136.stdout:3/599: write d3/d5/d31/f90 [275732,51009] 0 2024-09-18T12:51:16.082 INFO:tasks.workunit.client.1.smithi136.stdout:2/613: link d5/d7/d17/c94 d5/d7/d17/d48/db2/db8/cbe 0 2024-09-18T12:51:16.084 INFO:tasks.workunit.client.1.smithi136.stdout:8/712: mkdir d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103 0 2024-09-18T12:51:16.089 INFO:tasks.workunit.client.1.smithi136.stdout:8/713: dread d9/d14/d1a/d2b/f4d [0,4194304] 0 2024-09-18T12:51:16.091 INFO:tasks.workunit.client.1.smithi136.stdout:4/500: dwrite d0/d2/f17 [4194304,4194304] 0 2024-09-18T12:51:16.095 INFO:tasks.workunit.client.1.smithi136.stdout:4/501: stat d0/d3/d54/d5c/c7c 0 2024-09-18T12:51:16.095 INFO:tasks.workunit.client.1.smithi136.stdout:4/502: stat d0/l22 0 2024-09-18T12:51:16.095 INFO:tasks.workunit.client.1.smithi136.stdout:4/503: readlink d0/d2/l37 0 2024-09-18T12:51:16.095 INFO:tasks.workunit.client.1.smithi136.stdout:4/504: write d0/d45/f84 [404931,92887] 0 2024-09-18T12:51:16.096 INFO:tasks.workunit.client.1.smithi136.stdout:4/505: creat d0/d45/d67/d7b/f9d x:0 0 0 2024-09-18T12:51:16.096 INFO:tasks.workunit.client.1.smithi136.stdout:4/506: readlink d0/d25/l30 0 2024-09-18T12:51:16.096 INFO:tasks.workunit.client.1.smithi136.stdout:4/507: write d0/d2/f8c [950257,25239] 0 2024-09-18T12:51:16.098 INFO:tasks.workunit.client.1.smithi136.stdout:4/508: rename d0/d2/f8c to d0/d25/d83/f9e 0 2024-09-18T12:51:16.099 INFO:tasks.workunit.client.1.smithi136.stdout:4/509: mknod d0/d45/d67/c9f 0 2024-09-18T12:51:16.099 INFO:tasks.workunit.client.1.smithi136.stdout:4/510: fsync d0/d3/d54/f92 0 2024-09-18T12:51:16.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:15 smithi081 ceph-mon[27646]: pgmap v280: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 139 MiB/s rd, 183 MiB/s wr, 599 op/s 2024-09-18T12:51:16.109 INFO:tasks.workunit.client.1.smithi136.stdout:8/714: dwrite d9/d18/d34/d3d/d47/d65/d92/ff5 [0,4194304] 0 2024-09-18T12:51:16.109 INFO:tasks.workunit.client.1.smithi136.stdout:2/614: dwrite d5/d25/d2d/f6d [0,4194304] 0 2024-09-18T12:51:16.112 INFO:tasks.workunit.client.1.smithi136.stdout:8/715: mkdir d9/d14/d1a/d2b/d42/d104 0 2024-09-18T12:51:16.112 INFO:tasks.workunit.client.1.smithi136.stdout:8/716: dread - d9/d14/d1a/d2b/d42/d9e/fc3 zero size 2024-09-18T12:51:16.112 INFO:tasks.workunit.client.1.smithi136.stdout:8/717: creat d9/d18/d34/d88/f105 x:0 0 0 2024-09-18T12:51:16.113 INFO:tasks.workunit.client.1.smithi136.stdout:2/615: mkdir d5/d7/dbf 0 2024-09-18T12:51:16.114 INFO:tasks.workunit.client.1.smithi136.stdout:4/511: write d0/d2/f23 [4227582,124920] 0 2024-09-18T12:51:16.119 INFO:tasks.workunit.client.1.smithi136.stdout:8/718: mkdir d9/d18/d34/d3d/d47/dbe/d106 0 2024-09-18T12:51:16.120 INFO:tasks.workunit.client.1.smithi136.stdout:4/512: mkdir d0/d2/d85/da0 0 2024-09-18T12:51:16.122 INFO:tasks.workunit.client.1.smithi136.stdout:8/719: rename d9/d14/d1a/d7f/d8c/dcb/fd6 to d9/d14/d1a/d7f/f107 0 2024-09-18T12:51:16.123 INFO:tasks.workunit.client.1.smithi136.stdout:8/720: read - d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 zero size 2024-09-18T12:51:16.124 INFO:tasks.workunit.client.1.smithi136.stdout:4/513: rename d0/d3/d54/d5c/f64 to d0/d3/d54/d5c/fa1 0 2024-09-18T12:51:16.126 INFO:tasks.workunit.client.1.smithi136.stdout:1/558: sync 2024-09-18T12:51:16.126 INFO:tasks.workunit.client.1.smithi136.stdout:5/651: sync 2024-09-18T12:51:16.128 INFO:tasks.workunit.client.1.smithi136.stdout:1/559: unlink d2/d5/d2b/d34/l7e 0 2024-09-18T12:51:16.128 INFO:tasks.workunit.client.1.smithi136.stdout:1/560: fdatasync d2/d5/d2b/d9b/f71 0 2024-09-18T12:51:16.128 INFO:tasks.workunit.client.1.smithi136.stdout:1/561: write d2/d5/d2b/d9b/d2e/d9a/fad [376762,5817] 0 2024-09-18T12:51:16.128 INFO:tasks.workunit.client.1.smithi136.stdout:5/652: mknod d5/d1a/d2d/d34/d4e/d7a/d9e/da9/ccc 0 2024-09-18T12:51:16.130 INFO:tasks.workunit.client.1.smithi136.stdout:1/562: rename d2/d5/d2b/d9b/f71 to d2/d5/d2b/da9/fb6 0 2024-09-18T12:51:16.130 INFO:tasks.workunit.client.1.smithi136.stdout:1/563: fsync d2/d5/f5a 0 2024-09-18T12:51:16.130 INFO:tasks.workunit.client.1.smithi136.stdout:1/564: write d2/d5/d2b/d9b/d2e/d4c/f59 [4197521,75322] 0 2024-09-18T12:51:16.130 INFO:tasks.workunit.client.1.smithi136.stdout:1/565: write d2/d5/d2b/d9b/d2e/f79 [2157333,87369] 0 2024-09-18T12:51:16.130 INFO:tasks.workunit.client.1.smithi136.stdout:1/566: read - d2/f5b zero size 2024-09-18T12:51:16.131 INFO:tasks.workunit.client.1.smithi136.stdout:1/567: write d2/f42 [720160,81502] 0 2024-09-18T12:51:16.131 INFO:tasks.workunit.client.1.smithi136.stdout:1/568: write d2/f78 [679662,50196] 0 2024-09-18T12:51:16.131 INFO:tasks.workunit.client.1.smithi136.stdout:5/653: mknod d5/d1a/d2d/d3f/d7f/ccd 0 2024-09-18T12:51:16.131 INFO:tasks.workunit.client.1.smithi136.stdout:5/654: write d5/d1a/fc1 [296176,118261] 0 2024-09-18T12:51:16.131 INFO:tasks.workunit.client.1.smithi136.stdout:2/616: dwrite d5/d7/d11/d34/f9e [0,4194304] 0 2024-09-18T12:51:16.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/569: mknod d2/d5/d2b/d9b/cb7 0 2024-09-18T12:51:16.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/570: fsync d2/d5/d2b/d34/d86/f2c 0 2024-09-18T12:51:16.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/571: truncate d2/d5/d2b/d9b/d1b/f77 1576968 0 2024-09-18T12:51:16.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/572: stat d2/d5/d2b/d9b/d2e/d4c/f89 0 2024-09-18T12:51:16.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/573: chown d2/f42 1463274580 1 2024-09-18T12:51:16.135 INFO:tasks.workunit.client.1.smithi136.stdout:1/574: link d2/d5/d2b/d9b/d2e/d4c/f59 d2/d5/d2b/d34/d86/fb8 0 2024-09-18T12:51:16.142 INFO:tasks.workunit.client.1.smithi136.stdout:4/514: dwrite d0/d13/f7f [4194304,4194304] 0 2024-09-18T12:51:16.144 INFO:tasks.workunit.client.1.smithi136.stdout:4/515: mknod d0/d3/d54/d88/ca2 0 2024-09-18T12:51:16.144 INFO:tasks.workunit.client.1.smithi136.stdout:4/516: fdatasync d0/f15 0 2024-09-18T12:51:16.147 INFO:tasks.workunit.client.1.smithi136.stdout:4/517: creat d0/d25/d83/fa3 x:0 0 0 2024-09-18T12:51:16.147 INFO:tasks.workunit.client.1.smithi136.stdout:4/518: chown d0/d5f/f93 431 1 2024-09-18T12:51:16.148 INFO:tasks.workunit.client.1.smithi136.stdout:4/519: write d0/d25/f39 [188814,21251] 0 2024-09-18T12:51:16.150 INFO:tasks.workunit.client.1.smithi136.stdout:4/520: rename d0/d25/f2d to d0/d3/d54/fa4 0 2024-09-18T12:51:16.150 INFO:tasks.workunit.client.1.smithi136.stdout:4/521: chown d0/d3/d54/l6d 9 1 2024-09-18T12:51:16.150 INFO:tasks.workunit.client.1.smithi136.stdout:4/522: dread - d0/d3/d54/f92 zero size 2024-09-18T12:51:16.150 INFO:tasks.workunit.client.1.smithi136.stdout:4/523: creat d0/d3/fa5 x:0 0 0 2024-09-18T12:51:16.160 INFO:tasks.workunit.client.0.smithi081.stdout:5/358: sync 2024-09-18T12:51:16.161 INFO:tasks.workunit.client.1.smithi136.stdout:5/655: dwrite d5/f18 [0,4194304] 0 2024-09-18T12:51:16.175 INFO:tasks.workunit.client.1.smithi136.stdout:5/656: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:16.176 INFO:tasks.workunit.client.1.smithi136.stdout:5/657: read d5/d1a/d2d/f87 [4386,16148] 0 2024-09-18T12:51:16.181 INFO:tasks.workunit.client.1.smithi136.stdout:1/575: dwrite d2/d5/d2b/d9b/d2e/f6b [0,4194304] 0 2024-09-18T12:51:16.181 INFO:tasks.workunit.client.1.smithi136.stdout:2/617: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:16.182 INFO:tasks.workunit.client.1.smithi136.stdout:4/524: dwrite d0/d2/f49 [0,4194304] 0 2024-09-18T12:51:16.182 INFO:tasks.workunit.client.1.smithi136.stdout:4/525: chown d0/d25/c6e 616735 1 2024-09-18T12:51:16.182 INFO:tasks.workunit.client.0.smithi081.stdout:5/359: dwrite d2/f66 [0,4194304] 0 2024-09-18T12:51:16.184 INFO:tasks.workunit.client.1.smithi136.stdout:1/576: mknod d2/d5/d2b/cb9 0 2024-09-18T12:51:16.187 INFO:tasks.workunit.client.0.smithi081.stdout:6/273: sync 2024-09-18T12:51:16.189 INFO:tasks.workunit.client.1.smithi136.stdout:2/618: link d5/f65 d5/d7/d17/d48/db1/fc0 0 2024-09-18T12:51:16.189 INFO:tasks.workunit.client.1.smithi136.stdout:2/619: stat d5/d7/d11/d34/f50 0 2024-09-18T12:51:16.189 INFO:tasks.workunit.client.0.smithi081.stdout:6/274: mkdir d4/d12/d1c/d39/d40/d54 0 2024-09-18T12:51:16.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/620: mkdir d5/d7/d17/d48/dc1 0 2024-09-18T12:51:16.197 INFO:tasks.workunit.client.1.smithi136.stdout:2/621: rename d5/d7/d17/f6b to d5/d7/d17/d48/db1/fc2 0 2024-09-18T12:51:16.198 INFO:tasks.workunit.client.1.smithi136.stdout:2/622: dread - d5/d7/d41/d53/fba zero size 2024-09-18T12:51:16.198 INFO:tasks.workunit.client.1.smithi136.stdout:2/623: stat d5/d7/d17/l9c 0 2024-09-18T12:51:16.198 INFO:tasks.workunit.client.1.smithi136.stdout:2/624: creat d5/d25/d43/fc3 x:0 0 0 2024-09-18T12:51:16.200 INFO:tasks.workunit.client.1.smithi136.stdout:2/625: creat d5/d4a/d7a/fc4 x:0 0 0 2024-09-18T12:51:16.200 INFO:tasks.workunit.client.1.smithi136.stdout:2/626: write d5/d25/d43/d74/fa9 [9793,95972] 0 2024-09-18T12:51:16.200 INFO:tasks.workunit.client.1.smithi136.stdout:2/627: chown d5/d4a/d7a/c9f 1345037523 1 2024-09-18T12:51:16.202 INFO:tasks.workunit.client.1.smithi136.stdout:2/628: unlink d5/d4a/d67/c85 0 2024-09-18T12:51:16.202 INFO:tasks.workunit.client.1.smithi136.stdout:2/629: fdatasync d5/d25/f2e 0 2024-09-18T12:51:16.202 INFO:tasks.workunit.client.1.smithi136.stdout:2/630: chown d5/d25/l5d 81 1 2024-09-18T12:51:16.206 INFO:tasks.workunit.client.1.smithi136.stdout:2/631: dread d5/d7/d11/d34/fa7 [0,4194304] 0 2024-09-18T12:51:16.216 INFO:tasks.workunit.client.1.smithi136.stdout:5/658: dwrite d5/d1a/d2d/d34/d4e/d7a/f9f [0,4194304] 0 2024-09-18T12:51:16.219 INFO:tasks.workunit.client.1.smithi136.stdout:5/659: link d5/d1a/d4a/d79/lb1 d5/d1a/d2d/d34/lce 0 2024-09-18T12:51:16.219 INFO:tasks.workunit.client.1.smithi136.stdout:5/660: write d5/d1a/d30/f3b [885563,126712] 0 2024-09-18T12:51:16.219 INFO:tasks.workunit.client.1.smithi136.stdout:5/661: write d5/d1a/d2d/d3f/fc6 [736411,11809] 0 2024-09-18T12:51:16.219 INFO:tasks.workunit.client.1.smithi136.stdout:5/662: chown d5/db4 16387132 1 2024-09-18T12:51:16.219 INFO:tasks.workunit.client.1.smithi136.stdout:5/663: creat d5/d1a/d2d/d3f/fcf x:0 0 0 2024-09-18T12:51:16.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/360: dwrite d2/dd/d5e/f3c [0,4194304] 0 2024-09-18T12:51:16.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/275: dwrite d4/f21 [0,4194304] 0 2024-09-18T12:51:16.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/276: stat d4/d12/d1c/c29 0 2024-09-18T12:51:16.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/632: dwrite d5/d4a/d67/f75 [0,4194304] 0 2024-09-18T12:51:16.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/633: write d5/d4a/d67/fb4 [648262,53518] 0 2024-09-18T12:51:16.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/634: creat d5/d25/d43/fc5 x:0 0 0 2024-09-18T12:51:16.223 INFO:tasks.workunit.client.1.smithi136.stdout:2/635: readlink d5/d25/l5d 0 2024-09-18T12:51:16.223 INFO:tasks.workunit.client.1.smithi136.stdout:1/577: dwrite d2/d5/d2b/d9b/f19 [0,4194304] 0 2024-09-18T12:51:16.226 INFO:tasks.workunit.client.0.smithi081.stdout:6/277: symlink d4/d6/l55 0 2024-09-18T12:51:16.226 INFO:tasks.workunit.client.0.smithi081.stdout:6/278: fsync d4/d6/f27 0 2024-09-18T12:51:16.231 INFO:tasks.workunit.client.0.smithi081.stdout:5/361: write d2/d14/d33/d37/d3b/d6a/d20/f30 [2266274,107670] 0 2024-09-18T12:51:16.233 INFO:tasks.workunit.client.0.smithi081.stdout:5/362: getdents d2/d14/d33/d37/d3b/d5f 0 2024-09-18T12:51:16.233 INFO:tasks.workunit.client.0.smithi081.stdout:6/279: dread d4/d12/d28/d2a/d2d/d31/f3b [0,4194304] 0 2024-09-18T12:51:16.233 INFO:tasks.workunit.client.0.smithi081.stdout:6/280: write d4/d12/d28/d2a/d2d/d31/f51 [210639,30346] 0 2024-09-18T12:51:16.235 INFO:tasks.workunit.client.0.smithi081.stdout:6/281: mkdir d4/d12/d56 0 2024-09-18T12:51:16.235 INFO:tasks.workunit.client.0.smithi081.stdout:6/282: creat d4/d12/d1c/f57 x:0 0 0 2024-09-18T12:51:16.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/197: sync 2024-09-18T12:51:16.235 INFO:tasks.workunit.client.0.smithi081.stdout:3/318: sync 2024-09-18T12:51:16.235 INFO:tasks.workunit.client.0.smithi081.stdout:4/270: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:2/369: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:9/198: readlink dd/de/l23 0 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:9/199: chown dd/d15/d1a/l2d 2 1 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:6/283: write d4/d12/d28/d2a/d2d/f4f [117045,17977] 0 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:2/370: dread - d15/d16/d33/d53/d7a/f52 zero size 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:1/307: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/334: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/335: chown d2/d18/d22 278460885 1 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/336: chown d2/d42/l5a 3458030 1 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:0/289: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:8/310: sync 2024-09-18T12:51:16.236 INFO:tasks.workunit.client.0.smithi081.stdout:8/311: write d3/d1d/f4d [666582,18696] 0 2024-09-18T12:51:16.237 INFO:tasks.workunit.client.1.smithi136.stdout:2/636: rename d5/d7/f9a to d5/d7/fc6 0 2024-09-18T12:51:16.237 INFO:tasks.workunit.client.0.smithi081.stdout:5/363: getdents d2/d14/d33/d37/d3b/d6a 0 2024-09-18T12:51:16.237 INFO:tasks.workunit.client.0.smithi081.stdout:5/364: dread d2/dd/d5e/f40 [4194304,4194304] 0 2024-09-18T12:51:16.238 INFO:tasks.workunit.client.0.smithi081.stdout:4/271: mknod d3/d59/d14/d4b/c61 0 2024-09-18T12:51:16.238 INFO:tasks.workunit.client.0.smithi081.stdout:5/365: fsync d2/d14/d33/d37/d3b/d5f/f6e 0 2024-09-18T12:51:16.238 INFO:tasks.workunit.client.1.smithi136.stdout:1/578: rename d2/d5/d2b/d34/d5c/l76 to d2/d5/d2b/lba 0 2024-09-18T12:51:16.238 INFO:tasks.workunit.client.1.smithi136.stdout:1/579: read d2/d5/d2b/d9b/d2e/f31 [2120704,60880] 0 2024-09-18T12:51:16.239 INFO:tasks.workunit.client.0.smithi081.stdout:6/284: creat d4/f58 x:0 0 0 2024-09-18T12:51:16.240 INFO:tasks.workunit.client.0.smithi081.stdout:2/371: creat d15/d26/d4d/f7c x:0 0 0 2024-09-18T12:51:16.240 INFO:tasks.workunit.client.0.smithi081.stdout:2/372: creat d15/d26/d4d/f7d x:0 0 0 2024-09-18T12:51:16.240 INFO:tasks.workunit.client.1.smithi136.stdout:2/637: creat d5/d7/d17/fc7 x:0 0 0 2024-09-18T12:51:16.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/308: mknod d0/d18/d6a/c6f 0 2024-09-18T12:51:16.242 INFO:tasks.workunit.client.0.smithi081.stdout:7/337: mkdir d2/d7f 0 2024-09-18T12:51:16.244 INFO:tasks.workunit.client.1.smithi136.stdout:2/638: unlink d5/d4a/d67/c7c 0 2024-09-18T12:51:16.244 INFO:tasks.workunit.client.0.smithi081.stdout:0/290: unlink d7/l2d 0 2024-09-18T12:51:16.244 INFO:tasks.workunit.client.0.smithi081.stdout:0/291: chown d7/d9/d4b/d53 120530250 1 2024-09-18T12:51:16.244 INFO:tasks.workunit.client.0.smithi081.stdout:0/292: fdatasync d7/d9/d4b/d4a/f1e 0 2024-09-18T12:51:16.245 INFO:tasks.workunit.client.0.smithi081.stdout:8/312: creat d3/d2f/f72 x:0 0 0 2024-09-18T12:51:16.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/373: rename d15/f1e to d15/d26/f7e 0 2024-09-18T12:51:16.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/374: chown d15/d16/d54/c56 37571623 1 2024-09-18T12:51:16.249 INFO:tasks.workunit.client.0.smithi081.stdout:7/338: link d2/d1d/d27/l7b d2/d18/d22/d48/l80 0 2024-09-18T12:51:16.249 INFO:tasks.workunit.client.0.smithi081.stdout:7/339: chown d2/f9 8502 1 2024-09-18T12:51:16.250 INFO:tasks.workunit.client.0.smithi081.stdout:8/313: mkdir d3/d73 0 2024-09-18T12:51:16.250 INFO:tasks.workunit.client.0.smithi081.stdout:8/314: creat d3/d1e/d4c/d53/f74 x:0 0 0 2024-09-18T12:51:16.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/375: mkdir d15/d6e/d7f 0 2024-09-18T12:51:16.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/376: write d15/d16/d33/d53/f79 [1569002,40741] 0 2024-09-18T12:51:16.252 INFO:tasks.workunit.client.0.smithi081.stdout:7/340: rmdir d2/d18/d60 39 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.0.smithi081.stdout:0/293: getdents d7/d9/d4b/d3d 0 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.1.smithi136.stdout:1/580: dread d2/d5/d2b/d9b/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.1.smithi136.stdout:2/639: rename d5/d7/d11/c4d to d5/d7/d11/d34/cc8 0 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.1.smithi136.stdout:2/640: creat d5/d25/d2d/d9d/da2/fc9 x:0 0 0 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.1.smithi136.stdout:2/641: stat d5/d25/f6c 0 2024-09-18T12:51:16.253 INFO:tasks.workunit.client.1.smithi136.stdout:2/642: dread - d5/d25/d43/f89 zero size 2024-09-18T12:51:16.254 INFO:tasks.workunit.client.1.smithi136.stdout:1/581: mknod d2/d5/d2b/d9b/d2e/d4c/d8e/cbb 0 2024-09-18T12:51:16.254 INFO:tasks.workunit.client.1.smithi136.stdout:1/582: truncate d2/d5/d2b/f4a 866457 0 2024-09-18T12:51:16.254 INFO:tasks.workunit.client.1.smithi136.stdout:1/583: chown d2/d5/d2b/c40 65325715 1 2024-09-18T12:51:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:8/315: symlink d3/d1d/l75 0 2024-09-18T12:51:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/319: write d3/db/df/d60/f5c [2681738,27632] 0 2024-09-18T12:51:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/320: stat d3/db/f4b 0 2024-09-18T12:51:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:0/294: unlink d7/d4f/l57 0 2024-09-18T12:51:16.257 INFO:tasks.workunit.client.1.smithi136.stdout:2/643: mkdir d5/d25/d43/d74/dca 0 2024-09-18T12:51:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:6/285: read d4/d12/d28/d2a/f4b [2628121,38310] 0 2024-09-18T12:51:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:6/286: fsync d4/d12/d1c/f48 0 2024-09-18T12:51:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:6/287: write d4/d12/d28/d2a/d2d/d31/f51 [590214,32844] 0 2024-09-18T12:51:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:6/288: write d4/d6/f27 [4565004,110579] 0 2024-09-18T12:51:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:2/377: write f7 [3629513,91502] 0 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:0/295: symlink d7/l60 0 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:3/321: creat d3/db/dc/f73 x:0 0 0 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:0/296: dread - d7/d4f/f5a zero size 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:0/297: write d7/d9/d4b/f38 [148309,112137] 0 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:0/298: dread - d7/d4f/f5a zero size 2024-09-18T12:51:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:0/299: chown d7/c20 204368 1 2024-09-18T12:51:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:9/200: dwrite dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:7/341: write d2/d18/d22/f25 [662019,941] 0 2024-09-18T12:51:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:7/342: fsync d2/d1d/f38 0 2024-09-18T12:51:16.266 INFO:tasks.workunit.client.1.smithi136.stdout:5/664: rmdir d5/d1a 39 2024-09-18T12:51:16.266 INFO:tasks.workunit.client.1.smithi136.stdout:5/665: truncate d5/d1a/d2d/d3f/f8a 1508185 0 2024-09-18T12:51:16.266 INFO:tasks.workunit.client.1.smithi136.stdout:1/584: symlink d2/d5/d2b/d63/lbc 0 2024-09-18T12:51:16.268 INFO:tasks.workunit.client.1.smithi136.stdout:2/644: creat d5/d4a/fcb x:0 0 0 2024-09-18T12:51:16.268 INFO:tasks.workunit.client.1.smithi136.stdout:2/645: fsync d5/d7/d11/d34/f9e 0 2024-09-18T12:51:16.268 INFO:tasks.workunit.client.1.smithi136.stdout:2/646: readlink d5/d25/l91 0 2024-09-18T12:51:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:6/289: mkdir d4/d12/d28/d59 0 2024-09-18T12:51:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:4/272: dwrite d3/d59/d14/f1e [0,4194304] 0 2024-09-18T12:51:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:4/273: write d3/d59/f21 [760724,16879] 0 2024-09-18T12:51:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:2/378: unlink d15/d16/d33/d53/d7a/c6c 0 2024-09-18T12:51:16.273 INFO:tasks.workunit.client.1.smithi136.stdout:9/606: sync 2024-09-18T12:51:16.273 INFO:tasks.workunit.client.1.smithi136.stdout:0/663: sync 2024-09-18T12:51:16.273 INFO:tasks.workunit.client.1.smithi136.stdout:3/600: sync 2024-09-18T12:51:16.273 INFO:tasks.workunit.client.1.smithi136.stdout:7/689: sync 2024-09-18T12:51:16.274 INFO:tasks.workunit.client.0.smithi081.stdout:7/343: creat d2/d14/d21/d49/f81 x:0 0 0 2024-09-18T12:51:16.274 INFO:tasks.workunit.client.0.smithi081.stdout:7/344: chown d2/d18/f3b 92762268 1 2024-09-18T12:51:16.275 INFO:tasks.workunit.client.1.smithi136.stdout:3/601: rename d3/d14/d17/d8c/d96/fb5 to d3/d14/d17/d53/fca 0 2024-09-18T12:51:16.275 INFO:tasks.workunit.client.1.smithi136.stdout:3/602: chown d3/d14/dc5/l45 1084978 1 2024-09-18T12:51:16.275 INFO:tasks.workunit.client.1.smithi136.stdout:3/603: chown d3/d14/d18/d7f/l6a 2 1 2024-09-18T12:51:16.275 INFO:tasks.workunit.client.1.smithi136.stdout:3/604: read - d3/d14/d17/d53/d73/fa5 zero size 2024-09-18T12:51:16.276 INFO:tasks.workunit.client.0.smithi081.stdout:6/290: symlink d4/d12/l5a 0 2024-09-18T12:51:16.276 INFO:tasks.workunit.client.1.smithi136.stdout:0/664: mknod d1/db/d76/db9/de5/db5/ce6 0 2024-09-18T12:51:16.276 INFO:tasks.workunit.client.0.smithi081.stdout:7/345: dread d2/f6 [0,4194304] 0 2024-09-18T12:51:16.277 INFO:tasks.workunit.client.0.smithi081.stdout:7/346: chown d2/d1d/d27/f7d 0 1 2024-09-18T12:51:16.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/291: read d4/d12/d28/d2a/d2d/d31/f3d [85403,47804] 0 2024-09-18T12:51:16.277 INFO:tasks.workunit.client.0.smithi081.stdout:6/292: write d4/d12/d28/d2a/f4b [4830424,37175] 0 2024-09-18T12:51:16.277 INFO:tasks.workunit.client.1.smithi136.stdout:9/607: mknod d6/db/cd0 0 2024-09-18T12:51:16.277 INFO:tasks.workunit.client.1.smithi136.stdout:9/608: fsync d6/df/f3b 0 2024-09-18T12:51:16.278 INFO:tasks.workunit.client.0.smithi081.stdout:2/379: creat d15/d16/d33/d53/d7a/d2f/d61/f80 x:0 0 0 2024-09-18T12:51:16.278 INFO:tasks.workunit.client.1.smithi136.stdout:7/690: mkdir d0/d35/d41/df3 0 2024-09-18T12:51:16.279 INFO:tasks.workunit.client.0.smithi081.stdout:0/300: rmdir d7/d9/d4b 39 2024-09-18T12:51:16.279 INFO:tasks.workunit.client.0.smithi081.stdout:0/301: chown d7/c14 1010414300 1 2024-09-18T12:51:16.279 INFO:tasks.workunit.client.1.smithi136.stdout:0/665: mknod d1/d3/d1a/d98/d81/d35/ddc/ce7 0 2024-09-18T12:51:16.279 INFO:tasks.workunit.client.1.smithi136.stdout:0/666: stat d1/d3/d1a/d62/fa5 0 2024-09-18T12:51:16.280 INFO:tasks.workunit.client.0.smithi081.stdout:9/201: getdents dd/d15 0 2024-09-18T12:51:16.280 INFO:tasks.workunit.client.1.smithi136.stdout:6/580: sync 2024-09-18T12:51:16.280 INFO:tasks.workunit.client.1.smithi136.stdout:6/581: write d8/d9/d56/f78 [918665,28456] 0 2024-09-18T12:51:16.281 INFO:tasks.workunit.client.1.smithi136.stdout:9/609: mkdir d6/da/dd1 0 2024-09-18T12:51:16.281 INFO:tasks.workunit.client.1.smithi136.stdout:9/610: write d6/da/d3d/d4d/d91/f16 [2383455,864] 0 2024-09-18T12:51:16.282 INFO:tasks.workunit.client.0.smithi081.stdout:6/293: rename d4/d12/d28/f36 to d4/d12/d1c/f5b 0 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/294: stat d4/d12/d1c/d39/f4a 0 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/295: read d4/d12/d28/d2a/d2d/d31/f3d [236231,46333] 0 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:2/380: rmdir d15/d16/d33 39 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:2/381: fdatasync d15/d16/f18 0 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:2/382: write d15/d26/f72 [961348,85603] 0 2024-09-18T12:51:16.283 INFO:tasks.workunit.client.0.smithi081.stdout:1/309: dwrite d0/d6/d33/d37/f6d [0,4194304] 0 2024-09-18T12:51:16.284 INFO:tasks.workunit.client.0.smithi081.stdout:0/302: creat d7/d9/d4b/d53/f61 x:0 0 0 2024-09-18T12:51:16.285 INFO:tasks.workunit.client.0.smithi081.stdout:8/316: dwrite d3/d1e/d4c/f69 [0,4194304] 0 2024-09-18T12:51:16.285 INFO:tasks.workunit.client.0.smithi081.stdout:0/303: readlink l2 0 2024-09-18T12:51:16.285 INFO:tasks.workunit.client.1.smithi136.stdout:5/666: dread d5/f4f [0,4194304] 0 2024-09-18T12:51:16.285 INFO:tasks.workunit.client.1.smithi136.stdout:0/667: mkdir d1/d3/d1a/d98/d81/d72/de8 0 2024-09-18T12:51:16.286 INFO:tasks.workunit.client.1.smithi136.stdout:5/667: readlink d5/d1a/d30/l49 0 2024-09-18T12:51:16.286 INFO:tasks.workunit.client.1.smithi136.stdout:0/668: fsync d1/d46/fb0 0 2024-09-18T12:51:16.286 INFO:tasks.workunit.client.0.smithi081.stdout:9/202: unlink dd/d15/d1a/d35/f36 0 2024-09-18T12:51:16.286 INFO:tasks.workunit.client.1.smithi136.stdout:7/691: dread d0/d39/d4d/f9c [0,4194304] 0 2024-09-18T12:51:16.287 INFO:tasks.workunit.client.1.smithi136.stdout:2/647: dread d5/d25/f40 [0,4194304] 0 2024-09-18T12:51:16.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/347: getdents d2/d18 0 2024-09-18T12:51:16.289 INFO:tasks.workunit.client.0.smithi081.stdout:2/383: dread d15/d26/f7e [0,4194304] 0 2024-09-18T12:51:16.289 INFO:tasks.workunit.client.1.smithi136.stdout:5/668: creat d5/d1a/fd0 x:0 0 0 2024-09-18T12:51:16.291 INFO:tasks.workunit.client.0.smithi081.stdout:6/296: rename d4/d12/d28/d2a/d2d/f30 to d4/f5c 0 2024-09-18T12:51:16.291 INFO:tasks.workunit.client.0.smithi081.stdout:6/297: write d4/f13 [2631717,44711] 0 2024-09-18T12:51:16.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/322: write d3/db/df/d29/f64 [478091,42862] 0 2024-09-18T12:51:16.292 INFO:tasks.workunit.client.0.smithi081.stdout:5/366: dwrite d2/d14/d33/d37/d3b/f38 [0,4194304] 0 2024-09-18T12:51:16.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/323: readlink d3/db/df/d29/l4d 0 2024-09-18T12:51:16.293 INFO:tasks.workunit.client.1.smithi136.stdout:0/669: mknod d1/db/d76/db9/ce9 0 2024-09-18T12:51:16.295 INFO:tasks.workunit.client.1.smithi136.stdout:7/692: creat d0/d39/dbf/ff4 x:0 0 0 2024-09-18T12:51:16.296 INFO:tasks.workunit.client.1.smithi136.stdout:8/721: sync 2024-09-18T12:51:16.296 INFO:tasks.workunit.client.1.smithi136.stdout:8/722: readlink d9/d18/d34/l39 0 2024-09-18T12:51:16.296 INFO:tasks.workunit.client.1.smithi136.stdout:4/526: sync 2024-09-18T12:51:16.296 INFO:tasks.workunit.client.1.smithi136.stdout:4/527: readlink d0/d3/l42 0 2024-09-18T12:51:16.296 INFO:tasks.workunit.client.1.smithi136.stdout:4/528: creat d0/d5f/fa6 x:0 0 0 2024-09-18T12:51:16.297 INFO:tasks.workunit.client.0.smithi081.stdout:1/310: truncate d0/d18/f38 226113 0 2024-09-18T12:51:16.297 INFO:tasks.workunit.client.1.smithi136.stdout:2/648: link d5/d25/c79 d5/d7/d11/ccc 0 2024-09-18T12:51:16.299 INFO:tasks.workunit.client.1.smithi136.stdout:8/723: symlink d9/d14/d1a/d2b/deb/l108 0 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.1.smithi136.stdout:8/724: write d9/d14/f71 [456604,71273] 0 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.1.smithi136.stdout:0/670: chown d1/d3/d1a/d98/d81/l3c 2957276 1 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/582: dread d8/d9/d3c/d4a/f54 [0,4194304] 0 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/583: dread - d8/daa/fb0 zero size 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/584: chown d8/c66 97992 1 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.0.smithi081.stdout:8/317: stat d3/l20 0 2024-09-18T12:51:16.300 INFO:tasks.workunit.client.0.smithi081.stdout:8/318: stat d3/d1d/l35 0 2024-09-18T12:51:16.302 INFO:tasks.workunit.client.1.smithi136.stdout:2/649: rename d5/d7/d17/d48/f93 to d5/d25/d43/d74/fcd 0 2024-09-18T12:51:16.302 INFO:tasks.workunit.client.1.smithi136.stdout:0/671: symlink d1/d3/d1a/d98/d81/d35/lea 0 2024-09-18T12:51:16.302 INFO:tasks.workunit.client.0.smithi081.stdout:0/304: symlink d7/d9/d4b/d4a/l62 0 2024-09-18T12:51:16.302 INFO:tasks.workunit.client.0.smithi081.stdout:0/305: readlink d7/d9/d12/l40 0 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:9/611: read d6/df/d23/fa1 [3976824,89592] 0 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:9/612: dread - d6/df/fc6 zero size 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:9/613: chown d6/d59/lb9 29145 1 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:4/529: symlink d0/la7 0 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:4/530: truncate d0/d5f/fa6 369055 0 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:4/531: dread - d0/d45/f62 zero size 2024-09-18T12:51:16.303 INFO:tasks.workunit.client.1.smithi136.stdout:4/532: stat d0/d5f/f75 0 2024-09-18T12:51:16.304 INFO:tasks.workunit.client.1.smithi136.stdout:2/650: symlink d5/d7/d41/d53/lce 0 2024-09-18T12:51:16.304 INFO:tasks.workunit.client.1.smithi136.stdout:0/672: mkdir d1/d3/d1a/d95/deb 0 2024-09-18T12:51:16.304 INFO:tasks.workunit.client.1.smithi136.stdout:0/673: dread - d1/d3/d1a/d98/d81/d72/f73 zero size 2024-09-18T12:51:16.305 INFO:tasks.workunit.client.0.smithi081.stdout:9/203: mknod dd/d15/c3c 0 2024-09-18T12:51:16.305 INFO:tasks.workunit.client.1.smithi136.stdout:9/614: symlink d6/da/d3d/d4d/d91/d38/dbc/ld2 0 2024-09-18T12:51:16.306 INFO:tasks.workunit.client.1.smithi136.stdout:3/605: dwrite d3/d2b/f4b [0,4194304] 0 2024-09-18T12:51:16.306 INFO:tasks.workunit.client.0.smithi081.stdout:6/298: mknod d4/d12/d1c/d39/d40/d54/c5d 0 2024-09-18T12:51:16.307 INFO:tasks.workunit.client.1.smithi136.stdout:3/606: chown d3/d10/d4a 0 1 2024-09-18T12:51:16.307 INFO:tasks.workunit.client.1.smithi136.stdout:0/674: symlink d1/d3/d1a/d98/lec 0 2024-09-18T12:51:16.308 INFO:tasks.workunit.client.1.smithi136.stdout:0/675: fdatasync d1/db/f3e 0 2024-09-18T12:51:16.308 INFO:tasks.workunit.client.1.smithi136.stdout:0/676: dread - d1/d3/d1a/d98/d81/d51/fd7 zero size 2024-09-18T12:51:16.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/324: getdents d3/db/df/d3b 0 2024-09-18T12:51:16.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/325: write d3/db/df/f6d [145362,31602] 0 2024-09-18T12:51:16.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/326: write d3/db/df/d29/d13/f61 [142937,44206] 0 2024-09-18T12:51:16.310 INFO:tasks.workunit.client.1.smithi136.stdout:2/651: getdents d5/d7/d41 0 2024-09-18T12:51:16.310 INFO:tasks.workunit.client.0.smithi081.stdout:7/348: dread d2/fe [0,4194304] 0 2024-09-18T12:51:16.310 INFO:tasks.workunit.client.0.smithi081.stdout:4/274: dwrite d3/d20/d3d/f5d [0,4194304] 0 2024-09-18T12:51:16.311 INFO:tasks.workunit.client.0.smithi081.stdout:4/275: readlink d3/db/d2d/l2e 0 2024-09-18T12:51:16.311 INFO:tasks.workunit.client.0.smithi081.stdout:4/276: chown d3/d59/f2c 4 1 2024-09-18T12:51:16.311 INFO:tasks.workunit.client.0.smithi081.stdout:5/367: dread d2/f66 [0,4194304] 0 2024-09-18T12:51:16.311 INFO:tasks.workunit.client.1.smithi136.stdout:0/677: mknod d1/d60/dcb/ced 0 2024-09-18T12:51:16.311 INFO:tasks.workunit.client.0.smithi081.stdout:8/319: mknod d3/d73/c76 0 2024-09-18T12:51:16.313 INFO:tasks.workunit.client.1.smithi136.stdout:9/615: mkdir d6/df/dd3 0 2024-09-18T12:51:16.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/533: dread d0/d13/f6c [0,4194304] 0 2024-09-18T12:51:16.314 INFO:tasks.workunit.client.1.smithi136.stdout:4/534: creat d0/d2/fa8 x:0 0 0 2024-09-18T12:51:16.314 INFO:tasks.workunit.client.1.smithi136.stdout:2/652: link d5/d7/d17/d48/f97 d5/d7/d11/d34/fcf 0 2024-09-18T12:51:16.314 INFO:tasks.workunit.client.0.smithi081.stdout:0/306: link d7/d9/f10 d7/d9/d4b/f63 0 2024-09-18T12:51:16.316 INFO:tasks.workunit.client.1.smithi136.stdout:0/678: mkdir d1/d60/dcb/dee 0 2024-09-18T12:51:16.316 INFO:tasks.workunit.client.1.smithi136.stdout:0/679: creat d1/d3/d1a/d98/d81/d70/dbc/fef x:0 0 0 2024-09-18T12:51:16.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/680: dread - d1/d3/d1a/d98/d81/d51/fb4 zero size 2024-09-18T12:51:16.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/681: write d1/d3/d1a/d98/d81/d72/f73 [602070,116953] 0 2024-09-18T12:51:16.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/682: write d1/d17/f4c [4578219,43455] 0 2024-09-18T12:51:16.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/683: write d1/d3/d1a/d98/d81/d51/fd7 [134608,55336] 0 2024-09-18T12:51:16.317 INFO:tasks.workunit.client.0.smithi081.stdout:2/384: dread d15/d16/d20/d31/f42 [0,4194304] 0 2024-09-18T12:51:16.318 INFO:tasks.workunit.client.1.smithi136.stdout:2/653: dread d5/d7/f8b [0,4194304] 0 2024-09-18T12:51:16.318 INFO:tasks.workunit.client.1.smithi136.stdout:2/654: chown d5/d7/d17/d48/db1/fc2 45 1 2024-09-18T12:51:16.319 INFO:tasks.workunit.client.0.smithi081.stdout:9/204: dread f0 [0,4194304] 0 2024-09-18T12:51:16.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/585: dread d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:16.323 INFO:tasks.workunit.client.1.smithi136.stdout:5/669: dwrite d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 [0,4194304] 0 2024-09-18T12:51:16.323 INFO:tasks.workunit.client.1.smithi136.stdout:0/684: rename d1/d46/l87 to d1/d3/d1a/d95/lf0 0 2024-09-18T12:51:16.323 INFO:tasks.workunit.client.1.smithi136.stdout:2/655: symlink d5/d7/d17/d48/db2/db8/ld0 0 2024-09-18T12:51:16.323 INFO:tasks.workunit.client.1.smithi136.stdout:0/685: write d1/d3/d1a/d62/fc8 [343939,66470] 0 2024-09-18T12:51:16.325 INFO:tasks.workunit.client.0.smithi081.stdout:7/349: creat d2/d42/f82 x:0 0 0 2024-09-18T12:51:16.327 INFO:tasks.workunit.client.1.smithi136.stdout:9/616: read d6/d59/f2a [4019487,121718] 0 2024-09-18T12:51:16.327 INFO:tasks.workunit.client.1.smithi136.stdout:4/535: dread d0/d45/f55 [0,4194304] 0 2024-09-18T12:51:16.328 INFO:tasks.workunit.client.0.smithi081.stdout:4/277: truncate d3/d59/d14/d27/f37 1789888 0 2024-09-18T12:51:16.328 INFO:tasks.workunit.client.0.smithi081.stdout:5/368: rmdir d2/d14/d1d/d1a 39 2024-09-18T12:51:16.329 INFO:tasks.workunit.client.1.smithi136.stdout:2/656: rmdir d5/d25/d43/d74/dca 0 2024-09-18T12:51:16.329 INFO:tasks.workunit.client.1.smithi136.stdout:6/586: dread d8/d9/d64/fac [0,4194304] 0 2024-09-18T12:51:16.329 INFO:tasks.workunit.client.1.smithi136.stdout:2/657: dread - d5/d7/f78 zero size 2024-09-18T12:51:16.329 INFO:tasks.workunit.client.1.smithi136.stdout:2/658: fdatasync d5/fa1 0 2024-09-18T12:51:16.330 INFO:tasks.workunit.client.1.smithi136.stdout:9/617: creat d6/db/d72/fd4 x:0 0 0 2024-09-18T12:51:16.331 INFO:tasks.workunit.client.1.smithi136.stdout:2/659: mknod d5/d7/d11/cd1 0 2024-09-18T12:51:16.332 INFO:tasks.workunit.client.1.smithi136.stdout:2/660: chown d5/d7/d17/f3c 495238 1 2024-09-18T12:51:16.332 INFO:tasks.workunit.client.0.smithi081.stdout:6/299: symlink d4/d12/d28/d2a/d2d/d31/l5e 0 2024-09-18T12:51:16.332 INFO:tasks.workunit.client.0.smithi081.stdout:2/385: rmdir d15/d26/d4d/d6b 39 2024-09-18T12:51:16.332 INFO:tasks.workunit.client.0.smithi081.stdout:2/386: write d15/d16/d20/f4f [829152,22973] 0 2024-09-18T12:51:16.333 INFO:tasks.workunit.client.0.smithi081.stdout:2/387: truncate d15/d16/d20/d22/d5a/f74 123236 0 2024-09-18T12:51:16.335 INFO:tasks.workunit.client.1.smithi136.stdout:9/618: rename d6/df/d23/d2b/f43 to d6/df/d23/dae/fd5 0 2024-09-18T12:51:16.335 INFO:tasks.workunit.client.1.smithi136.stdout:6/587: dread d8/d9/d3c/d4a/f54 [0,4194304] 0 2024-09-18T12:51:16.335 INFO:tasks.workunit.client.1.smithi136.stdout:4/536: dread d0/d2/f28 [0,4194304] 0 2024-09-18T12:51:16.336 INFO:tasks.workunit.client.0.smithi081.stdout:9/205: unlink dd/d15/f16 0 2024-09-18T12:51:16.336 INFO:tasks.workunit.client.1.smithi136.stdout:2/661: unlink d5/d25/d43/d74/f88 0 2024-09-18T12:51:16.336 INFO:tasks.workunit.client.1.smithi136.stdout:2/662: write d5/d7/d17/d48/db1/fc2 [368929,62152] 0 2024-09-18T12:51:16.336 INFO:tasks.workunit.client.1.smithi136.stdout:9/619: read d6/da/d3d/d4d/d91/d25/f39 [582520,90835] 0 2024-09-18T12:51:16.336 INFO:tasks.workunit.client.1.smithi136.stdout:9/620: creat d6/db/d12/fd6 x:0 0 0 2024-09-18T12:51:16.337 INFO:tasks.workunit.client.0.smithi081.stdout:7/350: creat d2/d7f/f83 x:0 0 0 2024-09-18T12:51:16.337 INFO:tasks.workunit.client.0.smithi081.stdout:7/351: dread - d2/d14/d21/d62/f70 zero size 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:2/663: read d5/d4a/d67/fa8 [57836,45161] 0 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:2/664: readlink d5/d7/d41/d53/l98 0 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:4/537: truncate d0/d13/f6c 333489 0 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:5/670: read d5/d1a/d2d/fb0 [3326856,76813] 0 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:5/671: write d5/d6b/fc5 [850908,114523] 0 2024-09-18T12:51:16.338 INFO:tasks.workunit.client.1.smithi136.stdout:5/672: stat d5/l8 0 2024-09-18T12:51:16.339 INFO:tasks.workunit.client.0.smithi081.stdout:4/278: unlink d3/c2a 0 2024-09-18T12:51:16.340 INFO:tasks.workunit.client.1.smithi136.stdout:2/665: mknod d5/d4a/d64/cd2 0 2024-09-18T12:51:16.340 INFO:tasks.workunit.client.0.smithi081.stdout:5/369: unlink d2/c49 0 2024-09-18T12:51:16.342 INFO:tasks.workunit.client.0.smithi081.stdout:6/300: truncate d4/d12/d28/f34 1240475 0 2024-09-18T12:51:16.342 INFO:tasks.workunit.client.0.smithi081.stdout:6/301: chown d4/d12/d28/d2a/d2d/d31/f51 2 1 2024-09-18T12:51:16.342 INFO:tasks.workunit.client.1.smithi136.stdout:4/538: rename d0/d2/c14 to d0/d3/d54/d8a/ca9 0 2024-09-18T12:51:16.343 INFO:tasks.workunit.client.1.smithi136.stdout:4/539: chown d0/d3/d90 2875 1 2024-09-18T12:51:16.343 INFO:tasks.workunit.client.1.smithi136.stdout:4/540: read - d0/d3/f7d zero size 2024-09-18T12:51:16.343 INFO:tasks.workunit.client.0.smithi081.stdout:3/327: dwrite d3/f46 [4194304,4194304] 0 2024-09-18T12:51:16.344 INFO:tasks.workunit.client.0.smithi081.stdout:2/388: symlink d15/d16/d33/d53/l81 0 2024-09-18T12:51:16.344 INFO:tasks.workunit.client.0.smithi081.stdout:9/206: truncate dd/de/f13 221865 0 2024-09-18T12:51:16.345 INFO:tasks.workunit.client.1.smithi136.stdout:5/673: link d5/d1a/d2d/fb0 d5/d1a/d2d/d34/d4e/fd1 0 2024-09-18T12:51:16.346 INFO:tasks.workunit.client.0.smithi081.stdout:7/352: mkdir d2/d1d/d4e/d84 0 2024-09-18T12:51:16.346 INFO:tasks.workunit.client.1.smithi136.stdout:9/621: link d6/df/c9a d6/d13/d4c/cd7 0 2024-09-18T12:51:16.346 INFO:tasks.workunit.client.1.smithi136.stdout:9/622: fdatasync d6/df/d23/d2b/d79/d53/f54 0 2024-09-18T12:51:16.348 INFO:tasks.workunit.client.0.smithi081.stdout:4/279: creat d3/d59/d14/d54/f62 x:0 0 0 2024-09-18T12:51:16.349 INFO:tasks.workunit.client.1.smithi136.stdout:2/666: mknod d5/d7/d11/d34/cd3 0 2024-09-18T12:51:16.350 INFO:tasks.workunit.client.1.smithi136.stdout:4/541: rmdir d0/d8d 39 2024-09-18T12:51:16.350 INFO:tasks.workunit.client.1.smithi136.stdout:4/542: dread - d0/d3/f97 zero size 2024-09-18T12:51:16.351 INFO:tasks.workunit.client.1.smithi136.stdout:4/543: readlink d0/d2/l3c 0 2024-09-18T12:51:16.352 INFO:tasks.workunit.client.1.smithi136.stdout:9/623: mknod d6/df/d23/d2b/d79/d8b/cd8 0 2024-09-18T12:51:16.352 INFO:tasks.workunit.client.1.smithi136.stdout:9/624: readlink d6/da/d3d/d4d/d91/d38/dbc/lbd 0 2024-09-18T12:51:16.352 INFO:tasks.workunit.client.0.smithi081.stdout:6/302: mknod d4/d12/d1c/d39/c5f 0 2024-09-18T12:51:16.353 INFO:tasks.workunit.client.1.smithi136.stdout:2/667: truncate d5/d4a/d64/f7d 617882 0 2024-09-18T12:51:16.353 INFO:tasks.workunit.client.1.smithi136.stdout:2/668: chown d5/d7/d3b/f51 135732 1 2024-09-18T12:51:16.354 INFO:tasks.workunit.client.1.smithi136.stdout:9/625: mknod d6/d96/dbb/cd9 0 2024-09-18T12:51:16.355 INFO:tasks.workunit.client.0.smithi081.stdout:8/320: getdents d3/d73 0 2024-09-18T12:51:16.356 INFO:tasks.workunit.client.1.smithi136.stdout:9/626: symlink d6/df/d23/dae/lda 0 2024-09-18T12:51:16.356 INFO:tasks.workunit.client.1.smithi136.stdout:9/627: chown d6/da/d3d/d4d/d91/d38 208 1 2024-09-18T12:51:16.356 INFO:tasks.workunit.client.1.smithi136.stdout:9/628: write d6/d13/d4c/f50 [4263302,45713] 0 2024-09-18T12:51:16.357 INFO:tasks.workunit.client.1.smithi136.stdout:9/629: write d6/db/d12/f37 [272626,36018] 0 2024-09-18T12:51:16.358 INFO:tasks.workunit.client.0.smithi081.stdout:2/389: truncate d15/d16/d20/d22/f2a 255075 0 2024-09-18T12:51:16.360 INFO:tasks.workunit.client.0.smithi081.stdout:4/280: creat d3/d59/f63 x:0 0 0 2024-09-18T12:51:16.360 INFO:tasks.workunit.client.1.smithi136.stdout:9/630: unlink d6/df/d23/d2b/fcf 0 2024-09-18T12:51:16.361 INFO:tasks.workunit.client.1.smithi136.stdout:7/693: dwrite d0/d35/d36/fc1 [0,4194304] 0 2024-09-18T12:51:16.361 INFO:tasks.workunit.client.1.smithi136.stdout:7/694: chown d0/d35/d41/d50 939 1 2024-09-18T12:51:16.362 INFO:tasks.workunit.client.0.smithi081.stdout:0/307: dwrite d7/d9/d4b/d53/f61 [0,4194304] 0 2024-09-18T12:51:16.362 INFO:tasks.workunit.client.0.smithi081.stdout:0/308: creat d7/d9/d4b/d53/f64 x:0 0 0 2024-09-18T12:51:16.362 INFO:tasks.workunit.client.0.smithi081.stdout:0/309: write d7/d4f/f5a [351457,28125] 0 2024-09-18T12:51:16.363 INFO:tasks.workunit.client.1.smithi136.stdout:3/607: dwrite d3/d14/d18/d7f/f7a [0,4194304] 0 2024-09-18T12:51:16.363 INFO:tasks.workunit.client.1.smithi136.stdout:3/608: chown d3/d10/l60 7 1 2024-09-18T12:51:16.363 INFO:tasks.workunit.client.1.smithi136.stdout:3/609: chown d3/d14/d18/l44 60052 1 2024-09-18T12:51:16.364 INFO:tasks.workunit.client.0.smithi081.stdout:1/311: dwrite d0/d18/f25 [0,4194304] 0 2024-09-18T12:51:16.364 INFO:tasks.workunit.client.1.smithi136.stdout:9/631: link d6/d13/fc1 d6/da/fdb 0 2024-09-18T12:51:16.365 INFO:tasks.workunit.client.0.smithi081.stdout:5/370: rmdir d2/d14/d33/d37 39 2024-09-18T12:51:16.366 INFO:tasks.workunit.client.0.smithi081.stdout:8/321: creat d3/d1e/f77 x:0 0 0 2024-09-18T12:51:16.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/390: truncate d15/d16/f19 677875 0 2024-09-18T12:51:16.368 INFO:tasks.workunit.client.1.smithi136.stdout:2/669: dread d5/d7/d17/d48/f4e [0,4194304] 0 2024-09-18T12:51:16.368 INFO:tasks.workunit.client.1.smithi136.stdout:2/670: readlink d5/d7/l8 0 2024-09-18T12:51:16.368 INFO:tasks.workunit.client.1.smithi136.stdout:2/671: chown d5/d25/l5d 2338055 1 2024-09-18T12:51:16.368 INFO:tasks.workunit.client.1.smithi136.stdout:2/672: fsync d5/d25/d43/d74/f8e 0 2024-09-18T12:51:16.369 INFO:tasks.workunit.client.1.smithi136.stdout:3/610: symlink d3/d14/d17/d8c/lcb 0 2024-09-18T12:51:16.371 INFO:tasks.workunit.client.0.smithi081.stdout:0/310: rename d7/ce to d7/d5d/c65 0 2024-09-18T12:51:16.372 INFO:tasks.workunit.client.1.smithi136.stdout:9/632: rename d6/d59/lb9 to d6/df/d23/d2b/d79/d8b/ldc 0 2024-09-18T12:51:16.372 INFO:tasks.workunit.client.1.smithi136.stdout:6/588: dwrite d8/dc/f1d [0,4194304] 0 2024-09-18T12:51:16.372 INFO:tasks.workunit.client.1.smithi136.stdout:6/589: write d8/daa/fb0 [279117,8653] 0 2024-09-18T12:51:16.373 INFO:tasks.workunit.client.1.smithi136.stdout:8/725: dwrite d9/d14/f71 [0,4194304] 0 2024-09-18T12:51:16.373 INFO:tasks.workunit.client.0.smithi081.stdout:1/312: mkdir d0/d6/d33/d42/d70 0 2024-09-18T12:51:16.373 INFO:tasks.workunit.client.0.smithi081.stdout:1/313: write d0/db/d4f/f6e [405268,89743] 0 2024-09-18T12:51:16.373 INFO:tasks.workunit.client.1.smithi136.stdout:9/633: dread d6/da/d3d/d4d/d91/d25/f39 [0,4194304] 0 2024-09-18T12:51:16.375 INFO:tasks.workunit.client.0.smithi081.stdout:5/371: creat d2/d47/f76 x:0 0 0 2024-09-18T12:51:16.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/328: dwrite d3/db/dc/d1a/f6a [0,4194304] 0 2024-09-18T12:51:16.375 INFO:tasks.workunit.client.0.smithi081.stdout:2/391: mknod d15/d16/d20/d22/d5a/c82 0 2024-09-18T12:51:16.377 INFO:tasks.workunit.client.1.smithi136.stdout:2/673: truncate d5/d25/d43/f52 3258843 0 2024-09-18T12:51:16.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/281: mknod d3/db/d35/c64 0 2024-09-18T12:51:16.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/282: write d3/d59/d45/d4f/f5a [875582,25587] 0 2024-09-18T12:51:16.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/283: dread - d3/d59/d14/d3e/f51 zero size 2024-09-18T12:51:16.378 INFO:tasks.workunit.client.1.smithi136.stdout:7/695: read d0/d39/d4d/d9a/fb1 [2180027,106414] 0 2024-09-18T12:51:16.380 INFO:tasks.workunit.client.1.smithi136.stdout:6/590: dread d8/d9/d3c/d4a/f53 [0,4194304] 0 2024-09-18T12:51:16.380 INFO:tasks.workunit.client.1.smithi136.stdout:6/591: creat d8/d9/de/d60/d94/fbc x:0 0 0 2024-09-18T12:51:16.384 INFO:tasks.workunit.client.0.smithi081.stdout:0/311: rename d7/d9/d4b/d53/l55 to d7/d9/d4b/d33/l66 0 2024-09-18T12:51:16.384 INFO:tasks.workunit.client.0.smithi081.stdout:9/207: dwrite dd/d31/f3b [0,4194304] 0 2024-09-18T12:51:16.384 INFO:tasks.workunit.client.0.smithi081.stdout:9/208: fsync dd/d1d/d1e/d24/f33 0 2024-09-18T12:51:16.385 INFO:tasks.workunit.client.1.smithi136.stdout:4/544: dwrite d0/d25/f39 [0,4194304] 0 2024-09-18T12:51:16.387 INFO:tasks.workunit.client.0.smithi081.stdout:0/312: dread d7/f21 [0,4194304] 0 2024-09-18T12:51:16.389 INFO:tasks.workunit.client.0.smithi081.stdout:4/284: dread d3/d59/d14/f29 [0,4194304] 0 2024-09-18T12:51:16.391 INFO:tasks.workunit.client.1.smithi136.stdout:6/592: write d8/dc/f31 [1824180,107101] 0 2024-09-18T12:51:16.392 INFO:tasks.workunit.client.1.smithi136.stdout:8/726: dread d9/d18/d34/d3d/d47/dbe/de3/ff2 [0,4194304] 0 2024-09-18T12:51:16.392 INFO:tasks.workunit.client.1.smithi136.stdout:8/727: readlink d9/d18/d34/la3 0 2024-09-18T12:51:16.393 INFO:tasks.workunit.client.1.smithi136.stdout:8/728: fsync d9/d18/f44 0 2024-09-18T12:51:16.393 INFO:tasks.workunit.client.1.smithi136.stdout:9/634: unlink d6/df/d75/fad 0 2024-09-18T12:51:16.393 INFO:tasks.workunit.client.0.smithi081.stdout:6/303: dwrite d4/f58 [0,4194304] 0 2024-09-18T12:51:16.394 INFO:tasks.workunit.client.1.smithi136.stdout:7/696: creat d0/d39/d4d/d9a/dee/ff5 x:0 0 0 2024-09-18T12:51:16.394 INFO:tasks.workunit.client.1.smithi136.stdout:7/697: truncate d0/d2c/d85/fa6 663037 0 2024-09-18T12:51:16.394 INFO:tasks.workunit.client.1.smithi136.stdout:7/698: creat d0/d12/d5e/d67/ff6 x:0 0 0 2024-09-18T12:51:16.396 INFO:tasks.workunit.client.1.smithi136.stdout:2/674: dwrite f3 [0,4194304] 0 2024-09-18T12:51:16.399 INFO:tasks.workunit.client.1.smithi136.stdout:4/545: creat d0/d3/d54/d8a/faa x:0 0 0 2024-09-18T12:51:16.399 INFO:tasks.workunit.client.1.smithi136.stdout:4/546: fsync d0/d3/fa5 0 2024-09-18T12:51:16.400 INFO:tasks.workunit.client.0.smithi081.stdout:0/313: write d7/d9/d4b/f63 [7289039,23976] 0 2024-09-18T12:51:16.401 INFO:tasks.workunit.client.0.smithi081.stdout:8/322: rmdir d3/d1e/d4c 39 2024-09-18T12:51:16.401 INFO:tasks.workunit.client.0.smithi081.stdout:8/323: truncate d3/d1e/d4c/d53/f74 740579 0 2024-09-18T12:51:16.401 INFO:tasks.workunit.client.0.smithi081.stdout:8/324: write d3/d1e/d4c/d53/f66 [728875,45421] 0 2024-09-18T12:51:16.401 INFO:tasks.workunit.client.1.smithi136.stdout:6/593: mknod d8/d9d/d9f/cbd 0 2024-09-18T12:51:16.403 INFO:tasks.workunit.client.1.smithi136.stdout:9/635: dread d6/da/d3d/f7b [0,4194304] 0 2024-09-18T12:51:16.403 INFO:tasks.workunit.client.0.smithi081.stdout:1/314: dwrite d0/d6/d33/d42/f5b [0,4194304] 0 2024-09-18T12:51:16.403 INFO:tasks.workunit.client.1.smithi136.stdout:8/729: mkdir d9/d14/d1a/d2b/d42/d6e/d75/d109 0 2024-09-18T12:51:16.403 INFO:tasks.workunit.client.1.smithi136.stdout:8/730: write d9/d14/d1a/d2b/d42/d6e/f84 [4751011,52179] 0 2024-09-18T12:51:16.404 INFO:tasks.workunit.client.0.smithi081.stdout:5/372: unlink d2/d14/d1d/d1a/c2d 0 2024-09-18T12:51:16.405 INFO:tasks.workunit.client.1.smithi136.stdout:7/699: stat d0/d2c/d2e/dc5 0 2024-09-18T12:51:16.407 INFO:tasks.workunit.client.1.smithi136.stdout:2/675: mknod d5/d25/d43/d74/cd4 0 2024-09-18T12:51:16.408 INFO:tasks.workunit.client.0.smithi081.stdout:2/392: creat d15/d26/d4d/d6b/f83 x:0 0 0 2024-09-18T12:51:16.408 INFO:tasks.workunit.client.0.smithi081.stdout:2/393: chown d15/d16/d54/c56 443452 1 2024-09-18T12:51:16.410 INFO:tasks.workunit.client.1.smithi136.stdout:8/731: unlink d9/d14/l52 0 2024-09-18T12:51:16.412 INFO:tasks.workunit.client.0.smithi081.stdout:3/329: rename d3/db/l3f to d3/db/df/d60/d58/l74 0 2024-09-18T12:51:16.413 INFO:tasks.workunit.client.1.smithi136.stdout:6/594: write d8/d9/d3c/f58 [537732,120289] 0 2024-09-18T12:51:16.414 INFO:tasks.workunit.client.1.smithi136.stdout:7/700: mknod d0/d2c/d2e/dc5/cf7 0 2024-09-18T12:51:16.414 INFO:tasks.workunit.client.0.smithi081.stdout:1/315: dread d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:16.414 INFO:tasks.workunit.client.0.smithi081.stdout:1/316: chown d0/d6 32484 1 2024-09-18T12:51:16.414 INFO:tasks.workunit.client.0.smithi081.stdout:1/317: fdatasync d0/d6/fd 0 2024-09-18T12:51:16.414 INFO:tasks.workunit.client.0.smithi081.stdout:1/318: chown d0/d6/d7/d2e/d51/d2c 2145567 1 2024-09-18T12:51:16.415 INFO:tasks.workunit.client.0.smithi081.stdout:9/209: mkdir dd/d15/d1a/d3d 0 2024-09-18T12:51:16.415 INFO:tasks.workunit.client.1.smithi136.stdout:2/676: mkdir d5/d7/dbf/dd5 0 2024-09-18T12:51:16.416 INFO:tasks.workunit.client.1.smithi136.stdout:8/732: mknod d9/d14/d1a/c10a 0 2024-09-18T12:51:16.416 INFO:tasks.workunit.client.1.smithi136.stdout:9/636: dread d6/d13/d4c/fa7 [0,4194304] 0 2024-09-18T12:51:16.416 INFO:tasks.workunit.client.1.smithi136.stdout:9/637: stat d6/db/d12/d62/f74 0 2024-09-18T12:51:16.419 INFO:tasks.workunit.client.1.smithi136.stdout:7/701: mknod d0/d39/d4d/d69/dd1/cf8 0 2024-09-18T12:51:16.420 INFO:tasks.workunit.client.0.smithi081.stdout:6/304: rmdir d4/d12/d1c/d39/d40/d54 39 2024-09-18T12:51:16.420 INFO:tasks.workunit.client.0.smithi081.stdout:6/305: read - d4/f4d zero size 2024-09-18T12:51:16.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/325: unlink d3/d1e/d4c/d53/c6e 0 2024-09-18T12:51:16.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/326: getdents d3/d73 0 2024-09-18T12:51:16.424 INFO:tasks.workunit.client.1.smithi136.stdout:9/638: rmdir d6/df/d23/d2b/d79 39 2024-09-18T12:51:16.426 INFO:tasks.workunit.client.1.smithi136.stdout:6/595: getdents d8/d9/d56/d96 0 2024-09-18T12:51:16.426 INFO:tasks.workunit.client.1.smithi136.stdout:6/596: write d8/d9/de/d60/d94/fa1 [464760,57383] 0 2024-09-18T12:51:16.427 INFO:tasks.workunit.client.0.smithi081.stdout:5/373: creat d2/d14/d33/d37/d3b/f77 x:0 0 0 2024-09-18T12:51:16.428 INFO:tasks.workunit.client.1.smithi136.stdout:8/733: dread d9/d14/d1a/d2b/f91 [4194304,4194304] 0 2024-09-18T12:51:16.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/374: dread d2/dd/d5e/f3a [0,4194304] 0 2024-09-18T12:51:16.430 INFO:tasks.workunit.client.0.smithi081.stdout:2/394: rename d15/f46 to d15/f84 0 2024-09-18T12:51:16.431 INFO:tasks.workunit.client.1.smithi136.stdout:7/702: getdents d0/d35/d41/d50/d5a 0 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/677: getdents d5/d7 0 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/678: chown d5/d7/d17/l9c 3840897 1 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/679: creat d5/d7/d17/d48/fd6 x:0 0 0 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/680: creat d5/d4a/d67/fd7 x:0 0 0 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/681: chown d5/d25/d2d/d9d/la3 524302 1 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/682: chown d5/d7/d41/f96 839 1 2024-09-18T12:51:16.434 INFO:tasks.workunit.client.1.smithi136.stdout:2/683: stat d5/d7/d17/f27 0 2024-09-18T12:51:16.435 INFO:tasks.workunit.client.0.smithi081.stdout:1/319: mkdir d0/d6/d33/d37/d71 0 2024-09-18T12:51:16.436 INFO:tasks.workunit.client.0.smithi081.stdout:9/210: creat dd/d1d/d1e/d39/f3e x:0 0 0 2024-09-18T12:51:16.437 INFO:tasks.workunit.client.0.smithi081.stdout:5/375: mknod d2/d14/d33/c78 0 2024-09-18T12:51:16.438 INFO:tasks.workunit.client.1.smithi136.stdout:6/597: creat d8/d9/de/d1c/fbe x:0 0 0 2024-09-18T12:51:16.438 INFO:tasks.workunit.client.1.smithi136.stdout:6/598: fdatasync d8/d9/d64/f82 0 2024-09-18T12:51:16.439 INFO:tasks.workunit.client.1.smithi136.stdout:8/734: mkdir d9/d18/d34/d88/d10b 0 2024-09-18T12:51:16.440 INFO:tasks.workunit.client.0.smithi081.stdout:1/320: getdents d0/d6/d7/d2e/d51 0 2024-09-18T12:51:16.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/321: dread d0/d6/f1b [0,4194304] 0 2024-09-18T12:51:16.441 INFO:tasks.workunit.client.1.smithi136.stdout:7/703: mknod d0/d39/d4d/d55/cf9 0 2024-09-18T12:51:16.442 INFO:tasks.workunit.client.0.smithi081.stdout:9/211: link dd/d1d/d1e/d24/d2a/f30 dd/d1d/d1e/d39/f3f 0 2024-09-18T12:51:16.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/212: write f0 [1532211,25237] 0 2024-09-18T12:51:16.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/213: creat dd/de/f40 x:0 0 0 2024-09-18T12:51:16.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/214: write dd/d15/f3a [616326,2512] 0 2024-09-18T12:51:16.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/376: creat d2/d14/d33/d37/d3b/d5f/f79 x:0 0 0 2024-09-18T12:51:16.444 INFO:tasks.workunit.client.1.smithi136.stdout:9/639: getdents d6/db/d72 0 2024-09-18T12:51:16.445 INFO:tasks.workunit.client.1.smithi136.stdout:9/640: chown d6/da/d3d/f69 5950 1 2024-09-18T12:51:16.445 INFO:tasks.workunit.client.1.smithi136.stdout:9/641: creat d6/df/d23/d2b/d79/d53/d5c/fdd x:0 0 0 2024-09-18T12:51:16.445 INFO:tasks.workunit.client.1.smithi136.stdout:2/684: write d5/d25/f2e [1489862,76266] 0 2024-09-18T12:51:16.445 INFO:tasks.workunit.client.0.smithi081.stdout:4/285: rename d3/d59 to d3/d20/d3d/d65 0 2024-09-18T12:51:16.447 INFO:tasks.workunit.client.1.smithi136.stdout:7/704: rmdir d0/d12/d1a 39 2024-09-18T12:51:16.448 INFO:tasks.workunit.client.0.smithi081.stdout:5/377: rmdir d2/d14/d33/d37/d3b/d6a/d20 39 2024-09-18T12:51:16.450 INFO:tasks.workunit.client.1.smithi136.stdout:7/705: dread d0/d35/d41/d50/d7f/d6b/f75 [0,4194304] 0 2024-09-18T12:51:16.451 INFO:tasks.workunit.client.1.smithi136.stdout:9/642: mkdir d6/df/d75/dde 0 2024-09-18T12:51:16.451 INFO:tasks.workunit.client.0.smithi081.stdout:0/314: rename d7/d9/d4b/f3f to d7/f67 0 2024-09-18T12:51:16.452 INFO:tasks.workunit.client.0.smithi081.stdout:0/315: stat l2 0 2024-09-18T12:51:16.452 INFO:tasks.workunit.client.0.smithi081.stdout:1/322: dread d0/d6/d7/d2e/d51/d2c/f45 [0,4194304] 0 2024-09-18T12:51:16.452 INFO:tasks.workunit.client.0.smithi081.stdout:1/323: fsync d0/d6/d7/d2e/d51/d2c/f5c 0 2024-09-18T12:51:16.453 INFO:tasks.workunit.client.1.smithi136.stdout:7/706: mkdir d0/d35/d41/d50/d7f/dfa 0 2024-09-18T12:51:16.453 INFO:tasks.workunit.client.0.smithi081.stdout:6/306: dwrite d4/f21 [0,4194304] 0 2024-09-18T12:51:16.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/330: dwrite d3/f46 [0,4194304] 0 2024-09-18T12:51:16.455 INFO:tasks.workunit.client.1.smithi136.stdout:9/643: creat d6/d96/dbb/fdf x:0 0 0 2024-09-18T12:51:16.456 INFO:tasks.workunit.client.0.smithi081.stdout:2/395: dwrite d15/d16/d20/d22/d5a/f74 [0,4194304] 0 2024-09-18T12:51:16.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/316: mkdir d7/d9/d4b/d4a/d68 0 2024-09-18T12:51:16.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/317: chown d7/f3c 255977009 1 2024-09-18T12:51:16.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/318: creat d7/d9/d4b/d53/f69 x:0 0 0 2024-09-18T12:51:16.458 INFO:tasks.workunit.client.1.smithi136.stdout:7/707: creat d0/d35/d41/ffb x:0 0 0 2024-09-18T12:51:16.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/331: symlink d3/db/d1b/l75 0 2024-09-18T12:51:16.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/332: getdents d3/db/df/d3b 0 2024-09-18T12:51:16.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/333: truncate d3/db/df/d29/f30 1360040 0 2024-09-18T12:51:16.461 INFO:tasks.workunit.client.1.smithi136.stdout:9/644: creat d6/df/fe0 x:0 0 0 2024-09-18T12:51:16.462 INFO:tasks.workunit.client.1.smithi136.stdout:7/708: mkdir d0/d35/d41/d50/d9b/dfc 0 2024-09-18T12:51:16.462 INFO:tasks.workunit.client.0.smithi081.stdout:1/324: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:16.464 INFO:tasks.workunit.client.0.smithi081.stdout:5/378: write d2/d14/d33/d37/d3b/d6a/f35 [6189436,100081] 0 2024-09-18T12:51:16.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/327: rename d3/d2f/f42 to d3/d1e/f78 0 2024-09-18T12:51:16.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/328: stat d3/l22 0 2024-09-18T12:51:16.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/329: read - d3/d1e/f36 zero size 2024-09-18T12:51:16.466 INFO:tasks.workunit.client.0.smithi081.stdout:5/379: dread d2/d14/f4e [0,4194304] 0 2024-09-18T12:51:16.467 INFO:tasks.workunit.client.0.smithi081.stdout:6/307: dread d4/f7 [0,4194304] 0 2024-09-18T12:51:16.467 INFO:tasks.workunit.client.0.smithi081.stdout:6/308: write d4/d12/f32 [301631,2927] 0 2024-09-18T12:51:16.467 INFO:tasks.workunit.client.1.smithi136.stdout:9/645: dread d6/da/d3d/d4d/d91/d25/d55/f5b [0,4194304] 0 2024-09-18T12:51:16.468 INFO:tasks.workunit.client.0.smithi081.stdout:2/396: dread f9 [4194304,4194304] 0 2024-09-18T12:51:16.469 INFO:tasks.workunit.client.0.smithi081.stdout:3/334: truncate d3/db/f56 544165 0 2024-09-18T12:51:16.470 INFO:tasks.workunit.client.1.smithi136.stdout:9/646: mknod d6/da/ce1 0 2024-09-18T12:51:16.470 INFO:tasks.workunit.client.1.smithi136.stdout:9/647: truncate d6/df/fc6 555634 0 2024-09-18T12:51:16.471 INFO:tasks.workunit.client.0.smithi081.stdout:9/215: rename dd/d1d/d1e/c21 to dd/c41 0 2024-09-18T12:51:16.472 INFO:tasks.workunit.client.1.smithi136.stdout:6/599: dwrite d8/dc/f6e [0,4194304] 0 2024-09-18T12:51:16.472 INFO:tasks.workunit.client.1.smithi136.stdout:6/600: fdatasync d8/f5a 0 2024-09-18T12:51:16.474 INFO:tasks.workunit.client.1.smithi136.stdout:6/601: write d8/d9/d3c/d4a/fb2 [428408,110363] 0 2024-09-18T12:51:16.474 INFO:tasks.workunit.client.1.smithi136.stdout:6/602: write d8/d9/de/d1c/f2b [4921859,31400] 0 2024-09-18T12:51:16.475 INFO:tasks.workunit.client.0.smithi081.stdout:6/309: mkdir d4/d12/d1c/d39/d60 0 2024-09-18T12:51:16.475 INFO:tasks.workunit.client.0.smithi081.stdout:6/310: stat d4/d6 0 2024-09-18T12:51:16.475 INFO:tasks.workunit.client.0.smithi081.stdout:6/311: fsync d4/f24 0 2024-09-18T12:51:16.475 INFO:tasks.workunit.client.1.smithi136.stdout:2/685: dwrite d5/d7/d17/d48/f4e [4194304,4194304] 0 2024-09-18T12:51:16.476 INFO:tasks.workunit.client.0.smithi081.stdout:3/335: mkdir d3/db/df/d29/d12/d44/d76 0 2024-09-18T12:51:16.477 INFO:tasks.workunit.client.0.smithi081.stdout:2/397: dread d15/f17 [0,4194304] 0 2024-09-18T12:51:16.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/325: rmdir d0/db/d12 39 2024-09-18T12:51:16.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/326: chown d0/d18/d6a 171819 1 2024-09-18T12:51:16.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/327: readlink d0/d54/l67 0 2024-09-18T12:51:16.478 INFO:tasks.workunit.client.0.smithi081.stdout:8/330: dread d3/d1e/f27 [0,4194304] 0 2024-09-18T12:51:16.478 INFO:tasks.workunit.client.0.smithi081.stdout:8/331: write d3/f3f [803837,70635] 0 2024-09-18T12:51:16.479 INFO:tasks.workunit.client.1.smithi136.stdout:9/648: rmdir d6/da/d3d 39 2024-09-18T12:51:16.479 INFO:tasks.workunit.client.0.smithi081.stdout:4/286: getdents d3 0 2024-09-18T12:51:16.479 INFO:tasks.workunit.client.1.smithi136.stdout:7/709: read d0/d35/d4f/f82 [3657531,20775] 0 2024-09-18T12:51:16.480 INFO:tasks.workunit.client.0.smithi081.stdout:5/380: write d2/d14/d33/d37/d3b/d2a/f4c [638877,37072] 0 2024-09-18T12:51:16.481 INFO:tasks.workunit.client.1.smithi136.stdout:6/603: stat d8/d9/d3c/d45/cb7 0 2024-09-18T12:51:16.481 INFO:tasks.workunit.client.0.smithi081.stdout:0/319: rename d7/d9/d4b/c50 to d7/d9/d4b/d4a/c6a 0 2024-09-18T12:51:16.482 INFO:tasks.workunit.client.0.smithi081.stdout:9/216: symlink dd/d1d/l42 0 2024-09-18T12:51:16.483 INFO:tasks.workunit.client.1.smithi136.stdout:2/686: symlink d5/d7/dbf/ld8 0 2024-09-18T12:51:16.484 INFO:tasks.workunit.client.1.smithi136.stdout:9/649: symlink d6/da/d3d/d4d/d91/d25/d55/le2 0 2024-09-18T12:51:16.485 INFO:tasks.workunit.client.0.smithi081.stdout:3/336: mknod d3/db/dc/c77 0 2024-09-18T12:51:16.485 INFO:tasks.workunit.client.0.smithi081.stdout:8/332: dread d3/d1d/f49 [0,4194304] 0 2024-09-18T12:51:16.486 INFO:tasks.workunit.client.1.smithi136.stdout:7/710: dread d0/d35/d41/d50/d7f/f42 [0,4194304] 0 2024-09-18T12:51:16.486 INFO:tasks.workunit.client.0.smithi081.stdout:2/398: mknod d15/d16/d20/d22/d5a/c85 0 2024-09-18T12:51:16.488 INFO:tasks.workunit.client.0.smithi081.stdout:1/328: truncate d0/db/d12/f24 4511666 0 2024-09-18T12:51:16.490 INFO:tasks.workunit.client.1.smithi136.stdout:6/604: getdents d8/d9/d3c/d4a 0 2024-09-18T12:51:16.490 INFO:tasks.workunit.client.0.smithi081.stdout:5/381: link d2/dd/f21 d2/dd/d5e/f7a 0 2024-09-18T12:51:16.490 INFO:tasks.workunit.client.0.smithi081.stdout:6/312: write d4/f21 [1429098,3521] 0 2024-09-18T12:51:16.491 INFO:tasks.workunit.client.0.smithi081.stdout:4/287: read d3/db/d2d/d4e/f5f [3331545,113781] 0 2024-09-18T12:51:16.491 INFO:tasks.workunit.client.0.smithi081.stdout:4/288: write d3/db/fe [924171,3589] 0 2024-09-18T12:51:16.491 INFO:tasks.workunit.client.0.smithi081.stdout:4/289: chown d3/d20/d3d/d65/f19 0 1 2024-09-18T12:51:16.492 INFO:tasks.workunit.client.0.smithi081.stdout:0/320: symlink d7/d9/d12/l6b 0 2024-09-18T12:51:16.492 INFO:tasks.workunit.client.0.smithi081.stdout:0/321: truncate d7/d4f/f5a 1355062 0 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/687: symlink d5/d7/dbf/dd5/ld9 0 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/688: stat d5/d25/d2d/f6d 0 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/689: chown d5/d7/d17/d48/db1 1227 1 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/690: creat d5/d7/d11/d34/fda x:0 0 0 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/691: chown d5/d7/d17/d48/ca6 514 1 2024-09-18T12:51:16.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/692: write d5/d7/fe [1709357,62742] 0 2024-09-18T12:51:16.495 INFO:tasks.workunit.client.1.smithi136.stdout:7/711: rmdir d0/d2c 39 2024-09-18T12:51:16.495 INFO:tasks.workunit.client.1.smithi136.stdout:9/650: write d6/db/d12/d62/f8e [4168885,95002] 0 2024-09-18T12:51:16.497 INFO:tasks.workunit.client.1.smithi136.stdout:6/605: creat d8/d9/d3c/d4a/fbf x:0 0 0 2024-09-18T12:51:16.503 INFO:tasks.workunit.client.1.smithi136.stdout:6/606: rename d8/d9/de/d60/d71/d76/f89 to d8/d9/de/d1c/d50/da8/fc0 0 2024-09-18T12:51:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:4/290: read d3/db/f23 [3052706,83731] 0 2024-09-18T12:51:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:4/291: dread - d3/d20/d3d/d65/d14/d54/f62 zero size 2024-09-18T12:51:16.505 INFO:tasks.workunit.client.1.smithi136.stdout:6/607: symlink d8/d9/d64/lc1 0 2024-09-18T12:51:16.514 INFO:tasks.workunit.client.1.smithi136.stdout:6/608: dread d8/f19 [0,4194304] 0 2024-09-18T12:51:16.547 INFO:tasks.workunit.client.0.smithi081.stdout:9/217: rename dd/d15/f3a to dd/d1d/d1e/f43 0 2024-09-18T12:51:16.547 INFO:tasks.workunit.client.0.smithi081.stdout:9/218: chown dd/de/f13 35 1 2024-09-18T12:51:16.547 INFO:tasks.workunit.client.0.smithi081.stdout:9/219: creat dd/d1d/d1e/d24/f44 x:0 0 0 2024-09-18T12:51:16.548 INFO:tasks.workunit.client.0.smithi081.stdout:3/337: link d3/db/df/d60/d58/l74 d3/db/df/d29/d12/d44/d76/l78 0 2024-09-18T12:51:16.549 INFO:tasks.workunit.client.0.smithi081.stdout:5/382: dwrite d2/d14/d33/d37/d3b/d5f/f60 [0,4194304] 0 2024-09-18T12:51:16.549 INFO:tasks.workunit.client.1.smithi136.stdout:7/712: dwrite d0/d35/d36/fc1 [0,4194304] 0 2024-09-18T12:51:16.549 INFO:tasks.workunit.client.1.smithi136.stdout:7/713: readlink d0/d35/d36/l14 0 2024-09-18T12:51:16.550 INFO:tasks.workunit.client.0.smithi081.stdout:2/399: truncate d15/d16/d33/d53/d7a/d32/f3c 787847 0 2024-09-18T12:51:16.550 INFO:tasks.workunit.client.0.smithi081.stdout:0/322: dwrite d7/d9/d4b/d33/f34 [0,4194304] 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.0.smithi081.stdout:4/292: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:6/609: dwrite d8/d9/de/d1c/f5f [0,4194304] 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:6/610: chown d8/d9/de/d60/d71/f93 69306481 1 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:9/651: dwrite d6/da/d3d/fc3 [0,4194304] 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:9/652: fsync d6/da/d3d/d4d/d91/d25/d55/f8d 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:9/653: stat d6/d13/d4c 0 2024-09-18T12:51:16.551 INFO:tasks.workunit.client.1.smithi136.stdout:2/693: dwrite d5/d7/d17/f3c [0,4194304] 0 2024-09-18T12:51:16.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/329: creat d0/d6/d33/d37/d71/f72 x:0 0 0 2024-09-18T12:51:16.557 INFO:tasks.workunit.client.0.smithi081.stdout:6/313: symlink d4/d12/l61 0 2024-09-18T12:51:16.557 INFO:tasks.workunit.client.0.smithi081.stdout:6/314: fdatasync d4/d6/fb 0 2024-09-18T12:51:16.557 INFO:tasks.workunit.client.0.smithi081.stdout:6/315: readlink d4/d6/l2e 0 2024-09-18T12:51:16.557 INFO:tasks.workunit.client.0.smithi081.stdout:6/316: creat d4/d12/d28/f62 x:0 0 0 2024-09-18T12:51:16.560 INFO:tasks.workunit.client.1.smithi136.stdout:6/611: mknod d8/d9/d56/cc2 0 2024-09-18T12:51:16.560 INFO:tasks.workunit.client.1.smithi136.stdout:9/654: creat d6/df/dd3/fe3 x:0 0 0 2024-09-18T12:51:16.564 INFO:tasks.workunit.client.1.smithi136.stdout:2/694: rename d5/d7/d11/f29 to d5/d25/d2d/fdb 0 2024-09-18T12:51:16.564 INFO:tasks.workunit.client.1.smithi136.stdout:2/695: fdatasync d5/d7/d17/f3c 0 2024-09-18T12:51:16.565 INFO:tasks.workunit.client.1.smithi136.stdout:9/655: dread d6/da/d3d/f7b [0,4194304] 0 2024-09-18T12:51:16.568 INFO:tasks.workunit.client.0.smithi081.stdout:2/400: dwrite d15/d16/d20/d22/d5a/f71 [0,4194304] 0 2024-09-18T12:51:16.569 INFO:tasks.workunit.client.1.smithi136.stdout:6/612: creat d8/d9/de/d1c/db9/fc3 x:0 0 0 2024-09-18T12:51:16.571 INFO:tasks.workunit.client.1.smithi136.stdout:2/696: symlink d5/d25/d2d/d9d/da2/ldc 0 2024-09-18T12:51:16.571 INFO:tasks.workunit.client.1.smithi136.stdout:2/697: creat d5/d4a/fdd x:0 0 0 2024-09-18T12:51:16.573 INFO:tasks.workunit.client.1.smithi136.stdout:9/656: unlink d6/df/d23/d2b/c34 0 2024-09-18T12:51:16.576 INFO:tasks.workunit.client.1.smithi136.stdout:2/698: creat d5/d25/fde x:0 0 0 2024-09-18T12:51:16.577 INFO:tasks.workunit.client.0.smithi081.stdout:6/317: write d4/f58 [3088089,17759] 0 2024-09-18T12:51:16.578 INFO:tasks.workunit.client.0.smithi081.stdout:6/318: fdatasync d4/d12/d28/d2a/d2d/d31/f3d 0 2024-09-18T12:51:16.578 INFO:tasks.workunit.client.0.smithi081.stdout:6/319: write d4/d6/f27 [4728757,21751] 0 2024-09-18T12:51:16.578 INFO:tasks.workunit.client.1.smithi136.stdout:2/699: mkdir d5/d7/d17/d48/db2/db8/ddf 0 2024-09-18T12:51:16.578 INFO:tasks.workunit.client.1.smithi136.stdout:2/700: readlink d5/d25/l91 0 2024-09-18T12:51:16.581 INFO:tasks.workunit.client.1.smithi136.stdout:2/701: mkdir d5/d7/d11/de0 0 2024-09-18T12:51:16.581 INFO:tasks.workunit.client.1.smithi136.stdout:2/702: dread - d5/d7/fb6 zero size 2024-09-18T12:51:16.582 INFO:tasks.workunit.client.1.smithi136.stdout:2/703: truncate d5/d25/d43/f89 814630 0 2024-09-18T12:51:16.583 INFO:tasks.workunit.client.1.smithi136.stdout:2/704: symlink d5/d25/le1 0 2024-09-18T12:51:16.584 INFO:tasks.workunit.client.0.smithi081.stdout:9/220: mkdir dd/d15/d45 0 2024-09-18T12:51:16.585 INFO:tasks.workunit.client.0.smithi081.stdout:3/338: dwrite d3/db/df/d60/f5c [4194304,4194304] 0 2024-09-18T12:51:16.589 INFO:tasks.workunit.client.0.smithi081.stdout:0/323: stat d7/c14 0 2024-09-18T12:51:16.591 INFO:tasks.workunit.client.0.smithi081.stdout:1/330: mknod d0/d6/d7/d2e/d41/c73 0 2024-09-18T12:51:16.591 INFO:tasks.workunit.client.0.smithi081.stdout:1/331: write d0/db/f39 [9006155,8722] 0 2024-09-18T12:51:16.591 INFO:tasks.workunit.client.0.smithi081.stdout:1/332: truncate d0/db/f14 345806 0 2024-09-18T12:51:16.593 INFO:tasks.workunit.client.1.smithi136.stdout:7/714: dwrite d0/d35/feb [0,4194304] 0 2024-09-18T12:51:16.593 INFO:tasks.workunit.client.1.smithi136.stdout:7/715: fdatasync d0/d35/d41/d50/d7f/d6b/f75 0 2024-09-18T12:51:16.594 INFO:tasks.workunit.client.1.smithi136.stdout:7/716: truncate d0/d35/d41/d50/d5a/f86 1729125 0 2024-09-18T12:51:16.595 INFO:tasks.workunit.client.1.smithi136.stdout:1/585: sync 2024-09-18T12:51:16.597 INFO:tasks.workunit.client.0.smithi081.stdout:2/401: link d15/d26/d4d/f7d d15/d16/d33/f86 0 2024-09-18T12:51:16.597 INFO:tasks.workunit.client.0.smithi081.stdout:2/402: read - d15/d16/d20/f55 zero size 2024-09-18T12:51:16.598 INFO:tasks.workunit.client.1.smithi136.stdout:7/717: link d0/d35/d41/d50/d5a/d98/dd0/fed d0/d39/d4d/d9a/da2/ffd 0 2024-09-18T12:51:16.598 INFO:tasks.workunit.client.1.smithi136.stdout:7/718: dread - d0/d39/d4d/d9a/da2/ffd zero size 2024-09-18T12:51:16.598 INFO:tasks.workunit.client.1.smithi136.stdout:7/719: mkdir d0/d35/d41/dfe 0 2024-09-18T12:51:16.600 INFO:tasks.workunit.client.0.smithi081.stdout:0/324: symlink d7/d4f/l6c 0 2024-09-18T12:51:16.600 INFO:tasks.workunit.client.0.smithi081.stdout:3/339: read d3/f46 [8271896,7405] 0 2024-09-18T12:51:16.601 INFO:tasks.workunit.client.0.smithi081.stdout:9/221: write dd/d1d/d1e/f29 [1840044,15856] 0 2024-09-18T12:51:16.601 INFO:tasks.workunit.client.0.smithi081.stdout:9/222: write dd/d1d/f2e [817525,66832] 0 2024-09-18T12:51:16.601 INFO:tasks.workunit.client.0.smithi081.stdout:1/333: unlink d0/db/d12/c2a 0 2024-09-18T12:51:16.602 INFO:tasks.workunit.client.1.smithi136.stdout:1/586: dread d2/d5/d2b/d34/d86/fb8 [0,4194304] 0 2024-09-18T12:51:16.602 INFO:tasks.workunit.client.0.smithi081.stdout:2/403: symlink d15/d26/l87 0 2024-09-18T12:51:16.603 INFO:tasks.workunit.client.0.smithi081.stdout:9/223: stat dd/c14 0 2024-09-18T12:51:16.604 INFO:tasks.workunit.client.0.smithi081.stdout:9/224: chown fa 197833 1 2024-09-18T12:51:16.604 INFO:tasks.workunit.client.0.smithi081.stdout:9/225: chown dd/c19 139657 1 2024-09-18T12:51:16.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/587: rename d2/f3c to d2/d5/d2b/d9b/fbd 0 2024-09-18T12:51:16.606 INFO:tasks.workunit.client.0.smithi081.stdout:2/404: link d15/d16/d20/d22/c39 d15/d16/d33/d53/c88 0 2024-09-18T12:51:16.607 INFO:tasks.workunit.client.0.smithi081.stdout:2/405: getdents d15/d16/d54 0 2024-09-18T12:51:16.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/406: link l2 d15/d6e/l89 0 2024-09-18T12:51:16.611 INFO:tasks.workunit.client.0.smithi081.stdout:2/407: mknod d15/d16/d20/d22/c8a 0 2024-09-18T12:51:16.611 INFO:tasks.workunit.client.0.smithi081.stdout:2/408: stat d15/d26/d4d/d6b/f83 0 2024-09-18T12:51:16.611 INFO:tasks.workunit.client.0.smithi081.stdout:2/409: fdatasync d15/d16/d20/d22/f34 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:2/410: dread - d15/d16/d33/d53/d7a/d2f/d61/f80 zero size 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:0/325: write d7/d9/d4b/f54 [2767917,1659] 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/383: dwrite d2/d14/f17 [0,4194304] 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/384: readlink d2/d14/d1d/l62 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/385: write d2/dd/d5e/f3a [2112,114553] 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/386: readlink d2/l5 0 2024-09-18T12:51:16.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/387: truncate d2/d47/f58 2099101 0 2024-09-18T12:51:16.613 INFO:tasks.workunit.client.0.smithi081.stdout:5/388: dread - d2/dd/d5e/f70 zero size 2024-09-18T12:51:16.614 INFO:tasks.workunit.client.0.smithi081.stdout:2/411: unlink l4 0 2024-09-18T12:51:16.614 INFO:tasks.workunit.client.0.smithi081.stdout:2/412: chown d15/d26/d4d 32325 1 2024-09-18T12:51:16.615 INFO:tasks.workunit.client.1.smithi136.stdout:6/613: dwrite d8/d9/de/d1c/f20 [0,4194304] 0 2024-09-18T12:51:16.615 INFO:tasks.workunit.client.1.smithi136.stdout:6/614: read - d8/d9/d64/f82 zero size 2024-09-18T12:51:16.617 INFO:tasks.workunit.client.1.smithi136.stdout:9/657: dwrite d6/da/d3d/d4d/d91/d25/f31 [0,4194304] 0 2024-09-18T12:51:16.618 INFO:tasks.workunit.client.0.smithi081.stdout:6/320: dwrite d4/fe [0,4194304] 0 2024-09-18T12:51:16.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/326: unlink d7/d9/d4b/f54 0 2024-09-18T12:51:16.619 INFO:tasks.workunit.client.0.smithi081.stdout:5/389: symlink d2/d14/d33/d37/d3b/d16/l7b 0 2024-09-18T12:51:16.622 INFO:tasks.workunit.client.0.smithi081.stdout:3/340: read d3/f7 [46053,63176] 0 2024-09-18T12:51:16.622 INFO:tasks.workunit.client.0.smithi081.stdout:2/413: creat d15/d16/d33/f8b x:0 0 0 2024-09-18T12:51:16.623 INFO:tasks.workunit.client.0.smithi081.stdout:1/334: dread d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:16.625 INFO:tasks.workunit.client.0.smithi081.stdout:6/321: dread d4/fa [0,4194304] 0 2024-09-18T12:51:16.625 INFO:tasks.workunit.client.0.smithi081.stdout:6/322: fsync d4/fe 0 2024-09-18T12:51:16.626 INFO:tasks.workunit.client.0.smithi081.stdout:3/341: truncate d3/db/df/d29/d12/d44/f62 1122654 0 2024-09-18T12:51:16.626 INFO:tasks.workunit.client.0.smithi081.stdout:3/342: write d3/db/df/d29/d13/f61 [504957,25509] 0 2024-09-18T12:51:16.629 INFO:tasks.workunit.client.1.smithi136.stdout:2/705: dwrite d5/d7/f78 [0,4194304] 0 2024-09-18T12:51:16.629 INFO:tasks.workunit.client.1.smithi136.stdout:2/706: stat d5/d25/d43/d74/f76 0 2024-09-18T12:51:16.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/720: dwrite d0/d35/d41/d50/d5a/f86 [0,4194304] 0 2024-09-18T12:51:16.632 INFO:tasks.workunit.client.1.smithi136.stdout:7/721: dread d0/d35/fa0 [0,4194304] 0 2024-09-18T12:51:16.632 INFO:tasks.workunit.client.1.smithi136.stdout:7/722: chown d0/d35/d36/fb3 30090 1 2024-09-18T12:51:16.632 INFO:tasks.workunit.client.1.smithi136.stdout:7/723: dread - d0/d35/d4f/dd5/fda zero size 2024-09-18T12:51:16.633 INFO:tasks.workunit.client.0.smithi081.stdout:6/323: creat d4/d12/d56/f63 x:0 0 0 2024-09-18T12:51:16.634 INFO:tasks.workunit.client.0.smithi081.stdout:5/390: dread d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:16.636 INFO:tasks.workunit.client.0.smithi081.stdout:0/327: write d7/d9/d4b/d4a/f1b [4167713,75588] 0 2024-09-18T12:51:16.636 INFO:tasks.workunit.client.0.smithi081.stdout:0/328: chown d7/l30 5803 1 2024-09-18T12:51:16.636 INFO:tasks.workunit.client.0.smithi081.stdout:3/343: rename d3/d23/f70 to d3/d23/f79 0 2024-09-18T12:51:16.637 INFO:tasks.workunit.client.1.smithi136.stdout:2/707: symlink d5/d25/d43/le2 0 2024-09-18T12:51:16.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/708: write d5/d7/f5a [461572,78495] 0 2024-09-18T12:51:16.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/709: truncate d5/d25/f62 1216163 0 2024-09-18T12:51:16.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/710: truncate d5/d7/f5a 1407756 0 2024-09-18T12:51:16.638 INFO:tasks.workunit.client.1.smithi136.stdout:1/588: dwrite d2/d5/d2b/d34/d5c/f9e [0,4194304] 0 2024-09-18T12:51:16.640 INFO:tasks.workunit.client.1.smithi136.stdout:7/724: rename d0/d2c/d2e/fb5 to d0/d35/d41/d50/d9b/dc2/fff 0 2024-09-18T12:51:16.641 INFO:tasks.workunit.client.1.smithi136.stdout:2/711: dread d5/d25/d43/d74/fa9 [0,4194304] 0 2024-09-18T12:51:16.642 INFO:tasks.workunit.client.1.smithi136.stdout:1/589: mkdir d2/d5/d2b/d9b/dbe 0 2024-09-18T12:51:16.643 INFO:tasks.workunit.client.0.smithi081.stdout:5/391: symlink d2/d14/d33/d37/d3b/d16/d56/l7c 0 2024-09-18T12:51:16.643 INFO:tasks.workunit.client.0.smithi081.stdout:5/392: chown d2/d14/d33/d37/f54 23253 1 2024-09-18T12:51:16.643 INFO:tasks.workunit.client.0.smithi081.stdout:5/393: dread - d2/d14/d33/d37/d3b/d16/f69 zero size 2024-09-18T12:51:16.644 INFO:tasks.workunit.client.0.smithi081.stdout:5/394: readlink d2/d14/d33/d37/d3b/d16/l7b 0 2024-09-18T12:51:16.644 INFO:tasks.workunit.client.0.smithi081.stdout:5/395: truncate d2/dd/f75 146137 0 2024-09-18T12:51:16.644 INFO:tasks.workunit.client.0.smithi081.stdout:5/396: read d2/dd/f75 [39231,99360] 0 2024-09-18T12:51:16.645 INFO:tasks.workunit.client.1.smithi136.stdout:7/725: mkdir d0/d35/d36/d7c/d100 0 2024-09-18T12:51:16.645 INFO:tasks.workunit.client.1.smithi136.stdout:7/726: write d0/d35/d41/f5c [2316399,130907] 0 2024-09-18T12:51:16.645 INFO:tasks.workunit.client.1.smithi136.stdout:7/727: chown d0/d12/d1a/d46/l52 516275 1 2024-09-18T12:51:16.646 INFO:tasks.workunit.client.0.smithi081.stdout:0/329: link d7/d9/c2a d7/d9/c6d 0 2024-09-18T12:51:16.647 INFO:tasks.workunit.client.0.smithi081.stdout:3/344: creat d3/db/df/d3b/d47/f7a x:0 0 0 2024-09-18T12:51:16.650 INFO:tasks.workunit.client.0.smithi081.stdout:2/414: rename d15/d26/d4d to d15/d16/d20/d22/d8c 0 2024-09-18T12:51:16.653 INFO:tasks.workunit.client.0.smithi081.stdout:2/415: dread d15/d16/d20/d22/f34 [0,4194304] 0 2024-09-18T12:51:16.653 INFO:tasks.workunit.client.0.smithi081.stdout:2/416: write d15/d16/d20/d31/f49 [4309224,72994] 0 2024-09-18T12:51:16.653 INFO:tasks.workunit.client.0.smithi081.stdout:0/330: unlink d7/d9/d4b/d4a/f4c 0 2024-09-18T12:51:16.653 INFO:tasks.workunit.client.1.smithi136.stdout:2/712: read d5/d25/d43/f52 [2331098,92265] 0 2024-09-18T12:51:16.656 INFO:tasks.workunit.client.0.smithi081.stdout:3/345: unlink d3/db/df/d3b/d47/c5b 0 2024-09-18T12:51:16.656 INFO:tasks.workunit.client.0.smithi081.stdout:3/346: creat d3/db/df/d29/d13/d68/f7b x:0 0 0 2024-09-18T12:51:16.656 INFO:tasks.workunit.client.0.smithi081.stdout:3/347: fdatasync d3/db/df/d29/d13/d68/f6b 0 2024-09-18T12:51:16.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/331: link d7/d9/l59 d7/d9/d4b/d4a/l6e 0 2024-09-18T12:51:16.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/332: stat d7/d9/d4b/d4a/f1b 0 2024-09-18T12:51:16.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/335: dwrite d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:16.663 INFO:tasks.workunit.client.1.smithi136.stdout:6/615: dwrite d8/d9/de/d1c/d50/f85 [0,4194304] 0 2024-09-18T12:51:16.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/333: unlink d7/f22 0 2024-09-18T12:51:16.664 INFO:tasks.workunit.client.0.smithi081.stdout:1/336: write d0/d6/f1b [53622,68903] 0 2024-09-18T12:51:16.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/334: dread - d7/d9/d4b/f5c zero size 2024-09-18T12:51:16.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/335: creat d7/f6f x:0 0 0 2024-09-18T12:51:16.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/336: chown d7/d9/d4b/d4a/f1b 64601 1 2024-09-18T12:51:16.666 INFO:tasks.workunit.client.0.smithi081.stdout:6/324: dwrite d4/d12/d1c/f5b [0,4194304] 0 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:9/658: dwrite d6/da/fdb [0,4194304] 0 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:5/674: sync 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:0/686: sync 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:0/687: truncate d1/d3/d1a/fce 302635 0 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:5/675: write d5/d1a/d2d/f87 [151756,121473] 0 2024-09-18T12:51:16.667 INFO:tasks.workunit.client.1.smithi136.stdout:8/735: sync 2024-09-18T12:51:16.668 INFO:tasks.workunit.client.1.smithi136.stdout:3/611: sync 2024-09-18T12:51:16.668 INFO:tasks.workunit.client.1.smithi136.stdout:4/547: sync 2024-09-18T12:51:16.668 INFO:tasks.workunit.client.1.smithi136.stdout:6/616: truncate d8/f65 303583 0 2024-09-18T12:51:16.669 INFO:tasks.workunit.client.0.smithi081.stdout:0/337: unlink d7/f3c 0 2024-09-18T12:51:16.671 INFO:tasks.workunit.client.0.smithi081.stdout:6/325: mkdir d4/d12/d1c/d64 0 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.0.smithi081.stdout:0/338: rmdir d7/d9/d4b/d33/d43 39 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.0.smithi081.stdout:0/339: creat d7/d9/d4b/d53/f70 x:0 0 0 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.1.smithi136.stdout:9/659: creat d6/db/d12/d62/fe4 x:0 0 0 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.1.smithi136.stdout:3/612: truncate d3/d14/dc5/f91 252863 0 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.1.smithi136.stdout:3/613: creat d3/d14/d17/d53/d73/fcc x:0 0 0 2024-09-18T12:51:16.672 INFO:tasks.workunit.client.1.smithi136.stdout:0/688: truncate d1/d3/d1a/d98/d81/d35/d84/f91 1449228 0 2024-09-18T12:51:16.673 INFO:tasks.workunit.client.1.smithi136.stdout:4/548: mknod d0/d8d/cab 0 2024-09-18T12:51:16.674 INFO:tasks.workunit.client.0.smithi081.stdout:6/326: unlink d4/d12/d28/f34 0 2024-09-18T12:51:16.675 INFO:tasks.workunit.client.1.smithi136.stdout:3/614: truncate d3/d2b/d6c/fa2 3351971 0 2024-09-18T12:51:16.675 INFO:tasks.workunit.client.1.smithi136.stdout:3/615: chown d3/d14/d17/d53/f89 298 1 2024-09-18T12:51:16.678 INFO:tasks.workunit.client.1.smithi136.stdout:0/689: symlink d1/d3/d1a/d98/d81/d35/lf1 0 2024-09-18T12:51:16.769 INFO:tasks.workunit.client.1.smithi136.stdout:4/549: mknod d0/d3/d54/d88/cac 0 2024-09-18T12:51:16.769 INFO:tasks.workunit.client.1.smithi136.stdout:0/690: fdatasync d1/d3/d1a/d62/d75/fcc 0 2024-09-18T12:51:16.779 INFO:tasks.workunit.client.0.smithi081.stdout:6/327: symlink d4/d6/l65 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/328: getdents d4/d12/d28/d59 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:3/348: read d3/db/f4b [1184719,7530] 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:3/349: fsync d3/db/df/d29/f48 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/329: mknod d4/d12/d28/d2a/d2d/c66 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/330: truncate d4/d12/d28/d2a/d2d/d31/f3d 108559 0 2024-09-18T12:51:16.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/331: chown d4/d12/d28/d2a/f45 7 1 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:6/332: creat d4/d12/d28/d2a/d2d/d31/f67 x:0 0 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:6/333: write d4/d12/d56/f63 [544458,96385] 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:6/334: rename d4/d12/d28/d2a/d2d/c47 to d4/d6/c68 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:6/335: write d4/d12/d28/f3c [1500404,84703] 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:5/397: dwrite d2/d14/d33/d37/d3b/f77 [0,4194304] 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/417: dwrite d15/d16/d20/d22/f34 [0,4194304] 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/418: symlink d15/d16/d20/d59/l8d 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/419: chown d15/d16/d33/d53/d7a/d32 2 1 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/420: rename d15/d16/d33/d53/d7a/d2f/d61/d7b to d15/d8e 0 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:0/340: rmdir d7 39 2024-09-18T12:51:16.781 INFO:tasks.workunit.client.0.smithi081.stdout:0/341: truncate d7/d9/f23 270329 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/342: write d7/f6f [579048,64336] 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/343: stat d7/l42 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:1/337: dwrite d0/d6/d7/d2e/d51/d2c/f45 [0,4194304] 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/344: symlink d7/d4f/l71 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/345: stat d7/d9/d4b/d4a/l62 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:1/338: mknod d0/d54/c74 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/346: link d7/d9/f44 d7/d9/d4b/d4a/f72 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:1/339: mkdir d0/db/d12/d2d/d75 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:1/340: chown d0/db/l48 320563 1 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:6/336: dwrite d4/d12/d28/d2a/d2d/d31/f67 [0,4194304] 0 2024-09-18T12:51:16.782 INFO:tasks.workunit.client.0.smithi081.stdout:6/337: mknod d4/d12/d28/c69 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:6/338: fsync d4/d6/fd 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:2/421: fsync f7 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:6/339: rename d4/d6/l2e to d4/d12/d1c/d64/l6a 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:0/347: dread d7/d9/d4b/d4a/f16 [4194304,4194304] 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:0/348: chown l2 13492 1 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:3/350: dwrite d3/db/df/d29/f19 [0,4194304] 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:3/351: write d3/db/df/d29/d13/f1e [2707302,124586] 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:5/398: dread d2/dd/d5e/f3a [0,4194304] 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:6/340: rename d4/d12/d1c/d39/d40/f53 to d4/d12/d1c/f6b 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:2/422: symlink d15/d6e/l8f 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:2/423: readlink d15/d26/l87 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:2/424: creat d15/d16/d33/d53/d7a/d2f/d61/f90 x:0 0 0 2024-09-18T12:51:16.783 INFO:tasks.workunit.client.0.smithi081.stdout:2/425: dread - d15/d16/d33/f8b zero size 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:1/341: dread d0/d6/d33/d37/f6d [0,4194304] 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/349: write d7/d9/f23 [978166,90308] 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/426: symlink d15/d16/d33/d53/d7a/d2f/l91 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:1/342: mknod d0/d6/d7/d2e/d41/c76 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/350: symlink d7/d9/l73 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/351: readlink d7/d9/d4b/d33/l4e 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/352: truncate d7/d9/d12/f39 1575666 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/427: link f7 d15/d26/f92 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/428: write d15/d16/d20/d22/f2a [263122,109187] 0 2024-09-18T12:51:16.784 INFO:tasks.workunit.client.0.smithi081.stdout:3/352: dwrite f1 [0,4194304] 0 2024-09-18T12:51:16.785 INFO:tasks.workunit.client.0.smithi081.stdout:1/343: mknod d0/d6/d33/c77 0 2024-09-18T12:51:16.785 INFO:tasks.workunit.client.0.smithi081.stdout:0/353: stat d7/d9/l59 0 2024-09-18T12:51:16.785 INFO:tasks.workunit.client.0.smithi081.stdout:2/429: link d15/d16/d20/d31/f49 d15/d16/d20/d22/d8c/f93 0 2024-09-18T12:51:16.785 INFO:tasks.workunit.client.0.smithi081.stdout:3/353: rename d3/db/df/d60/f5c to d3/db/df/d29/d12/d44/d6f/f7c 0 2024-09-18T12:51:16.786 INFO:tasks.workunit.client.1.smithi136.stdout:4/550: rename d0/d13/l56 to d0/d2/d85/da0/lad 0 2024-09-18T12:51:16.786 INFO:tasks.workunit.client.1.smithi136.stdout:1/590: dwrite d2/d5/d2b/d9b/d2e/d4c/f1f [0,4194304] 0 2024-09-18T12:51:16.786 INFO:tasks.workunit.client.1.smithi136.stdout:4/551: mkdir d0/d3/dae 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/552: chown d0/d3/d54/d88/ca2 3259013 1 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/553: truncate d0/d2/f17 5774949 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:9/660: dread d6/da/fdb [0,4194304] 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:9/661: stat d6/da/d3d/d4d/d91/fbf 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/554: getdents d0/d2/d85 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/555: rmdir d0/d3/d54/d8a 39 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/556: write d0/f1 [8603833,85940] 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/557: creat d0/d5f/faf x:0 0 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:7/728: dwrite d0/d39/d4d/d9a/fb1 [0,4194304] 0 2024-09-18T12:51:16.787 INFO:tasks.workunit.client.1.smithi136.stdout:4/558: unlink d0/d2/l41 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:7/729: mkdir d0/d39/d4d/d55/d101 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:4/559: rename d0/d25/f3a to d0/d8d/fb0 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:7/730: mkdir d0/d12/d1a/dac/d102 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:7/731: creat d0/d35/d41/f103 x:0 0 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:8/736: dread d9/d18/d34/f3e [0,4194304] 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:9/662: dread d6/d13/d4c/f7e [0,4194304] 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:3/616: dwrite d3/d14/dc5/f3f [0,4194304] 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:5/676: dwrite d5/d1a/d30/f4c [0,4194304] 0 2024-09-18T12:51:16.788 INFO:tasks.workunit.client.1.smithi136.stdout:4/560: write d0/d3/f73 [1375659,116815] 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:3/617: mkdir d3/d10/d4a/dcd 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:3/618: fdatasync d3/d14/d18/f8d 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:5/677: symlink d5/d1a/d2d/d34/d88/ld2 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:6/617: dwrite d8/d9/d56/f67 [0,4194304] 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:6/618: fdatasync d8/d9/f74 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:4/561: truncate d0/f72 2288521 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:4/562: write d0/d3/d54/d5c/fa1 [35597,55275] 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:4/563: stat d0/d8d 0 2024-09-18T12:51:16.789 INFO:tasks.workunit.client.1.smithi136.stdout:4/564: chown d0/d25/d83/f9e 3 1 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/565: getdents d0/d3/d54/d5c/d8b 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:5/678: unlink d5/d1a/f1b 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:5/679: creat d5/d1a/d2d/d34/fd3 x:0 0 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:5/680: write d5/d1a/d2d/d34/d88/f86 [4318654,9243] 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/737: dwrite d9/d18/f48 [0,4194304] 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/738: chown d9/d18/d34/d3d/d47/d65/d92/ff5 58941109 1 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:7/732: dwrite d0/d35/d41/d50/fe6 [0,4194304] 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/566: write d0/f15 [7935667,86510] 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:4/567: fdatasync d0/d3/d54/fa4 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/739: dread d9/d14/d1a/d2b/d42/f49 [4194304,4194304] 0 2024-09-18T12:51:16.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/740: chown d9/d18/d34/d3d/d47/d65 1309 1 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:8/741: creat d9/d14/d1a/d2b/d42/da4/dd9/de1/f10c x:0 0 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/733: dread d0/d39/dbf/fc8 [0,4194304] 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/734: creat d0/d12/d5e/d67/f104 x:0 0 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/735: stat d0/d35/d41/d50/fe6 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:7/736: creat d0/d35/d41/d50/d7f/dfa/f105 x:0 0 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:5/681: dwrite d5/d1a/f68 [4194304,4194304] 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:9/663: dwrite d6/da/d3d/d4d/d91/d25/d55/f8d [0,4194304] 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:9/664: write d6/da/d3d/d41/fb8 [157523,58032] 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:9/665: chown d6/df/d23/d2b/c48 982922 1 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:8/742: rename d9/d14/d1a/d2b/d42/d6e/d75/d9a to d9/d18/d34/d3d/d47/dbe/de3/d10d 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:4/568: dwrite d0/d8d/f8e [0,4194304] 0 2024-09-18T12:51:16.791 INFO:tasks.workunit.client.1.smithi136.stdout:5/682: symlink d5/d1a/d2d/d34/d4e/d9b/ld4 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:7/737: mkdir d0/d2c/d2e/d106 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:7/738: write d0/d35/f6c [454327,54674] 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:7/739: chown d0/d35/d41/d50/d9b/lba 478629 1 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:9/666: mkdir d6/df/d23/d2b/de5 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:8/743: link d9/d14/d1a/d2b/d42/da4/da7/fa9 d9/d18/d34/d88/f10e 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:5/683: rename d5/d1a/d2d/d34/d4e/d7a/d9e/fb6 to d5/d1a/d2d/d3f/d7f/fd5 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:5/684: fdatasync d5/f5f 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:4/569: write d0/d2/f3e [6979047,26843] 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:7/740: mkdir d0/d35/d4f/d107 0 2024-09-18T12:51:16.792 INFO:tasks.workunit.client.1.smithi136.stdout:9/667: creat d6/df/d75/dde/fe6 x:0 0 0 2024-09-18T12:51:16.793 INFO:tasks.workunit.client.1.smithi136.stdout:7/741: mknod d0/d35/c108 0 2024-09-18T12:51:16.793 INFO:tasks.workunit.client.1.smithi136.stdout:5/685: dread d5/fc9 [0,4194304] 0 2024-09-18T12:51:16.793 INFO:tasks.workunit.client.1.smithi136.stdout:5/686: chown d5/d1a/l1e 124 1 2024-09-18T12:51:16.793 INFO:tasks.workunit.client.1.smithi136.stdout:4/570: rmdir d0/d45/d67 39 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/742: mkdir d0/d39/d4d/d9a/dee/d109 0 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/743: chown d0/d35/d41/d50/d7b/fb6 64 1 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/744: getdents d0/d35/d4f/d107 0 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:9/668: rmdir d6/db/d12/d62 39 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:5/687: mknod d5/d1a/d2d/d3f/d7f/dbc/cd6 0 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:4/571: mkdir d0/d3/d54/d88/db1 0 2024-09-18T12:51:16.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/745: mkdir d0/d10a 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/354: rmdir d7/d9/d4b/d3d 39 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:2/430: creat d15/d16/d20/d22/d8c/f94 x:0 0 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/355: unlink d7/c19 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:2/431: symlink d15/d16/d33/d53/d7a/d2f/l95 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:2/432: write d15/d16/d20/d22/d8c/f94 [412077,98730] 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:2/433: write d15/d16/d20/d22/d8c/f93 [1245430,111830] 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/356: symlink d7/d9/d4b/d53/l74 0 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/357: chown d7 69860888 1 2024-09-18T12:51:16.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/358: write d7/f21 [1542625,36736] 0 2024-09-18T12:51:16.797 INFO:tasks.workunit.client.0.smithi081.stdout:2/434: symlink d15/d16/d20/d22/d5a/l96 0 2024-09-18T12:51:16.797 INFO:tasks.workunit.client.0.smithi081.stdout:7/353: sync 2024-09-18T12:51:16.797 INFO:tasks.workunit.client.0.smithi081.stdout:3/354: dread d3/db/d1b/f34 [0,4194304] 0 2024-09-18T12:51:16.797 INFO:tasks.workunit.client.0.smithi081.stdout:3/355: chown d3/db/df/d29/f64 1811 1 2024-09-18T12:51:16.798 INFO:tasks.workunit.client.1.smithi136.stdout:8/744: dwrite d9/d14/d1a/d2b/d42/d9e/fdf [0,4194304] 0 2024-09-18T12:51:16.798 INFO:tasks.workunit.client.1.smithi136.stdout:5/688: rename d5/l26 to d5/d1a/d2d/d34/d4e/d7a/d9e/dad/ld7 0 2024-09-18T12:51:16.798 INFO:tasks.workunit.client.0.smithi081.stdout:3/356: link d3/db/f4b d3/db/d1b/f7d 0 2024-09-18T12:51:16.798 INFO:tasks.workunit.client.0.smithi081.stdout:3/357: chown d3/db/df/d29/d12/d44/d51 120248 1 2024-09-18T12:51:16.798 INFO:tasks.workunit.client.0.smithi081.stdout:3/358: fdatasync d3/f46 0 2024-09-18T12:51:16.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/344: dwrite d0/d6/d7/d2e/f63 [0,4194304] 0 2024-09-18T12:51:16.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/345: fdatasync d0/f20 0 2024-09-18T12:51:16.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/346: chown d0/d18/d6a 11 1 2024-09-18T12:51:16.804 INFO:tasks.workunit.client.1.smithi136.stdout:7/746: dread d0/d39/d4d/d9a/fb9 [0,4194304] 0 2024-09-18T12:51:16.805 INFO:tasks.workunit.client.1.smithi136.stdout:5/689: mkdir d5/d1a/d2d/d34/d4e/d9b/dd8 0 2024-09-18T12:51:16.805 INFO:tasks.workunit.client.1.smithi136.stdout:7/747: write d0/d35/d36/d7c/f7d [1131908,25189] 0 2024-09-18T12:51:16.805 INFO:tasks.workunit.client.1.smithi136.stdout:7/748: write d0/d2c/d2e/f32 [3938226,127859] 0 2024-09-18T12:51:16.806 INFO:tasks.workunit.client.1.smithi136.stdout:4/572: mknod d0/cb2 0 2024-09-18T12:51:16.806 INFO:tasks.workunit.client.1.smithi136.stdout:4/573: truncate d0/d3/d54/d88/f8f 440843 0 2024-09-18T12:51:16.808 INFO:tasks.workunit.client.1.smithi136.stdout:9/669: dread d6/df/d23/fa1 [0,4194304] 0 2024-09-18T12:51:16.811 INFO:tasks.workunit.client.0.smithi081.stdout:0/359: dwrite d7/d9/d4b/d53/f69 [0,4194304] 0 2024-09-18T12:51:16.812 INFO:tasks.workunit.client.1.smithi136.stdout:7/749: mkdir d0/d39/d4d/d9a/da2/d10b 0 2024-09-18T12:51:16.813 INFO:tasks.workunit.client.1.smithi136.stdout:4/574: symlink d0/d2/d85/lb3 0 2024-09-18T12:51:16.816 INFO:tasks.workunit.client.0.smithi081.stdout:0/360: mknod d7/d9/d4b/d33/d43/c75 0 2024-09-18T12:51:16.816 INFO:tasks.workunit.client.0.smithi081.stdout:0/361: chown d7/d9/d4b/d4a 323528 1 2024-09-18T12:51:16.816 INFO:tasks.workunit.client.0.smithi081.stdout:0/362: chown d7/d9/d4b/f5c 8304 1 2024-09-18T12:51:16.816 INFO:tasks.workunit.client.0.smithi081.stdout:0/363: write d7/d9/d4b/d53/f64 [212523,49617] 0 2024-09-18T12:51:16.819 INFO:tasks.workunit.client.0.smithi081.stdout:0/364: rename d7/d9/d4b/d4a/l6e to d7/d9/d12/l76 0 2024-09-18T12:51:16.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/365: mkdir d7/d9/d4b/d4a/d77 0 2024-09-18T12:51:16.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/366: chown d7/d9/d4b/d33/l56 1047592977 1 2024-09-18T12:51:16.821 INFO:tasks.workunit.client.1.smithi136.stdout:7/750: rename d0/d39/d4d/d9a/da2/d10b to d0/d35/d41/dfe/d10c 0 2024-09-18T12:51:16.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/367: symlink d7/l78 0 2024-09-18T12:51:16.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/368: fsync d7/d9/f10 0 2024-09-18T12:51:16.822 INFO:tasks.workunit.client.0.smithi081.stdout:0/369: symlink d7/d9/d4b/l79 0 2024-09-18T12:51:16.822 INFO:tasks.workunit.client.0.smithi081.stdout:2/435: dwrite d15/d16/d20/f55 [0,4194304] 0 2024-09-18T12:51:16.824 INFO:tasks.workunit.client.1.smithi136.stdout:7/751: mkdir d0/d12/d5e/d10d 0 2024-09-18T12:51:16.825 INFO:tasks.workunit.client.0.smithi081.stdout:2/436: mkdir d15/d16/d33/d53/d7a/d2f/d61/d97 0 2024-09-18T12:51:16.825 INFO:tasks.workunit.client.1.smithi136.stdout:4/575: rmdir d0/d25/d83 39 2024-09-18T12:51:16.825 INFO:tasks.workunit.client.1.smithi136.stdout:4/576: getdents d0/d3/d54/d5c/d8b 0 2024-09-18T12:51:16.826 INFO:tasks.workunit.client.0.smithi081.stdout:2/437: symlink d15/d16/d20/l98 0 2024-09-18T12:51:16.826 INFO:tasks.workunit.client.0.smithi081.stdout:2/438: write d15/f17 [2034881,62615] 0 2024-09-18T12:51:16.826 INFO:tasks.workunit.client.1.smithi136.stdout:7/752: symlink d0/d35/d41/d50/d9b/l10e 0 2024-09-18T12:51:16.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/439: write d15/d26/f72 [105991,49880] 0 2024-09-18T12:51:16.827 INFO:tasks.workunit.client.1.smithi136.stdout:4/577: symlink d0/d3/d54/d88/lb4 0 2024-09-18T12:51:16.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/440: creat d15/d16/d33/d53/d7a/d32/f99 x:0 0 0 2024-09-18T12:51:16.829 INFO:tasks.workunit.client.0.smithi081.stdout:2/441: fsync d15/d16/d20/f55 0 2024-09-18T12:51:16.829 INFO:tasks.workunit.client.0.smithi081.stdout:2/442: chown d15/d16/d33/d53/c88 1 1 2024-09-18T12:51:16.829 INFO:tasks.workunit.client.1.smithi136.stdout:7/753: mkdir d0/d35/d4f/dd5/d10f 0 2024-09-18T12:51:16.831 INFO:tasks.workunit.client.1.smithi136.stdout:4/578: rename d0/d3/f29 to d0/d3/dae/fb5 0 2024-09-18T12:51:16.831 INFO:tasks.workunit.client.1.smithi136.stdout:4/579: dread - d0/f6a zero size 2024-09-18T12:51:16.831 INFO:tasks.workunit.client.1.smithi136.stdout:4/580: readlink d0/l2a 0 2024-09-18T12:51:16.832 INFO:tasks.workunit.client.1.smithi136.stdout:7/754: unlink d0/d35/d41/d50/d7f/c38 0 2024-09-18T12:51:16.833 INFO:tasks.workunit.client.1.smithi136.stdout:4/581: creat d0/d3/d54/d5c/fb6 x:0 0 0 2024-09-18T12:51:16.833 INFO:tasks.workunit.client.1.smithi136.stdout:7/755: rmdir d0/d2c/d2e 39 2024-09-18T12:51:16.834 INFO:tasks.workunit.client.0.smithi081.stdout:7/354: dwrite d2/d1d/f28 [0,4194304] 0 2024-09-18T12:51:16.835 INFO:tasks.workunit.client.1.smithi136.stdout:5/690: dwrite d5/d1a/d2d/d34/fd3 [0,4194304] 0 2024-09-18T12:51:16.835 INFO:tasks.workunit.client.1.smithi136.stdout:5/691: write d5/fa5 [963369,69740] 0 2024-09-18T12:51:16.835 INFO:tasks.workunit.client.1.smithi136.stdout:4/582: rename d0/d3/d54/d5c/d8b to d0/d25/db7 0 2024-09-18T12:51:16.835 INFO:tasks.workunit.client.1.smithi136.stdout:4/583: chown d0/d45/f55 0 1 2024-09-18T12:51:16.836 INFO:tasks.workunit.client.0.smithi081.stdout:3/359: dwrite d3/db/dc/d1a/f6a [0,4194304] 0 2024-09-18T12:51:16.836 INFO:tasks.workunit.client.0.smithi081.stdout:7/355: unlink d2/d1d/f45 0 2024-09-18T12:51:16.836 INFO:tasks.workunit.client.0.smithi081.stdout:7/356: stat d2/d18/d60/d74 0 2024-09-18T12:51:16.837 INFO:tasks.workunit.client.1.smithi136.stdout:7/756: link d0/d2c/d2e/cdf d0/d35/d4f/c110 0 2024-09-18T12:51:16.837 INFO:tasks.workunit.client.0.smithi081.stdout:3/360: mknod d3/db/c7e 0 2024-09-18T12:51:16.839 INFO:tasks.workunit.client.0.smithi081.stdout:7/357: mkdir d2/d18/d60/d85 0 2024-09-18T12:51:16.841 INFO:tasks.workunit.client.0.smithi081.stdout:3/361: symlink d3/db/l7f 0 2024-09-18T12:51:16.841 INFO:tasks.workunit.client.0.smithi081.stdout:3/362: fsync d3/db/f56 0 2024-09-18T12:51:16.841 INFO:tasks.workunit.client.0.smithi081.stdout:0/370: dread f0 [4194304,4194304] 0 2024-09-18T12:51:16.843 INFO:tasks.workunit.client.1.smithi136.stdout:5/692: truncate d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 2938592 0 2024-09-18T12:51:16.843 INFO:tasks.workunit.client.1.smithi136.stdout:5/693: chown d5/d1a/c32 45662 1 2024-09-18T12:51:16.843 INFO:tasks.workunit.client.0.smithi081.stdout:7/358: mkdir d2/d56/d73/d7c/d86 0 2024-09-18T12:51:16.844 INFO:tasks.workunit.client.1.smithi136.stdout:4/584: dread d0/d3/d54/fa4 [0,4194304] 0 2024-09-18T12:51:16.844 INFO:tasks.workunit.client.1.smithi136.stdout:7/757: truncate d0/d2c/d2e/fdd 3082609 0 2024-09-18T12:51:16.844 INFO:tasks.workunit.client.1.smithi136.stdout:7/758: dread - d0/d35/d41/f103 zero size 2024-09-18T12:51:16.844 INFO:tasks.workunit.client.0.smithi081.stdout:3/363: creat d3/f80 x:0 0 0 2024-09-18T12:51:16.845 INFO:tasks.workunit.client.1.smithi136.stdout:5/694: read d5/d1a/d2d/d34/f45 [186404,102507] 0 2024-09-18T12:51:16.845 INFO:tasks.workunit.client.0.smithi081.stdout:0/371: symlink d7/d9/d4b/d33/l7a 0 2024-09-18T12:51:16.846 INFO:tasks.workunit.client.1.smithi136.stdout:4/585: symlink d0/d2/d85/lb8 0 2024-09-18T12:51:16.847 INFO:tasks.workunit.client.0.smithi081.stdout:7/359: mknod d2/d18/d60/d74/c87 0 2024-09-18T12:51:16.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/364: getdents d3/db/df/d29/d12/d44/d76 0 2024-09-18T12:51:16.849 INFO:tasks.workunit.client.1.smithi136.stdout:7/759: rename d0/d35/d41/f103 to d0/d35/d41/df3/f111 0 2024-09-18T12:51:16.849 INFO:tasks.workunit.client.1.smithi136.stdout:7/760: write d0/d35/d41/f5c [338277,58900] 0 2024-09-18T12:51:16.851 INFO:tasks.workunit.client.0.smithi081.stdout:7/360: unlink d2/d18/f71 0 2024-09-18T12:51:16.851 INFO:tasks.workunit.client.0.smithi081.stdout:7/361: write d2/f6 [610072,26206] 0 2024-09-18T12:51:16.853 INFO:tasks.workunit.client.0.smithi081.stdout:3/365: mknod d3/db/df/d29/d13/d68/c81 0 2024-09-18T12:51:16.854 INFO:tasks.workunit.client.0.smithi081.stdout:2/443: getdents d15/d16/d20 0 2024-09-18T12:51:16.854 INFO:tasks.workunit.client.0.smithi081.stdout:2/444: dread - d15/d16/d33/d53/d7a/d2f/d61/f80 zero size 2024-09-18T12:51:16.856 INFO:tasks.workunit.client.0.smithi081.stdout:0/372: dread d7/d9/d4b/d4a/f1a [0,4194304] 0 2024-09-18T12:51:16.856 INFO:tasks.workunit.client.0.smithi081.stdout:0/373: readlink d7/l60 0 2024-09-18T12:51:16.856 INFO:tasks.workunit.client.1.smithi136.stdout:7/761: symlink d0/d35/l112 0 2024-09-18T12:51:16.857 INFO:tasks.workunit.client.0.smithi081.stdout:3/366: truncate d3/d23/f5e 2375561 0 2024-09-18T12:51:16.857 INFO:tasks.workunit.client.0.smithi081.stdout:2/445: stat d15/d16/d33/c47 0 2024-09-18T12:51:16.858 INFO:tasks.workunit.client.0.smithi081.stdout:7/362: getdents d2/d14 0 2024-09-18T12:51:16.858 INFO:tasks.workunit.client.0.smithi081.stdout:7/363: creat d2/d7f/f88 x:0 0 0 2024-09-18T12:51:16.860 INFO:tasks.workunit.client.0.smithi081.stdout:0/374: mknod d7/d9/d4b/d33/d43/c7b 0 2024-09-18T12:51:16.861 INFO:tasks.workunit.client.1.smithi136.stdout:4/586: dread d0/d5f/f75 [0,4194304] 0 2024-09-18T12:51:16.863 INFO:tasks.workunit.client.0.smithi081.stdout:3/367: mknod d3/db/df/d29/d13/c82 0 2024-09-18T12:51:16.863 INFO:tasks.workunit.client.0.smithi081.stdout:3/368: write d3/f46 [7666630,7188] 0 2024-09-18T12:51:16.863 INFO:tasks.workunit.client.0.smithi081.stdout:7/364: dread d2/d14/d21/d62/f64 [0,4194304] 0 2024-09-18T12:51:16.863 INFO:tasks.workunit.client.1.smithi136.stdout:4/587: symlink d0/d25/d79/lb9 0 2024-09-18T12:51:16.864 INFO:tasks.workunit.client.0.smithi081.stdout:0/375: mkdir d7/d7c 0 2024-09-18T12:51:16.864 INFO:tasks.workunit.client.1.smithi136.stdout:4/588: mkdir d0/d3/d54/dba 0 2024-09-18T12:51:16.865 INFO:tasks.workunit.client.0.smithi081.stdout:0/376: mkdir d7/d9/d4b/d33/d7d 0 2024-09-18T12:51:16.867 INFO:tasks.workunit.client.1.smithi136.stdout:4/589: creat d0/d3/d54/d8a/fbb x:0 0 0 2024-09-18T12:51:16.869 INFO:tasks.workunit.client.1.smithi136.stdout:4/590: symlink d0/d2/lbc 0 2024-09-18T12:51:16.869 INFO:tasks.workunit.client.1.smithi136.stdout:4/591: readlink d0/l78 0 2024-09-18T12:51:16.869 INFO:tasks.workunit.client.1.smithi136.stdout:4/592: write d0/d25/d83/fa3 [387141,110684] 0 2024-09-18T12:51:16.869 INFO:tasks.workunit.client.1.smithi136.stdout:4/593: chown d0/d3/f43 1993515244 1 2024-09-18T12:51:16.870 INFO:tasks.workunit.client.1.smithi136.stdout:4/594: fsync d0/d3/d54/d88/f8f 0 2024-09-18T12:51:16.870 INFO:tasks.workunit.client.1.smithi136.stdout:5/695: dwrite d5/d1a/f85 [0,4194304] 0 2024-09-18T12:51:16.870 INFO:tasks.workunit.client.0.smithi081.stdout:0/377: creat d7/d9/d4b/d4a/d77/f7e x:0 0 0 2024-09-18T12:51:16.872 INFO:tasks.workunit.client.1.smithi136.stdout:4/595: link d0/d2/c24 d0/d45/d67/d7b/cbd 0 2024-09-18T12:51:16.873 INFO:tasks.workunit.client.1.smithi136.stdout:2/713: sync 2024-09-18T12:51:16.875 INFO:tasks.workunit.client.0.smithi081.stdout:0/378: creat d7/d5d/f7f x:0 0 0 2024-09-18T12:51:16.875 INFO:tasks.workunit.client.1.smithi136.stdout:5/696: symlink d5/d1a/d4a/ld9 0 2024-09-18T12:51:16.875 INFO:tasks.workunit.client.1.smithi136.stdout:5/697: truncate d5/d1a/d2d/d34/f95 652608 0 2024-09-18T12:51:16.876 INFO:tasks.workunit.client.0.smithi081.stdout:0/379: unlink d7/c58 0 2024-09-18T12:51:16.876 INFO:tasks.workunit.client.0.smithi081.stdout:0/380: readlink d7/d9/d4b/d33/d43/l48 0 2024-09-18T12:51:16.876 INFO:tasks.workunit.client.0.smithi081.stdout:7/365: dread d2/f13 [0,4194304] 0 2024-09-18T12:51:16.878 INFO:tasks.workunit.client.1.smithi136.stdout:7/762: dwrite d0/d35/d4f/dd5/fda [0,4194304] 0 2024-09-18T12:51:16.878 INFO:tasks.workunit.client.1.smithi136.stdout:7/763: chown d0/d12/d1a/d46 1400134 1 2024-09-18T12:51:16.878 INFO:tasks.workunit.client.1.smithi136.stdout:7/764: fsync d0/d39/d4d/d9a/da2/ffd 0 2024-09-18T12:51:16.878 INFO:tasks.workunit.client.0.smithi081.stdout:0/381: creat d7/f80 x:0 0 0 2024-09-18T12:51:16.879 INFO:tasks.workunit.client.1.smithi136.stdout:4/596: rename d0/l33 to d0/d3/d54/d88/lbe 0 2024-09-18T12:51:16.879 INFO:tasks.workunit.client.1.smithi136.stdout:4/597: chown d0/d3/fa5 109729 1 2024-09-18T12:51:16.881 INFO:tasks.workunit.client.1.smithi136.stdout:2/714: link d5/fa1 d5/d7/fe3 0 2024-09-18T12:51:16.883 INFO:tasks.workunit.client.1.smithi136.stdout:5/698: unlink d5/d1a/d2d/d34/d88/f86 0 2024-09-18T12:51:16.884 INFO:tasks.workunit.client.1.smithi136.stdout:2/715: dread d5/d25/d43/f52 [0,4194304] 0 2024-09-18T12:51:16.885 INFO:tasks.workunit.client.1.smithi136.stdout:2/716: read d5/d25/f8d [711177,26378] 0 2024-09-18T12:51:16.885 INFO:tasks.workunit.client.1.smithi136.stdout:2/717: write d5/d7/d41/f58 [4815269,48242] 0 2024-09-18T12:51:16.886 INFO:tasks.workunit.client.1.smithi136.stdout:2/718: chown d5/d25/d43/d74/cd4 16026 1 2024-09-18T12:51:16.887 INFO:tasks.workunit.client.0.smithi081.stdout:0/382: read d7/d9/d4b/d53/f69 [3396776,62870] 0 2024-09-18T12:51:16.887 INFO:tasks.workunit.client.0.smithi081.stdout:0/383: mknod d7/d9/d4b/d4a/d68/c81 0 2024-09-18T12:51:16.888 INFO:tasks.workunit.client.0.smithi081.stdout:7/366: dread d2/f12 [0,4194304] 0 2024-09-18T12:51:16.892 INFO:tasks.workunit.client.1.smithi136.stdout:7/765: mkdir d0/d35/d41/d50/d113 0 2024-09-18T12:51:16.892 INFO:tasks.workunit.client.1.smithi136.stdout:7/766: chown d0/d35/d4f/d107 1886664289 1 2024-09-18T12:51:16.895 INFO:tasks.workunit.client.0.smithi081.stdout:0/384: rmdir d7/d5d 39 2024-09-18T12:51:16.896 INFO:tasks.workunit.client.1.smithi136.stdout:2/719: dread d5/f1c [4194304,4194304] 0 2024-09-18T12:51:16.896 INFO:tasks.workunit.client.1.smithi136.stdout:4/598: rename d0/l22 to d0/d25/db7/lbf 0 2024-09-18T12:51:16.898 INFO:tasks.workunit.client.0.smithi081.stdout:0/385: creat d7/d9/d4b/d33/f82 x:0 0 0 2024-09-18T12:51:16.899 INFO:tasks.workunit.client.0.smithi081.stdout:0/386: creat d7/d9/d4b/d4a/d68/f83 x:0 0 0 2024-09-18T12:51:16.901 INFO:tasks.workunit.client.1.smithi136.stdout:7/767: creat d0/d35/d41/d50/d9b/dc2/de0/f114 x:0 0 0 2024-09-18T12:51:16.902 INFO:tasks.workunit.client.1.smithi136.stdout:5/699: dread d5/d1a/f3a [0,4194304] 0 2024-09-18T12:51:16.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/700: fsync d5/d1a/d30/f4c 0 2024-09-18T12:51:16.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/701: read - d5/d1a/d2d/d3f/fa8 zero size 2024-09-18T12:51:16.903 INFO:tasks.workunit.client.1.smithi136.stdout:7/768: creat d0/d35/d41/dfe/d10c/f115 x:0 0 0 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:0/691: sync 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:0/692: write d1/d3/d1a/d98/d81/d72/f8e [2437596,2154] 0 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:0/693: readlink d1/d3/d1a/d98/d81/d35/lf1 0 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:0/694: readlink d1/d60/lc1 0 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:3/619: sync 2024-09-18T12:51:16.904 INFO:tasks.workunit.client.1.smithi136.stdout:3/620: chown d3/d14/d17/d53 7278 1 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/621: creat d3/d14/d17/d75/d86/fce x:0 0 0 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/622: chown d3/d14/d17/d8c/c99 0 1 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/623: readlink d3/d10/l8f 0 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/624: chown d3/d14/d22/l1c 9 1 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/625: creat d3/d14/d17/d8c/d96/fcf x:0 0 0 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:3/626: chown d3/d14/d18/l28 911704 1 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:1/591: sync 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:6/619: sync 2024-09-18T12:51:16.905 INFO:tasks.workunit.client.1.smithi136.stdout:5/702: symlink d5/d6b/dc3/lda 0 2024-09-18T12:51:16.908 INFO:tasks.workunit.client.1.smithi136.stdout:0/695: unlink d1/d3/d1a/d62/d75/l7d 0 2024-09-18T12:51:16.908 INFO:tasks.workunit.client.1.smithi136.stdout:0/696: read d1/d17/f4c [491411,130215] 0 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:8/745: sync 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:9/670: sync 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:1/592: mknod d2/d5/d2b/d34/d86/cbf 0 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:8/746: fdatasync d9/d14/d1a/d2b/d42/da4/dd9/de1/f10c 0 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:1/593: truncate d2/d5/d2b/d34/d86/d50/f57 4627241 0 2024-09-18T12:51:16.910 INFO:tasks.workunit.client.1.smithi136.stdout:1/594: chown d2/d5/fa1 56305662 1 2024-09-18T12:51:16.911 INFO:tasks.workunit.client.1.smithi136.stdout:1/595: stat d2/d5/d2b/c82 0 2024-09-18T12:51:16.912 INFO:tasks.workunit.client.1.smithi136.stdout:9/671: rename d6/db/d12/fd6 to d6/fe7 0 2024-09-18T12:51:16.913 INFO:tasks.workunit.client.1.smithi136.stdout:1/596: mknod d2/d5/d2b/d9b/d2e/d9a/cc0 0 2024-09-18T12:51:16.913 INFO:tasks.workunit.client.1.smithi136.stdout:1/597: chown d2/d5/fa1 352316504 1 2024-09-18T12:51:16.914 INFO:tasks.workunit.client.1.smithi136.stdout:1/598: creat d2/d5/d2b/d9b/d2e/d9a/fc1 x:0 0 0 2024-09-18T12:51:16.915 INFO:tasks.workunit.client.1.smithi136.stdout:9/672: mkdir d6/db/de8 0 2024-09-18T12:51:16.915 INFO:tasks.workunit.client.0.smithi081.stdout:0/387: dread d7/d9/d4b/d4a/f29 [0,4194304] 0 2024-09-18T12:51:16.916 INFO:tasks.workunit.client.0.smithi081.stdout:0/388: chown d7/d9/d12/l6b 45 1 2024-09-18T12:51:16.919 INFO:tasks.workunit.client.1.smithi136.stdout:6/620: dread d8/d9/d56/f86 [0,4194304] 0 2024-09-18T12:51:16.919 INFO:tasks.workunit.client.1.smithi136.stdout:6/621: creat d8/d9/de/d60/d94/fc4 x:0 0 0 2024-09-18T12:51:16.921 INFO:tasks.workunit.client.1.smithi136.stdout:6/622: creat d8/d9/d64/dbb/fc5 x:0 0 0 2024-09-18T12:51:16.923 INFO:tasks.workunit.client.1.smithi136.stdout:6/623: link d8/d9/de/d60/fa5 d8/daa/fc6 0 2024-09-18T12:51:16.924 INFO:tasks.workunit.client.1.smithi136.stdout:6/624: symlink d8/d9/d56/lc7 0 2024-09-18T12:51:16.924 INFO:tasks.workunit.client.1.smithi136.stdout:6/625: fdatasync d8/f30 0 2024-09-18T12:51:16.934 INFO:tasks.workunit.client.1.smithi136.stdout:0/697: dread d1/d3/d1a/d98/d81/d35/f40 [0,4194304] 0 2024-09-18T12:51:16.991 INFO:tasks.workunit.client.1.smithi136.stdout:2/720: dwrite d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:16.991 INFO:tasks.workunit.client.1.smithi136.stdout:2/721: chown f3 2785 1 2024-09-18T12:51:16.992 INFO:tasks.workunit.client.1.smithi136.stdout:2/722: link d5/d25/f40 d5/d4a/d67/fe4 0 2024-09-18T12:51:16.992 INFO:tasks.workunit.client.1.smithi136.stdout:2/723: creat d5/d7/d41/d53/fe5 x:0 0 0 2024-09-18T12:51:16.992 INFO:tasks.workunit.client.1.smithi136.stdout:2/724: creat d5/d4a/fe6 x:0 0 0 2024-09-18T12:51:16.992 INFO:tasks.workunit.client.0.smithi081.stdout:7/367: dwrite d2/d14/f2f [4194304,4194304] 0 2024-09-18T12:51:16.995 INFO:tasks.workunit.client.1.smithi136.stdout:2/725: rename d5/d7/d3b/l49 to d5/d7/d41/d53/le7 0 2024-09-18T12:51:16.995 INFO:tasks.workunit.client.0.smithi081.stdout:7/368: dread d2/d1d/d27/f3d [0,4194304] 0 2024-09-18T12:51:16.996 INFO:tasks.workunit.client.1.smithi136.stdout:2/726: rename d5/d25/d2d/fdb to d5/d4a/fe8 0 2024-09-18T12:51:16.996 INFO:tasks.workunit.client.0.smithi081.stdout:7/369: creat d2/d18/d60/d85/f89 x:0 0 0 2024-09-18T12:51:16.998 INFO:tasks.workunit.client.1.smithi136.stdout:2/727: rename d5/d7/d41/f4f to d5/d25/d43/fe9 0 2024-09-18T12:51:16.998 INFO:tasks.workunit.client.0.smithi081.stdout:7/370: rename d2/d18/d60/d74 to d2/d14/d66/d8a 0 2024-09-18T12:51:16.998 INFO:tasks.workunit.client.0.smithi081.stdout:7/371: chown d2/f34 39 1 2024-09-18T12:51:16.998 INFO:tasks.workunit.client.0.smithi081.stdout:7/372: fdatasync d2/f34 0 2024-09-18T12:51:16.999 INFO:tasks.workunit.client.1.smithi136.stdout:5/703: dwrite d5/d1a/d2d/d34/fa3 [0,4194304] 0 2024-09-18T12:51:16.999 INFO:tasks.workunit.client.1.smithi136.stdout:5/704: stat d5/d1a/d2d/d34/fa3 0 2024-09-18T12:51:17.014 INFO:tasks.workunit.client.0.smithi081.stdout:7/373: write d2/f11 [4104447,116832] 0 2024-09-18T12:51:17.014 INFO:tasks.workunit.client.0.smithi081.stdout:7/374: stat d2/d1d/d27/f3d 0 2024-09-18T12:51:17.020 INFO:tasks.workunit.client.1.smithi136.stdout:1/599: dwrite d2/f3f [0,4194304] 0 2024-09-18T12:51:17.021 INFO:tasks.workunit.client.1.smithi136.stdout:7/769: dwrite d0/d35/d41/d50/d5a/d98/fe7 [0,4194304] 0 2024-09-18T12:51:17.021 INFO:tasks.workunit.client.1.smithi136.stdout:7/770: read - d0/d35/d41/d50/fbc zero size 2024-09-18T12:51:17.022 INFO:tasks.workunit.client.1.smithi136.stdout:3/627: dwrite d3/d14/d18/f8d [0,4194304] 0 2024-09-18T12:51:17.023 INFO:tasks.workunit.client.1.smithi136.stdout:9/673: dwrite d6/d13/d4c/fa7 [0,4194304] 0 2024-09-18T12:51:17.023 INFO:tasks.workunit.client.1.smithi136.stdout:0/698: dwrite d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:17.023 INFO:tasks.workunit.client.1.smithi136.stdout:0/699: chown d1/d3/d1a/d98/d81/d51/fd7 67 1 2024-09-18T12:51:17.023 INFO:tasks.workunit.client.1.smithi136.stdout:9/674: creat d6/df/d75/fe9 x:0 0 0 2024-09-18T12:51:17.025 INFO:tasks.workunit.client.1.smithi136.stdout:7/771: mkdir d0/d12/d5e/d10d/d116 0 2024-09-18T12:51:17.027 INFO:tasks.workunit.client.1.smithi136.stdout:2/728: write d5/d7/d17/d48/f4e [6011950,64170] 0 2024-09-18T12:51:17.027 INFO:tasks.workunit.client.1.smithi136.stdout:6/626: dwrite d8/d9/de/d1c/f5e [0,4194304] 0 2024-09-18T12:51:17.027 INFO:tasks.workunit.client.1.smithi136.stdout:5/705: dwrite d5/d1a/d2d/fb9 [0,4194304] 0 2024-09-18T12:51:17.031 INFO:tasks.workunit.client.1.smithi136.stdout:0/700: rename d1/d3/d1a/d98/d81/d35/l3d to d1/d46/lf2 0 2024-09-18T12:51:17.033 INFO:tasks.workunit.client.0.smithi081.stdout:7/375: dwrite d2/d14/d21/f78 [0,4194304] 0 2024-09-18T12:51:17.033 INFO:tasks.workunit.client.0.smithi081.stdout:7/376: write d2/d1d/f36 [260073,99804] 0 2024-09-18T12:51:17.033 INFO:tasks.workunit.client.1.smithi136.stdout:9/675: truncate d6/da/d3d/f7b 2270596 0 2024-09-18T12:51:17.034 INFO:tasks.workunit.client.0.smithi081.stdout:7/377: truncate d2/d14/f16 316260 0 2024-09-18T12:51:17.035 INFO:tasks.workunit.client.0.smithi081.stdout:7/378: truncate d2/d56/d73/d7c/f63 416897 0 2024-09-18T12:51:17.037 INFO:tasks.workunit.client.1.smithi136.stdout:1/600: getdents d2/d5/d2b/d34/d86 0 2024-09-18T12:51:17.039 INFO:tasks.workunit.client.1.smithi136.stdout:2/729: rmdir d5/d7/d41 39 2024-09-18T12:51:17.039 INFO:tasks.workunit.client.1.smithi136.stdout:2/730: chown d5/d7/d41/d53/f63 180704 1 2024-09-18T12:51:17.039 INFO:tasks.workunit.client.1.smithi136.stdout:0/701: dread d1/d60/f68 [0,4194304] 0 2024-09-18T12:51:17.040 INFO:tasks.workunit.client.1.smithi136.stdout:6/627: readlink d8/d9/d3c/d4a/l63 0 2024-09-18T12:51:17.040 INFO:tasks.workunit.client.1.smithi136.stdout:6/628: dread - d8/d9/d3c/d4a/fbf zero size 2024-09-18T12:51:17.040 INFO:tasks.workunit.client.1.smithi136.stdout:6/629: write d8/d9/f21 [746592,2135] 0 2024-09-18T12:51:17.041 INFO:tasks.workunit.client.1.smithi136.stdout:5/706: symlink d5/d6b/dac/ldb 0 2024-09-18T12:51:17.041 INFO:tasks.workunit.client.1.smithi136.stdout:5/707: write d5/d1a/d30/f81 [2201607,68454] 0 2024-09-18T12:51:17.042 INFO:tasks.workunit.client.1.smithi136.stdout:3/628: rmdir d3/d14/d17/d75/d86 39 2024-09-18T12:51:17.042 INFO:tasks.workunit.client.1.smithi136.stdout:3/629: write d3/d14/d18/f88 [163543,101102] 0 2024-09-18T12:51:17.042 INFO:tasks.workunit.client.1.smithi136.stdout:3/630: chown d3/d2b/d6c 32251 1 2024-09-18T12:51:17.043 INFO:tasks.workunit.client.1.smithi136.stdout:9/676: creat d6/da/dd1/fea x:0 0 0 2024-09-18T12:51:17.044 INFO:tasks.workunit.client.1.smithi136.stdout:2/731: mkdir d5/d7/d17/d48/dc1/dea 0 2024-09-18T12:51:17.048 INFO:tasks.workunit.client.1.smithi136.stdout:0/702: unlink d1/db/d76/db9/ce9 0 2024-09-18T12:51:17.048 INFO:tasks.workunit.client.0.smithi081.stdout:7/379: dread d2/f34 [0,4194304] 0 2024-09-18T12:51:17.049 INFO:tasks.workunit.client.1.smithi136.stdout:7/772: dwrite d0/d35/d41/d50/fbc [0,4194304] 0 2024-09-18T12:51:17.049 INFO:tasks.workunit.client.1.smithi136.stdout:7/773: stat d0/d2c 0 2024-09-18T12:51:17.050 INFO:tasks.workunit.client.0.smithi081.stdout:7/380: rename d2/d18/d3c/c6b to d2/c8b 0 2024-09-18T12:51:17.050 INFO:tasks.workunit.client.1.smithi136.stdout:5/708: creat d5/d1a/d2d/d34/d4e/d7a/d9e/da9/fdc x:0 0 0 2024-09-18T12:51:17.050 INFO:tasks.workunit.client.1.smithi136.stdout:5/709: truncate d5/d1a/fc0 881579 0 2024-09-18T12:51:17.051 INFO:tasks.workunit.client.0.smithi081.stdout:7/381: creat d2/d18/f8c x:0 0 0 2024-09-18T12:51:17.051 INFO:tasks.workunit.client.0.smithi081.stdout:9/226: sync 2024-09-18T12:51:17.051 INFO:tasks.workunit.client.0.smithi081.stdout:8/333: sync 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.0.smithi081.stdout:4/293: sync 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.0.smithi081.stdout:7/382: creat d2/d18/d22/d48/f8d x:0 0 0 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.0.smithi081.stdout:7/383: truncate d2/d18/f8c 358113 0 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.1.smithi136.stdout:1/601: dread d2/d5/d2b/d9b/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.1.smithi136.stdout:1/602: chown d2/c87 8218160 1 2024-09-18T12:51:17.052 INFO:tasks.workunit.client.1.smithi136.stdout:1/603: write d2/d5/fa1 [938612,108551] 0 2024-09-18T12:51:17.053 INFO:tasks.workunit.client.1.smithi136.stdout:1/604: write d2/f16 [4733597,100007] 0 2024-09-18T12:51:17.053 INFO:tasks.workunit.client.1.smithi136.stdout:3/631: unlink d3/c15 0 2024-09-18T12:51:17.053 INFO:tasks.workunit.client.0.smithi081.stdout:8/334: link d3/d1e/d4c/d53/c63 d3/d2f/c79 0 2024-09-18T12:51:17.056 INFO:tasks.workunit.client.0.smithi081.stdout:9/227: rename dd/c10 to dd/d1d/c46 0 2024-09-18T12:51:17.056 INFO:tasks.workunit.client.0.smithi081.stdout:9/228: dread - dd/d1d/d1e/d39/f3e zero size 2024-09-18T12:51:17.056 INFO:tasks.workunit.client.0.smithi081.stdout:9/229: fsync dd/d1d/d1e/d39/f3f 0 2024-09-18T12:51:17.056 INFO:tasks.workunit.client.1.smithi136.stdout:6/630: dread d8/d9/de/d1c/f20 [0,4194304] 0 2024-09-18T12:51:17.056 INFO:tasks.workunit.client.1.smithi136.stdout:6/631: chown d8/d9d/db4 21 1 2024-09-18T12:51:17.057 INFO:tasks.workunit.client.1.smithi136.stdout:6/632: chown d8/d9/de/d1c/l37 29120486 1 2024-09-18T12:51:17.057 INFO:tasks.workunit.client.1.smithi136.stdout:6/633: creat d8/d9/de/d60/d94/fc8 x:0 0 0 2024-09-18T12:51:17.057 INFO:tasks.workunit.client.1.smithi136.stdout:2/732: rename d5/d25/l5d to d5/d25/d2d/d9d/leb 0 2024-09-18T12:51:17.057 INFO:tasks.workunit.client.1.smithi136.stdout:2/733: fdatasync d5/d7/f8b 0 2024-09-18T12:51:17.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/384: truncate d2/d18/f1e 301996 0 2024-09-18T12:51:17.058 INFO:tasks.workunit.client.1.smithi136.stdout:0/703: mknod d1/d60/d82/cf3 0 2024-09-18T12:51:17.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/385: mknod d2/d18/d3c/c8e 0 2024-09-18T12:51:17.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/386: write d2/d18/d22/d48/f75 [323770,4854] 0 2024-09-18T12:51:17.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/387: chown d2/d56 286487 1 2024-09-18T12:51:17.062 INFO:tasks.workunit.client.0.smithi081.stdout:4/294: rename d3/db/f39 to d3/d20/d5b/f66 0 2024-09-18T12:51:17.063 INFO:tasks.workunit.client.0.smithi081.stdout:7/388: link d2/d14/d21/c35 d2/c8f 0 2024-09-18T12:51:17.066 INFO:tasks.workunit.client.0.smithi081.stdout:9/230: rename dd/c19 to dd/d31/c47 0 2024-09-18T12:51:17.070 INFO:tasks.workunit.client.1.smithi136.stdout:3/632: dread d3/d2b/d6c/fa2 [0,4194304] 0 2024-09-18T12:51:17.072 INFO:tasks.workunit.client.1.smithi136.stdout:7/774: symlink d0/d35/d41/d50/d7f/dfa/l117 0 2024-09-18T12:51:17.075 INFO:tasks.workunit.client.1.smithi136.stdout:1/605: mknod d2/d5/d2b/da9/cc2 0 2024-09-18T12:51:17.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/389: getdents d2/d18 0 2024-09-18T12:51:17.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/390: write d2/f10 [793998,640] 0 2024-09-18T12:51:17.077 INFO:tasks.workunit.client.0.smithi081.stdout:4/295: dread d3/f22 [0,4194304] 0 2024-09-18T12:51:17.077 INFO:tasks.workunit.client.0.smithi081.stdout:4/296: fdatasync d3/d20/d3d/d65/d14/d3e/f51 0 2024-09-18T12:51:17.077 INFO:tasks.workunit.client.0.smithi081.stdout:7/391: rmdir d2/d18/d60 39 2024-09-18T12:51:17.077 INFO:tasks.workunit.client.1.smithi136.stdout:6/634: unlink d8/d9/c7d 0 2024-09-18T12:51:17.078 INFO:tasks.workunit.client.1.smithi136.stdout:6/635: chown d8/d9/d64/f98 699 1 2024-09-18T12:51:17.078 INFO:tasks.workunit.client.0.smithi081.stdout:7/392: rmdir d2/d1d/d4e 39 2024-09-18T12:51:17.078 INFO:tasks.workunit.client.1.smithi136.stdout:2/734: truncate d5/d25/f28 670462 0 2024-09-18T12:51:17.082 INFO:tasks.workunit.client.1.smithi136.stdout:0/704: mknod d1/d17/dd1/cf4 0 2024-09-18T12:51:17.083 INFO:tasks.workunit.client.1.smithi136.stdout:9/677: dwrite d6/db/d72/fb3 [0,4194304] 0 2024-09-18T12:51:17.085 INFO:tasks.workunit.client.1.smithi136.stdout:3/633: mknod d3/d14/d17/d53/cd0 0 2024-09-18T12:51:17.085 INFO:tasks.workunit.client.1.smithi136.stdout:3/634: fsync d3/d14/d22/f1f 0 2024-09-18T12:51:17.085 INFO:tasks.workunit.client.1.smithi136.stdout:3/635: fsync d3/d14/fb9 0 2024-09-18T12:51:17.085 INFO:tasks.workunit.client.1.smithi136.stdout:3/636: truncate d3/d14/d17/d8c/d96/fcf 264459 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:1/606: unlink d2/d5/d2b/d9b/d2e/c4e 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:6/636: unlink d8/d9/d64/f77 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:7/775: dread d0/d35/d4f/dd5/fda [0,4194304] 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:9/678: dread d6/da/fdb [0,4194304] 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:9/679: write d6/db/d72/fd4 [886061,32201] 0 2024-09-18T12:51:17.091 INFO:tasks.workunit.client.1.smithi136.stdout:5/710: dwrite d5/d1a/fc1 [0,4194304] 0 2024-09-18T12:51:17.093 INFO:tasks.workunit.client.1.smithi136.stdout:1/607: write d2/d5/d2b/d9b/d2e/d9a/fad [286904,83461] 0 2024-09-18T12:51:17.093 INFO:tasks.workunit.client.1.smithi136.stdout:3/637: dread d3/d14/d17/d8c/d96/f9c [0,4194304] 0 2024-09-18T12:51:17.093 INFO:tasks.workunit.client.1.smithi136.stdout:2/735: rename d5/d4a/l56 to d5/d7/dbf/lec 0 2024-09-18T12:51:17.095 INFO:tasks.workunit.client.1.smithi136.stdout:7/776: truncate d0/fa 7078249 0 2024-09-18T12:51:17.095 INFO:tasks.workunit.client.0.smithi081.stdout:9/231: dwrite dd/d1d/d1e/d39/f3e [0,4194304] 0 2024-09-18T12:51:17.095 INFO:tasks.workunit.client.0.smithi081.stdout:9/232: truncate dd/de/f13 1264795 0 2024-09-18T12:51:17.096 INFO:tasks.workunit.client.0.smithi081.stdout:9/233: write dd/d1d/d1e/d24/f33 [1639007,111949] 0 2024-09-18T12:51:17.096 INFO:tasks.workunit.client.0.smithi081.stdout:8/335: dwrite d3/d1d/f55 [0,4194304] 0 2024-09-18T12:51:17.098 INFO:tasks.workunit.client.1.smithi136.stdout:5/711: link d5/d1a/d30/d7b/fca d5/d1a/d2d/d34/fdd 0 2024-09-18T12:51:17.099 INFO:tasks.workunit.client.1.smithi136.stdout:3/638: fsync d3/d14/d18/f88 0 2024-09-18T12:51:17.100 INFO:tasks.workunit.client.0.smithi081.stdout:9/234: mkdir dd/d1d/d1e/d24/d48 0 2024-09-18T12:51:17.101 INFO:tasks.workunit.client.1.smithi136.stdout:1/608: stat d2/d5/d2b/d9b/d1b/cb2 0 2024-09-18T12:51:17.102 INFO:tasks.workunit.client.0.smithi081.stdout:9/235: creat dd/d1d/d1e/d2f/f49 x:0 0 0 2024-09-18T12:51:17.102 INFO:tasks.workunit.client.1.smithi136.stdout:9/680: rename d6/d96/f86 to d6/df/d23/d2b/de5/feb 0 2024-09-18T12:51:17.102 INFO:tasks.workunit.client.1.smithi136.stdout:9/681: chown d6/db/d12/d62/f8e 113581301 1 2024-09-18T12:51:17.102 INFO:tasks.workunit.client.1.smithi136.stdout:9/682: dread - d6/db/d12/d62/f74 zero size 2024-09-18T12:51:17.103 INFO:tasks.workunit.client.1.smithi136.stdout:9/683: creat d6/df/d75/fec x:0 0 0 2024-09-18T12:51:17.103 INFO:tasks.workunit.client.1.smithi136.stdout:7/777: creat d0/d35/dd9/f118 x:0 0 0 2024-09-18T12:51:17.103 INFO:tasks.workunit.client.1.smithi136.stdout:7/778: chown d0/d35/d41/d50/cb2 7 1 2024-09-18T12:51:17.103 INFO:tasks.workunit.client.0.smithi081.stdout:4/297: dwrite d3/db/fe [0,4194304] 0 2024-09-18T12:51:17.104 INFO:tasks.workunit.client.0.smithi081.stdout:4/298: chown d3/d20/d3d/d65/d14/f31 192321053 1 2024-09-18T12:51:17.104 INFO:tasks.workunit.client.1.smithi136.stdout:5/712: truncate d5/f1c 15038 0 2024-09-18T12:51:17.104 INFO:tasks.workunit.client.1.smithi136.stdout:5/713: write d5/d1a/d4a/d79/f94 [258992,120384] 0 2024-09-18T12:51:17.104 INFO:tasks.workunit.client.1.smithi136.stdout:5/714: fdatasync d5/d1a/d2d/d34/d4e/f70 0 2024-09-18T12:51:17.106 INFO:tasks.workunit.client.1.smithi136.stdout:3/639: creat d3/d14/d17/d75/d87/fd1 x:0 0 0 2024-09-18T12:51:17.107 INFO:tasks.workunit.client.0.smithi081.stdout:7/393: dread d2/d18/f1e [0,4194304] 0 2024-09-18T12:51:17.107 INFO:tasks.workunit.client.1.smithi136.stdout:1/609: mknod d2/d5/d2b/cc3 0 2024-09-18T12:51:17.111 INFO:tasks.workunit.client.1.smithi136.stdout:7/779: rmdir d0/d35/d36/d7c/d100 0 2024-09-18T12:51:17.113 INFO:tasks.workunit.client.1.smithi136.stdout:0/705: dwrite d1/d60/f6f [0,4194304] 0 2024-09-18T12:51:17.114 INFO:tasks.workunit.client.1.smithi136.stdout:3/640: unlink d3/d14/d22/c25 0 2024-09-18T12:51:17.117 INFO:tasks.workunit.client.1.smithi136.stdout:7/780: symlink d0/d12/d1a/d46/l119 0 2024-09-18T12:51:17.117 INFO:tasks.workunit.client.1.smithi136.stdout:9/684: read d6/da/d3d/d4d/d91/d25/f31 [247988,608] 0 2024-09-18T12:51:17.117 INFO:tasks.workunit.client.1.smithi136.stdout:7/781: chown d0/d35/d41 614379 1 2024-09-18T12:51:17.117 INFO:tasks.workunit.client.1.smithi136.stdout:1/610: mkdir d2/dc4 0 2024-09-18T12:51:17.118 INFO:tasks.workunit.client.1.smithi136.stdout:0/706: unlink d1/d3/f58 0 2024-09-18T12:51:17.118 INFO:tasks.workunit.client.1.smithi136.stdout:0/707: creat d1/d3/d1a/d98/d81/d70/dbc/ff5 x:0 0 0 2024-09-18T12:51:17.118 INFO:tasks.workunit.client.1.smithi136.stdout:0/708: stat d1/d3/d1a/d98/d81/d72 0 2024-09-18T12:51:17.119 INFO:tasks.workunit.client.1.smithi136.stdout:3/641: rmdir d3/d10/d4a/dcd 0 2024-09-18T12:51:17.119 INFO:tasks.workunit.client.1.smithi136.stdout:3/642: write d3/d10/d4a/d51/fa0 [2217995,1467] 0 2024-09-18T12:51:17.120 INFO:tasks.workunit.client.1.smithi136.stdout:3/643: stat d3/d10 0 2024-09-18T12:51:17.121 INFO:tasks.workunit.client.1.smithi136.stdout:6/637: dwrite d8/d9/d3c/f62 [0,4194304] 0 2024-09-18T12:51:17.121 INFO:tasks.workunit.client.0.smithi081.stdout:9/236: truncate dd/d1d/d1e/d24/d2a/f30 806670 0 2024-09-18T12:51:17.121 INFO:tasks.workunit.client.0.smithi081.stdout:9/237: stat dd/d1b/l27 0 2024-09-18T12:51:17.122 INFO:tasks.workunit.client.1.smithi136.stdout:1/611: symlink d2/d5/d2b/da9/lc5 0 2024-09-18T12:51:17.122 INFO:tasks.workunit.client.1.smithi136.stdout:1/612: fdatasync d2/d5/d2b/d9b/d2e/fb5 0 2024-09-18T12:51:17.122 INFO:tasks.workunit.client.1.smithi136.stdout:1/613: write d2/d5/d2b/d9b/d2e/f79 [924725,33166] 0 2024-09-18T12:51:17.123 INFO:tasks.workunit.client.1.smithi136.stdout:2/736: dwrite f3 [0,4194304] 0 2024-09-18T12:51:17.126 INFO:tasks.workunit.client.0.smithi081.stdout:9/238: dread dd/d1d/d1e/f43 [0,4194304] 0 2024-09-18T12:51:17.127 INFO:tasks.workunit.client.1.smithi136.stdout:0/709: creat d1/d17/dd1/ff6 x:0 0 0 2024-09-18T12:51:17.129 INFO:tasks.workunit.client.1.smithi136.stdout:6/638: mkdir d8/d9/de/d1c/dc9 0 2024-09-18T12:51:17.129 INFO:tasks.workunit.client.1.smithi136.stdout:4/599: sync 2024-09-18T12:51:17.129 INFO:tasks.workunit.client.1.smithi136.stdout:8/747: sync 2024-09-18T12:51:17.130 INFO:tasks.workunit.client.1.smithi136.stdout:8/748: chown d9/d14/d1a/d2b/d42/d6e/d75/db4 325173 1 2024-09-18T12:51:17.130 INFO:tasks.workunit.client.1.smithi136.stdout:4/600: creat d0/d13/fc0 x:0 0 0 2024-09-18T12:51:17.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/685: rmdir d6/db 39 2024-09-18T12:51:17.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/686: fdatasync d6/da/d3d/d4d/d91/f6f 0 2024-09-18T12:51:17.130 INFO:tasks.workunit.client.1.smithi136.stdout:9/687: write d6/db/d12/d62/fe4 [79374,41276] 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:1/614: creat d2/d5/d2b/d9b/d1b/fc6 x:0 0 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:4/601: dread d0/d25/d83/f9e [0,4194304] 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:2/737: getdents d5/d7/d17/d48/db1 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:5/715: dwrite d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 [0,4194304] 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:0/710: dread d1/d17/f2b [0,4194304] 0 2024-09-18T12:51:17.133 INFO:tasks.workunit.client.1.smithi136.stdout:0/711: fsync d1/f1f 0 2024-09-18T12:51:17.134 INFO:tasks.workunit.client.0.smithi081.stdout:7/394: dwrite d2/d18/d22/d48/f8d [0,4194304] 0 2024-09-18T12:51:17.135 INFO:tasks.workunit.client.1.smithi136.stdout:6/639: creat d8/d9d/db4/fca x:0 0 0 2024-09-18T12:51:17.138 INFO:tasks.workunit.client.1.smithi136.stdout:7/782: write d0/d39/fb8 [1840975,90845] 0 2024-09-18T12:51:17.138 INFO:tasks.workunit.client.1.smithi136.stdout:8/749: creat d9/d18/d34/d3d/d47/d65/d92/f10f x:0 0 0 2024-09-18T12:51:17.139 INFO:tasks.workunit.client.0.smithi081.stdout:9/239: write dd/d1d/d1e/d39/f3e [777940,12796] 0 2024-09-18T12:51:17.141 INFO:tasks.workunit.client.0.smithi081.stdout:9/240: mkdir dd/d31/d4a 0 2024-09-18T12:51:17.141 INFO:tasks.workunit.client.1.smithi136.stdout:3/644: dwrite d3/d14/d18/d7f/f56 [4194304,4194304] 0 2024-09-18T12:51:17.141 INFO:tasks.workunit.client.1.smithi136.stdout:9/688: link d6/df/d75/fe9 d6/da/d3d/d4d/fed 0 2024-09-18T12:51:17.143 INFO:tasks.workunit.client.0.smithi081.stdout:9/241: symlink dd/d15/d1a/d35/l4b 0 2024-09-18T12:51:17.143 INFO:tasks.workunit.client.0.smithi081.stdout:9/242: fsync dd/d1b/f34 0 2024-09-18T12:51:17.143 INFO:tasks.workunit.client.0.smithi081.stdout:9/243: truncate dd/d1d/d1e/d2f/f49 626854 0 2024-09-18T12:51:17.146 INFO:tasks.workunit.client.0.smithi081.stdout:7/395: dread d2/d1d/d27/f50 [0,4194304] 0 2024-09-18T12:51:17.148 INFO:tasks.workunit.client.1.smithi136.stdout:1/615: rename d2/d5/d2b/d9b/d2e/d4c/f46 to d2/d5/d2b/d9b/d1b/fc7 0 2024-09-18T12:51:17.149 INFO:tasks.workunit.client.0.smithi081.stdout:7/396: mkdir d2/d56/d73/d90 0 2024-09-18T12:51:17.149 INFO:tasks.workunit.client.1.smithi136.stdout:4/602: unlink d0/cb2 0 2024-09-18T12:51:17.150 INFO:tasks.workunit.client.1.smithi136.stdout:2/738: getdents d5/d7 0 2024-09-18T12:51:17.150 INFO:tasks.workunit.client.1.smithi136.stdout:7/783: dread d0/d39/f43 [0,4194304] 0 2024-09-18T12:51:17.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/397: mknod d2/d18/d3c/c91 0 2024-09-18T12:51:17.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/398: stat d2/d1d/d27/c4d 0 2024-09-18T12:51:17.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/399: truncate d2/f11 8362829 0 2024-09-18T12:51:17.154 INFO:tasks.workunit.client.0.smithi081.stdout:7/400: link d2/d42/l55 d2/d1d/d4e/d84/l92 0 2024-09-18T12:51:17.155 INFO:tasks.workunit.client.1.smithi136.stdout:5/716: creat d5/d1a/d30/d7b/fde x:0 0 0 2024-09-18T12:51:17.156 INFO:tasks.workunit.client.0.smithi081.stdout:7/401: unlink d2/d14/d21/d49/f54 0 2024-09-18T12:51:17.159 INFO:tasks.workunit.client.1.smithi136.stdout:3/645: rmdir d3/d5 39 2024-09-18T12:51:17.161 INFO:tasks.workunit.client.1.smithi136.stdout:6/640: dwrite d8/d9/d56/f7e [0,4194304] 0 2024-09-18T12:51:17.167 INFO:tasks.workunit.client.1.smithi136.stdout:1/616: dread d2/d5/d2b/d34/d86/d50/f57 [0,4194304] 0 2024-09-18T12:51:17.168 INFO:tasks.workunit.client.1.smithi136.stdout:7/784: unlink d0/f62 0 2024-09-18T12:51:17.168 INFO:tasks.workunit.client.1.smithi136.stdout:7/785: truncate d0/d35/d36/ff 2884452 0 2024-09-18T12:51:17.168 INFO:tasks.workunit.client.0.smithi081.stdout:7/402: dread d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:17.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/403: write d2/d42/f41 [350395,15140] 0 2024-09-18T12:51:17.171 INFO:tasks.workunit.client.1.smithi136.stdout:5/717: write d5/fc9 [17069,87993] 0 2024-09-18T12:51:17.171 INFO:tasks.workunit.client.1.smithi136.stdout:5/718: dread - d5/d1a/d2d/d34/d4e/d7a/d9e/da9/fdc zero size 2024-09-18T12:51:17.176 INFO:tasks.workunit.client.1.smithi136.stdout:4/603: dwrite d0/d13/f69 [0,4194304] 0 2024-09-18T12:51:17.178 INFO:tasks.workunit.client.1.smithi136.stdout:0/712: rename d1/db/l88 to d1/d3/lf7 0 2024-09-18T12:51:17.178 INFO:tasks.workunit.client.1.smithi136.stdout:2/739: dwrite d5/d7/fe3 [0,4194304] 0 2024-09-18T12:51:17.179 INFO:tasks.workunit.client.0.smithi081.stdout:9/244: dwrite dd/d1d/d1e/d24/f44 [0,4194304] 0 2024-09-18T12:51:17.181 INFO:tasks.workunit.client.1.smithi136.stdout:4/604: dread d0/d3/d54/fa4 [0,4194304] 0 2024-09-18T12:51:17.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/245: getdents dd 0 2024-09-18T12:51:17.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/246: readlink dd/d1b/l27 0 2024-09-18T12:51:17.188 INFO:tasks.workunit.client.1.smithi136.stdout:5/719: link d5/f18 d5/d1a/d2d/d34/d4e/d7a/d9e/dad/fdf 0 2024-09-18T12:51:17.189 INFO:tasks.workunit.client.1.smithi136.stdout:5/720: write d5/d1a/d2d/fa6 [289989,44357] 0 2024-09-18T12:51:17.189 INFO:tasks.workunit.client.1.smithi136.stdout:5/721: dread - d5/d1a/d30/d7b/fca zero size 2024-09-18T12:51:17.189 INFO:tasks.workunit.client.1.smithi136.stdout:6/641: symlink d8/d9/d3c/d4a/lcb 0 2024-09-18T12:51:17.192 INFO:tasks.workunit.client.0.smithi081.stdout:9/247: read dd/d1d/d1e/d24/f44 [1601639,70219] 0 2024-09-18T12:51:17.193 INFO:tasks.workunit.client.0.smithi081.stdout:9/248: rename dd/d15/d1a/d35/l4b to dd/de/l4c 0 2024-09-18T12:51:17.193 INFO:tasks.workunit.client.0.smithi081.stdout:9/249: write dd/f20 [944068,119858] 0 2024-09-18T12:51:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/250: symlink dd/d1b/l4d 0 2024-09-18T12:51:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/251: write dd/de/f40 [967022,65799] 0 2024-09-18T12:51:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/252: chown dd/d1d/c46 767430 1 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/253: chown dd/d15/l32 3957271 1 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/254: chown dd/d1d/d1e/d39/f3e 181 1 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/255: symlink dd/d15/d1a/l4e 0 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.1.smithi136.stdout:0/713: dwrite d1/d3/f1e [0,4194304] 0 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/740: link d5/d7/d17/d48/l4c d5/d7/d17/d48/dc1/led 0 2024-09-18T12:51:17.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/741: write d5/d7/d11/d34/f50 [1080322,121410] 0 2024-09-18T12:51:17.196 INFO:tasks.workunit.client.1.smithi136.stdout:2/742: dread - d5/d25/d2d/f8f zero size 2024-09-18T12:51:17.197 INFO:tasks.workunit.client.1.smithi136.stdout:0/714: dread d1/d3/d1a/d98/d81/d72/f73 [0,4194304] 0 2024-09-18T12:51:17.198 INFO:tasks.workunit.client.1.smithi136.stdout:4/605: link d0/d3/l65 d0/d25/lc1 0 2024-09-18T12:51:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/256: getdents dd/d15/d1a/d35 0 2024-09-18T12:51:17.200 INFO:tasks.workunit.client.1.smithi136.stdout:5/722: unlink d5/d1a/f43 0 2024-09-18T12:51:17.200 INFO:tasks.workunit.client.1.smithi136.stdout:5/723: creat d5/d1a/fe0 x:0 0 0 2024-09-18T12:51:17.202 INFO:tasks.workunit.client.1.smithi136.stdout:6/642: symlink d8/d9/de/d1c/dc9/lcc 0 2024-09-18T12:51:17.205 INFO:tasks.workunit.client.1.smithi136.stdout:2/743: mknod d5/d4a/d7a/cee 0 2024-09-18T12:51:17.206 INFO:tasks.workunit.client.1.smithi136.stdout:0/715: unlink d1/db/c15 0 2024-09-18T12:51:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:5/399: sync 2024-09-18T12:51:17.208 INFO:tasks.workunit.client.1.smithi136.stdout:4/606: dread d0/d3/f43 [0,4194304] 0 2024-09-18T12:51:17.209 INFO:tasks.workunit.client.1.smithi136.stdout:4/607: fsync d0/d3/f53 0 2024-09-18T12:51:17.209 INFO:tasks.workunit.client.1.smithi136.stdout:4/608: chown d0/d3/f89 0 1 2024-09-18T12:51:17.210 INFO:tasks.workunit.client.1.smithi136.stdout:6/643: mknod d8/d9/d56/d96/d9c/ccd 0 2024-09-18T12:51:17.210 INFO:tasks.workunit.client.1.smithi136.stdout:6/644: truncate d8/f19 1522601 0 2024-09-18T12:51:17.210 INFO:tasks.workunit.client.1.smithi136.stdout:6/645: write d8/d9/de/d60/d71/d7f/f87 [379993,45732] 0 2024-09-18T12:51:17.211 INFO:tasks.workunit.client.1.smithi136.stdout:8/750: rename d9/d18/d34/d88 to d9/d14/d1a/d2b/deb/d110 0 2024-09-18T12:51:17.211 INFO:tasks.workunit.client.1.smithi136.stdout:8/751: read d9/d14/d1a/d2b/f33 [390061,71226] 0 2024-09-18T12:51:17.212 INFO:tasks.workunit.client.1.smithi136.stdout:2/744: creat d5/fef x:0 0 0 2024-09-18T12:51:17.212 INFO:tasks.workunit.client.1.smithi136.stdout:2/745: write d5/d7/d11/d34/f50 [1261462,111931] 0 2024-09-18T12:51:17.213 INFO:tasks.workunit.client.1.smithi136.stdout:0/716: symlink d1/d3/d1a/d62/lf8 0 2024-09-18T12:51:17.214 INFO:tasks.workunit.client.1.smithi136.stdout:6/646: creat d8/d9d/fce x:0 0 0 2024-09-18T12:51:17.216 INFO:tasks.workunit.client.1.smithi136.stdout:3/646: rename d3/d10/l3b to d3/d14/d17/d75/d86/ld2 0 2024-09-18T12:51:17.216 INFO:tasks.workunit.client.1.smithi136.stdout:3/647: chown d3/d14/f71 0 1 2024-09-18T12:51:17.216 INFO:tasks.workunit.client.1.smithi136.stdout:3/648: creat d3/d10/d4a/fd3 x:0 0 0 2024-09-18T12:51:17.217 INFO:tasks.workunit.client.1.smithi136.stdout:8/752: symlink d9/d14/d1a/d2b/d42/d9e/dda/dfa/l111 0 2024-09-18T12:51:17.218 INFO:tasks.workunit.client.1.smithi136.stdout:1/617: rename d2/d5/d2b/d34/l64 to d2/d5/d2b/da9/lc8 0 2024-09-18T12:51:17.218 INFO:tasks.workunit.client.1.smithi136.stdout:1/618: chown d2/d5/d2b/d34/l56 1626558 1 2024-09-18T12:51:17.220 INFO:tasks.workunit.client.1.smithi136.stdout:3/649: rmdir d3/d14/d17/d8c 39 2024-09-18T12:51:17.221 INFO:tasks.workunit.client.1.smithi136.stdout:7/786: rename d0/d39/d4d/d9a/da2/la9 to d0/d12/d1a/d46/l11a 0 2024-09-18T12:51:17.221 INFO:tasks.workunit.client.1.smithi136.stdout:7/787: truncate d0/d39/f43 5052386 0 2024-09-18T12:51:17.222 INFO:tasks.workunit.client.1.smithi136.stdout:3/650: write d3/d5/fb7 [802140,36768] 0 2024-09-18T12:51:17.222 INFO:tasks.workunit.client.1.smithi136.stdout:3/651: dread - d3/d14/d17/d53/d73/fa5 zero size 2024-09-18T12:51:17.223 INFO:tasks.workunit.client.0.smithi081.stdout:5/400: write d2/d14/d1d/d1a/f4a [3459526,100106] 0 2024-09-18T12:51:17.223 INFO:tasks.workunit.client.0.smithi081.stdout:5/401: write d2/d47/f76 [9762,126368] 0 2024-09-18T12:51:17.223 INFO:tasks.workunit.client.0.smithi081.stdout:5/402: read d2/d14/d33/d37/d3b/d6a/f25 [1534634,43640] 0 2024-09-18T12:51:17.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/724: dwrite d5/d1a/d4a/f77 [0,4194304] 0 2024-09-18T12:51:17.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/725: creat d5/fe1 x:0 0 0 2024-09-18T12:51:17.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/726: chown d5/d1a/d30/f3c 59 1 2024-09-18T12:51:17.225 INFO:tasks.workunit.client.1.smithi136.stdout:5/727: fdatasync d5/d1a/d2d/d34/f35 0 2024-09-18T12:51:17.225 INFO:tasks.workunit.client.1.smithi136.stdout:2/746: rename d5/d25/d43/d74/fa9 to d5/d4a/ff0 0 2024-09-18T12:51:17.229 INFO:tasks.workunit.client.1.smithi136.stdout:7/788: mkdir d0/d35/d41/d11b 0 2024-09-18T12:51:17.229 INFO:tasks.workunit.client.1.smithi136.stdout:7/789: write d0/d12/d5e/d67/ff6 [623185,32483] 0 2024-09-18T12:51:17.230 INFO:tasks.workunit.client.1.smithi136.stdout:0/717: write d1/d60/f6f [185998,69521] 0 2024-09-18T12:51:17.230 INFO:tasks.workunit.client.0.smithi081.stdout:9/257: dwrite fa [0,4194304] 0 2024-09-18T12:51:17.232 INFO:tasks.workunit.client.1.smithi136.stdout:4/609: dread d0/d2/f50 [0,4194304] 0 2024-09-18T12:51:17.234 INFO:tasks.workunit.client.1.smithi136.stdout:7/790: creat d0/d35/d4f/d91/f11c x:0 0 0 2024-09-18T12:51:17.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/258: mkdir dd/de/d4f 0 2024-09-18T12:51:17.236 INFO:tasks.workunit.client.0.smithi081.stdout:9/259: mknod dd/d1d/d1e/d24/c50 0 2024-09-18T12:51:17.237 INFO:tasks.workunit.client.0.smithi081.stdout:9/260: chown dd/d15/d1a/l2d 5901 1 2024-09-18T12:51:17.237 INFO:tasks.workunit.client.0.smithi081.stdout:9/261: fdatasync dd/de/f13 0 2024-09-18T12:51:17.237 INFO:tasks.workunit.client.0.smithi081.stdout:9/262: write dd/d15/d1a/f22 [1140664,117946] 0 2024-09-18T12:51:17.238 INFO:tasks.workunit.client.1.smithi136.stdout:4/610: rename d0/d2/d85/l91 to d0/d25/db7/lc2 0 2024-09-18T12:51:17.238 INFO:tasks.workunit.client.1.smithi136.stdout:4/611: chown d0/d25/d79 132299 1 2024-09-18T12:51:17.238 INFO:tasks.workunit.client.1.smithi136.stdout:5/728: write d5/f4f [2562446,60726] 0 2024-09-18T12:51:17.238 INFO:tasks.workunit.client.1.smithi136.stdout:8/753: write d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d [2168050,77836] 0 2024-09-18T12:51:17.241 INFO:tasks.workunit.client.1.smithi136.stdout:6/647: dwrite d8/d9/f34 [0,4194304] 0 2024-09-18T12:51:17.241 INFO:tasks.workunit.client.1.smithi136.stdout:7/791: mknod d0/d35/d41/dbb/c11d 0 2024-09-18T12:51:17.245 INFO:tasks.workunit.client.1.smithi136.stdout:4/612: truncate d0/d13/f34 1965213 0 2024-09-18T12:51:17.246 INFO:tasks.workunit.client.1.smithi136.stdout:5/729: symlink d5/d1a/d2d/d3f/d7f/dbc/dc8/le2 0 2024-09-18T12:51:17.247 INFO:tasks.workunit.client.1.smithi136.stdout:8/754: symlink d9/d18/d34/d3d/d47/d65/d93/d96/l112 0 2024-09-18T12:51:17.249 INFO:tasks.workunit.client.1.smithi136.stdout:6/648: mkdir d8/dcf 0 2024-09-18T12:51:17.252 INFO:tasks.workunit.client.1.smithi136.stdout:1/619: dwrite d2/d5/d2b/d9b/d2e/d9a/fad [0,4194304] 0 2024-09-18T12:51:17.252 INFO:tasks.workunit.client.1.smithi136.stdout:7/792: mkdir d0/d35/d4f/dd5/d94/d11e 0 2024-09-18T12:51:17.254 INFO:tasks.workunit.client.1.smithi136.stdout:5/730: getdents d5/d1a/d4a 0 2024-09-18T12:51:17.254 INFO:tasks.workunit.client.1.smithi136.stdout:5/731: chown d5/fa5 1545 1 2024-09-18T12:51:17.258 INFO:tasks.workunit.client.1.smithi136.stdout:5/732: rename d5/d6b/f71 to d5/d1a/d30/fe3 0 2024-09-18T12:51:17.258 INFO:tasks.workunit.client.1.smithi136.stdout:5/733: chown d5/d1a/l22 18 1 2024-09-18T12:51:17.260 INFO:tasks.workunit.client.1.smithi136.stdout:5/734: creat d5/d1a/d2d/d34/d4e/d7a/fe4 x:0 0 0 2024-09-18T12:51:17.262 INFO:tasks.workunit.client.1.smithi136.stdout:5/735: symlink d5/d1a/d2d/d34/d4e/le5 0 2024-09-18T12:51:17.263 INFO:tasks.workunit.client.1.smithi136.stdout:8/755: dread d9/d14/f11 [0,4194304] 0 2024-09-18T12:51:17.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/736: symlink d5/d1a/d4a/le6 0 2024-09-18T12:51:17.263 INFO:tasks.workunit.client.1.smithi136.stdout:5/737: creat d5/d1a/d2d/d34/fe7 x:0 0 0 2024-09-18T12:51:17.264 INFO:tasks.workunit.client.1.smithi136.stdout:8/756: mknod d9/d14/d1a/d2b/d42/d6e/d75/c113 0 2024-09-18T12:51:17.265 INFO:tasks.workunit.client.1.smithi136.stdout:8/757: write d9/d18/d34/fed [220643,16621] 0 2024-09-18T12:51:17.265 INFO:tasks.workunit.client.1.smithi136.stdout:8/758: chown d9/d18/d34/d3d/d8b 303021 1 2024-09-18T12:51:17.265 INFO:tasks.workunit.client.1.smithi136.stdout:8/759: write d9/d18/d34/d3d/d47/dbe/ff8 [1011094,23863] 0 2024-09-18T12:51:17.266 INFO:tasks.workunit.client.1.smithi136.stdout:5/738: symlink d5/d1a/d2d/d34/d4e/d9b/le8 0 2024-09-18T12:51:17.266 INFO:tasks.workunit.client.1.smithi136.stdout:5/739: truncate d5/d1a/d2d/f87 1341478 0 2024-09-18T12:51:17.267 INFO:tasks.workunit.client.1.smithi136.stdout:8/760: truncate d9/d14/d1a/d2b/d42/d9e/fdf 2368036 0 2024-09-18T12:51:17.268 INFO:tasks.workunit.client.1.smithi136.stdout:8/761: write d9/d18/dc5/fcc [3683844,64337] 0 2024-09-18T12:51:17.268 INFO:tasks.workunit.client.1.smithi136.stdout:5/740: symlink d5/d6b/dac/le9 0 2024-09-18T12:51:17.269 INFO:tasks.workunit.client.1.smithi136.stdout:7/793: write d0/d39/d4d/d9a/fb1 [941537,108905] 0 2024-09-18T12:51:17.269 INFO:tasks.workunit.client.1.smithi136.stdout:8/762: mknod d9/d18/d34/d3d/d8b/c114 0 2024-09-18T12:51:17.270 INFO:tasks.workunit.client.1.smithi136.stdout:7/794: write d0/d39/fb8 [1086176,14051] 0 2024-09-18T12:51:17.270 INFO:tasks.workunit.client.1.smithi136.stdout:5/741: truncate d5/d1a/d2d/d34/d4e/d7a/f9f 594895 0 2024-09-18T12:51:17.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/263: dread dd/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:51:17.273 INFO:tasks.workunit.client.1.smithi136.stdout:7/795: rename d0/d39/fb8 to d0/d35/dd9/f11f 0 2024-09-18T12:51:17.273 INFO:tasks.workunit.client.1.smithi136.stdout:7/796: write d0/d39/d4d/d9a/fb1 [3220463,56896] 0 2024-09-18T12:51:17.274 INFO:tasks.workunit.client.0.smithi081.stdout:9/264: creat dd/d15/f51 x:0 0 0 2024-09-18T12:51:17.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/797: mkdir d0/d35/d4f/dd5/d94/db0/d120 0 2024-09-18T12:51:17.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/798: rename d0/d35/d41 to d0/d35/d41/dbb/d121 22 2024-09-18T12:51:17.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/799: fdatasync d0/d35/feb 0 2024-09-18T12:51:17.276 INFO:tasks.workunit.client.1.smithi136.stdout:7/800: fsync d0/d35/d41/d50/d5a/fa7 0 2024-09-18T12:51:17.276 INFO:tasks.workunit.client.0.smithi081.stdout:9/265: mknod dd/d1d/c52 0 2024-09-18T12:51:17.276 INFO:tasks.workunit.client.0.smithi081.stdout:9/266: fsync dd/f20 0 2024-09-18T12:51:17.277 INFO:tasks.workunit.client.1.smithi136.stdout:7/801: mkdir d0/d35/d4f/d91/d122 0 2024-09-18T12:51:17.279 INFO:tasks.workunit.client.0.smithi081.stdout:9/267: dread dd/de/f40 [0,4194304] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.1.smithi136.stdout:0/718: dwrite d1/db/d77/fa6 [0,4194304] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.1.smithi136.stdout:8/763: dread d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.1.smithi136.stdout:0/719: write d1/d3/d1a/f7c [448584,94945] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.1.smithi136.stdout:3/652: dwrite d3/d5/f9f [0,4194304] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/403: dwrite d2/d14/d33/d37/d3b/d16/f73 [0,4194304] 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/404: chown d2/d14/d33/d37/d3b/d5f/f60 396060036 1 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/405: readlink d2/d14/d33/d37/d3b/l55 0 2024-09-18T12:51:17.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/406: stat d2/d14/d33/d37/d3b/f13 0 2024-09-18T12:51:17.282 INFO:tasks.workunit.client.1.smithi136.stdout:4/613: dwrite d0/d2/f16 [0,4194304] 0 2024-09-18T12:51:17.286 INFO:tasks.workunit.client.1.smithi136.stdout:8/764: creat d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/f115 x:0 0 0 2024-09-18T12:51:17.289 INFO:tasks.workunit.client.0.smithi081.stdout:5/407: dread d2/dd/d5e/f7a [0,4194304] 0 2024-09-18T12:51:17.289 INFO:tasks.workunit.client.0.smithi081.stdout:5/408: chown d2/dd/f10 32707962 1 2024-09-18T12:51:17.290 INFO:tasks.workunit.client.1.smithi136.stdout:6/649: getdents d8/d9/de/d1c/dc9 0 2024-09-18T12:51:17.290 INFO:tasks.workunit.client.1.smithi136.stdout:6/650: write d8/d9/de/f3d [1158344,57220] 0 2024-09-18T12:51:17.291 INFO:tasks.workunit.client.1.smithi136.stdout:6/651: write d8/d9/d3c/f59 [4656172,35640] 0 2024-09-18T12:51:17.291 INFO:tasks.workunit.client.1.smithi136.stdout:0/720: dread d1/d3/d1a/d98/d81/d72/f8e [0,4194304] 0 2024-09-18T12:51:17.291 INFO:tasks.workunit.client.1.smithi136.stdout:6/652: chown c4 3 1 2024-09-18T12:51:17.292 INFO:tasks.workunit.client.0.smithi081.stdout:5/409: creat d2/d14/d33/d37/d3b/d6a/d20/f7d x:0 0 0 2024-09-18T12:51:17.292 INFO:tasks.workunit.client.0.smithi081.stdout:5/410: creat d2/d14/d33/f7e x:0 0 0 2024-09-18T12:51:17.294 INFO:tasks.workunit.client.0.smithi081.stdout:5/411: mkdir d2/d47/d7f 0 2024-09-18T12:51:17.304 INFO:tasks.workunit.client.1.smithi136.stdout:6/653: read d8/dc/f41 [432509,60357] 0 2024-09-18T12:51:17.311 INFO:tasks.workunit.client.1.smithi136.stdout:6/654: dread d8/f3b [0,4194304] 0 2024-09-18T12:51:17.311 INFO:tasks.workunit.client.1.smithi136.stdout:3/653: mknod d3/d14/d17/db8/cd4 0 2024-09-18T12:51:17.311 INFO:tasks.workunit.client.1.smithi136.stdout:6/655: write d8/d9/de/d60/d71/f93 [201538,78393] 0 2024-09-18T12:51:17.311 INFO:tasks.workunit.client.1.smithi136.stdout:4/614: mkdir d0/d3/d54/d5c/dc3 0 2024-09-18T12:51:17.311 INFO:tasks.workunit.client.1.smithi136.stdout:4/615: chown d0/d5f/f93 43398902 1 2024-09-18T12:51:17.312 INFO:tasks.workunit.client.1.smithi136.stdout:4/616: truncate d0/d8d/f9c 438182 0 2024-09-18T12:51:17.312 INFO:tasks.workunit.client.1.smithi136.stdout:8/765: getdents d9/d14/d1a/d2b/deb/d110 0 2024-09-18T12:51:17.312 INFO:tasks.workunit.client.1.smithi136.stdout:8/766: fsync d9/d18/d34/d3d/d47/d65/f66 0 2024-09-18T12:51:17.313 INFO:tasks.workunit.client.0.smithi081.stdout:9/268: dwrite dd/d1d/d1e/d24/d2a/f30 [0,4194304] 0 2024-09-18T12:51:17.313 INFO:tasks.workunit.client.0.smithi081.stdout:9/269: chown dd/d15 72 1 2024-09-18T12:51:17.314 INFO:tasks.workunit.client.1.smithi136.stdout:7/802: dwrite d0/d35/d41/d50/d9b/dc2/de0/f114 [0,4194304] 0 2024-09-18T12:51:17.314 INFO:tasks.workunit.client.0.smithi081.stdout:5/412: dwrite d2/d14/d33/f6b [0,4194304] 0 2024-09-18T12:51:17.314 INFO:tasks.workunit.client.0.smithi081.stdout:5/413: chown d2/d14/d33/f6b 1779 1 2024-09-18T12:51:17.315 INFO:tasks.workunit.client.0.smithi081.stdout:5/414: dread d2/d14/f4e [0,4194304] 0 2024-09-18T12:51:17.315 INFO:tasks.workunit.client.0.smithi081.stdout:5/415: creat d2/dd/d5e/f80 x:0 0 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:5/416: write d2/d14/f1e [1913656,70877] 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:5/417: chown d2/dd/f75 10838 1 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:5/418: fdatasync d2/dd/d5e/f3c 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:5/419: truncate d2/fe 2334593 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:5/420: dread - d2/d14/d33/d37/d3b/d16/d56/f65 zero size 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.0.smithi081.stdout:9/270: creat dd/d15/d1a/d35/f53 x:0 0 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.1.smithi136.stdout:3/654: mkdir d3/d14/d22/d2c/dd5 0 2024-09-18T12:51:17.316 INFO:tasks.workunit.client.1.smithi136.stdout:3/655: write d3/d14/d17/d75/d87/fd1 [749481,59180] 0 2024-09-18T12:51:17.317 INFO:tasks.workunit.client.1.smithi136.stdout:6/656: fsync d8/d9/d3c/d4a/fb2 0 2024-09-18T12:51:17.318 INFO:tasks.workunit.client.0.smithi081.stdout:5/421: creat d2/d14/d1d/d1a/f81 x:0 0 0 2024-09-18T12:51:17.319 INFO:tasks.workunit.client.0.smithi081.stdout:9/271: mknod dd/d31/c54 0 2024-09-18T12:51:17.321 INFO:tasks.workunit.client.0.smithi081.stdout:5/422: rename d2/d14/l5b to d2/d14/d33/d37/d3b/d16/l82 0 2024-09-18T12:51:17.322 INFO:tasks.workunit.client.1.smithi136.stdout:4/617: write d0/d3/f53 [2754131,29366] 0 2024-09-18T12:51:17.322 INFO:tasks.workunit.client.1.smithi136.stdout:4/618: readlink d0/d3/d54/d88/lb4 0 2024-09-18T12:51:17.323 INFO:tasks.workunit.client.0.smithi081.stdout:5/423: unlink d2/d14/d1d/d1a/l64 0 2024-09-18T12:51:17.328 INFO:tasks.workunit.client.1.smithi136.stdout:3/656: mknod d3/d14/d17/d8c/cd6 0 2024-09-18T12:51:17.329 INFO:tasks.workunit.client.1.smithi136.stdout:6/657: mknod d8/d9/de/d1c/d50/cd0 0 2024-09-18T12:51:17.329 INFO:tasks.workunit.client.1.smithi136.stdout:7/803: getdents d0/d35/d41/d50/d5a/d98/dd0 0 2024-09-18T12:51:17.330 INFO:tasks.workunit.client.1.smithi136.stdout:8/767: dwrite d9/d18/f41 [8388608,4194304] 0 2024-09-18T12:51:17.331 INFO:tasks.workunit.client.1.smithi136.stdout:8/768: truncate d9/d18/d34/d3d/f54 4426247 0 2024-09-18T12:51:17.331 INFO:tasks.workunit.client.1.smithi136.stdout:4/619: link d0/d25/db7/lbf d0/d45/d67/lc4 0 2024-09-18T12:51:17.333 INFO:tasks.workunit.client.1.smithi136.stdout:6/658: unlink d8/d9/c39 0 2024-09-18T12:51:17.335 INFO:tasks.workunit.client.1.smithi136.stdout:7/804: creat d0/d12/d1a/f123 x:0 0 0 2024-09-18T12:51:17.337 INFO:tasks.workunit.client.1.smithi136.stdout:8/769: rename c1 to d9/d14/d1a/c116 0 2024-09-18T12:51:17.338 INFO:tasks.workunit.client.1.smithi136.stdout:5/742: getdents d5/d1a/d4a 0 2024-09-18T12:51:17.339 INFO:tasks.workunit.client.1.smithi136.stdout:3/657: getdents d3/d2b/d6c 0 2024-09-18T12:51:17.339 INFO:tasks.workunit.client.1.smithi136.stdout:3/658: readlink d3/d14/d18/lbe 0 2024-09-18T12:51:17.339 INFO:tasks.workunit.client.1.smithi136.stdout:3/659: truncate d3/d14/d18/f8d 4733348 0 2024-09-18T12:51:17.340 INFO:tasks.workunit.client.1.smithi136.stdout:6/659: truncate d8/d9/de/d1c/f5f 560799 0 2024-09-18T12:51:17.343 INFO:tasks.workunit.client.1.smithi136.stdout:7/805: rename d0/d39/f7e to d0/d2c/d2e/dc5/f124 0 2024-09-18T12:51:17.343 INFO:tasks.workunit.client.1.smithi136.stdout:7/806: chown d0/d12/d5e/c5f 8070 1 2024-09-18T12:51:17.343 INFO:tasks.workunit.client.1.smithi136.stdout:7/807: fsync d0/d35/d41/d50/d7f/d6b/f75 0 2024-09-18T12:51:17.344 INFO:tasks.workunit.client.1.smithi136.stdout:7/808: creat d0/d35/d41/d50/d7f/dfa/f125 x:0 0 0 2024-09-18T12:51:17.344 INFO:tasks.workunit.client.1.smithi136.stdout:8/770: creat d9/d18/d34/d3d/d47/dbe/de3/d101/f117 x:0 0 0 2024-09-18T12:51:17.346 INFO:tasks.workunit.client.1.smithi136.stdout:5/743: mknod d5/d1a/d2d/d3f/d7f/dbc/dc8/cea 0 2024-09-18T12:51:17.346 INFO:tasks.workunit.client.1.smithi136.stdout:5/744: read d5/d1a/d2d/d34/f35 [2299943,32145] 0 2024-09-18T12:51:17.347 INFO:tasks.workunit.client.1.smithi136.stdout:5/745: write d5/d1a/f85 [5227932,43867] 0 2024-09-18T12:51:17.347 INFO:tasks.workunit.client.1.smithi136.stdout:5/746: write d5/d1a/d2d/d34/f95 [565110,82513] 0 2024-09-18T12:51:17.347 INFO:tasks.workunit.client.1.smithi136.stdout:5/747: readlink d5/d1a/d30/l5a 0 2024-09-18T12:51:17.347 INFO:tasks.workunit.client.1.smithi136.stdout:5/748: write d5/fc9 [2321024,123117] 0 2024-09-18T12:51:17.348 INFO:tasks.workunit.client.1.smithi136.stdout:3/660: creat d3/d5/d3c/fd7 x:0 0 0 2024-09-18T12:51:17.349 INFO:tasks.workunit.client.1.smithi136.stdout:3/661: write d3/d14/dc5/f91 [725110,15585] 0 2024-09-18T12:51:17.351 INFO:tasks.workunit.client.0.smithi081.stdout:9/272: dwrite dd/d15/f51 [0,4194304] 0 2024-09-18T12:51:17.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/424: dwrite d2/d14/d33/d37/d3b/f13 [0,4194304] 0 2024-09-18T12:51:17.353 INFO:tasks.workunit.client.1.smithi136.stdout:4/620: dwrite d0/d13/fc0 [0,4194304] 0 2024-09-18T12:51:17.356 INFO:tasks.workunit.client.1.smithi136.stdout:6/660: rename d8/d9/de/d60/d71/d7f/f87 to d8/dcf/fd1 0 2024-09-18T12:51:17.356 INFO:tasks.workunit.client.1.smithi136.stdout:6/661: read d8/dc/f31 [2180123,55682] 0 2024-09-18T12:51:17.357 INFO:tasks.workunit.client.1.smithi136.stdout:6/662: creat d8/d9/de/d1c/fd2 x:0 0 0 2024-09-18T12:51:17.357 INFO:tasks.workunit.client.1.smithi136.stdout:6/663: readlink d8/d9/de/l1a 0 2024-09-18T12:51:17.357 INFO:tasks.workunit.client.0.smithi081.stdout:5/425: rmdir d2/dd/d5e 39 2024-09-18T12:51:17.357 INFO:tasks.workunit.client.0.smithi081.stdout:5/426: readlink d2/d14/d33/d37/d3b/d2a/l3e 0 2024-09-18T12:51:17.359 INFO:tasks.workunit.client.0.smithi081.stdout:5/427: symlink d2/d14/d33/d37/d3b/d16/l83 0 2024-09-18T12:51:17.359 INFO:tasks.workunit.client.1.smithi136.stdout:7/809: link d0/d35/d4f/dd5/l8f d0/d35/d41/d50/d5a/d98/dd0/l126 0 2024-09-18T12:51:17.361 INFO:tasks.workunit.client.1.smithi136.stdout:8/771: mknod d9/d18/d34/d3d/d47/dbe/c118 0 2024-09-18T12:51:17.363 INFO:tasks.workunit.client.0.smithi081.stdout:9/273: write fa [3214144,74107] 0 2024-09-18T12:51:17.365 INFO:tasks.workunit.client.0.smithi081.stdout:9/274: rename dd/d15/d45 to dd/d1d/d1e/d24/d2a/d55 0 2024-09-18T12:51:17.366 INFO:tasks.workunit.client.1.smithi136.stdout:3/662: mknod d3/d14/cd8 0 2024-09-18T12:51:17.366 INFO:tasks.workunit.client.0.smithi081.stdout:1/347: sync 2024-09-18T12:51:17.367 INFO:tasks.workunit.client.0.smithi081.stdout:6/341: sync 2024-09-18T12:51:17.367 INFO:tasks.workunit.client.0.smithi081.stdout:6/342: chown d4/d12/d28/d2a/d2d/d31/f3d 34 1 2024-09-18T12:51:17.367 INFO:tasks.workunit.client.0.smithi081.stdout:6/343: read - d4/d12/d28/d2a/f45 zero size 2024-09-18T12:51:17.367 INFO:tasks.workunit.client.0.smithi081.stdout:1/348: creat d0/db/f78 x:0 0 0 2024-09-18T12:51:17.367 INFO:tasks.workunit.client.0.smithi081.stdout:9/275: unlink dd/d1d/l42 0 2024-09-18T12:51:17.370 INFO:tasks.workunit.client.0.smithi081.stdout:9/276: truncate dd/f20 439228 0 2024-09-18T12:51:17.371 INFO:tasks.workunit.client.1.smithi136.stdout:4/621: symlink d0/d2/d85/lc5 0 2024-09-18T12:51:17.371 INFO:tasks.workunit.client.1.smithi136.stdout:4/622: truncate d0/d45/d67/f99 765817 0 2024-09-18T12:51:17.371 INFO:tasks.workunit.client.1.smithi136.stdout:4/623: truncate d0/d2/f77 1504029 0 2024-09-18T12:51:17.372 INFO:tasks.workunit.client.0.smithi081.stdout:9/277: dread dd/de/f40 [0,4194304] 0 2024-09-18T12:51:17.373 INFO:tasks.workunit.client.0.smithi081.stdout:9/278: truncate dd/d15/d1a/d35/f53 732369 0 2024-09-18T12:51:17.374 INFO:tasks.workunit.client.0.smithi081.stdout:9/279: symlink dd/d1d/d1e/d24/d48/l56 0 2024-09-18T12:51:17.375 INFO:tasks.workunit.client.0.smithi081.stdout:9/280: symlink dd/d15/d1a/d35/l57 0 2024-09-18T12:51:17.375 INFO:tasks.workunit.client.1.smithi136.stdout:6/664: creat d8/d9/d56/fd3 x:0 0 0 2024-09-18T12:51:17.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/281: mknod dd/d1d/d1e/d2f/c58 0 2024-09-18T12:51:17.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/282: fdatasync dd/de/f40 0 2024-09-18T12:51:17.378 INFO:tasks.workunit.client.0.smithi081.stdout:9/283: mkdir dd/de/d59 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:7/810: symlink d0/d35/d4f/dd5/d94/db0/d120/l127 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:7/811: stat d0/c79 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:7/812: fdatasync d0/d39/dbf/fc8 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:8/772: truncate d9/d14/f1d 2637476 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:8/773: write d9/d14/d1a/d7f/ffe [857237,11005] 0 2024-09-18T12:51:17.379 INFO:tasks.workunit.client.1.smithi136.stdout:8/774: truncate d9/d18/d34/d3d/d47/fb7 433489 0 2024-09-18T12:51:17.380 INFO:tasks.workunit.client.0.smithi081.stdout:9/284: link dd/d1d/d1e/d24/c50 dd/d1d/d1e/d24/d2a/d55/c5a 0 2024-09-18T12:51:17.380 INFO:tasks.workunit.client.0.smithi081.stdout:9/285: creat dd/de/f5b x:0 0 0 2024-09-18T12:51:17.381 INFO:tasks.workunit.client.0.smithi081.stdout:9/286: chown dd/de/f13 289 1 2024-09-18T12:51:17.381 INFO:tasks.workunit.client.1.smithi136.stdout:3/663: truncate d3/d14/d22/f1f 1224818 0 2024-09-18T12:51:17.382 INFO:tasks.workunit.client.1.smithi136.stdout:4/624: creat d0/d3/d54/d88/db1/fc6 x:0 0 0 2024-09-18T12:51:17.382 INFO:tasks.workunit.client.1.smithi136.stdout:4/625: stat d0/d3/d54/d88/db1/fc6 0 2024-09-18T12:51:17.382 INFO:tasks.workunit.client.0.smithi081.stdout:1/349: dwrite d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:17.385 INFO:tasks.workunit.client.0.smithi081.stdout:1/350: mkdir d0/d6/d7/d2e/d41/d79 0 2024-09-18T12:51:17.386 INFO:tasks.workunit.client.1.smithi136.stdout:8/775: mknod d9/d18/d34/d3d/d47/c119 0 2024-09-18T12:51:17.386 INFO:tasks.workunit.client.1.smithi136.stdout:9/689: sync 2024-09-18T12:51:17.386 INFO:tasks.workunit.client.1.smithi136.stdout:9/690: chown d6/df/d23/d2b/c48 469473595 1 2024-09-18T12:51:17.387 INFO:tasks.workunit.client.0.smithi081.stdout:1/351: rename d0/d6/d7/d2e/d51/d40 to d0/d6/d7/d2e/d4e/d7a 0 2024-09-18T12:51:17.387 INFO:tasks.workunit.client.0.smithi081.stdout:1/352: readlink d0/db/l48 0 2024-09-18T12:51:17.387 INFO:tasks.workunit.client.0.smithi081.stdout:1/353: chown d0/d6/d7/d2e/d4e/d7a 3 1 2024-09-18T12:51:17.387 INFO:tasks.workunit.client.0.smithi081.stdout:1/354: chown d0/db/d4f 0 1 2024-09-18T12:51:17.388 INFO:tasks.workunit.client.1.smithi136.stdout:4/626: creat d0/d25/db7/fc7 x:0 0 0 2024-09-18T12:51:17.389 INFO:tasks.workunit.client.0.smithi081.stdout:6/344: dwrite d4/d12/d28/d2a/d2d/d31/f3b [0,4194304] 0 2024-09-18T12:51:17.393 INFO:tasks.workunit.client.1.smithi136.stdout:9/691: mkdir d6/da/d3d/d4d/d91/d25/dee 0 2024-09-18T12:51:17.393 INFO:tasks.workunit.client.1.smithi136.stdout:7/813: dread d0/d2c/f48 [0,4194304] 0 2024-09-18T12:51:17.393 INFO:tasks.workunit.client.1.smithi136.stdout:6/665: mknod d8/d9/d3c/d4a/cd4 0 2024-09-18T12:51:17.394 INFO:tasks.workunit.client.1.smithi136.stdout:7/814: stat d0/d35/d41/d50/d7f/dfa/l117 0 2024-09-18T12:51:17.394 INFO:tasks.workunit.client.1.smithi136.stdout:8/776: getdents d9/d18/d34 0 2024-09-18T12:51:17.395 INFO:tasks.workunit.client.1.smithi136.stdout:8/777: creat d9/d18/d34/d3d/d47/d65/d93/d96/f11a x:0 0 0 2024-09-18T12:51:17.395 INFO:tasks.workunit.client.1.smithi136.stdout:8/778: fsync d9/d14/d1a/d2b/f2e 0 2024-09-18T12:51:17.397 INFO:tasks.workunit.client.1.smithi136.stdout:9/692: rename d6/df/d23/d2b/c7c to d6/da/d3d/d41/cef 0 2024-09-18T12:51:17.398 INFO:tasks.workunit.client.1.smithi136.stdout:6/666: chown d8/d9/d3c/d4a/l8b 138960 1 2024-09-18T12:51:17.401 INFO:tasks.workunit.client.0.smithi081.stdout:6/345: rename d4/c17 to d4/d12/d28/d2a/d2d/d31/c6c 0 2024-09-18T12:51:17.402 INFO:tasks.workunit.client.1.smithi136.stdout:7/815: rename d0/d35/d36/l23 to d0/d35/d4f/d91/l128 0 2024-09-18T12:51:17.404 INFO:tasks.workunit.client.1.smithi136.stdout:6/667: symlink d8/d9/d64/dbb/ld5 0 2024-09-18T12:51:17.404 INFO:tasks.workunit.client.1.smithi136.stdout:6/668: chown d8/d9/d3c/d4a/l8b 82366266 1 2024-09-18T12:51:17.404 INFO:tasks.workunit.client.1.smithi136.stdout:6/669: fsync d8/d9/de/d1c/d50/f73 0 2024-09-18T12:51:17.404 INFO:tasks.workunit.client.0.smithi081.stdout:9/287: dwrite dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:17.405 INFO:tasks.workunit.client.0.smithi081.stdout:6/346: symlink d4/d12/d28/l6d 0 2024-09-18T12:51:17.405 INFO:tasks.workunit.client.0.smithi081.stdout:6/347: read d4/f7 [630699,74865] 0 2024-09-18T12:51:17.408 INFO:tasks.workunit.client.0.smithi081.stdout:9/288: symlink dd/d15/l5c 0 2024-09-18T12:51:17.409 INFO:tasks.workunit.client.0.smithi081.stdout:1/355: rmdir d0 39 2024-09-18T12:51:17.409 INFO:tasks.workunit.client.1.smithi136.stdout:6/670: dread d8/f6c [0,4194304] 0 2024-09-18T12:51:17.410 INFO:tasks.workunit.client.0.smithi081.stdout:6/348: creat d4/d12/d1c/d39/d60/f6e x:0 0 0 2024-09-18T12:51:17.411 INFO:tasks.workunit.client.1.smithi136.stdout:6/671: creat d8/d9/de/d60/d71/d76/fd6 x:0 0 0 2024-09-18T12:51:17.412 INFO:tasks.workunit.client.0.smithi081.stdout:1/356: rename d0/db/d12/f47 to d0/d6/d7/d2e/d51/d2c/f7b 0 2024-09-18T12:51:17.413 INFO:tasks.workunit.client.1.smithi136.stdout:6/672: unlink d8/d9/d56/d96/fab 0 2024-09-18T12:51:17.414 INFO:tasks.workunit.client.0.smithi081.stdout:6/349: mkdir d4/d12/d1c/d39/d40/d6f 0 2024-09-18T12:51:17.427 INFO:tasks.workunit.client.0.smithi081.stdout:9/289: dread dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:17.427 INFO:tasks.workunit.client.0.smithi081.stdout:9/290: creat dd/d1d/d1e/d39/f5d x:0 0 0 2024-09-18T12:51:17.427 INFO:tasks.workunit.client.0.smithi081.stdout:9/291: fsync f6 0 2024-09-18T12:51:17.427 INFO:tasks.workunit.client.0.smithi081.stdout:9/292: chown dd/d1d/d1e/f43 504846560 1 2024-09-18T12:51:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/293: creat dd/de/d59/f5e x:0 0 0 2024-09-18T12:51:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/294: stat dd 0 2024-09-18T12:51:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/295: read dd/d1d/d1e/d24/f44 [3399012,57116] 0 2024-09-18T12:51:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/296: write dd/d1d/d1e/d24/d2a/f30 [5222620,43062] 0 2024-09-18T12:51:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/297: write dd/d1d/d1e/d24/f44 [4982339,49200] 0 2024-09-18T12:51:17.434 INFO:tasks.workunit.client.1.smithi136.stdout:6/673: write d8/d9/de/d1c/d50/da8/fc0 [1929830,2611] 0 2024-09-18T12:51:17.434 INFO:tasks.workunit.client.1.smithi136.stdout:8/779: dwrite d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d [0,4194304] 0 2024-09-18T12:51:17.434 INFO:tasks.workunit.client.1.smithi136.stdout:6/674: fdatasync d8/d9/de/d1c/f38 0 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.1.smithi136.stdout:8/780: write d9/d14/d1a/d2b/f91 [9164029,6162] 0 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.1.smithi136.stdout:7/816: dwrite d0/d35/fa0 [0,4194304] 0 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.1.smithi136.stdout:7/817: read - d0/d35/d41/d50/d7f/dfa/f105 zero size 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.1.smithi136.stdout:7/818: chown d0/d35/d41/d50/d5a/fa7 4911114 1 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:1/357: dwrite d0/d6/d7/d8/f34 [0,4194304] 0 2024-09-18T12:51:17.435 INFO:tasks.workunit.client.1.smithi136.stdout:4/627: dwrite d0/d45/f55 [0,4194304] 0 2024-09-18T12:51:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:1/358: truncate d0/db/d12/d2d/f2f 543452 0 2024-09-18T12:51:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:1/359: symlink d0/db/d12/d55/l7c 0 2024-09-18T12:51:17.440 INFO:tasks.workunit.client.1.smithi136.stdout:7/819: getdents d0/d35/d4f/dd5/d94/db0 0 2024-09-18T12:51:17.449 INFO:tasks.workunit.client.1.smithi136.stdout:4/628: write d0/d25/f6f [1532801,129008] 0 2024-09-18T12:51:17.450 INFO:tasks.workunit.client.1.smithi136.stdout:6/675: dread d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:17.452 INFO:tasks.workunit.client.1.smithi136.stdout:6/676: rmdir d8/d9/d56 39 2024-09-18T12:51:17.453 INFO:tasks.workunit.client.1.smithi136.stdout:6/677: mknod d8/d9/de/d1c/cd7 0 2024-09-18T12:51:17.455 INFO:tasks.workunit.client.1.smithi136.stdout:6/678: unlink d8/d9/de/d1c/d50/f73 0 2024-09-18T12:51:17.455 INFO:tasks.workunit.client.1.smithi136.stdout:6/679: stat d8/d9/de/d1c/db9/fc3 0 2024-09-18T12:51:17.456 INFO:tasks.workunit.client.1.smithi136.stdout:6/680: mknod d8/d9/de/d60/d71/d76/cd8 0 2024-09-18T12:51:17.458 INFO:tasks.workunit.client.0.smithi081.stdout:9/298: dwrite dd/d1d/d1e/d24/f44 [0,4194304] 0 2024-09-18T12:51:17.458 INFO:tasks.workunit.client.0.smithi081.stdout:9/299: fsync dd/de/f40 0 2024-09-18T12:51:17.458 INFO:tasks.workunit.client.0.smithi081.stdout:9/300: chown dd/d1d/d1e/d24/c50 9 1 2024-09-18T12:51:17.458 INFO:tasks.workunit.client.1.smithi136.stdout:6/681: creat d8/d9/d56/d96/d9c/fd9 x:0 0 0 2024-09-18T12:51:17.458 INFO:tasks.workunit.client.1.smithi136.stdout:6/682: chown d8/daa/fb0 6402535 1 2024-09-18T12:51:17.459 INFO:tasks.workunit.client.1.smithi136.stdout:6/683: truncate d8/d9/d56/d96/fa6 4673719 0 2024-09-18T12:51:17.459 INFO:tasks.workunit.client.1.smithi136.stdout:6/684: unlink d8/d9/d56/d96/fa6 0 2024-09-18T12:51:17.459 INFO:tasks.workunit.client.1.smithi136.stdout:2/747: sync 2024-09-18T12:51:17.459 INFO:tasks.workunit.client.1.smithi136.stdout:1/620: sync 2024-09-18T12:51:17.460 INFO:tasks.workunit.client.1.smithi136.stdout:8/781: dwrite d9/d14/d1a/d7f/ffe [0,4194304] 0 2024-09-18T12:51:17.462 INFO:tasks.workunit.client.1.smithi136.stdout:6/685: creat d8/d9/d56/d96/fda x:0 0 0 2024-09-18T12:51:17.463 INFO:tasks.workunit.client.0.smithi081.stdout:9/301: symlink dd/d15/d1a/d3d/l5f 0 2024-09-18T12:51:17.463 INFO:tasks.workunit.client.1.smithi136.stdout:2/748: creat d5/d7/d11/ff1 x:0 0 0 2024-09-18T12:51:17.463 INFO:tasks.workunit.client.1.smithi136.stdout:2/749: fsync d5/d25/d43/d74/fcd 0 2024-09-18T12:51:17.464 INFO:tasks.workunit.client.1.smithi136.stdout:8/782: rmdir d9/d18/d34/d3d 39 2024-09-18T12:51:17.466 INFO:tasks.workunit.client.1.smithi136.stdout:2/750: creat d5/d7/d17/d48/db2/ff2 x:0 0 0 2024-09-18T12:51:17.468 INFO:tasks.workunit.client.1.smithi136.stdout:2/751: symlink d5/d7/d3b/lf3 0 2024-09-18T12:51:17.468 INFO:tasks.workunit.client.1.smithi136.stdout:2/752: write d5/d7/d17/d48/db2/ff2 [628344,101736] 0 2024-09-18T12:51:17.469 INFO:tasks.workunit.client.1.smithi136.stdout:2/753: truncate d5/d25/f40 1691389 0 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.1.smithi136.stdout:2/754: rename d5/d7/d11/d34/f9b to d5/d7/dbf/ff4 0 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/360: dwrite d0/d6/f1b [0,4194304] 0 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/361: chown d0/d6/d33/d42/f5b 10275 1 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/362: fsync d0/d54/f5e 0 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/363: truncate d0/db/f65 770912 0 2024-09-18T12:51:17.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/364: chown d0/d6/d66 73 1 2024-09-18T12:51:17.473 INFO:tasks.workunit.client.0.smithi081.stdout:1/365: link d0/d6/f36 d0/f7d 0 2024-09-18T12:51:17.474 INFO:tasks.workunit.client.0.smithi081.stdout:2/446: sync 2024-09-18T12:51:17.476 INFO:tasks.workunit.client.0.smithi081.stdout:1/366: unlink d0/d6/f3d 0 2024-09-18T12:51:17.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/367: chown d0/db/d12 44158817 1 2024-09-18T12:51:17.478 INFO:tasks.workunit.client.1.smithi136.stdout:1/621: write d2/d5/d2b/d34/d86/f2c [5894017,85070] 0 2024-09-18T12:51:17.479 INFO:tasks.workunit.client.0.smithi081.stdout:9/302: dread dd/d1d/d1e/d39/f3f [0,4194304] 0 2024-09-18T12:51:17.480 INFO:tasks.workunit.client.1.smithi136.stdout:1/622: symlink d2/d5/d2b/d9b/lc9 0 2024-09-18T12:51:17.481 INFO:tasks.workunit.client.0.smithi081.stdout:9/303: symlink dd/d15/d1a/d35/l60 0 2024-09-18T12:51:17.482 INFO:tasks.workunit.client.1.smithi136.stdout:1/623: mknod d2/d5/d2b/d9b/cca 0 2024-09-18T12:51:17.483 INFO:tasks.workunit.client.0.smithi081.stdout:9/304: truncate dd/d31/f3b 3257820 0 2024-09-18T12:51:17.483 INFO:tasks.workunit.client.0.smithi081.stdout:9/305: chown dd/de/l11 2 1 2024-09-18T12:51:17.484 INFO:tasks.workunit.client.1.smithi136.stdout:1/624: truncate d2/d5/d2b/d9b/d2e/d4c/f1f 1583733 0 2024-09-18T12:51:17.487 INFO:tasks.workunit.client.1.smithi136.stdout:1/625: mkdir d2/d5/d9/dcb 0 2024-09-18T12:51:17.487 INFO:tasks.workunit.client.1.smithi136.stdout:1/626: truncate d2/d5/f1e 597334 0 2024-09-18T12:51:17.487 INFO:tasks.workunit.client.1.smithi136.stdout:1/627: write d2/f5b [846485,27252] 0 2024-09-18T12:51:17.489 INFO:tasks.workunit.client.0.smithi081.stdout:9/306: dread fa [0,4194304] 0 2024-09-18T12:51:17.489 INFO:tasks.workunit.client.0.smithi081.stdout:9/307: chown dd/d1d/d1e/d39/f3f 121624 1 2024-09-18T12:51:17.494 INFO:tasks.workunit.client.1.smithi136.stdout:6/686: dwrite d8/d9/de/f16 [0,4194304] 0 2024-09-18T12:51:17.494 INFO:tasks.workunit.client.1.smithi136.stdout:6/687: dread - d8/d9/d3c/f7a zero size 2024-09-18T12:51:17.495 INFO:tasks.workunit.client.1.smithi136.stdout:6/688: creat d8/d9/de/d60/fdb x:0 0 0 2024-09-18T12:51:17.495 INFO:tasks.workunit.client.1.smithi136.stdout:6/689: creat d8/d9/de/d1c/fdc x:0 0 0 2024-09-18T12:51:17.497 INFO:tasks.workunit.client.1.smithi136.stdout:6/690: write d8/d9/d3c/d4a/f53 [1250379,95848] 0 2024-09-18T12:51:17.498 INFO:tasks.workunit.client.1.smithi136.stdout:6/691: mknod d8/d9/de/d1c/db9/cdd 0 2024-09-18T12:51:17.498 INFO:tasks.workunit.client.1.smithi136.stdout:8/783: dwrite d9/d18/d34/d3d/d47/d65/fab [0,4194304] 0 2024-09-18T12:51:17.498 INFO:tasks.workunit.client.1.smithi136.stdout:8/784: dread - d9/d14/d1a/d2b/deb/d110/f10e zero size 2024-09-18T12:51:17.500 INFO:tasks.workunit.client.1.smithi136.stdout:8/785: mknod d9/d18/d34/d3d/d47/dbe/de3/d101/c11b 0 2024-09-18T12:51:17.501 INFO:tasks.workunit.client.1.smithi136.stdout:8/786: readlink d9/d18/d34/d3d/d47/dbe/de3/d10d/lfb 0 2024-09-18T12:51:17.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/787: mkdir d9/d18/d34/d3d/d11c 0 2024-09-18T12:51:17.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/788: fsync d9/d18/d34/d3d/d47/d65/fe0 0 2024-09-18T12:51:17.502 INFO:tasks.workunit.client.1.smithi136.stdout:8/789: fsync d9/d18/f44 0 2024-09-18T12:51:17.503 INFO:tasks.workunit.client.0.smithi081.stdout:1/368: dwrite d0/db/f39 [0,4194304] 0 2024-09-18T12:51:17.503 INFO:tasks.workunit.client.0.smithi081.stdout:1/369: write d0/db/f14 [752496,108101] 0 2024-09-18T12:51:17.503 INFO:tasks.workunit.client.0.smithi081.stdout:2/447: dwrite d15/d16/f23 [0,4194304] 0 2024-09-18T12:51:17.504 INFO:tasks.workunit.client.1.smithi136.stdout:2/755: dwrite d5/f1c [8388608,4194304] 0 2024-09-18T12:51:17.504 INFO:tasks.workunit.client.1.smithi136.stdout:2/756: creat d5/d25/d43/d74/ff5 x:0 0 0 2024-09-18T12:51:17.504 INFO:tasks.workunit.client.1.smithi136.stdout:1/628: dread d2/d5/d9/f10 [0,4194304] 0 2024-09-18T12:51:17.504 INFO:tasks.workunit.client.1.smithi136.stdout:1/629: chown d2/d5/d2b/d9b/d1b/fc7 631270366 1 2024-09-18T12:51:17.505 INFO:tasks.workunit.client.0.smithi081.stdout:1/370: creat d0/f7e x:0 0 0 2024-09-18T12:51:17.505 INFO:tasks.workunit.client.1.smithi136.stdout:8/790: dread d9/d18/f1c [0,4194304] 0 2024-09-18T12:51:17.505 INFO:tasks.workunit.client.1.smithi136.stdout:8/791: creat d9/f11d x:0 0 0 2024-09-18T12:51:17.506 INFO:tasks.workunit.client.1.smithi136.stdout:1/630: dread d2/f74 [0,4194304] 0 2024-09-18T12:51:17.509 INFO:tasks.workunit.client.0.smithi081.stdout:9/308: write dd/d31/f3b [3812577,48961] 0 2024-09-18T12:51:17.510 INFO:tasks.workunit.client.0.smithi081.stdout:9/309: dread dd/d1d/d1e/d2f/f49 [0,4194304] 0 2024-09-18T12:51:17.512 INFO:tasks.workunit.client.1.smithi136.stdout:8/792: rename d9/d18/d34/d3d/f54 to d9/d14/d1a/d2b/d42/d104/f11e 0 2024-09-18T12:51:17.512 INFO:tasks.workunit.client.1.smithi136.stdout:8/793: dread - d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 zero size 2024-09-18T12:51:17.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/692: write d8/d9/de/f40 [6190220,41513] 0 2024-09-18T12:51:17.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/693: chown d8/d9/c17 1 1 2024-09-18T12:51:17.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/694: chown d8/d9/de/d60/c75 46606014 1 2024-09-18T12:51:17.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/695: stat d8/f30 0 2024-09-18T12:51:17.513 INFO:tasks.workunit.client.1.smithi136.stdout:6/696: creat d8/d9/d56/d96/d9c/fde x:0 0 0 2024-09-18T12:51:17.514 INFO:tasks.workunit.client.1.smithi136.stdout:1/631: rename d2/d5/d2b/d34/f47 to d2/d5/d2b/d9b/d2e/d4c/d8e/fcc 0 2024-09-18T12:51:17.514 INFO:tasks.workunit.client.0.smithi081.stdout:1/371: write d0/d6/d33/d42/f5b [3247796,103045] 0 2024-09-18T12:51:17.516 INFO:tasks.workunit.client.0.smithi081.stdout:1/372: creat d0/db/d12/d28/f7f x:0 0 0 2024-09-18T12:51:17.516 INFO:tasks.workunit.client.0.smithi081.stdout:1/373: rename d0/db/d4f to d0/db/d4f/d50/d80 22 2024-09-18T12:51:17.517 INFO:tasks.workunit.client.1.smithi136.stdout:6/697: dread d8/d9/de/d60/d71/f93 [0,4194304] 0 2024-09-18T12:51:17.517 INFO:tasks.workunit.client.0.smithi081.stdout:2/448: write d15/d16/d20/d31/f42 [4057313,57918] 0 2024-09-18T12:51:17.518 INFO:tasks.workunit.client.1.smithi136.stdout:1/632: mknod d2/d5/d2b/da9/ccd 0 2024-09-18T12:51:17.518 INFO:tasks.workunit.client.0.smithi081.stdout:1/374: creat d0/d6/d7/f81 x:0 0 0 2024-09-18T12:51:17.519 INFO:tasks.workunit.client.1.smithi136.stdout:6/698: truncate d8/dc/f43 62336 0 2024-09-18T12:51:17.519 INFO:tasks.workunit.client.0.smithi081.stdout:2/449: mknod d15/d16/d20/d22/d8c/c9a 0 2024-09-18T12:51:17.520 INFO:tasks.workunit.client.0.smithi081.stdout:9/310: write dd/d1b/f34 [7759414,84144] 0 2024-09-18T12:51:17.520 INFO:tasks.workunit.client.0.smithi081.stdout:9/311: truncate dd/d1d/f2e 4384593 0 2024-09-18T12:51:17.522 INFO:tasks.workunit.client.1.smithi136.stdout:1/633: mkdir d2/d5/d2b/d9b/dbe/dce 0 2024-09-18T12:51:17.523 INFO:tasks.workunit.client.1.smithi136.stdout:2/757: dwrite d5/d7/f3f [0,4194304] 0 2024-09-18T12:51:17.523 INFO:tasks.workunit.client.1.smithi136.stdout:2/758: dread - d5/d25/d43/fc5 zero size 2024-09-18T12:51:17.524 INFO:tasks.workunit.client.0.smithi081.stdout:9/312: symlink dd/d1d/d1e/d24/d2a/d55/l61 0 2024-09-18T12:51:17.524 INFO:tasks.workunit.client.0.smithi081.stdout:2/450: dread d15/d16/d20/d31/f5e [0,4194304] 0 2024-09-18T12:51:17.525 INFO:tasks.workunit.client.1.smithi136.stdout:8/794: write d9/d14/d1a/f37 [2556327,51158] 0 2024-09-18T12:51:17.525 INFO:tasks.workunit.client.1.smithi136.stdout:8/795: fdatasync d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 0 2024-09-18T12:51:17.525 INFO:tasks.workunit.client.1.smithi136.stdout:6/699: rename d8/d9/d3c/l61 to d8/daa/ldf 0 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/700: dread - d8/d9/d3c/fba zero size 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/701: fsync d8/d9/d3c/f68 0 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/702: write d8/d9/de/d1c/f20 [4123334,26210] 0 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/703: chown d8/d9/d56/d96 57190 1 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/704: stat d8/d9/de/d1c/d50 0 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.1.smithi136.stdout:6/705: creat d8/d9/de/d60/d71/d76/fe0 x:0 0 0 2024-09-18T12:51:17.526 INFO:tasks.workunit.client.0.smithi081.stdout:1/375: link d0/f4a d0/d6/d7/d8/f82 0 2024-09-18T12:51:17.527 INFO:tasks.workunit.client.1.smithi136.stdout:2/759: creat d5/d7/dbf/dd5/ff6 x:0 0 0 2024-09-18T12:51:17.528 INFO:tasks.workunit.client.0.smithi081.stdout:9/313: rename dd/d1d/d1e/d24/f44 to dd/d31/d4a/f62 0 2024-09-18T12:51:17.529 INFO:tasks.workunit.client.0.smithi081.stdout:9/314: write dd/d1d/d1e/d39/f3e [3008404,131039] 0 2024-09-18T12:51:17.529 INFO:tasks.workunit.client.1.smithi136.stdout:8/796: mknod d9/d14/d1a/d2b/d42/d104/c11f 0 2024-09-18T12:51:17.530 INFO:tasks.workunit.client.0.smithi081.stdout:2/451: creat d15/d16/d20/d59/f9b x:0 0 0 2024-09-18T12:51:17.533 INFO:tasks.workunit.client.1.smithi136.stdout:5/749: sync 2024-09-18T12:51:17.533 INFO:tasks.workunit.client.1.smithi136.stdout:0/721: sync 2024-09-18T12:51:17.533 INFO:tasks.workunit.client.1.smithi136.stdout:0/722: chown d1/d60/f68 3769030 1 2024-09-18T12:51:17.533 INFO:tasks.workunit.client.1.smithi136.stdout:0/723: truncate d1/d3/d1a/d98/d81/d70/dbc/fef 1030996 0 2024-09-18T12:51:17.534 INFO:tasks.workunit.client.1.smithi136.stdout:9/693: sync 2024-09-18T12:51:17.534 INFO:tasks.workunit.client.1.smithi136.stdout:3/664: sync 2024-09-18T12:51:17.534 INFO:tasks.workunit.client.1.smithi136.stdout:3/665: write d3/d14/d17/d8c/d96/fa4 [884247,65940] 0 2024-09-18T12:51:17.535 INFO:tasks.workunit.client.0.smithi081.stdout:9/315: write dd/d1d/d1e/d24/d2a/f2c [3512906,12477] 0 2024-09-18T12:51:17.535 INFO:tasks.workunit.client.1.smithi136.stdout:2/760: mkdir d5/d7/d3b/df7 0 2024-09-18T12:51:17.535 INFO:tasks.workunit.client.1.smithi136.stdout:2/761: chown d5/d7/d11/cd1 1 1 2024-09-18T12:51:17.536 INFO:tasks.workunit.client.0.smithi081.stdout:1/376: mkdir d0/d6/d33/d42/d83 0 2024-09-18T12:51:17.536 INFO:tasks.workunit.client.0.smithi081.stdout:1/377: chown d0/d18/d6a/c6f 178751 1 2024-09-18T12:51:17.536 INFO:tasks.workunit.client.0.smithi081.stdout:9/316: dread dd/f20 [0,4194304] 0 2024-09-18T12:51:17.537 INFO:tasks.workunit.client.1.smithi136.stdout:6/706: rmdir d8/d9/d3c/d4a 39 2024-09-18T12:51:17.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/762: write d5/d25/f28 [359473,20815] 0 2024-09-18T12:51:17.537 INFO:tasks.workunit.client.1.smithi136.stdout:2/763: chown d5/d25/d2d 4 1 2024-09-18T12:51:17.538 INFO:tasks.workunit.client.0.smithi081.stdout:1/378: mkdir d0/d6/d7/d2e/d4e/d7a/d84 0 2024-09-18T12:51:17.538 INFO:tasks.workunit.client.0.smithi081.stdout:1/379: fsync d0/f15 0 2024-09-18T12:51:17.540 INFO:tasks.workunit.client.1.smithi136.stdout:0/724: mknod d1/d3/d1a/d98/cf9 0 2024-09-18T12:51:17.540 INFO:tasks.workunit.client.0.smithi081.stdout:1/380: mknod d0/d6/d7/d2e/d51/d2c/c85 0 2024-09-18T12:51:17.541 INFO:tasks.workunit.client.0.smithi081.stdout:1/381: symlink d0/d6/d7/d2e/d51/l86 0 2024-09-18T12:51:17.542 INFO:tasks.workunit.client.1.smithi136.stdout:5/750: dread d5/d1a/d2d/d34/f35 [0,4194304] 0 2024-09-18T12:51:17.542 INFO:tasks.workunit.client.0.smithi081.stdout:1/382: creat d0/db/d32/f87 x:0 0 0 2024-09-18T12:51:17.543 INFO:tasks.workunit.client.0.smithi081.stdout:1/383: symlink d0/l88 0 2024-09-18T12:51:17.544 INFO:tasks.workunit.client.0.smithi081.stdout:1/384: chown d0/d6/d33/d37/d71/f72 434837 1 2024-09-18T12:51:17.544 INFO:tasks.workunit.client.1.smithi136.stdout:5/751: rename d5/d1a/d2d/d34/d88/ld2 to d5/db4/leb 0 2024-09-18T12:51:17.545 INFO:tasks.workunit.client.1.smithi136.stdout:5/752: write d5/d1a/d2d/d34/d4e/d9b/f9c [1382038,106326] 0 2024-09-18T12:51:17.545 INFO:tasks.workunit.client.1.smithi136.stdout:5/753: truncate d5/d1a/d2d/d3f/fc6 1529671 0 2024-09-18T12:51:17.548 INFO:tasks.workunit.client.1.smithi136.stdout:5/754: unlink d5/d1a/d2d/d34/d88/lb2 0 2024-09-18T12:51:17.548 INFO:tasks.workunit.client.1.smithi136.stdout:5/755: write d5/f9 [1190962,90479] 0 2024-09-18T12:51:17.550 INFO:tasks.workunit.client.1.smithi136.stdout:3/666: write d3/d14/d18/d7f/f56 [8212831,123174] 0 2024-09-18T12:51:17.550 INFO:tasks.workunit.client.1.smithi136.stdout:9/694: dread d6/da/d3d/d4d/d91/d25/f27 [0,4194304] 0 2024-09-18T12:51:17.550 INFO:tasks.workunit.client.1.smithi136.stdout:1/634: dwrite d2/f6c [0,4194304] 0 2024-09-18T12:51:17.552 INFO:tasks.workunit.client.1.smithi136.stdout:8/797: dwrite d9/d18/d34/d3d/d47/d65/f7b [0,4194304] 0 2024-09-18T12:51:17.552 INFO:tasks.workunit.client.1.smithi136.stdout:8/798: read - d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 zero size 2024-09-18T12:51:17.552 INFO:tasks.workunit.client.1.smithi136.stdout:8/799: fdatasync d9/d14/d1a/d2b/f58 0 2024-09-18T12:51:17.552 INFO:tasks.workunit.client.1.smithi136.stdout:3/667: truncate d3/d2b/f92 3277912 0 2024-09-18T12:51:17.553 INFO:tasks.workunit.client.1.smithi136.stdout:9/695: mknod d6/cf0 0 2024-09-18T12:51:17.553 INFO:tasks.workunit.client.1.smithi136.stdout:9/696: readlink d6/df/d23/d2b/l6e 0 2024-09-18T12:51:17.553 INFO:tasks.workunit.client.1.smithi136.stdout:9/697: fdatasync d6/df/d23/d2b/fcc 0 2024-09-18T12:51:17.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/452: write d15/d16/f18 [3148557,110297] 0 2024-09-18T12:51:17.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/453: readlink d15/d16/d33/d53/l57 0 2024-09-18T12:51:17.556 INFO:tasks.workunit.client.1.smithi136.stdout:8/800: creat d9/d14/d1a/d2b/deb/f120 x:0 0 0 2024-09-18T12:51:17.556 INFO:tasks.workunit.client.1.smithi136.stdout:8/801: write d9/d14/d1a/d7f/d8c/fac [1888654,24911] 0 2024-09-18T12:51:17.557 INFO:tasks.workunit.client.1.smithi136.stdout:3/668: mkdir d3/d14/d17/d75/d86/dd9 0 2024-09-18T12:51:17.558 INFO:tasks.workunit.client.0.smithi081.stdout:2/454: rename f11 to d15/d16/d33/d53/d7a/d2f/d61/d97/f9c 0 2024-09-18T12:51:17.560 INFO:tasks.workunit.client.1.smithi136.stdout:9/698: dread d6/da/fba [0,4194304] 0 2024-09-18T12:51:17.560 INFO:tasks.workunit.client.1.smithi136.stdout:3/669: unlink d3/d14/d18/d7f/f56 0 2024-09-18T12:51:17.562 INFO:tasks.workunit.client.0.smithi081.stdout:2/455: creat d15/d16/d20/d22/d8c/d6b/f9d x:0 0 0 2024-09-18T12:51:17.562 INFO:tasks.workunit.client.1.smithi136.stdout:9/699: mknod d6/d59/cf1 0 2024-09-18T12:51:17.562 INFO:tasks.workunit.client.1.smithi136.stdout:9/700: creat d6/da/ff2 x:0 0 0 2024-09-18T12:51:17.564 INFO:tasks.workunit.client.1.smithi136.stdout:1/635: write d2/f6f [3910978,17383] 0 2024-09-18T12:51:17.574 INFO:tasks.workunit.client.1.smithi136.stdout:8/802: dread d9/d14/f63 [0,4194304] 0 2024-09-18T12:51:17.575 INFO:tasks.workunit.client.1.smithi136.stdout:8/803: chown d9/d18/d34/d3d/f4b 76739 1 2024-09-18T12:51:17.575 INFO:tasks.workunit.client.1.smithi136.stdout:8/804: dread - d9/f11d zero size 2024-09-18T12:51:17.576 INFO:tasks.workunit.client.1.smithi136.stdout:8/805: chown d9/d14/d1a/d7f/d8c 7186 1 2024-09-18T12:51:17.577 INFO:tasks.workunit.client.1.smithi136.stdout:2/764: dwrite d5/d7/d11/d34/fda [0,4194304] 0 2024-09-18T12:51:17.578 INFO:tasks.workunit.client.1.smithi136.stdout:2/765: creat d5/d25/ff8 x:0 0 0 2024-09-18T12:51:17.578 INFO:tasks.workunit.client.1.smithi136.stdout:9/701: dread d6/df/d23/d2b/d79/d53/fb7 [0,4194304] 0 2024-09-18T12:51:17.581 INFO:tasks.workunit.client.1.smithi136.stdout:2/766: creat d5/d4a/d64/ff9 x:0 0 0 2024-09-18T12:51:17.581 INFO:tasks.workunit.client.1.smithi136.stdout:1/636: dread d2/d5/d2b/d9b/f19 [0,4194304] 0 2024-09-18T12:51:17.583 INFO:tasks.workunit.client.1.smithi136.stdout:1/637: unlink d2/d5/d2b/d9b/d2e/f4f 0 2024-09-18T12:51:17.583 INFO:tasks.workunit.client.1.smithi136.stdout:1/638: creat d2/d5/d2b/d34/d5c/fcf x:0 0 0 2024-09-18T12:51:17.585 INFO:tasks.workunit.client.1.smithi136.stdout:1/639: mkdir d2/d5/d9/db4/dd0 0 2024-09-18T12:51:17.587 INFO:tasks.workunit.client.1.smithi136.stdout:1/640: rename d2/d5/d2b/d34/d86/d50 to d2/d5/d2b/dd1 0 2024-09-18T12:51:17.587 INFO:tasks.workunit.client.1.smithi136.stdout:1/641: chown d2/d5/d2b/d34/d5c/d96 84293 1 2024-09-18T12:51:17.588 INFO:tasks.workunit.client.1.smithi136.stdout:0/725: dwrite d1/d3/d1a/d95/fa3 [0,4194304] 0 2024-09-18T12:51:17.588 INFO:tasks.workunit.client.1.smithi136.stdout:5/756: dwrite d5/d1a/d2d/d3f/fc6 [0,4194304] 0 2024-09-18T12:51:17.588 INFO:tasks.workunit.client.1.smithi136.stdout:5/757: readlink d5/l8 0 2024-09-18T12:51:17.591 INFO:tasks.workunit.client.1.smithi136.stdout:8/806: write d9/d14/f71 [843779,109375] 0 2024-09-18T12:51:17.591 INFO:tasks.workunit.client.1.smithi136.stdout:0/726: link d1/d3/d1a/d95/fc3 d1/d60/dcb/ffa 0 2024-09-18T12:51:17.591 INFO:tasks.workunit.client.1.smithi136.stdout:6/707: dwrite d8/d9/d64/f98 [0,4194304] 0 2024-09-18T12:51:17.591 INFO:tasks.workunit.client.1.smithi136.stdout:8/807: fsync d9/d18/d34/d3d/d47/dbe/de3/d10d/fef 0 2024-09-18T12:51:17.596 INFO:tasks.workunit.client.1.smithi136.stdout:9/702: dread d6/da/d3d/d4d/d91/f16 [0,4194304] 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/703: write d6/da/d3d/d4d/d91/d38/fa3 [1007910,16782] 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:0/727: symlink d1/d46/lfb 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:0/728: dread - d1/db/faa zero size 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/704: unlink d6/fe7 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/705: readlink d6/da/d3d/d4d/d91/d25/d55/la4 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/706: mkdir d6/da/d3d/d4d/d91/d25/df3 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:8/808: write d9/d14/f63 [313448,114578] 0 2024-09-18T12:51:17.597 INFO:tasks.workunit.client.1.smithi136.stdout:2/767: write d5/d7/f10 [2766671,47211] 0 2024-09-18T12:51:17.598 INFO:tasks.workunit.client.1.smithi136.stdout:9/707: truncate d6/da/d3d/d4d/d91/f6f 1405401 0 2024-09-18T12:51:17.599 INFO:tasks.workunit.client.1.smithi136.stdout:8/809: symlink d9/d14/d1a/d2b/d42/d6e/d75/d109/l121 0 2024-09-18T12:51:17.599 INFO:tasks.workunit.client.1.smithi136.stdout:0/729: dread d1/db/f3e [0,4194304] 0 2024-09-18T12:51:17.599 INFO:tasks.workunit.client.1.smithi136.stdout:8/810: read d9/d18/d34/d3d/d47/d65/fe0 [727582,65937] 0 2024-09-18T12:51:17.599 INFO:tasks.workunit.client.1.smithi136.stdout:8/811: read d9/d14/f63 [1101449,127312] 0 2024-09-18T12:51:17.599 INFO:tasks.workunit.client.1.smithi136.stdout:8/812: chown d9/d18/d34/d3d/d47/d65/d93/d96/d9b/ca2 64106015 1 2024-09-18T12:51:17.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/456: dwrite d15/d26/f92 [0,4194304] 0 2024-09-18T12:51:17.606 INFO:tasks.workunit.client.0.smithi081.stdout:1/385: dwrite d0/db/d12/f22 [0,4194304] 0 2024-09-18T12:51:17.612 INFO:tasks.workunit.client.1.smithi136.stdout:3/670: dwrite d3/d2b/d6c/db4/fc9 [0,4194304] 0 2024-09-18T12:51:17.612 INFO:tasks.workunit.client.1.smithi136.stdout:1/642: dread d2/f60 [0,4194304] 0 2024-09-18T12:51:17.612 INFO:tasks.workunit.client.1.smithi136.stdout:5/758: dread d5/d1a/d2d/d34/d4e/d7a/d9e/dad/fdf [0,4194304] 0 2024-09-18T12:51:17.621 INFO:tasks.workunit.client.1.smithi136.stdout:9/708: write d6/da/fdb [707480,55951] 0 2024-09-18T12:51:17.622 INFO:tasks.workunit.client.1.smithi136.stdout:0/730: write d1/d60/d82/f9f [1214066,16864] 0 2024-09-18T12:51:17.627 INFO:tasks.workunit.client.1.smithi136.stdout:1/643: rename d2/d5/fd to d2/fd2 0 2024-09-18T12:51:17.629 INFO:tasks.workunit.client.1.smithi136.stdout:5/759: unlink d5/d1a/d2d/d34/f45 0 2024-09-18T12:51:17.629 INFO:tasks.workunit.client.1.smithi136.stdout:5/760: creat d5/d1a/d2d/d34/d4e/d7a/fec x:0 0 0 2024-09-18T12:51:17.629 INFO:tasks.workunit.client.1.smithi136.stdout:5/761: fsync d5/d1a/d4a/d79/f90 0 2024-09-18T12:51:17.629 INFO:tasks.workunit.client.1.smithi136.stdout:5/762: dread - d5/d1a/d2d/f99 zero size 2024-09-18T12:51:17.631 INFO:tasks.workunit.client.1.smithi136.stdout:9/709: link d6/d59/f68 d6/d13/ff4 0 2024-09-18T12:51:17.631 INFO:tasks.workunit.client.1.smithi136.stdout:9/710: creat d6/da/dd1/ff5 x:0 0 0 2024-09-18T12:51:17.633 INFO:tasks.workunit.client.1.smithi136.stdout:5/763: dread d5/d6b/fc5 [0,4194304] 0 2024-09-18T12:51:17.633 INFO:tasks.workunit.client.1.smithi136.stdout:8/813: dwrite d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d [0,4194304] 0 2024-09-18T12:51:17.635 INFO:tasks.workunit.client.0.smithi081.stdout:2/457: dread d15/d16/d33/d53/d7a/d32/f68 [0,4194304] 0 2024-09-18T12:51:17.635 INFO:tasks.workunit.client.0.smithi081.stdout:1/386: dwrite d0/d6/f17 [0,4194304] 0 2024-09-18T12:51:17.638 INFO:tasks.workunit.client.0.smithi081.stdout:2/458: mknod d15/d16/d20/d22/d5a/c9e 0 2024-09-18T12:51:17.638 INFO:tasks.workunit.client.0.smithi081.stdout:2/459: dread - d15/f84 zero size 2024-09-18T12:51:17.639 INFO:tasks.workunit.client.0.smithi081.stdout:2/460: symlink d15/d16/d33/d53/d7a/d2f/d61/d97/l9f 0 2024-09-18T12:51:17.641 INFO:tasks.workunit.client.0.smithi081.stdout:2/461: truncate d15/d26/f92 229322 0 2024-09-18T12:51:17.641 INFO:tasks.workunit.client.0.smithi081.stdout:2/462: dread - d15/d16/d20/f76 zero size 2024-09-18T12:51:17.641 INFO:tasks.workunit.client.1.smithi136.stdout:1/644: dread d2/d5/d2b/dd1/f57 [0,4194304] 0 2024-09-18T12:51:17.642 INFO:tasks.workunit.client.1.smithi136.stdout:9/711: rename d6/db/d12/f33 to d6/ff6 0 2024-09-18T12:51:17.643 INFO:tasks.workunit.client.0.smithi081.stdout:2/463: mkdir d15/d16/d33/d53/d7a/d32/d6d/da0 0 2024-09-18T12:51:17.646 INFO:tasks.workunit.client.1.smithi136.stdout:5/764: mkdir d5/d1a/d30/ded 0 2024-09-18T12:51:17.646 INFO:tasks.workunit.client.1.smithi136.stdout:5/765: chown d5/d1a/d2d/d34/d4e/d7a/fec 15682365 1 2024-09-18T12:51:17.647 INFO:tasks.workunit.client.0.smithi081.stdout:1/387: write d0/d6/d7/d8/fc [1140205,35331] 0 2024-09-18T12:51:17.647 INFO:tasks.workunit.client.1.smithi136.stdout:0/731: getdents d1/d3/d1a/d95 0 2024-09-18T12:51:17.649 INFO:tasks.workunit.client.1.smithi136.stdout:1/645: stat d2/d5/d9/c49 0 2024-09-18T12:51:17.649 INFO:tasks.workunit.client.0.smithi081.stdout:1/388: link d0/d6/fd d0/d6/d7/d2e/d4e/f89 0 2024-09-18T12:51:17.650 INFO:tasks.workunit.client.1.smithi136.stdout:5/766: truncate d5/d1a/f53 3432532 0 2024-09-18T12:51:17.651 INFO:tasks.workunit.client.0.smithi081.stdout:1/389: mknod d0/d6/d33/d42/c8a 0 2024-09-18T12:51:17.651 INFO:tasks.workunit.client.0.smithi081.stdout:2/464: dread d15/d16/d33/d53/d7a/d32/f68 [0,4194304] 0 2024-09-18T12:51:17.652 INFO:tasks.workunit.client.0.smithi081.stdout:2/465: mknod d15/d26/ca1 0 2024-09-18T12:51:17.653 INFO:tasks.workunit.client.0.smithi081.stdout:2/466: mknod d15/d16/d33/d53/d7a/d2f/d61/ca2 0 2024-09-18T12:51:17.653 INFO:tasks.workunit.client.1.smithi136.stdout:5/767: mknod d5/d1a/d2d/d34/d4e/d7a/d9e/dad/cee 0 2024-09-18T12:51:17.653 INFO:tasks.workunit.client.1.smithi136.stdout:5/768: fdatasync f2 0 2024-09-18T12:51:17.656 INFO:tasks.workunit.client.1.smithi136.stdout:7/820: sync 2024-09-18T12:51:17.656 INFO:tasks.workunit.client.1.smithi136.stdout:4/629: sync 2024-09-18T12:51:17.656 INFO:tasks.workunit.client.1.smithi136.stdout:4/630: dread - d0/d3/d54/d8a/fbb zero size 2024-09-18T12:51:17.657 INFO:tasks.workunit.client.1.smithi136.stdout:0/732: dread d1/d46/f66 [0,4194304] 0 2024-09-18T12:51:17.658 INFO:tasks.workunit.client.1.smithi136.stdout:4/631: mknod d0/d3/d54/cc8 0 2024-09-18T12:51:17.661 INFO:tasks.workunit.client.1.smithi136.stdout:0/733: rename d1/f1f to d1/d3/d1a/d98/d81/d35/d54/ffc 0 2024-09-18T12:51:17.661 INFO:tasks.workunit.client.1.smithi136.stdout:5/769: dread d5/d1a/d2d/d3f/f8a [0,4194304] 0 2024-09-18T12:51:17.663 INFO:tasks.workunit.client.1.smithi136.stdout:5/770: creat d5/d1a/d4a/da1/fef x:0 0 0 2024-09-18T12:51:17.665 INFO:tasks.workunit.client.1.smithi136.stdout:1/646: dread d2/d5/d2b/d9b/d1b/f25 [0,4194304] 0 2024-09-18T12:51:17.665 INFO:tasks.workunit.client.1.smithi136.stdout:8/814: dwrite d9/d18/d34/d3d/d47/d65/f76 [0,4194304] 0 2024-09-18T12:51:17.666 INFO:tasks.workunit.client.0.smithi081.stdout:1/390: dread d0/d6/fe [4194304,4194304] 0 2024-09-18T12:51:17.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/821: write d0/d35/d41/d50/d7b/fb6 [3376141,48477] 0 2024-09-18T12:51:17.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/822: rename d0/d35/d4f to d0/d35/d4f/d129 22 2024-09-18T12:51:17.670 INFO:tasks.workunit.client.1.smithi136.stdout:7/823: truncate d0/d39/d4d/d9a/da2/ffd 895456 0 2024-09-18T12:51:17.671 INFO:tasks.workunit.client.1.smithi136.stdout:1/647: dread d2/f41 [0,4194304] 0 2024-09-18T12:51:17.671 INFO:tasks.workunit.client.1.smithi136.stdout:7/824: rename d0/d39/d4d/d9a/fb9 to d0/d39/d4d/d9a/dee/d109/f12a 0 2024-09-18T12:51:17.673 INFO:tasks.workunit.client.1.smithi136.stdout:1/648: rename d2/d5/d2b/dd1 to d2/d5/d2b/d9b/dbe/dd3 0 2024-09-18T12:51:17.674 INFO:tasks.workunit.client.1.smithi136.stdout:7/825: creat d0/d35/d41/dbb/f12b x:0 0 0 2024-09-18T12:51:17.676 INFO:tasks.workunit.client.1.smithi136.stdout:8/815: write d9/d14/d1a/f4e [363917,102229] 0 2024-09-18T12:51:17.677 INFO:tasks.workunit.client.1.smithi136.stdout:1/649: rmdir d2/d5/d2b/d9b/dbe/dce 0 2024-09-18T12:51:17.677 INFO:tasks.workunit.client.1.smithi136.stdout:1/650: stat d2/d5/d2b/d34 0 2024-09-18T12:51:17.679 INFO:tasks.workunit.client.1.smithi136.stdout:1/651: symlink d2/d5/d2b/d34/d86/ld4 0 2024-09-18T12:51:17.679 INFO:tasks.workunit.client.1.smithi136.stdout:5/771: dread d5/d1a/d30/f40 [0,4194304] 0 2024-09-18T12:51:17.680 INFO:tasks.workunit.client.1.smithi136.stdout:1/652: symlink d2/d5/d9/db4/ld5 0 2024-09-18T12:51:17.680 INFO:tasks.workunit.client.1.smithi136.stdout:9/712: dwrite d6/db/d12/f37 [0,4194304] 0 2024-09-18T12:51:17.683 INFO:tasks.workunit.client.1.smithi136.stdout:1/653: link d2/d5/d2b/d9b/l7a d2/d5/d2b/d9b/d2e/d9a/ld6 0 2024-09-18T12:51:17.687 INFO:tasks.workunit.client.1.smithi136.stdout:8/816: dread d9/d14/f63 [0,4194304] 0 2024-09-18T12:51:17.688 INFO:tasks.workunit.client.1.smithi136.stdout:8/817: mkdir d9/d14/d1a/d2b/d42/d6e/d75/db4/d122 0 2024-09-18T12:51:17.689 INFO:tasks.workunit.client.1.smithi136.stdout:8/818: symlink d9/d18/d34/d3d/d47/dbe/de3/l123 0 2024-09-18T12:51:17.690 INFO:tasks.workunit.client.1.smithi136.stdout:4/632: dwrite d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:17.691 INFO:tasks.workunit.client.1.smithi136.stdout:8/819: mknod d9/d14/d1a/d2b/deb/d110/c124 0 2024-09-18T12:51:17.691 INFO:tasks.workunit.client.0.smithi081.stdout:2/467: dwrite d15/d16/d20/d22/f34 [4194304,4194304] 0 2024-09-18T12:51:17.692 INFO:tasks.workunit.client.0.smithi081.stdout:1/391: dread d0/d6/d33/f61 [0,4194304] 0 2024-09-18T12:51:17.692 INFO:tasks.workunit.client.1.smithi136.stdout:8/820: creat d9/d14/d1a/d2b/deb/d110/d10b/f125 x:0 0 0 2024-09-18T12:51:17.694 INFO:tasks.workunit.client.0.smithi081.stdout:2/468: mknod d15/d16/d33/d53/d7a/d32/d6d/ca3 0 2024-09-18T12:51:17.695 INFO:tasks.workunit.client.0.smithi081.stdout:1/392: symlink d0/d6/d66/l8b 0 2024-09-18T12:51:17.696 INFO:tasks.workunit.client.0.smithi081.stdout:1/393: chown d0/d6/d7/d2e/d4e/l68 414348 1 2024-09-18T12:51:17.696 INFO:tasks.workunit.client.1.smithi136.stdout:8/821: mkdir d9/d14/d1a/d2b/deb/d126 0 2024-09-18T12:51:17.697 INFO:tasks.workunit.client.1.smithi136.stdout:8/822: truncate d9/d18/d34/d3d/d47/d65/d93/d96/fc8 829910 0 2024-09-18T12:51:17.697 INFO:tasks.workunit.client.0.smithi081.stdout:2/469: creat d15/d16/d20/fa4 x:0 0 0 2024-09-18T12:51:17.697 INFO:tasks.workunit.client.1.smithi136.stdout:5/772: dread d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 [0,4194304] 0 2024-09-18T12:51:17.698 INFO:tasks.workunit.client.0.smithi081.stdout:1/394: creat d0/d6/d33/d42/d70/f8c x:0 0 0 2024-09-18T12:51:17.699 INFO:tasks.workunit.client.1.smithi136.stdout:8/823: rmdir d9/d18/d34/d3d/d47/d65 39 2024-09-18T12:51:17.701 INFO:tasks.workunit.client.1.smithi136.stdout:1/654: write d2/f41 [1306556,88733] 0 2024-09-18T12:51:17.704 INFO:tasks.workunit.client.1.smithi136.stdout:5/773: creat d5/d1a/d2d/d34/d88/ff0 x:0 0 0 2024-09-18T12:51:17.707 INFO:tasks.workunit.client.1.smithi136.stdout:1/655: creat d2/d5/d2b/d9b/dbe/dd3/fd7 x:0 0 0 2024-09-18T12:51:17.708 INFO:tasks.workunit.client.1.smithi136.stdout:5/774: mknod d5/d78/cf1 0 2024-09-18T12:51:17.708 INFO:tasks.workunit.client.1.smithi136.stdout:5/775: creat d5/d1a/d2d/d34/d88/ff2 x:0 0 0 2024-09-18T12:51:17.709 INFO:tasks.workunit.client.1.smithi136.stdout:8/824: dread d9/d18/d34/d3d/d47/d65/f7b [0,4194304] 0 2024-09-18T12:51:17.712 INFO:tasks.workunit.client.1.smithi136.stdout:5/776: mkdir d5/d1a/d30/df3 0 2024-09-18T12:51:17.713 INFO:tasks.workunit.client.1.smithi136.stdout:1/656: rename d2/d5/d9/f10 to d2/d5/d9/fd8 0 2024-09-18T12:51:17.714 INFO:tasks.workunit.client.1.smithi136.stdout:1/657: write d2/d5/f5a [5726206,112110] 0 2024-09-18T12:51:17.714 INFO:tasks.workunit.client.1.smithi136.stdout:8/825: symlink d9/d18/d34/d3d/d47/d65/d92/l127 0 2024-09-18T12:51:17.714 INFO:tasks.workunit.client.1.smithi136.stdout:5/777: rmdir d5/d1a/d30/df3 0 2024-09-18T12:51:17.714 INFO:tasks.workunit.client.1.smithi136.stdout:5/778: write d5/d1a/d2d/d34/d4e/fd1 [4876996,106567] 0 2024-09-18T12:51:17.715 INFO:tasks.workunit.client.1.smithi136.stdout:5/779: creat d5/d1a/d2d/d34/ff4 x:0 0 0 2024-09-18T12:51:17.715 INFO:tasks.workunit.client.1.smithi136.stdout:5/780: truncate d5/d1a/fe0 137410 0 2024-09-18T12:51:17.718 INFO:tasks.workunit.client.1.smithi136.stdout:1/658: mkdir d2/d5/d2b/d9b/d2e/d4c/dd9 0 2024-09-18T12:51:17.718 INFO:tasks.workunit.client.1.smithi136.stdout:9/713: dwrite d6/da/d3d/d4d/fa2 [0,4194304] 0 2024-09-18T12:51:17.718 INFO:tasks.workunit.client.1.smithi136.stdout:8/826: creat d9/d14/d1a/f128 x:0 0 0 2024-09-18T12:51:17.720 INFO:tasks.workunit.client.1.smithi136.stdout:5/781: mkdir d5/d1a/d2d/d34/d4e/df5 0 2024-09-18T12:51:17.720 INFO:tasks.workunit.client.1.smithi136.stdout:4/633: dwrite d0/d3/fa5 [0,4194304] 0 2024-09-18T12:51:17.722 INFO:tasks.workunit.client.1.smithi136.stdout:1/659: mkdir d2/d5/d2b/d63/dda 0 2024-09-18T12:51:17.723 INFO:tasks.workunit.client.1.smithi136.stdout:4/634: write d0/d25/d83/f9e [388116,113120] 0 2024-09-18T12:51:17.723 INFO:tasks.workunit.client.1.smithi136.stdout:5/782: stat d5/d1a/d2d/d34/d4e/d7a/d9e/dad/ld7 0 2024-09-18T12:51:17.726 INFO:tasks.workunit.client.1.smithi136.stdout:1/660: mkdir d2/d5/d2b/d9b/dbe/dd3/d65/ddb 0 2024-09-18T12:51:17.727 INFO:tasks.workunit.client.1.smithi136.stdout:4/635: mknod d0/d5f/cc9 0 2024-09-18T12:51:17.729 INFO:tasks.workunit.client.1.smithi136.stdout:5/783: creat d5/d1a/d2d/d34/d4e/df5/ff6 x:0 0 0 2024-09-18T12:51:17.729 INFO:tasks.workunit.client.1.smithi136.stdout:5/784: fsync d5/d1a/d2d/d34/d4e/d9b/f9c 0 2024-09-18T12:51:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/470: dwrite d15/d16/d20/d22/d8c/d6b/f83 [0,4194304] 0 2024-09-18T12:51:17.730 INFO:tasks.workunit.client.1.smithi136.stdout:0/734: dwrite d1/d17/f37 [0,4194304] 0 2024-09-18T12:51:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:1/395: dwrite d0/db/d32/f87 [0,4194304] 0 2024-09-18T12:51:17.731 INFO:tasks.workunit.client.1.smithi136.stdout:4/636: link d0/d25/f6f d0/d25/db7/fca 0 2024-09-18T12:51:17.731 INFO:tasks.workunit.client.1.smithi136.stdout:0/735: dread d1/d3/d1a/fce [0,4194304] 0 2024-09-18T12:51:17.732 INFO:tasks.workunit.client.1.smithi136.stdout:5/785: truncate d5/f4f 8048297 0 2024-09-18T12:51:17.732 INFO:tasks.workunit.client.1.smithi136.stdout:9/714: dread d6/da/d3d/fc3 [0,4194304] 0 2024-09-18T12:51:17.732 INFO:tasks.workunit.client.1.smithi136.stdout:9/715: read d6/da/d3d/d41/fb8 [458661,96197] 0 2024-09-18T12:51:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:2/471: rename d15/d16/d20/d31/f49 to d15/d16/d20/fa5 0 2024-09-18T12:51:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:2/472: write d15/d16/d20/d22/d8c/f7d [628496,69903] 0 2024-09-18T12:51:17.735 INFO:tasks.workunit.client.1.smithi136.stdout:9/716: creat d6/d13/ff7 x:0 0 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/661: dread d2/d5/d2b/d9b/dbe/dd3/f57 [0,4194304] 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/662: read d2/d5/d2b/d34/f4b [559353,130227] 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/663: write d2/fb3 [771509,48663] 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:1/664: write d2/d5/fa1 [1273438,120098] 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:4/637: getdents d0/d45 0 2024-09-18T12:51:17.736 INFO:tasks.workunit.client.1.smithi136.stdout:4/638: write d0/d5f/f81 [687014,31926] 0 2024-09-18T12:51:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:1/396: read d0/d6/d33/f61 [2313495,122509] 0 2024-09-18T12:51:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:1/397: write d0/d6/d7/d2e/d51/d2c/f5c [989026,85855] 0 2024-09-18T12:51:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/473: rename d15/d16/d33/d53/d7a/d2f/d61/d97/f9c to d15/d16/d33/d53/d7a/d2f/fa6 0 2024-09-18T12:51:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/474: write d15/d16/d33/f8b [696998,97260] 0 2024-09-18T12:51:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:2/475: fdatasync d15/d16/d33/d53/d7a/d2f/fa6 0 2024-09-18T12:51:17.738 INFO:tasks.workunit.client.1.smithi136.stdout:9/717: mkdir d6/da/d3d/d4d/d91/d25/dee/df8 0 2024-09-18T12:51:17.738 INFO:tasks.workunit.client.1.smithi136.stdout:9/718: stat d6/db/d12/f60 0 2024-09-18T12:51:17.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/476: creat d15/d16/fa7 x:0 0 0 2024-09-18T12:51:17.739 INFO:tasks.workunit.client.0.smithi081.stdout:2/477: mkdir d15/d26/da8 0 2024-09-18T12:51:17.739 INFO:tasks.workunit.client.1.smithi136.stdout:4/639: symlink d0/d3/d54/d88/db1/lcb 0 2024-09-18T12:51:17.740 INFO:tasks.workunit.client.0.smithi081.stdout:2/478: mknod d15/d26/ca9 0 2024-09-18T12:51:17.740 INFO:tasks.workunit.client.0.smithi081.stdout:2/479: write d15/d16/d20/d22/d8c/d6b/f9d [830211,27507] 0 2024-09-18T12:51:17.741 INFO:tasks.workunit.client.1.smithi136.stdout:8/827: dwrite d9/d14/d1a/d2b/d42/da4/dd9/de1/fe2 [0,4194304] 0 2024-09-18T12:51:17.741 INFO:tasks.workunit.client.1.smithi136.stdout:8/828: chown d9/d14/d1a/d2b/d42/d6e/f84 3 1 2024-09-18T12:51:17.741 INFO:tasks.workunit.client.1.smithi136.stdout:9/719: mkdir d6/df/d23/d2b/d79/d53/d5c/df9 0 2024-09-18T12:51:17.741 INFO:tasks.workunit.client.1.smithi136.stdout:9/720: chown d6/df/d23/d2b/d79/d53/c9e 3663915 1 2024-09-18T12:51:17.742 INFO:tasks.workunit.client.1.smithi136.stdout:0/736: dread d1/d3/d1a/d98/d81/d51/fc6 [0,4194304] 0 2024-09-18T12:51:17.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/480: symlink d15/d16/d33/d53/d7a/d2f/laa 0 2024-09-18T12:51:17.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/481: write d15/d16/d20/d59/f77 [899530,102439] 0 2024-09-18T12:51:17.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/482: creat d15/d16/d33/d53/d7a/d32/fab x:0 0 0 2024-09-18T12:51:17.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/483: dread - d15/d16/d33/d53/d7a/d32/fab zero size 2024-09-18T12:51:17.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/484: creat d15/d16/d33/d53/d7a/d2f/d61/d97/fac x:0 0 0 2024-09-18T12:51:17.746 INFO:tasks.workunit.client.1.smithi136.stdout:1/665: dread d2/d5/d2b/d9b/d2e/d4c/f1f [0,4194304] 0 2024-09-18T12:51:17.746 INFO:tasks.workunit.client.1.smithi136.stdout:1/666: creat d2/d5/d2b/d9b/dbe/dd3/fdc x:0 0 0 2024-09-18T12:51:17.746 INFO:tasks.workunit.client.1.smithi136.stdout:8/829: mknod d9/d14/d1a/d2b/d42/da4/da7/c129 0 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:2/485: creat d15/d16/d33/d53/d7a/d2f/fad x:0 0 0 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:3/369: sync 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:0/389: sync 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:0/390: read - d7/d9/d4b/d4a/d68/f83 zero size 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:0/391: write d7/d9/d4b/d4a/f1a [736180,74873] 0 2024-09-18T12:51:17.747 INFO:tasks.workunit.client.0.smithi081.stdout:0/392: chown d7/d9/d4b/d53/l74 19971307 1 2024-09-18T12:51:17.748 INFO:tasks.workunit.client.1.smithi136.stdout:9/721: creat d6/df/d23/d2b/d79/ffa x:0 0 0 2024-09-18T12:51:17.751 INFO:tasks.workunit.client.0.smithi081.stdout:0/393: creat d7/d9/d4b/f84 x:0 0 0 2024-09-18T12:51:17.751 INFO:tasks.workunit.client.1.smithi136.stdout:0/737: creat d1/db/d76/db9/ffd x:0 0 0 2024-09-18T12:51:17.751 INFO:tasks.workunit.client.1.smithi136.stdout:0/738: write d1/d3/d1a/d98/d81/d35/f4d [359466,18463] 0 2024-09-18T12:51:17.753 INFO:tasks.workunit.client.0.smithi081.stdout:2/486: getdents d15/d16/d33 0 2024-09-18T12:51:17.757 INFO:tasks.workunit.client.1.smithi136.stdout:1/667: creat d2/d5/d2b/d9b/fdd x:0 0 0 2024-09-18T12:51:17.758 INFO:tasks.workunit.client.0.smithi081.stdout:2/487: symlink d15/d16/d33/d53/d7a/d2f/d61/d97/lae 0 2024-09-18T12:51:17.758 INFO:tasks.workunit.client.0.smithi081.stdout:2/488: stat d15/d16/d33/d53/d7a/d2f/c30 0 2024-09-18T12:51:17.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/398: dwrite d0/d6/d33/d37/d71/f72 [0,4194304] 0 2024-09-18T12:51:17.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/399: truncate d0/db/f14 1157267 0 2024-09-18T12:51:17.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/400: chown d0/d18/f38 40987321 1 2024-09-18T12:51:17.765 INFO:tasks.workunit.client.1.smithi136.stdout:4/640: dwrite d0/d13/f69 [0,4194304] 0 2024-09-18T12:51:17.767 INFO:tasks.workunit.client.0.smithi081.stdout:1/401: symlink d0/d6/d7/d2e/l8d 0 2024-09-18T12:51:17.768 INFO:tasks.workunit.client.0.smithi081.stdout:1/402: creat d0/db/d12/d28/f8e x:0 0 0 2024-09-18T12:51:17.768 INFO:tasks.workunit.client.1.smithi136.stdout:9/722: creat d6/da/d3d/d4d/d91/d25/dee/df8/ffb x:0 0 0 2024-09-18T12:51:17.768 INFO:tasks.workunit.client.1.smithi136.stdout:9/723: fdatasync d6/df/d23/d2b/d79/ffa 0 2024-09-18T12:51:17.769 INFO:tasks.workunit.client.1.smithi136.stdout:1/668: truncate d2/d5/d2b/d9b/dbe/dd3/f6d 3276910 0 2024-09-18T12:51:17.770 INFO:tasks.workunit.client.0.smithi081.stdout:1/403: unlink d0/db/f78 0 2024-09-18T12:51:17.771 INFO:tasks.workunit.client.0.smithi081.stdout:1/404: mknod d0/d6/c8f 0 2024-09-18T12:51:17.773 INFO:tasks.workunit.client.0.smithi081.stdout:1/405: unlink d0/d6/d7/c5f 0 2024-09-18T12:51:17.773 INFO:tasks.workunit.client.1.smithi136.stdout:1/669: unlink d2/d5/d2b/d9b/dbe/dd3/fd7 0 2024-09-18T12:51:17.774 INFO:tasks.workunit.client.0.smithi081.stdout:1/406: mkdir d0/d6/d33/d37/d71/d90 0 2024-09-18T12:51:17.775 INFO:tasks.workunit.client.0.smithi081.stdout:1/407: mkdir d0/d18/d6a/d91 0 2024-09-18T12:51:17.775 INFO:tasks.workunit.client.0.smithi081.stdout:1/408: truncate d0/d6/d7/d2e/d51/d2c/f5c 2096391 0 2024-09-18T12:51:17.776 INFO:tasks.workunit.client.0.smithi081.stdout:1/409: mknod d0/d6/d7/c92 0 2024-09-18T12:51:17.776 INFO:tasks.workunit.client.0.smithi081.stdout:1/410: creat d0/f93 x:0 0 0 2024-09-18T12:51:17.780 INFO:tasks.workunit.client.1.smithi136.stdout:4/641: dread d0/d2/f23 [4194304,4194304] 0 2024-09-18T12:51:17.780 INFO:tasks.workunit.client.1.smithi136.stdout:4/642: creat d0/d13/fcc x:0 0 0 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:4/299: sync 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:9/317: sync 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:6/350: sync 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:8/336: sync 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:5/428: sync 2024-09-18T12:51:17.783 INFO:tasks.workunit.client.0.smithi081.stdout:6/351: creat d4/d6/f70 x:0 0 0 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/404: sync 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/405: dread - d2/d18/d3c/f65 zero size 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/429: read d2/d14/d1d/d1a/f2b [41559,66960] 0 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/430: fdatasync d2/dd/f10 0 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/431: stat d2/d47/f76 0 2024-09-18T12:51:17.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/432: chown d2/dd/f75 12787506 1 2024-09-18T12:51:17.785 INFO:tasks.workunit.client.0.smithi081.stdout:4/300: creat d3/f67 x:0 0 0 2024-09-18T12:51:17.785 INFO:tasks.workunit.client.1.smithi136.stdout:9/724: write d6/db/d72/fb3 [2579731,16168] 0 2024-09-18T12:51:17.785 INFO:tasks.workunit.client.1.smithi136.stdout:8/830: dwrite d9/d18/d34/f6f [0,4194304] 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:0/394: dwrite d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:0/395: write d7/f21 [1699211,89010] 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/489: dwrite d15/d16/d33/d53/d7a/f52 [0,4194304] 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:1/411: read d0/db/d12/d2d/f2f [309712,68030] 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:1/412: readlink d0/db/d12/l1e 0 2024-09-18T12:51:17.788 INFO:tasks.workunit.client.0.smithi081.stdout:1/413: chown d0/d18/d6a 281 1 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:1/414: write d0/d6/d66/f6b [904998,86958] 0 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:1/415: write d0/d6/fe [13028506,14289] 0 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:8/337: symlink d3/d1e/d4c/d53/l7a 0 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/318: mknod dd/d15/d1a/c63 0 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/319: stat dd/c41 0 2024-09-18T12:51:17.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/320: creat dd/d1d/d1e/d24/f64 x:0 0 0 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/831: mkdir d9/d18/d34/d3d/d47/d65/d92/d12a 0 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/832: dread - d9/d18/d34/d3d/d47/dbe/dd1/fe9 zero size 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/833: stat d9/d14/d1a/d2b/d42/da4/da7/fa9 0 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/834: fsync d9/d18/d34/d3d/d47/dbe/dd1/fe9 0 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.1.smithi136.stdout:8/835: readlink d9/d14/d1a/d2b/l3f 0 2024-09-18T12:51:17.790 INFO:tasks.workunit.client.0.smithi081.stdout:6/352: creat d4/d12/d1c/d64/f71 x:0 0 0 2024-09-18T12:51:17.791 INFO:tasks.workunit.client.0.smithi081.stdout:7/406: creat d2/d56/d73/d90/f93 x:0 0 0 2024-09-18T12:51:17.793 INFO:tasks.workunit.client.1.smithi136.stdout:8/836: rename d9/d14/d1a/d2b/d42/c86 to d9/d14/d1a/d2b/d42/d9e/c12b 0 2024-09-18T12:51:17.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/396: creat d7/d4f/f85 x:0 0 0 2024-09-18T12:51:17.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/397: chown d7/d7c 56 1 2024-09-18T12:51:17.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/398: creat d7/d9/d4b/d33/f86 x:0 0 0 2024-09-18T12:51:17.795 INFO:tasks.workunit.client.1.smithi136.stdout:8/837: getdents d9/d14/d1a/d2b/d42/da4/db9/dc0 0 2024-09-18T12:51:17.795 INFO:tasks.workunit.client.1.smithi136.stdout:8/838: creat d9/d18/d34/d3d/d47/d65/d93/d96/f12c x:0 0 0 2024-09-18T12:51:17.798 INFO:tasks.workunit.client.0.smithi081.stdout:1/416: creat d0/d6/d33/d37/f94 x:0 0 0 2024-09-18T12:51:17.800 INFO:tasks.workunit.client.0.smithi081.stdout:9/321: creat dd/de/d4f/f65 x:0 0 0 2024-09-18T12:51:17.801 INFO:tasks.workunit.client.0.smithi081.stdout:6/353: truncate d4/f13 4449873 0 2024-09-18T12:51:17.802 INFO:tasks.workunit.client.0.smithi081.stdout:8/338: write d3/d1e/d4c/f69 [2192155,111139] 0 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/399: creat d7/d9/d4b/d33/d43/f87 x:0 0 0 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/400: write d7/d9/d4b/f5c [184325,112278] 0 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:0/401: stat d7/f21 0 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:1/417: write d0/d6/d7/d8/f29 [1268253,55821] 0 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:1/418: chown d0/db/d12/d55 8 1 2024-09-18T12:51:17.804 INFO:tasks.workunit.client.0.smithi081.stdout:1/419: stat d0/d6/d66/f6b 0 2024-09-18T12:51:17.805 INFO:tasks.workunit.client.0.smithi081.stdout:7/407: dread d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:17.805 INFO:tasks.workunit.client.0.smithi081.stdout:8/339: symlink d3/d1e/d4c/d68/l7b 0 2024-09-18T12:51:17.805 INFO:tasks.workunit.client.1.smithi136.stdout:6/708: sync 2024-09-18T12:51:17.805 INFO:tasks.workunit.client.1.smithi136.stdout:6/709: chown d8/d9/de/d60/d71 372599 1 2024-09-18T12:51:17.806 INFO:tasks.workunit.client.0.smithi081.stdout:0/402: creat d7/d9/d4b/d33/d7d/f88 x:0 0 0 2024-09-18T12:51:17.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/420: mknod d0/d6/d7/d2e/d4e/d7a/d84/c95 0 2024-09-18T12:51:17.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/421: chown d0/d6/d7/d2e/d41/d79 350585 1 2024-09-18T12:51:17.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/422: fsync d0/db/f2b 0 2024-09-18T12:51:17.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/423: chown d0/db/d4f/d50 936 1 2024-09-18T12:51:17.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/424: dread - d0/db/d12/d28/f8e zero size 2024-09-18T12:51:17.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/425: fsync d0/d6/d7/d2e/d51/f56 0 2024-09-18T12:51:17.808 INFO:tasks.workunit.client.0.smithi081.stdout:7/408: mknod d2/d56/c94 0 2024-09-18T12:51:17.809 INFO:tasks.workunit.client.1.smithi136.stdout:6/710: truncate d8/f92 542169 0 2024-09-18T12:51:17.809 INFO:tasks.workunit.client.1.smithi136.stdout:6/711: write d8/d9/de/d60/d71/d76/fe0 [166412,51328] 0 2024-09-18T12:51:17.809 INFO:tasks.workunit.client.1.smithi136.stdout:6/712: creat d8/d9/de/d60/d71/d76/d97/fe1 x:0 0 0 2024-09-18T12:51:17.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/713: mknod d8/d9/da9/ce2 0 2024-09-18T12:51:17.812 INFO:tasks.workunit.client.1.smithi136.stdout:6/714: readlink d8/d9/d3c/d4a/l63 0 2024-09-18T12:51:17.814 INFO:tasks.workunit.client.1.smithi136.stdout:8/839: read d9/d18/f48 [68565,26414] 0 2024-09-18T12:51:17.815 INFO:tasks.workunit.client.0.smithi081.stdout:0/403: dread d7/d9/d4b/f38 [0,4194304] 0 2024-09-18T12:51:17.815 INFO:tasks.workunit.client.0.smithi081.stdout:0/404: chown d7/d4f/f5a 4734 1 2024-09-18T12:51:17.815 INFO:tasks.workunit.client.0.smithi081.stdout:0/405: chown d7/l60 255632831 1 2024-09-18T12:51:17.815 INFO:tasks.workunit.client.0.smithi081.stdout:0/406: chown d7/d9/l73 3385653 1 2024-09-18T12:51:17.816 INFO:tasks.workunit.client.1.smithi136.stdout:6/715: mknod d8/d9/de/d1c/d50/ce3 0 2024-09-18T12:51:17.816 INFO:tasks.workunit.client.1.smithi136.stdout:6/716: creat d8/d9/d3c/fe4 x:0 0 0 2024-09-18T12:51:17.816 INFO:tasks.workunit.client.1.smithi136.stdout:8/840: truncate d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 309236 0 2024-09-18T12:51:17.818 INFO:tasks.workunit.client.1.smithi136.stdout:6/717: symlink d8/d9/de/d60/d71/d7f/le5 0 2024-09-18T12:51:17.819 INFO:tasks.workunit.client.1.smithi136.stdout:8/841: truncate d9/d14/fe 248160 0 2024-09-18T12:51:17.819 INFO:tasks.workunit.client.1.smithi136.stdout:4/643: dwrite d0/d8d/f9c [0,4194304] 0 2024-09-18T12:51:17.821 INFO:tasks.workunit.client.1.smithi136.stdout:6/718: rmdir d8/daa 39 2024-09-18T12:51:17.821 INFO:tasks.workunit.client.1.smithi136.stdout:6/719: readlink d8/dc/l1f 0 2024-09-18T12:51:17.823 INFO:tasks.workunit.client.1.smithi136.stdout:4/644: symlink d0/d25/d79/lcd 0 2024-09-18T12:51:17.823 INFO:tasks.workunit.client.1.smithi136.stdout:4/645: stat d0/d2/d85/lb3 0 2024-09-18T12:51:17.823 INFO:tasks.workunit.client.1.smithi136.stdout:6/720: rmdir d8/d9/de 39 2024-09-18T12:51:17.823 INFO:tasks.workunit.client.1.smithi136.stdout:6/721: readlink d8/d9/de/d60/l95 0 2024-09-18T12:51:17.825 INFO:tasks.workunit.client.1.smithi136.stdout:4/646: unlink d0/d3/d54/d88/lb4 0 2024-09-18T12:51:17.826 INFO:tasks.workunit.client.1.smithi136.stdout:9/725: dwrite d6/d59/f35 [0,4194304] 0 2024-09-18T12:51:17.826 INFO:tasks.workunit.client.1.smithi136.stdout:9/726: stat d6/d59 0 2024-09-18T12:51:17.826 INFO:tasks.workunit.client.1.smithi136.stdout:9/727: write d6/df/fe0 [1042034,25530] 0 2024-09-18T12:51:17.827 INFO:tasks.workunit.client.1.smithi136.stdout:9/728: truncate d6/df/d23/dae/fd5 228169 0 2024-09-18T12:51:17.828 INFO:tasks.workunit.client.1.smithi136.stdout:4/647: rename d0/f72 to d0/d25/db7/fce 0 2024-09-18T12:51:17.828 INFO:tasks.workunit.client.1.smithi136.stdout:1/670: dwrite d2/f41 [0,4194304] 0 2024-09-18T12:51:17.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/490: dwrite d15/d16/d33/d53/f79 [0,4194304] 0 2024-09-18T12:51:17.829 INFO:tasks.workunit.client.0.smithi081.stdout:9/322: dread dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:17.829 INFO:tasks.workunit.client.0.smithi081.stdout:9/323: creat dd/de/d4f/f66 x:0 0 0 2024-09-18T12:51:17.832 INFO:tasks.workunit.client.0.smithi081.stdout:0/407: write d7/d9/d12/f26 [4120154,11442] 0 2024-09-18T12:51:17.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/324: link f0 dd/d1d/d1e/d24/f67 0 2024-09-18T12:51:17.835 INFO:tasks.workunit.client.0.smithi081.stdout:4/301: dwrite d3/d20/d3d/d65/d14/f31 [0,4194304] 0 2024-09-18T12:51:17.836 INFO:tasks.workunit.client.0.smithi081.stdout:8/340: dwrite d3/d1e/d4c/f64 [0,4194304] 0 2024-09-18T12:51:17.836 INFO:tasks.workunit.client.0.smithi081.stdout:8/341: write d3/d1e/d4c/d53/f5f [894817,105069] 0 2024-09-18T12:51:17.837 INFO:tasks.workunit.client.0.smithi081.stdout:1/426: dwrite d0/d6/d7/d2e/d51/f56 [0,4194304] 0 2024-09-18T12:51:17.837 INFO:tasks.workunit.client.0.smithi081.stdout:2/491: read d15/d16/f19 [492607,30428] 0 2024-09-18T12:51:17.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/354: dwrite d4/d12/d28/d2a/d2d/d31/f51 [0,4194304] 0 2024-09-18T12:51:17.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/355: creat d4/d12/d1c/f72 x:0 0 0 2024-09-18T12:51:17.839 INFO:tasks.workunit.client.0.smithi081.stdout:7/409: dwrite d2/f10 [0,4194304] 0 2024-09-18T12:51:17.842 INFO:tasks.workunit.client.1.smithi136.stdout:9/729: symlink d6/d59/lfc 0 2024-09-18T12:51:17.842 INFO:tasks.workunit.client.1.smithi136.stdout:9/730: truncate d6/f42 986034 0 2024-09-18T12:51:17.843 INFO:tasks.workunit.client.0.smithi081.stdout:4/302: rmdir d3/d20/d3d/d65 39 2024-09-18T12:51:17.844 INFO:tasks.workunit.client.0.smithi081.stdout:7/410: dread d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:17.845 INFO:tasks.workunit.client.0.smithi081.stdout:7/411: creat d2/d18/d22/f95 x:0 0 0 2024-09-18T12:51:17.845 INFO:tasks.workunit.client.0.smithi081.stdout:7/412: readlink d2/d42/l5a 0 2024-09-18T12:51:17.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/342: symlink d3/d1e/d4c/d68/l7c 0 2024-09-18T12:51:17.851 INFO:tasks.workunit.client.1.smithi136.stdout:4/648: mkdir d0/d2/d85/da0/dcf 0 2024-09-18T12:51:17.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/427: mkdir d0/d96 0 2024-09-18T12:51:17.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/428: chown d0/l5 154974538 1 2024-09-18T12:51:17.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/429: chown d0/ff 163 1 2024-09-18T12:51:17.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/430: chown d0/f15 1931 1 2024-09-18T12:51:17.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/722: rmdir d8 39 2024-09-18T12:51:17.856 INFO:tasks.workunit.client.1.smithi136.stdout:1/671: mknod d2/d5/d2b/d9b/d2e/d4c/dd9/cde 0 2024-09-18T12:51:17.862 INFO:tasks.workunit.client.0.smithi081.stdout:2/492: dwrite d15/d16/d33/d53/d7a/d2f/d61/f80 [0,4194304] 0 2024-09-18T12:51:17.862 INFO:tasks.workunit.client.0.smithi081.stdout:2/493: fsync d15/d16/f18 0 2024-09-18T12:51:17.863 INFO:tasks.workunit.client.0.smithi081.stdout:0/408: dwrite d7/d9/d4b/d33/f86 [0,4194304] 0 2024-09-18T12:51:17.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/731: creat d6/da/d3d/d4d/d91/d38/dbc/ffd x:0 0 0 2024-09-18T12:51:17.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/732: write d6/da/d3d/d4d/d91/d38/dbc/ffd [62403,55664] 0 2024-09-18T12:51:17.865 INFO:tasks.workunit.client.0.smithi081.stdout:9/325: rename dd/d1d/d1e/d2f/f49 to dd/d1d/d1e/d24/d2a/f68 0 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.0.smithi081.stdout:9/326: write f0 [700587,101767] 0 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.0.smithi081.stdout:9/327: creat dd/d1d/d1e/d2f/f69 x:0 0 0 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.0.smithi081.stdout:7/413: rename d2/d56 to d2/d56/d73/d7c/d96 22 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.0.smithi081.stdout:7/414: chown d2/d18/d22/d48/l4c 1607 1 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.1.smithi136.stdout:4/649: creat d0/d3/d54/dba/fd0 x:0 0 0 2024-09-18T12:51:17.866 INFO:tasks.workunit.client.1.smithi136.stdout:4/650: getdents d0/d3/d90 0 2024-09-18T12:51:17.867 INFO:tasks.workunit.client.0.smithi081.stdout:8/343: truncate d3/f25 1265148 0 2024-09-18T12:51:17.868 INFO:tasks.workunit.client.0.smithi081.stdout:1/431: dread d0/db/f39 [0,4194304] 0 2024-09-18T12:51:17.869 INFO:tasks.workunit.client.1.smithi136.stdout:8/842: dread d9/d14/d1a/d2b/d42/d6e/d75/db4/fc1 [0,4194304] 0 2024-09-18T12:51:17.871 INFO:tasks.workunit.client.1.smithi136.stdout:6/723: symlink d8/d9/d3c/le6 0 2024-09-18T12:51:17.873 INFO:tasks.workunit.client.1.smithi136.stdout:9/733: unlink d6/da/d3d/d4d/d91/d38/dbc/ffd 0 2024-09-18T12:51:17.875 INFO:tasks.workunit.client.0.smithi081.stdout:4/303: dwrite d3/db/d2d/d4e/f5f [0,4194304] 0 2024-09-18T12:51:17.875 INFO:tasks.workunit.client.0.smithi081.stdout:4/304: chown d3/d20/d3d/d65/d14/d54/f57 254451 1 2024-09-18T12:51:17.875 INFO:tasks.workunit.client.1.smithi136.stdout:4/651: rmdir d0/d25/d79 39 2024-09-18T12:51:17.876 INFO:tasks.workunit.client.1.smithi136.stdout:4/652: write d0/d3/d54/d8a/faa [825389,40275] 0 2024-09-18T12:51:17.876 INFO:tasks.workunit.client.1.smithi136.stdout:6/724: getdents d8/d9/de/d1c/db9 0 2024-09-18T12:51:17.877 INFO:tasks.workunit.client.1.smithi136.stdout:1/672: mkdir d2/d5/d9/ddf 0 2024-09-18T12:51:17.877 INFO:tasks.workunit.client.1.smithi136.stdout:4/653: creat d0/d2/d85/da0/fd1 x:0 0 0 2024-09-18T12:51:17.878 INFO:tasks.workunit.client.1.smithi136.stdout:4/654: write d0/fc [1013588,58918] 0 2024-09-18T12:51:17.878 INFO:tasks.workunit.client.1.smithi136.stdout:4/655: stat d0/d3/d54/d8a/fbb 0 2024-09-18T12:51:17.883 INFO:tasks.workunit.client.1.smithi136.stdout:2/768: sync 2024-09-18T12:51:17.883 INFO:tasks.workunit.client.1.smithi136.stdout:3/671: sync 2024-09-18T12:51:17.883 INFO:tasks.workunit.client.1.smithi136.stdout:3/672: chown d3/d10/d84 981592 1 2024-09-18T12:51:17.883 INFO:tasks.workunit.client.1.smithi136.stdout:7/826: sync 2024-09-18T12:51:17.884 INFO:tasks.workunit.client.1.smithi136.stdout:0/739: sync 2024-09-18T12:51:17.884 INFO:tasks.workunit.client.1.smithi136.stdout:0/740: chown d1/db/d76/lbd 1 1 2024-09-18T12:51:17.884 INFO:tasks.workunit.client.1.smithi136.stdout:5/786: sync 2024-09-18T12:51:17.884 INFO:tasks.workunit.client.0.smithi081.stdout:9/328: mknod dd/d1d/d1e/d2f/c6a 0 2024-09-18T12:51:17.884 INFO:tasks.workunit.client.0.smithi081.stdout:6/356: dwrite d4/d12/d28/d2a/d2d/d31/f3b [0,4194304] 0 2024-09-18T12:51:17.888 INFO:tasks.workunit.client.1.smithi136.stdout:0/741: dread d1/d3/d1a/d98/d81/d72/f73 [0,4194304] 0 2024-09-18T12:51:17.889 INFO:tasks.workunit.client.1.smithi136.stdout:3/673: rmdir d3/d14/d22/d2c 39 2024-09-18T12:51:17.889 INFO:tasks.workunit.client.0.smithi081.stdout:7/415: mknod d2/d18/d3c/c97 0 2024-09-18T12:51:17.889 INFO:tasks.workunit.client.1.smithi136.stdout:2/769: mknod d5/d25/cfa 0 2024-09-18T12:51:17.890 INFO:tasks.workunit.client.1.smithi136.stdout:7/827: link d0/da8/l72 d0/d35/d41/df3/l12c 0 2024-09-18T12:51:17.891 INFO:tasks.workunit.client.1.smithi136.stdout:3/674: truncate d3/d14/d17/f4d 1808239 0 2024-09-18T12:51:17.891 INFO:tasks.workunit.client.1.smithi136.stdout:3/675: write d3/d14/d17/d75/d86/fb0 [1085647,34634] 0 2024-09-18T12:51:17.891 INFO:tasks.workunit.client.1.smithi136.stdout:1/673: dread d2/d5/d2b/d9b/f58 [0,4194304] 0 2024-09-18T12:51:17.893 INFO:tasks.workunit.client.0.smithi081.stdout:8/344: link d3/d1d/f55 d3/d1e/d4c/d53/f7d 0 2024-09-18T12:51:17.894 INFO:tasks.workunit.client.1.smithi136.stdout:2/770: rename d5/d25/cfa to d5/d25/d2d/d9d/da2/cfb 0 2024-09-18T12:51:17.894 INFO:tasks.workunit.client.1.smithi136.stdout:3/676: mknod d3/d14/d18/cda 0 2024-09-18T12:51:17.894 INFO:tasks.workunit.client.0.smithi081.stdout:1/432: creat d0/d6/d33/d42/d83/f97 x:0 0 0 2024-09-18T12:51:17.894 INFO:tasks.workunit.client.0.smithi081.stdout:1/433: stat d0/d6/d7/d2e/l3c 0 2024-09-18T12:51:17.896 INFO:tasks.workunit.client.1.smithi136.stdout:8/843: dwrite d9/d18/f5a [0,4194304] 0 2024-09-18T12:51:17.898 INFO:tasks.workunit.client.1.smithi136.stdout:1/674: mknod d2/d5/d9/db4/dd0/ce0 0 2024-09-18T12:51:17.898 INFO:tasks.workunit.client.1.smithi136.stdout:4/656: dread d0/d25/db7/fca [0,4194304] 0 2024-09-18T12:51:17.898 INFO:tasks.workunit.client.1.smithi136.stdout:4/657: dread - d0/d45/d67/d7b/f9d zero size 2024-09-18T12:51:17.898 INFO:tasks.workunit.client.1.smithi136.stdout:1/675: creat d2/d5/fe1 x:0 0 0 2024-09-18T12:51:17.900 INFO:tasks.workunit.client.1.smithi136.stdout:2/771: symlink d5/d7/d17/d48/dc1/lfc 0 2024-09-18T12:51:17.901 INFO:tasks.workunit.client.1.smithi136.stdout:3/677: symlink d3/d10/d84/ldb 0 2024-09-18T12:51:17.901 INFO:tasks.workunit.client.0.smithi081.stdout:0/409: rmdir d7/d9/d4b 39 2024-09-18T12:51:17.902 INFO:tasks.workunit.client.1.smithi136.stdout:7/828: dread d0/d35/d4f/dd5/fda [0,4194304] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/787: write d5/d1a/d2d/d34/fd3 [497554,3939] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/788: write d5/f1c [364288,103902] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/789: write d5/d1a/d2d/d3f/f8a [1653198,45333] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/790: write d5/f9 [1548678,68760] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/791: truncate d5/d1a/d30/fe3 848305 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.1.smithi136.stdout:5/792: write d5/f4f [8697351,117415] 0 2024-09-18T12:51:17.903 INFO:tasks.workunit.client.0.smithi081.stdout:9/329: creat dd/d1d/f6b x:0 0 0 2024-09-18T12:51:17.904 INFO:tasks.workunit.client.1.smithi136.stdout:2/772: rename d5/d4a/f92 to d5/d25/d2d/d9d/ffd 0 2024-09-18T12:51:17.904 INFO:tasks.workunit.client.1.smithi136.stdout:7/829: symlink d0/d39/d4d/d9a/dee/d109/l12d 0 2024-09-18T12:51:17.905 INFO:tasks.workunit.client.0.smithi081.stdout:6/357: mkdir d4/d12/d1c/d39/d73 0 2024-09-18T12:51:17.906 INFO:tasks.workunit.client.0.smithi081.stdout:8/345: dread d3/d1d/d4a/f4f [4194304,4194304] 0 2024-09-18T12:51:17.907 INFO:tasks.workunit.client.1.smithi136.stdout:9/734: dwrite d6/da/d3d/d4d/f84 [0,4194304] 0 2024-09-18T12:51:17.908 INFO:tasks.workunit.client.1.smithi136.stdout:1/676: dread d2/f4 [0,4194304] 0 2024-09-18T12:51:17.908 INFO:tasks.workunit.client.1.smithi136.stdout:6/725: dwrite d8/d9/de/d60/d71/d76/d97/faf [4194304,4194304] 0 2024-09-18T12:51:17.910 INFO:tasks.workunit.client.1.smithi136.stdout:7/830: write d0/d2c/d2e/fb7 [535299,27028] 0 2024-09-18T12:51:17.915 INFO:tasks.workunit.client.0.smithi081.stdout:1/434: rename d0/d6/d7/d2e/d41 to d0/d6/d33/d37/d98 0 2024-09-18T12:51:17.916 INFO:tasks.workunit.client.0.smithi081.stdout:0/410: unlink d7/d9/d4b/d4a/d68/f83 0 2024-09-18T12:51:17.916 INFO:tasks.workunit.client.0.smithi081.stdout:0/411: write d7/d9/f10 [5021299,43703] 0 2024-09-18T12:51:17.916 INFO:tasks.workunit.client.0.smithi081.stdout:8/346: dread d3/d1e/d4c/d53/f7d [0,4194304] 0 2024-09-18T12:51:17.917 INFO:tasks.workunit.client.1.smithi136.stdout:3/678: write d3/d14/d17/f4d [1009471,108621] 0 2024-09-18T12:51:17.917 INFO:tasks.workunit.client.1.smithi136.stdout:9/735: mknod d6/da/d3d/d4d/d91/d25/dee/cfe 0 2024-09-18T12:51:17.918 INFO:tasks.workunit.client.0.smithi081.stdout:9/330: unlink dd/d1d/c52 0 2024-09-18T12:51:17.920 INFO:tasks.workunit.client.0.smithi081.stdout:8/347: creat d3/d1d/d4a/f7e x:0 0 0 2024-09-18T12:51:17.922 INFO:tasks.workunit.client.0.smithi081.stdout:8/348: truncate d3/d1d/d4a/f4f 4239141 0 2024-09-18T12:51:17.923 INFO:tasks.workunit.client.0.smithi081.stdout:1/435: write d0/d6/fe [6739551,42318] 0 2024-09-18T12:51:17.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/436: mkdir d0/db/d12/d2d/d99 0 2024-09-18T12:51:17.925 INFO:tasks.workunit.client.1.smithi136.stdout:6/726: dread d8/f30 [0,4194304] 0 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.0.smithi081.stdout:8/349: dread d3/d2f/f31 [0,4194304] 0 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.0.smithi081.stdout:8/350: dread - d3/f6c zero size 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.0.smithi081.stdout:8/351: truncate d3/d1e/f36 927131 0 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.0.smithi081.stdout:8/352: chown d3/l10 242846900 1 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.1.smithi136.stdout:5/793: rmdir d5 39 2024-09-18T12:51:17.926 INFO:tasks.workunit.client.1.smithi136.stdout:5/794: chown d5/d1a/d2d/fa6 3 1 2024-09-18T12:51:17.927 INFO:tasks.workunit.client.0.smithi081.stdout:6/358: write d4/d6/fd [925645,94870] 0 2024-09-18T12:51:17.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/331: read dd/d15/d1a/d35/f53 [662191,104585] 0 2024-09-18T12:51:17.927 INFO:tasks.workunit.client.1.smithi136.stdout:1/677: mknod d2/d5/d2b/d9b/d2e/d4c/d8e/ce2 0 2024-09-18T12:51:17.927 INFO:tasks.workunit.client.0.smithi081.stdout:8/353: mkdir d3/d1d/d4a/d7f 0 2024-09-18T12:51:17.929 INFO:tasks.workunit.client.0.smithi081.stdout:9/332: link dd/d31/f3b dd/d1d/d1e/d24/d48/f6c 0 2024-09-18T12:51:17.929 INFO:tasks.workunit.client.0.smithi081.stdout:9/333: chown dd/d1d/d1e/d39 13798 1 2024-09-18T12:51:17.929 INFO:tasks.workunit.client.1.smithi136.stdout:2/773: rmdir d5/d7/d11/d34 39 2024-09-18T12:51:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:6/359: mkdir d4/d12/d28/d2a/d74 0 2024-09-18T12:51:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:6/360: truncate d4/d12/f32 1084763 0 2024-09-18T12:51:17.932 INFO:tasks.workunit.client.1.smithi136.stdout:7/831: rmdir d0/d2c/d85 39 2024-09-18T12:51:17.932 INFO:tasks.workunit.client.1.smithi136.stdout:7/832: truncate d0/d35/f6c 975262 0 2024-09-18T12:51:17.932 INFO:tasks.workunit.client.1.smithi136.stdout:7/833: chown d0/d12/l16 31579991 1 2024-09-18T12:51:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:9/334: mkdir dd/d1d/d1e/d24/d48/d6d 0 2024-09-18T12:51:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:9/335: dread - dd/de/f5b zero size 2024-09-18T12:51:17.935 INFO:tasks.workunit.client.1.smithi136.stdout:4/658: dwrite d0/d3/f97 [0,4194304] 0 2024-09-18T12:51:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:6/361: rename d4/d12/d28/d2a/d2d/f3a to d4/f75 0 2024-09-18T12:51:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:8/354: read d3/d1e/f36 [496198,110872] 0 2024-09-18T12:51:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:9/336: mknod dd/d1d/d1e/c6e 0 2024-09-18T12:51:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:6/362: mknod d4/d12/d1c/d39/d60/c76 0 2024-09-18T12:51:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:1/437: write d0/d6/d33/d37/d71/f72 [2751445,94872] 0 2024-09-18T12:51:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:4/305: dwrite d3/db/f36 [0,4194304] 0 2024-09-18T12:51:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:7/416: dwrite d2/d1d/f38 [4194304,4194304] 0 2024-09-18T12:51:17.942 INFO:tasks.workunit.client.1.smithi136.stdout:3/679: rename d3/d14/d18/d7f/caf to d3/d14/d17/d8c/d96/cdc 0 2024-09-18T12:51:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:8/355: link d3/d1e/c2a d3/d1e/d4c/d53/c80 0 2024-09-18T12:51:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:9/337: symlink dd/d1d/d1e/d24/d48/d6d/l6f 0 2024-09-18T12:51:17.947 INFO:tasks.workunit.client.1.smithi136.stdout:6/727: dwrite d8/d9/d3c/fb5 [0,4194304] 0 2024-09-18T12:51:17.947 INFO:tasks.workunit.client.1.smithi136.stdout:5/795: creat d5/d1a/d2d/d3f/d7f/ff7 x:0 0 0 2024-09-18T12:51:17.948 INFO:tasks.workunit.client.1.smithi136.stdout:2/774: mknod d5/d4a/d64/cfe 0 2024-09-18T12:51:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:0/412: dread d7/d9/d12/f31 [4194304,4194304] 0 2024-09-18T12:51:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:0/413: write d7/f6f [1454014,67295] 0 2024-09-18T12:51:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:0/414: write d7/d9/d4b/d53/f70 [197540,87720] 0 2024-09-18T12:51:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:0/415: dread - d7/f67 zero size 2024-09-18T12:51:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:1/438: rename d0/d6/d33/d37/d98/c73 to d0/d6/d66/c9a 0 2024-09-18T12:51:17.951 INFO:tasks.workunit.client.1.smithi136.stdout:4/659: mknod d0/d25/db7/cd2 0 2024-09-18T12:51:17.955 INFO:tasks.workunit.client.0.smithi081.stdout:4/306: mknod d3/d20/d3d/c68 0 2024-09-18T12:51:17.956 INFO:tasks.workunit.client.1.smithi136.stdout:3/680: unlink d3/d14/d17/db8/cd4 0 2024-09-18T12:51:17.958 INFO:tasks.workunit.client.1.smithi136.stdout:5/796: dread d5/d1a/fc1 [0,4194304] 0 2024-09-18T12:51:17.959 INFO:tasks.workunit.client.1.smithi136.stdout:6/728: symlink d8/d9/de/d1c/le7 0 2024-09-18T12:51:17.959 INFO:tasks.workunit.client.1.smithi136.stdout:6/729: fdatasync d8/d9/de/f3d 0 2024-09-18T12:51:17.959 INFO:tasks.workunit.client.0.smithi081.stdout:0/416: getdents d7/d9/d4b/d4a/d77 0 2024-09-18T12:51:17.960 INFO:tasks.workunit.client.1.smithi136.stdout:6/730: write d8/d9/de/d1c/f2b [4864441,116273] 0 2024-09-18T12:51:17.961 INFO:tasks.workunit.client.1.smithi136.stdout:4/660: mkdir d0/d5f/dd3 0 2024-09-18T12:51:17.961 INFO:tasks.workunit.client.1.smithi136.stdout:4/661: read - d0/f6a zero size 2024-09-18T12:51:17.961 INFO:tasks.workunit.client.1.smithi136.stdout:4/662: write d0/d45/f62 [33305,43523] 0 2024-09-18T12:51:17.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/356: dwrite d3/d1d/f21 [0,4194304] 0 2024-09-18T12:51:17.962 INFO:tasks.workunit.client.0.smithi081.stdout:9/338: rename dd/d31/c54 to dd/d1d/d1e/d24/d48/c70 0 2024-09-18T12:51:17.963 INFO:tasks.workunit.client.1.smithi136.stdout:3/681: creat d3/d14/d17/d75/fdd x:0 0 0 2024-09-18T12:51:17.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/307: rmdir d3/d20/d3d/d65/d45 39 2024-09-18T12:51:17.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/308: write d3/d20/d3d/d65/d14/d3e/f51 [511300,117180] 0 2024-09-18T12:51:17.965 INFO:tasks.workunit.client.0.smithi081.stdout:6/363: truncate d4/d12/d1c/f23 4177679 0 2024-09-18T12:51:17.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/417: truncate d2/d18/f1f 2601306 0 2024-09-18T12:51:17.967 INFO:tasks.workunit.client.1.smithi136.stdout:5/797: creat d5/d1a/d2d/d34/d88/ff8 x:0 0 0 2024-09-18T12:51:17.967 INFO:tasks.workunit.client.1.smithi136.stdout:5/798: truncate d5/d1a/d2d/fb0 5770766 0 2024-09-18T12:51:17.967 INFO:tasks.workunit.client.0.smithi081.stdout:8/357: mkdir d3/d73/d81 0 2024-09-18T12:51:17.969 INFO:tasks.workunit.client.1.smithi136.stdout:6/731: rmdir d8/d9/d64 39 2024-09-18T12:51:17.969 INFO:tasks.workunit.client.0.smithi081.stdout:9/339: mknod dd/d31/c71 0 2024-09-18T12:51:17.971 INFO:tasks.workunit.client.1.smithi136.stdout:4/663: mkdir d0/d3/d54/d88/dd4 0 2024-09-18T12:51:17.971 INFO:tasks.workunit.client.0.smithi081.stdout:1/439: rename d0/d6/d33/d42/d70/f8c to d0/d6/d7/d2e/d4e/f9b 0 2024-09-18T12:51:17.972 INFO:tasks.workunit.client.0.smithi081.stdout:6/364: rename d4/d12/d1c to d4/d12/d1c/d39/d77 22 2024-09-18T12:51:17.973 INFO:tasks.workunit.client.0.smithi081.stdout:0/417: dread d7/d9/d4b/d4a/f72 [0,4194304] 0 2024-09-18T12:51:17.973 INFO:tasks.workunit.client.0.smithi081.stdout:9/340: dread dd/d1d/d1e/d39/f3f [4194304,4194304] 0 2024-09-18T12:51:17.975 INFO:tasks.workunit.client.0.smithi081.stdout:7/418: getdents d2/d14/d66 0 2024-09-18T12:51:17.975 INFO:tasks.workunit.client.1.smithi136.stdout:7/834: rename d0/d35/dd9 to d0/d35/d41/d50/d113/d12e 0 2024-09-18T12:51:17.976 INFO:tasks.workunit.client.1.smithi136.stdout:9/736: write d6/f42 [197027,4618] 0 2024-09-18T12:51:17.977 INFO:tasks.workunit.client.0.smithi081.stdout:8/358: link d3/d1e/d4c/d53/f66 d3/d1e/d4c/d68/f82 0 2024-09-18T12:51:17.978 INFO:tasks.workunit.client.1.smithi136.stdout:5/799: mknod d5/d6b/dac/cf9 0 2024-09-18T12:51:17.979 INFO:tasks.workunit.client.0.smithi081.stdout:1/440: link d0/d6/d33/d42/l57 d0/d18/d6a/l9c 0 2024-09-18T12:51:17.979 INFO:tasks.workunit.client.0.smithi081.stdout:1/441: fdatasync d0/d54/f5e 0 2024-09-18T12:51:17.979 INFO:tasks.workunit.client.1.smithi136.stdout:6/732: read d8/d9/de/d1c/d50/f7c [1472751,95385] 0 2024-09-18T12:51:17.980 INFO:tasks.workunit.client.0.smithi081.stdout:9/341: mknod dd/d1d/d1e/d24/d2a/d55/c72 0 2024-09-18T12:51:17.980 INFO:tasks.workunit.client.1.smithi136.stdout:2/775: rename d5/d7/f8b to d5/d4a/fff 0 2024-09-18T12:51:17.980 INFO:tasks.workunit.client.1.smithi136.stdout:2/776: chown d5/d25/d43/ca5 890150 1 2024-09-18T12:51:17.981 INFO:tasks.workunit.client.1.smithi136.stdout:5/800: mkdir d5/d1a/d30/dfa 0 2024-09-18T12:51:17.982 INFO:tasks.workunit.client.1.smithi136.stdout:7/835: dread d0/d12/d5e/d67/ff6 [0,4194304] 0 2024-09-18T12:51:17.982 INFO:tasks.workunit.client.1.smithi136.stdout:7/836: creat d0/d35/d36/d7c/f12f x:0 0 0 2024-09-18T12:51:17.983 INFO:tasks.workunit.client.1.smithi136.stdout:7/837: creat d0/d35/d41/d50/f130 x:0 0 0 2024-09-18T12:51:17.983 INFO:tasks.workunit.client.1.smithi136.stdout:7/838: chown d0 115743365 1 2024-09-18T12:51:17.984 INFO:tasks.workunit.client.0.smithi081.stdout:9/342: mkdir dd/d1d/d1e/d39/d73 0 2024-09-18T12:51:17.984 INFO:tasks.workunit.client.0.smithi081.stdout:9/343: fsync f6 0 2024-09-18T12:51:17.985 INFO:tasks.workunit.client.1.smithi136.stdout:3/682: rename d3/d14/d18/d7f/fa3 to d3/d5/d3c/fde 0 2024-09-18T12:51:17.985 INFO:tasks.workunit.client.0.smithi081.stdout:0/418: dread d7/d9/d12/f26 [0,4194304] 0 2024-09-18T12:51:17.986 INFO:tasks.workunit.client.0.smithi081.stdout:4/309: dwrite d3/d20/d3d/d65/d2f/f33 [0,4194304] 0 2024-09-18T12:51:17.987 INFO:tasks.workunit.client.0.smithi081.stdout:7/419: rename d2/d1d/d27/l7b to d2/d18/d60/d85/l98 0 2024-09-18T12:51:17.987 INFO:tasks.workunit.client.0.smithi081.stdout:7/420: chown d2/d18/d22/f95 281787209 1 2024-09-18T12:51:17.987 INFO:tasks.workunit.client.0.smithi081.stdout:7/421: creat d2/d18/d3c/f99 x:0 0 0 2024-09-18T12:51:17.988 INFO:tasks.workunit.client.1.smithi136.stdout:2/777: mkdir d5/d7/d41/d100 0 2024-09-18T12:51:17.988 INFO:tasks.workunit.client.1.smithi136.stdout:2/778: truncate d5/d4a/fe8 972316 0 2024-09-18T12:51:17.991 INFO:tasks.workunit.client.1.smithi136.stdout:7/839: mknod d0/d35/d41/c131 0 2024-09-18T12:51:17.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/359: write d3/f13 [4245670,51658] 0 2024-09-18T12:51:17.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/360: truncate d3/d1e/d4c/d53/f74 1474751 0 2024-09-18T12:51:17.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/361: fsync d3/f11 0 2024-09-18T12:51:17.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/362: readlink d3/d2f/l61 0 2024-09-18T12:51:17.994 INFO:tasks.workunit.client.1.smithi136.stdout:9/737: rename d6/da/d3d/d4d/f9d to d6/da/d3d/fff 0 2024-09-18T12:51:17.995 INFO:tasks.workunit.client.0.smithi081.stdout:1/442: write d0/db/f39 [6231013,122491] 0 2024-09-18T12:51:17.995 INFO:tasks.workunit.client.0.smithi081.stdout:1/443: chown d0/d6/d33/d37/d71/f72 0 1 2024-09-18T12:51:17.995 INFO:tasks.workunit.client.0.smithi081.stdout:9/344: rename dd/de/f5b to dd/f74 0 2024-09-18T12:51:17.995 INFO:tasks.workunit.client.0.smithi081.stdout:9/345: stat dd/d15/d1a/c63 0 2024-09-18T12:51:17.995 INFO:tasks.workunit.client.0.smithi081.stdout:9/346: creat dd/de/d4f/f75 x:0 0 0 2024-09-18T12:51:17.996 INFO:tasks.workunit.client.0.smithi081.stdout:1/444: write d0/db/f65 [427057,11244] 0 2024-09-18T12:51:17.996 INFO:tasks.workunit.client.1.smithi136.stdout:4/664: dwrite d0/d2/f23 [4194304,4194304] 0 2024-09-18T12:51:17.996 INFO:tasks.workunit.client.1.smithi136.stdout:4/665: creat d0/d3/d54/d88/fd5 x:0 0 0 2024-09-18T12:51:17.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/363: rmdir d3/d73/d81 0 2024-09-18T12:51:17.997 INFO:tasks.workunit.client.1.smithi136.stdout:5/801: rename d5/l20 to d5/d1a/d30/d7b/lfb 0 2024-09-18T12:51:17.999 INFO:tasks.workunit.client.0.smithi081.stdout:1/445: write d0/f20 [736567,109054] 0 2024-09-18T12:51:17.999 INFO:tasks.workunit.client.0.smithi081.stdout:1/446: chown d0/f7d 118 1 2024-09-18T12:51:17.999 INFO:tasks.workunit.client.0.smithi081.stdout:0/419: rename d7/f21 to d7/d9/d4b/d3d/f89 0 2024-09-18T12:51:17.999 INFO:tasks.workunit.client.0.smithi081.stdout:1/447: write d0/f7e [416272,130961] 0 2024-09-18T12:51:18.000 INFO:tasks.workunit.client.1.smithi136.stdout:9/738: creat d6/d96/f100 x:0 0 0 2024-09-18T12:51:18.000 INFO:tasks.workunit.client.1.smithi136.stdout:9/739: dread - d6/df/dd3/fe3 zero size 2024-09-18T12:51:18.001 INFO:tasks.workunit.client.0.smithi081.stdout:8/364: creat d3/d1e/d4c/d68/f83 x:0 0 0 2024-09-18T12:51:18.001 INFO:tasks.workunit.client.1.smithi136.stdout:2/779: dread d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:18.002 INFO:tasks.workunit.client.1.smithi136.stdout:2/780: creat d5/d25/d2d/d9d/da2/f101 x:0 0 0 2024-09-18T12:51:18.003 INFO:tasks.workunit.client.0.smithi081.stdout:0/420: rename d7/d9/d4b/f5c to d7/d9/d4b/d4a/f8a 0 2024-09-18T12:51:18.004 INFO:tasks.workunit.client.1.smithi136.stdout:5/802: rename d5/d1a/d2d/d34/l3e to d5/d1a/d2d/d34/d4e/d9b/dd8/lfc 0 2024-09-18T12:51:18.005 INFO:tasks.workunit.client.0.smithi081.stdout:1/448: unlink d0/db/l13 0 2024-09-18T12:51:18.005 INFO:tasks.workunit.client.0.smithi081.stdout:1/449: write d0/d6/d7/d2e/d51/d2c/f5c [2113208,9604] 0 2024-09-18T12:51:18.007 INFO:tasks.workunit.client.0.smithi081.stdout:8/365: creat d3/d1d/d4a/d7f/f84 x:0 0 0 2024-09-18T12:51:18.007 INFO:tasks.workunit.client.0.smithi081.stdout:8/366: chown d3/d1e/f2b 441 1 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/740: mkdir d6/db/de8/d101 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/741: fsync d6/db/d12/d62/f74 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/742: fdatasync d6/df/d23/fa1 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/743: write d6/df/d75/fe9 [321659,29190] 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/744: chown d6/da/d3d/d41/cc5 34801865 1 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/745: write d6/df/d23/d2b/fa6 [835997,103676] 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/746: fsync d6/df/d75/dde/fe6 0 2024-09-18T12:51:18.008 INFO:tasks.workunit.client.1.smithi136.stdout:9/747: chown d6/da/d3d/d4d/ca5 5917513 1 2024-09-18T12:51:18.009 INFO:tasks.workunit.client.1.smithi136.stdout:9/748: write d6/df/fe0 [655163,103960] 0 2024-09-18T12:51:18.011 INFO:tasks.workunit.client.0.smithi081.stdout:1/450: rename d0/d54/c74 to d0/d6/c9d 0 2024-09-18T12:51:18.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/310: write d3/db/f36 [987687,16948] 0 2024-09-18T12:51:18.016 INFO:tasks.workunit.client.1.smithi136.stdout:5/803: write d5/d1a/d30/f4c [3095308,64882] 0 2024-09-18T12:51:18.017 INFO:tasks.workunit.client.1.smithi136.stdout:3/683: dwrite d3/d14/dc5/f91 [0,4194304] 0 2024-09-18T12:51:18.017 INFO:tasks.workunit.client.0.smithi081.stdout:4/311: rmdir d3/db/d2d 39 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/781: rename d5/d7/d11/d34/l73 to d5/d25/d2d/d9d/da2/l102 0 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/782: stat d5/d7/d17/d48/f97 0 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/783: creat d5/d7/d3b/f103 x:0 0 0 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/784: readlink d5/d4a/l72 0 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/785: creat d5/d25/f104 x:0 0 0 2024-09-18T12:51:18.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/786: chown d5/d7/d17/d48/db2/db8/ddf 1062099629 1 2024-09-18T12:51:18.019 INFO:tasks.workunit.client.0.smithi081.stdout:9/347: dwrite dd/d1d/d1e/d24/d2a/f68 [0,4194304] 0 2024-09-18T12:51:18.024 INFO:tasks.workunit.client.1.smithi136.stdout:4/666: dwrite d0/d5f/f81 [0,4194304] 0 2024-09-18T12:51:18.024 INFO:tasks.workunit.client.1.smithi136.stdout:4/667: read d0/d45/f63 [3968705,34094] 0 2024-09-18T12:51:18.025 INFO:tasks.workunit.client.1.smithi136.stdout:5/804: creat d5/db4/ffd x:0 0 0 2024-09-18T12:51:18.025 INFO:tasks.workunit.client.1.smithi136.stdout:3/684: rmdir d3/d14/d17/d75/d86 39 2024-09-18T12:51:18.027 INFO:tasks.workunit.client.0.smithi081.stdout:1/451: dread d0/d18/f25 [0,4194304] 0 2024-09-18T12:51:18.027 INFO:tasks.workunit.client.0.smithi081.stdout:1/452: chown d0/d6/f1b 3 1 2024-09-18T12:51:18.030 INFO:tasks.workunit.client.0.smithi081.stdout:9/348: mknod dd/d1d/d1e/d39/d73/c76 0 2024-09-18T12:51:18.030 INFO:tasks.workunit.client.0.smithi081.stdout:9/349: fdatasync f7 0 2024-09-18T12:51:18.030 INFO:tasks.workunit.client.0.smithi081.stdout:9/350: readlink dd/d15/d1a/d35/l57 0 2024-09-18T12:51:18.031 INFO:tasks.workunit.client.0.smithi081.stdout:4/312: dread d3/db/d2d/f3b [0,4194304] 0 2024-09-18T12:51:18.031 INFO:tasks.workunit.client.0.smithi081.stdout:0/421: dwrite d7/d9/d4b/d53/f70 [0,4194304] 0 2024-09-18T12:51:18.032 INFO:tasks.workunit.client.1.smithi136.stdout:4/668: link d0/d3/fa5 d0/d25/fd6 0 2024-09-18T12:51:18.032 INFO:tasks.workunit.client.1.smithi136.stdout:2/787: getdents d5/d4a/d7a 0 2024-09-18T12:51:18.034 INFO:tasks.workunit.client.1.smithi136.stdout:9/749: dwrite d6/d13/fc1 [0,4194304] 0 2024-09-18T12:51:18.034 INFO:tasks.workunit.client.0.smithi081.stdout:1/453: mknod d0/d6/d7/d2e/d51/c9e 0 2024-09-18T12:51:18.034 INFO:tasks.workunit.client.0.smithi081.stdout:1/454: truncate d0/d6/d7/d8/f82 350168 0 2024-09-18T12:51:18.035 INFO:tasks.workunit.client.1.smithi136.stdout:2/788: rmdir d5/d4a/d64 39 2024-09-18T12:51:18.035 INFO:tasks.workunit.client.1.smithi136.stdout:2/789: truncate d5/d7/d11/f31 4492880 0 2024-09-18T12:51:18.035 INFO:tasks.workunit.client.1.smithi136.stdout:2/790: creat d5/d4a/d67/f105 x:0 0 0 2024-09-18T12:51:18.035 INFO:tasks.workunit.client.1.smithi136.stdout:2/791: truncate d5/d7/d11/d34/f50 2064805 0 2024-09-18T12:51:18.036 INFO:tasks.workunit.client.0.smithi081.stdout:9/351: mkdir dd/d1d/d1e/d77 0 2024-09-18T12:51:18.037 INFO:tasks.workunit.client.1.smithi136.stdout:9/750: symlink d6/df/d75/l102 0 2024-09-18T12:51:18.039 INFO:tasks.workunit.client.1.smithi136.stdout:9/751: rmdir d6/df/d23/d2b/de5 39 2024-09-18T12:51:18.039 INFO:tasks.workunit.client.1.smithi136.stdout:9/752: truncate d6/da/d3d/d4d/d91/d25/dee/df8/ffb 355630 0 2024-09-18T12:51:18.039 INFO:tasks.workunit.client.1.smithi136.stdout:9/753: truncate d6/db/d12/f60 4511696 0 2024-09-18T12:51:18.040 INFO:tasks.workunit.client.0.smithi081.stdout:4/313: symlink d3/db/d2d/l69 0 2024-09-18T12:51:18.040 INFO:tasks.workunit.client.0.smithi081.stdout:4/314: write d3/d20/d3d/d65/f2c [995648,45046] 0 2024-09-18T12:51:18.041 INFO:tasks.workunit.client.1.smithi136.stdout:9/754: symlink d6/df/d23/d2b/de5/l103 0 2024-09-18T12:51:18.044 INFO:tasks.workunit.client.1.smithi136.stdout:4/669: write d0/d13/f69 [3996890,126856] 0 2024-09-18T12:51:18.045 INFO:tasks.workunit.client.0.smithi081.stdout:0/422: link d7/d9/d4b/d33/l4e d7/d4f/l8b 0 2024-09-18T12:51:18.046 INFO:tasks.workunit.client.1.smithi136.stdout:5/805: read d5/f4f [7819556,100091] 0 2024-09-18T12:51:18.046 INFO:tasks.workunit.client.1.smithi136.stdout:5/806: write d5/d1a/d2d/d34/d88/ff2 [85109,34139] 0 2024-09-18T12:51:18.049 INFO:tasks.workunit.client.0.smithi081.stdout:1/455: mkdir d0/d6/d7/d2e/d51/d2c/d9f 0 2024-09-18T12:51:18.050 INFO:tasks.workunit.client.0.smithi081.stdout:1/456: write d0/f7e [604781,63277] 0 2024-09-18T12:51:18.050 INFO:tasks.workunit.client.0.smithi081.stdout:1/457: dread - d0/f93 zero size 2024-09-18T12:51:18.050 INFO:tasks.workunit.client.0.smithi081.stdout:1/458: write d0/d6/d33/f61 [4924954,35813] 0 2024-09-18T12:51:18.050 INFO:tasks.workunit.client.0.smithi081.stdout:1/459: chown d0/d18/d6a/c6f 844960865 1 2024-09-18T12:51:18.050 INFO:tasks.workunit.client.0.smithi081.stdout:9/352: dread fa [0,4194304] 0 2024-09-18T12:51:18.051 INFO:tasks.workunit.client.0.smithi081.stdout:9/353: chown dd/d15/d1a/d35/l60 53182 1 2024-09-18T12:51:18.051 INFO:tasks.workunit.client.0.smithi081.stdout:0/423: read d7/d9/d4b/d3d/f89 [1458535,42471] 0 2024-09-18T12:51:18.051 INFO:tasks.workunit.client.1.smithi136.stdout:4/670: dread d0/d2/f77 [0,4194304] 0 2024-09-18T12:51:18.052 INFO:tasks.workunit.client.0.smithi081.stdout:4/315: creat d3/d20/d3d/d65/d14/d3e/f6a x:0 0 0 2024-09-18T12:51:18.052 INFO:tasks.workunit.client.0.smithi081.stdout:4/316: chown d3/db/d2d/l4d 21602569 1 2024-09-18T12:51:18.052 INFO:tasks.workunit.client.0.smithi081.stdout:4/317: chown d3/d20/d3d/d65/d14/d3e 2585 1 2024-09-18T12:51:18.052 INFO:tasks.workunit.client.0.smithi081.stdout:4/318: chown d3/db/f23 53027 1 2024-09-18T12:51:18.054 INFO:tasks.workunit.client.1.smithi136.stdout:6/733: dwrite d8/d9/d3c/f3f [0,4194304] 0 2024-09-18T12:51:18.056 INFO:tasks.workunit.client.1.smithi136.stdout:3/685: dwrite d3/d14/d18/f8d [0,4194304] 0 2024-09-18T12:51:18.056 INFO:tasks.workunit.client.1.smithi136.stdout:2/792: dwrite d5/d7/d41/f81 [0,4194304] 0 2024-09-18T12:51:18.056 INFO:tasks.workunit.client.1.smithi136.stdout:2/793: stat d5/d7/d11/c83 0 2024-09-18T12:51:18.057 INFO:tasks.workunit.client.0.smithi081.stdout:1/460: rename d0/d6/d7/d2e/d4e/d7a to d0/d18/d6a/d91/da0 0 2024-09-18T12:51:18.058 INFO:tasks.workunit.client.0.smithi081.stdout:9/354: mknod dd/d1d/d1e/d24/d48/d6d/c78 0 2024-09-18T12:51:18.060 INFO:tasks.workunit.client.1.smithi136.stdout:6/734: rename d8/d9/d56/d96/cae to d8/d9/de/d1c/d50/ce8 0 2024-09-18T12:51:18.060 INFO:tasks.workunit.client.0.smithi081.stdout:0/424: creat d7/d9/d4b/d53/f8c x:0 0 0 2024-09-18T12:51:18.061 INFO:tasks.workunit.client.0.smithi081.stdout:4/319: mkdir d3/d20/d3d/d6b 0 2024-09-18T12:51:18.063 INFO:tasks.workunit.client.1.smithi136.stdout:3/686: unlink d3/d14/d22/d2c/f68 0 2024-09-18T12:51:18.064 INFO:tasks.workunit.client.0.smithi081.stdout:1/461: rename d0/d6/d7/d2e/d4e/l68 to d0/d6/d33/d37/d71/d90/la1 0 2024-09-18T12:51:18.064 INFO:tasks.workunit.client.0.smithi081.stdout:1/462: write d0/d6/fe [4843403,56431] 0 2024-09-18T12:51:18.066 INFO:tasks.workunit.client.1.smithi136.stdout:2/794: symlink d5/d7/d11/d34/l106 0 2024-09-18T12:51:18.067 INFO:tasks.workunit.client.0.smithi081.stdout:9/355: link dd/d1d/d1e/d24/d48/d6d/l6f dd/d15/d1a/l79 0 2024-09-18T12:51:18.070 INFO:tasks.workunit.client.0.smithi081.stdout:0/425: creat d7/d9/d4b/d33/d7d/f8d x:0 0 0 2024-09-18T12:51:18.072 INFO:tasks.workunit.client.1.smithi136.stdout:5/807: dwrite d5/d1a/fd0 [0,4194304] 0 2024-09-18T12:51:18.072 INFO:tasks.workunit.client.1.smithi136.stdout:5/808: fsync d5/fe1 0 2024-09-18T12:51:18.072 INFO:tasks.workunit.client.1.smithi136.stdout:5/809: truncate d5/d1a/d2d/d34/ff4 184901 0 2024-09-18T12:51:18.072 INFO:tasks.workunit.client.1.smithi136.stdout:5/810: stat d5/d1a/d2d/d3f/d7f/ccd 0 2024-09-18T12:51:18.074 INFO:tasks.workunit.client.0.smithi081.stdout:4/320: mkdir d3/d20/d3d/d65/d45/d6c 0 2024-09-18T12:51:18.075 INFO:tasks.workunit.client.0.smithi081.stdout:0/426: rmdir d7/d5d 39 2024-09-18T12:51:18.075 INFO:tasks.workunit.client.0.smithi081.stdout:0/427: dread - d7/d9/d4b/d3d/f5e zero size 2024-09-18T12:51:18.075 INFO:tasks.workunit.client.0.smithi081.stdout:0/428: write d7/d9/f3e [8831336,83379] 0 2024-09-18T12:51:18.076 INFO:tasks.workunit.client.1.smithi136.stdout:5/811: write d5/d1a/fe0 [64649,92969] 0 2024-09-18T12:51:18.076 INFO:tasks.workunit.client.1.smithi136.stdout:5/812: chown d5/d1a/d30/d7b/fde 1 1 2024-09-18T12:51:18.079 INFO:tasks.workunit.client.0.smithi081.stdout:0/429: rename d7/d9/d4b/d33/d43/l48 to d7/d7c/l8e 0 2024-09-18T12:51:18.081 INFO:tasks.workunit.client.0.smithi081.stdout:0/430: mkdir d7/d4f/d8f 0 2024-09-18T12:51:18.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/356: dread dd/d1d/f2e [0,4194304] 0 2024-09-18T12:51:18.084 INFO:tasks.workunit.client.0.smithi081.stdout:0/431: creat d7/d9/f90 x:0 0 0 2024-09-18T12:51:18.084 INFO:tasks.workunit.client.0.smithi081.stdout:4/321: dread d3/db/d2d/d4e/f5f [0,4194304] 0 2024-09-18T12:51:18.085 INFO:tasks.workunit.client.1.smithi136.stdout:2/795: unlink d5/d25/d2d/d9d/lab 0 2024-09-18T12:51:18.085 INFO:tasks.workunit.client.1.smithi136.stdout:2/796: write d5/d25/ff8 [236306,119939] 0 2024-09-18T12:51:18.088 INFO:tasks.workunit.client.1.smithi136.stdout:5/813: mkdir d5/d1a/dfe 0 2024-09-18T12:51:18.088 INFO:tasks.workunit.client.1.smithi136.stdout:5/814: truncate d5/d1a/d2d/d34/f35 586269 0 2024-09-18T12:51:18.088 INFO:tasks.workunit.client.0.smithi081.stdout:4/322: dread d3/d20/d3d/d65/d45/d4f/f5a [0,4194304] 0 2024-09-18T12:51:18.089 INFO:tasks.workunit.client.1.smithi136.stdout:5/815: symlink d5/d1a/d2d/d34/d4e/d7a/d9e/dad/lff 0 2024-09-18T12:51:18.089 INFO:tasks.workunit.client.1.smithi136.stdout:5/816: chown d5/d6b/c9d 45705028 1 2024-09-18T12:51:18.089 INFO:tasks.workunit.client.1.smithi136.stdout:5/817: dread - d5/d1a/d2d/d34/d4e/fbf zero size 2024-09-18T12:51:18.089 INFO:tasks.workunit.client.1.smithi136.stdout:5/818: dread - d5/d1a/d2d/d34/d4e/fbf zero size 2024-09-18T12:51:18.090 INFO:tasks.workunit.client.0.smithi081.stdout:4/323: truncate d3/db/f23 2461807 0 2024-09-18T12:51:18.091 INFO:tasks.workunit.client.1.smithi136.stdout:5/819: mkdir d5/d1a/d30/d100 0 2024-09-18T12:51:18.091 INFO:tasks.workunit.client.0.smithi081.stdout:4/324: dread d3/d20/d3d/d65/d45/d4f/f5a [0,4194304] 0 2024-09-18T12:51:18.092 INFO:tasks.workunit.client.1.smithi136.stdout:5/820: symlink d5/d1a/d2d/dc4/l101 0 2024-09-18T12:51:18.092 INFO:tasks.workunit.client.0.smithi081.stdout:4/325: mkdir d3/db/d2d/d4e/d6d 0 2024-09-18T12:51:18.093 INFO:tasks.workunit.client.1.smithi136.stdout:5/821: rmdir d5/d6b 39 2024-09-18T12:51:18.093 INFO:tasks.workunit.client.1.smithi136.stdout:5/822: fdatasync d5/d1a/d2d/d34/d4e/d7a/f9f 0 2024-09-18T12:51:18.094 INFO:tasks.workunit.client.1.smithi136.stdout:6/735: dwrite d8/d9/d64/f69 [0,4194304] 0 2024-09-18T12:51:18.094 INFO:tasks.workunit.client.1.smithi136.stdout:6/736: read d8/dc/f31 [1346481,29017] 0 2024-09-18T12:51:18.094 INFO:tasks.workunit.client.0.smithi081.stdout:4/326: unlink d3/d20/d3d/d65/d14/d4b/c61 0 2024-09-18T12:51:18.096 INFO:tasks.workunit.client.1.smithi136.stdout:2/797: dread d5/d7/d17/f3c [0,4194304] 0 2024-09-18T12:51:18.096 INFO:tasks.workunit.client.1.smithi136.stdout:5/823: creat d5/d1a/d2d/d34/d4e/d9b/f102 x:0 0 0 2024-09-18T12:51:18.096 INFO:tasks.workunit.client.1.smithi136.stdout:5/824: read d5/d1a/f3a [7079890,66828] 0 2024-09-18T12:51:18.099 INFO:tasks.workunit.client.1.smithi136.stdout:2/798: link d5/d7/d41/d53/fba d5/d25/d2d/d9d/f107 0 2024-09-18T12:51:18.101 INFO:tasks.workunit.client.1.smithi136.stdout:5/825: mknod d5/d1a/d4a/da1/c103 0 2024-09-18T12:51:18.101 INFO:tasks.workunit.client.1.smithi136.stdout:5/826: fdatasync d5/d1a/d2d/f99 0 2024-09-18T12:51:18.101 INFO:tasks.workunit.client.0.smithi081.stdout:1/463: dwrite d0/d6/d7/d2e/d4e/f89 [0,4194304] 0 2024-09-18T12:51:18.101 INFO:tasks.workunit.client.0.smithi081.stdout:1/464: chown d0/d6/d66/c9a 1 1 2024-09-18T12:51:18.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/465: chown d0/db/f14 11990777 1 2024-09-18T12:51:18.102 INFO:tasks.workunit.client.1.smithi136.stdout:2/799: mknod d5/d4a/c108 0 2024-09-18T12:51:18.104 INFO:tasks.workunit.client.0.smithi081.stdout:1/466: rename d0/d6/c9d to d0/d18/d6a/d91/ca2 0 2024-09-18T12:51:18.104 INFO:tasks.workunit.client.1.smithi136.stdout:5/827: creat d5/d1a/d2d/d34/d4e/d7a/d9e/da9/f104 x:0 0 0 2024-09-18T12:51:18.104 INFO:tasks.workunit.client.1.smithi136.stdout:5/828: fdatasync d5/d1a/d2d/d34/d4e/f70 0 2024-09-18T12:51:18.105 INFO:tasks.workunit.client.1.smithi136.stdout:2/800: getdents d5/d4a/d64 0 2024-09-18T12:51:18.105 INFO:tasks.workunit.client.1.smithi136.stdout:2/801: read - d5/fef zero size 2024-09-18T12:51:18.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:17 smithi081 ceph-mon[27646]: pgmap v281: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 157 MiB/s rd, 200 MiB/s wr, 340 op/s 2024-09-18T12:51:18.107 INFO:tasks.workunit.client.1.smithi136.stdout:3/687: dwrite d3/d10/d4a/d51/fa0 [0,4194304] 0 2024-09-18T12:51:18.107 INFO:tasks.workunit.client.1.smithi136.stdout:3/688: fsync d3/d14/f71 0 2024-09-18T12:51:18.108 INFO:tasks.workunit.client.1.smithi136.stdout:2/802: unlink d5/d25/d2d/d9d/la3 0 2024-09-18T12:51:18.111 INFO:tasks.workunit.client.1.smithi136.stdout:3/689: truncate d3/d14/d18/f50 1745774 0 2024-09-18T12:51:18.119 INFO:tasks.workunit.client.0.smithi081.stdout:4/327: dwrite d3/d20/d5b/f66 [0,4194304] 0 2024-09-18T12:51:18.119 INFO:tasks.workunit.client.1.smithi136.stdout:5/829: dread d5/d1a/d2d/f8e [0,4194304] 0 2024-09-18T12:51:18.119 INFO:tasks.workunit.client.0.smithi081.stdout:4/328: getdents d3/d20/d3d/d65/d14/d54 0 2024-09-18T12:51:18.121 INFO:tasks.workunit.client.0.smithi081.stdout:4/329: rename d3/d20/d3d/d65/c26 to d3/db/d58/c6e 0 2024-09-18T12:51:18.121 INFO:tasks.workunit.client.0.smithi081.stdout:4/330: creat d3/f6f x:0 0 0 2024-09-18T12:51:18.129 INFO:tasks.workunit.client.1.smithi136.stdout:6/737: dwrite d8/d9d/fce [0,4194304] 0 2024-09-18T12:51:18.132 INFO:tasks.workunit.client.0.smithi081.stdout:1/467: dwrite d0/d6/d7/d2e/d51/d2c/f45 [0,4194304] 0 2024-09-18T12:51:18.132 INFO:tasks.workunit.client.0.smithi081.stdout:1/468: read d0/db/d12/d2d/f2f [184925,71264] 0 2024-09-18T12:51:18.136 INFO:tasks.workunit.client.0.smithi081.stdout:4/331: dread d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:18.136 INFO:tasks.workunit.client.0.smithi081.stdout:4/332: chown d3/d20/d3d/d65/d45/c46 95664 1 2024-09-18T12:51:18.141 INFO:tasks.workunit.client.1.smithi136.stdout:2/803: dwrite d5/d25/d43/f89 [0,4194304] 0 2024-09-18T12:51:18.141 INFO:tasks.workunit.client.1.smithi136.stdout:5/830: dwrite d5/d1a/d2d/d34/d88/ff8 [0,4194304] 0 2024-09-18T12:51:18.146 INFO:tasks.workunit.client.1.smithi136.stdout:2/804: creat d5/d7/dbf/f109 x:0 0 0 2024-09-18T12:51:18.147 INFO:tasks.workunit.client.1.smithi136.stdout:2/805: write d5/d25/d2d/d9d/f107 [79881,49412] 0 2024-09-18T12:51:18.148 INFO:tasks.workunit.client.1.smithi136.stdout:5/831: mkdir d5/d78/d105 0 2024-09-18T12:51:18.149 INFO:tasks.workunit.client.1.smithi136.stdout:5/832: creat d5/d78/d105/f106 x:0 0 0 2024-09-18T12:51:18.149 INFO:tasks.workunit.client.1.smithi136.stdout:5/833: getdents d5/d1a/dfe 0 2024-09-18T12:51:18.150 INFO:tasks.workunit.client.1.smithi136.stdout:5/834: rename d5/d1a/d2d/d34/c15 to d5/d1a/c107 0 2024-09-18T12:51:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:1/469: dwrite d0/d6/d7/d2e/d51/f56 [0,4194304] 0 2024-09-18T12:51:18.152 INFO:tasks.workunit.client.1.smithi136.stdout:5/835: truncate d5/d6b/f8c 2247154 0 2024-09-18T12:51:18.152 INFO:tasks.workunit.client.1.smithi136.stdout:5/836: readlink d5/d1a/d30/l49 0 2024-09-18T12:51:18.166 INFO:tasks.workunit.client.1.smithi136.stdout:8/844: sync 2024-09-18T12:51:18.166 INFO:tasks.workunit.client.1.smithi136.stdout:0/742: sync 2024-09-18T12:51:18.166 INFO:tasks.workunit.client.1.smithi136.stdout:1/678: sync 2024-09-18T12:51:18.166 INFO:tasks.workunit.client.1.smithi136.stdout:8/845: chown d9/d14/d1a/d2b/l30 3377 1 2024-09-18T12:51:18.167 INFO:tasks.workunit.client.1.smithi136.stdout:8/846: rename d9/d14/d1a/d2b/f58 to d9/d14/d1a/f12d 0 2024-09-18T12:51:18.167 INFO:tasks.workunit.client.1.smithi136.stdout:8/847: write d9/d14/d1a/d2b/d42/da4/db9/dc0/f77 [4066688,55077] 0 2024-09-18T12:51:18.168 INFO:tasks.workunit.client.1.smithi136.stdout:0/743: dread d1/d17/f2b [0,4194304] 0 2024-09-18T12:51:18.170 INFO:tasks.workunit.client.1.smithi136.stdout:0/744: creat d1/d3/d1a/d98/d81/ffe x:0 0 0 2024-09-18T12:51:18.172 INFO:tasks.workunit.client.1.smithi136.stdout:1/679: dread d2/d5/d2b/d9b/d2e/d4c/f89 [0,4194304] 0 2024-09-18T12:51:18.172 INFO:tasks.workunit.client.1.smithi136.stdout:1/680: stat d2/d5/d2b/d9b/d2e/d4c/f59 0 2024-09-18T12:51:18.172 INFO:tasks.workunit.client.1.smithi136.stdout:0/745: mkdir d1/d17/dd1/dff 0 2024-09-18T12:51:18.173 INFO:tasks.workunit.client.1.smithi136.stdout:0/746: mkdir d1/d3/d1a/d62/d75/d100 0 2024-09-18T12:51:18.175 INFO:tasks.workunit.client.0.smithi081.stdout:1/470: dwrite d0/d6/d33/d42/f5b [0,4194304] 0 2024-09-18T12:51:18.175 INFO:tasks.workunit.client.0.smithi081.stdout:1/471: chown d0/d6/d33/d37/d71/d90/la1 260327 1 2024-09-18T12:51:18.175 INFO:tasks.workunit.client.0.smithi081.stdout:1/472: chown d0/db/f65 793867 1 2024-09-18T12:51:18.175 INFO:tasks.workunit.client.0.smithi081.stdout:1/473: truncate d0/d6/d7/d2e/d51/d2c/f45 1891188 0 2024-09-18T12:51:18.176 INFO:tasks.workunit.client.1.smithi136.stdout:5/837: dwrite d5/d1a/f3a [4194304,4194304] 0 2024-09-18T12:51:18.179 INFO:tasks.workunit.client.1.smithi136.stdout:5/838: creat d5/d1a/d2d/d34/d4e/db5/f108 x:0 0 0 2024-09-18T12:51:18.181 INFO:tasks.workunit.client.1.smithi136.stdout:1/681: write d2/d5/d2b/d9b/dbe/dd3/f75 [1429302,502] 0 2024-09-18T12:51:18.181 INFO:tasks.workunit.client.1.smithi136.stdout:1/682: write d2/d5/d2b/d9b/fbd [533039,119786] 0 2024-09-18T12:51:18.181 INFO:tasks.workunit.client.1.smithi136.stdout:1/683: creat d2/d5/d2b/d34/d5c/fe3 x:0 0 0 2024-09-18T12:51:18.182 INFO:tasks.workunit.client.1.smithi136.stdout:5/839: rename d5/d1a/d2d/d34/fd3 to d5/d1a/dfe/f109 0 2024-09-18T12:51:18.184 INFO:tasks.workunit.client.1.smithi136.stdout:1/684: dread d2/d5/d2b/d9b/d2e/f33 [0,4194304] 0 2024-09-18T12:51:18.185 INFO:tasks.workunit.client.1.smithi136.stdout:1/685: symlink d2/d5/d2b/le4 0 2024-09-18T12:51:18.185 INFO:tasks.workunit.client.1.smithi136.stdout:1/686: chown d2/d5/d2b/d9b/dbe/dd3/d65 1 1 2024-09-18T12:51:18.186 INFO:tasks.workunit.client.1.smithi136.stdout:1/687: link d2/f6c d2/fe5 0 2024-09-18T12:51:18.190 INFO:tasks.workunit.client.1.smithi136.stdout:8/848: dwrite d9/d18/d34/d3d/d47/d65/fe0 [0,4194304] 0 2024-09-18T12:51:18.192 INFO:tasks.workunit.client.1.smithi136.stdout:5/840: dread d5/d6b/f8c [0,4194304] 0 2024-09-18T12:51:18.192 INFO:tasks.workunit.client.0.smithi081.stdout:1/474: dread d0/d6/f1b [0,4194304] 0 2024-09-18T12:51:18.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/475: mkdir d0/d18/d1a/da3 0 2024-09-18T12:51:18.194 INFO:tasks.workunit.client.1.smithi136.stdout:8/849: symlink d9/d14/d1a/d2b/d42/da4/de5/l12e 0 2024-09-18T12:51:18.195 INFO:tasks.workunit.client.1.smithi136.stdout:0/747: dwrite d1/d3/d1a/d98/d81/d51/fda [0,4194304] 0 2024-09-18T12:51:18.195 INFO:tasks.workunit.client.0.smithi081.stdout:1/476: truncate d0/d6/f1b 1952173 0 2024-09-18T12:51:18.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/477: mknod d0/d96/ca4 0 2024-09-18T12:51:18.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/478: chown d0/d6/fe 43066488 1 2024-09-18T12:51:18.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/479: stat d0/d6/d33/d37/d71/d90/la1 0 2024-09-18T12:51:18.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/480: stat d0/ff 0 2024-09-18T12:51:18.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/481: creat d0/db/d12/d28/fa5 x:0 0 0 2024-09-18T12:51:18.198 INFO:tasks.workunit.client.0.smithi081.stdout:1/482: stat d0/d6/d7/d2e/d51/d2c/f45 0 2024-09-18T12:51:18.198 INFO:tasks.workunit.client.1.smithi136.stdout:1/688: dread d2/d5/d2b/d9b/d2e/d9a/fad [0,4194304] 0 2024-09-18T12:51:18.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/483: link d0/db/l48 d0/d6/d7/d2e/la6 0 2024-09-18T12:51:18.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/484: creat d0/fa7 x:0 0 0 2024-09-18T12:51:18.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/485: chown d0/d6/d7/d2e/f63 15150186 1 2024-09-18T12:51:18.202 INFO:tasks.workunit.client.1.smithi136.stdout:0/748: dread d1/d3/d1a/d62/d75/fcf [0,4194304] 0 2024-09-18T12:51:18.202 INFO:tasks.workunit.client.1.smithi136.stdout:0/749: truncate d1/d46/d6c/fa9 686050 0 2024-09-18T12:51:18.202 INFO:tasks.workunit.client.1.smithi136.stdout:0/750: read d1/d3/d1a/d98/d81/d35/d54/f89 [3524955,117931] 0 2024-09-18T12:51:18.202 INFO:tasks.workunit.client.1.smithi136.stdout:1/689: rename d2/f6f to d2/fe6 0 2024-09-18T12:51:18.203 INFO:tasks.workunit.client.1.smithi136.stdout:5/841: write f2 [8275418,84373] 0 2024-09-18T12:51:18.203 INFO:tasks.workunit.client.1.smithi136.stdout:1/690: getdents d2/d5/d9/db4 0 2024-09-18T12:51:18.203 INFO:tasks.workunit.client.1.smithi136.stdout:1/691: chown d2/d5/d2b/d9b/d2e/d4c/dd9/cde 1358649 1 2024-09-18T12:51:18.205 INFO:tasks.workunit.client.1.smithi136.stdout:1/692: creat d2/d5/d2b/d9b/d2e/d4c/fe7 x:0 0 0 2024-09-18T12:51:18.206 INFO:tasks.workunit.client.1.smithi136.stdout:0/751: dread d1/d3/d1a/f6e [0,4194304] 0 2024-09-18T12:51:18.207 INFO:tasks.workunit.client.1.smithi136.stdout:1/693: rename d2/d5/d9/fd8 to d2/d5/d2b/d34/d5c/fe8 0 2024-09-18T12:51:18.208 INFO:tasks.workunit.client.1.smithi136.stdout:0/752: truncate d1/d3/f8 3528285 0 2024-09-18T12:51:18.208 INFO:tasks.workunit.client.1.smithi136.stdout:0/753: fsync d1/d60/f68 0 2024-09-18T12:51:18.212 INFO:tasks.workunit.client.1.smithi136.stdout:1/694: mkdir d2/d5/d2b/d34/d5c/d96/de9 0 2024-09-18T12:51:18.213 INFO:tasks.workunit.client.1.smithi136.stdout:0/754: write d1/d60/f99 [139106,23598] 0 2024-09-18T12:51:18.213 INFO:tasks.workunit.client.1.smithi136.stdout:8/850: dwrite d9/d14/d1a/f128 [0,4194304] 0 2024-09-18T12:51:18.213 INFO:tasks.workunit.client.1.smithi136.stdout:0/755: creat d1/d3/d1a/d62/d75/d100/f101 x:0 0 0 2024-09-18T12:51:18.213 INFO:tasks.workunit.client.1.smithi136.stdout:1/695: dread d2/d5/d2b/d34/d86/f48 [0,4194304] 0 2024-09-18T12:51:18.214 INFO:tasks.workunit.client.1.smithi136.stdout:1/696: dread - d2/d5/d2b/da9/fb6 zero size 2024-09-18T12:51:18.215 INFO:tasks.workunit.client.1.smithi136.stdout:8/851: mknod d9/d14/d1a/d2b/d42/d9e/dda/c12f 0 2024-09-18T12:51:18.215 INFO:tasks.workunit.client.1.smithi136.stdout:8/852: creat d9/d18/d34/d3d/d47/f130 x:0 0 0 2024-09-18T12:51:18.216 INFO:tasks.workunit.client.0.smithi081.stdout:1/486: dread d0/db/d12/f24 [0,4194304] 0 2024-09-18T12:51:18.217 INFO:tasks.workunit.client.1.smithi136.stdout:1/697: link d2/d5/d9/f3b d2/d5/d2b/da9/fea 0 2024-09-18T12:51:18.218 INFO:tasks.workunit.client.1.smithi136.stdout:1/698: fdatasync d2/d5/d2b/d9b/fbd 0 2024-09-18T12:51:18.218 INFO:tasks.workunit.client.0.smithi081.stdout:1/487: read d0/d6/d33/f61 [4497948,21310] 0 2024-09-18T12:51:18.218 INFO:tasks.workunit.client.0.smithi081.stdout:1/488: mknod d0/db/d4f/ca8 0 2024-09-18T12:51:18.221 INFO:tasks.workunit.client.0.smithi081.stdout:1/489: write d0/f15 [1103809,45354] 0 2024-09-18T12:51:18.221 INFO:tasks.workunit.client.0.smithi081.stdout:1/490: rename d0/d6/d33/d42 to d0/d6/d33/d42/d83/da9 22 2024-09-18T12:51:18.222 INFO:tasks.workunit.client.0.smithi081.stdout:1/491: creat d0/db/d12/d2d/faa x:0 0 0 2024-09-18T12:51:18.222 INFO:tasks.workunit.client.0.smithi081.stdout:3/370: sync 2024-09-18T12:51:18.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/433: sync 2024-09-18T12:51:18.223 INFO:tasks.workunit.client.1.smithi136.stdout:8/853: read d9/d14/f1f [2210083,36555] 0 2024-09-18T12:51:18.225 INFO:tasks.workunit.client.1.smithi136.stdout:8/854: mkdir d9/d14/d1a/d2b/d42/d6e/d75/db4/d122/d131 0 2024-09-18T12:51:18.225 INFO:tasks.workunit.client.1.smithi136.stdout:8/855: stat d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d 0 2024-09-18T12:51:18.227 INFO:tasks.workunit.client.1.smithi136.stdout:1/699: dread d2/d5/d2b/d9b/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:18.227 INFO:tasks.workunit.client.1.smithi136.stdout:5/842: dwrite d5/d1a/d2d/d3f/fcf [0,4194304] 0 2024-09-18T12:51:18.227 INFO:tasks.workunit.client.1.smithi136.stdout:1/700: write d2/d5/d2b/d9b/f19 [4682887,223] 0 2024-09-18T12:51:18.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/371: dread d3/db/df/d29/d13/f61 [0,4194304] 0 2024-09-18T12:51:18.228 INFO:tasks.workunit.client.1.smithi136.stdout:8/856: mknod d9/d18/d34/d3d/d8b/c132 0 2024-09-18T12:51:18.228 INFO:tasks.workunit.client.1.smithi136.stdout:8/857: dread - d9/d14/d1a/d2b/deb/d110/f105 zero size 2024-09-18T12:51:18.228 INFO:tasks.workunit.client.1.smithi136.stdout:1/701: read d2/d5/d2b/d9b/fbd [488200,56396] 0 2024-09-18T12:51:18.230 INFO:tasks.workunit.client.1.smithi136.stdout:8/858: dread d9/d18/d34/d3d/f78 [0,4194304] 0 2024-09-18T12:51:18.230 INFO:tasks.workunit.client.1.smithi136.stdout:8/859: truncate d9/d14/d1a/d7f/fe6 424233 0 2024-09-18T12:51:18.231 INFO:tasks.workunit.client.1.smithi136.stdout:0/756: write d1/d3/d1a/f33 [403276,14766] 0 2024-09-18T12:51:18.233 INFO:tasks.workunit.client.1.smithi136.stdout:7/840: sync 2024-09-18T12:51:18.233 INFO:tasks.workunit.client.1.smithi136.stdout:8/860: link d9/d14/d1a/f128 d9/f133 0 2024-09-18T12:51:18.236 INFO:tasks.workunit.client.1.smithi136.stdout:5/843: write d5/d1a/d30/f3c [3812027,130590] 0 2024-09-18T12:51:18.236 INFO:tasks.workunit.client.1.smithi136.stdout:5/844: chown d5/d78 137 1 2024-09-18T12:51:18.237 INFO:tasks.workunit.client.1.smithi136.stdout:0/757: link d1/d3/d1a/d98/d81/d70/dbc/ff5 d1/db/f102 0 2024-09-18T12:51:18.239 INFO:tasks.workunit.client.0.smithi081.stdout:5/434: dwrite d2/d14/d33/d37/d3b/d2a/f45 [0,4194304] 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/758: symlink d1/d60/dcb/dee/l103 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/759: write d1/db/d76/f83 [2097120,32098] 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/760: creat d1/db/d77/f104 x:0 0 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/761: write d1/d3/d1a/d98/d81/d35/d84/fbe [1371808,119243] 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/762: stat d1/d3/d1a/d98/d81/d35/cc4 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/763: truncate d1/db/d76/db9/ffd 889405 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/764: write d1/d3/d1a/d98/d81/d70/f86 [536657,113355] 0 2024-09-18T12:51:18.241 INFO:tasks.workunit.client.1.smithi136.stdout:0/765: dread - d1/d46/fe0 zero size 2024-09-18T12:51:18.242 INFO:tasks.workunit.client.0.smithi081.stdout:3/372: read d3/db/df/d29/d12/d44/d6f/f7c [6122727,103346] 0 2024-09-18T12:51:18.242 INFO:tasks.workunit.client.0.smithi081.stdout:5/435: mknod d2/d14/d33/d37/d3b/d16/d56/c84 0 2024-09-18T12:51:18.242 INFO:tasks.workunit.client.0.smithi081.stdout:5/436: stat d2/dd/d5e/f3a 0 2024-09-18T12:51:18.243 INFO:tasks.workunit.client.1.smithi136.stdout:7/841: dread d0/d35/d41/d50/d5a/f6a [0,4194304] 0 2024-09-18T12:51:18.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/373: mknod d3/db/df/d29/d13/d65/c83 0 2024-09-18T12:51:18.245 INFO:tasks.workunit.client.1.smithi136.stdout:0/766: rmdir d1 39 2024-09-18T12:51:18.245 INFO:tasks.workunit.client.1.smithi136.stdout:0/767: write d1/f31 [232973,53150] 0 2024-09-18T12:51:18.246 INFO:tasks.workunit.client.1.smithi136.stdout:7/842: creat d0/d39/dbf/dcf/f132 x:0 0 0 2024-09-18T12:51:18.249 INFO:tasks.workunit.client.1.smithi136.stdout:0/768: creat d1/d3/d1a/d98/d81/d51/db3/f105 x:0 0 0 2024-09-18T12:51:18.250 INFO:tasks.workunit.client.1.smithi136.stdout:0/769: mknod d1/db/d76/db9/de5/db5/c106 0 2024-09-18T12:51:18.251 INFO:tasks.workunit.client.0.smithi081.stdout:5/437: dread d2/d14/d33/d37/d3b/d6a/d20/f30 [0,4194304] 0 2024-09-18T12:51:18.252 INFO:tasks.workunit.client.1.smithi136.stdout:0/770: mknod d1/d60/d82/c107 0 2024-09-18T12:51:18.252 INFO:tasks.workunit.client.1.smithi136.stdout:1/702: dwrite d2/d5/d9/f3b [4194304,4194304] 0 2024-09-18T12:51:18.252 INFO:tasks.workunit.client.1.smithi136.stdout:1/703: chown d2/d5/d2b/d63/lb1 28543942 1 2024-09-18T12:51:18.256 INFO:tasks.workunit.client.1.smithi136.stdout:8/861: dwrite d9/d14/d1a/d2b/d42/fe4 [0,4194304] 0 2024-09-18T12:51:18.256 INFO:tasks.workunit.client.1.smithi136.stdout:8/862: dread - d9/d14/d1a/d2b/ff9 zero size 2024-09-18T12:51:18.258 INFO:tasks.workunit.client.1.smithi136.stdout:1/704: creat d2/d5/d2b/d34/feb x:0 0 0 2024-09-18T12:51:18.260 INFO:tasks.workunit.client.0.smithi081.stdout:3/374: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:18.260 INFO:tasks.workunit.client.1.smithi136.stdout:8/863: truncate d9/d18/d34/d3d/d47/d65/d92/ff5 2300506 0 2024-09-18T12:51:18.263 INFO:tasks.workunit.client.0.smithi081.stdout:3/375: mkdir d3/d84 0 2024-09-18T12:51:18.263 INFO:tasks.workunit.client.0.smithi081.stdout:5/438: dread d2/d14/d33/d37/d3b/d6a/f25 [0,4194304] 0 2024-09-18T12:51:18.263 INFO:tasks.workunit.client.1.smithi136.stdout:8/864: rename d9/d18/d34/d3d/d47/dbe/de3/d10d/le7 to d9/d18/d34/d3d/d47/dbe/de3/d101/l134 0 2024-09-18T12:51:18.263 INFO:tasks.workunit.client.1.smithi136.stdout:1/705: write d2/d5/d2b/d9b/d2e/d9a/fad [582164,14888] 0 2024-09-18T12:51:18.265 INFO:tasks.workunit.client.0.smithi081.stdout:3/376: rename d3/db/dc/l6c to d3/db/df/d29/d12/d44/d76/l85 0 2024-09-18T12:51:18.266 INFO:tasks.workunit.client.1.smithi136.stdout:8/865: creat d9/d14/d1a/d2b/d42/d6e/d75/db4/f135 x:0 0 0 2024-09-18T12:51:18.266 INFO:tasks.workunit.client.0.smithi081.stdout:3/377: mknod d3/d23/c86 0 2024-09-18T12:51:18.266 INFO:tasks.workunit.client.0.smithi081.stdout:3/378: creat d3/db/f87 x:0 0 0 2024-09-18T12:51:18.268 INFO:tasks.workunit.client.1.smithi136.stdout:1/706: getdents d2/d5/d2b/d9b/dbe 0 2024-09-18T12:51:18.268 INFO:tasks.workunit.client.0.smithi081.stdout:3/379: mknod d3/d84/c88 0 2024-09-18T12:51:18.285 INFO:tasks.workunit.client.0.smithi081.stdout:5/439: dwrite d2/d14/d33/f6b [0,4194304] 0 2024-09-18T12:51:18.286 INFO:tasks.workunit.client.1.smithi136.stdout:1/707: dread d2/d5/d2b/d9b/d2e/d4c/f2f [0,4194304] 0 2024-09-18T12:51:18.286 INFO:tasks.workunit.client.1.smithi136.stdout:1/708: chown d2/d5/d2b/da9/cc2 361 1 2024-09-18T12:51:18.287 INFO:tasks.workunit.client.1.smithi136.stdout:7/843: dwrite d0/d35/d41/d50/d7f/d6b/f75 [0,4194304] 0 2024-09-18T12:51:18.287 INFO:tasks.workunit.client.1.smithi136.stdout:7/844: dread - d0/d12/d1a/f123 zero size 2024-09-18T12:51:18.289 INFO:tasks.workunit.client.1.smithi136.stdout:1/709: unlink d2/d5/d2b/d9b/d2e/d4c/dd9/cde 0 2024-09-18T12:51:18.293 INFO:tasks.workunit.client.1.smithi136.stdout:7/845: mkdir d0/d35/d41/d50/d133 0 2024-09-18T12:51:18.293 INFO:tasks.workunit.client.1.smithi136.stdout:7/846: readlink d0/d35/d41/d50/d9b/l10e 0 2024-09-18T12:51:18.295 INFO:tasks.workunit.client.1.smithi136.stdout:7/847: mknod d0/d35/d4f/dd5/d94/c134 0 2024-09-18T12:51:18.295 INFO:tasks.workunit.client.1.smithi136.stdout:7/848: creat d0/d39/d4d/f135 x:0 0 0 2024-09-18T12:51:18.296 INFO:tasks.workunit.client.1.smithi136.stdout:7/849: dread - d0/d12/d5e/d67/fcb zero size 2024-09-18T12:51:18.296 INFO:tasks.workunit.client.1.smithi136.stdout:7/850: dread - d0/d39/dbf/ff4 zero size 2024-09-18T12:51:18.304 INFO:tasks.workunit.client.1.smithi136.stdout:9/755: sync 2024-09-18T12:51:18.305 INFO:tasks.workunit.client.1.smithi136.stdout:5/845: dwrite d5/f54 [0,4194304] 0 2024-09-18T12:51:18.305 INFO:tasks.workunit.client.1.smithi136.stdout:8/866: dwrite d9/d18/d34/d3d/f78 [0,4194304] 0 2024-09-18T12:51:18.307 INFO:tasks.workunit.client.1.smithi136.stdout:9/756: creat d6/da/d3d/d4d/d91/f104 x:0 0 0 2024-09-18T12:51:18.307 INFO:tasks.workunit.client.1.smithi136.stdout:9/757: chown d6/da/d3d/d41/cef 64366527 1 2024-09-18T12:51:18.310 INFO:tasks.workunit.client.1.smithi136.stdout:8/867: link d9/d18/d34/d3d/d47/dbe/ff8 d9/d18/d34/d3d/d47/dbe/dd1/f136 0 2024-09-18T12:51:18.310 INFO:tasks.workunit.client.1.smithi136.stdout:7/851: dread d0/d35/d41/d50/f5d [0,4194304] 0 2024-09-18T12:51:18.310 INFO:tasks.workunit.client.1.smithi136.stdout:9/758: mknod d6/db/c105 0 2024-09-18T12:51:18.310 INFO:tasks.workunit.client.1.smithi136.stdout:9/759: dread - d6/da/d3d/fff zero size 2024-09-18T12:51:18.312 INFO:tasks.workunit.client.1.smithi136.stdout:9/760: link d6/df/d75/fb2 d6/df/d23/f106 0 2024-09-18T12:51:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:17 smithi136 ceph-mon[35363]: pgmap v281: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 157 MiB/s rd, 200 MiB/s wr, 340 op/s 2024-09-18T12:51:18.317 INFO:tasks.workunit.client.0.smithi081.stdout:3/380: dwrite d3/db/d1b/f7d [0,4194304] 0 2024-09-18T12:51:18.319 INFO:tasks.workunit.client.1.smithi136.stdout:9/761: write d6/db/f2c [125511,126611] 0 2024-09-18T12:51:18.319 INFO:tasks.workunit.client.1.smithi136.stdout:9/762: creat d6/df/d75/dde/f107 x:0 0 0 2024-09-18T12:51:18.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/381: dread d3/db/df/d29/d13/f61 [0,4194304] 0 2024-09-18T12:51:18.320 INFO:tasks.workunit.client.1.smithi136.stdout:1/710: dwrite d2/d5/d2b/d9b/d1b/f25 [0,4194304] 0 2024-09-18T12:51:18.322 INFO:tasks.workunit.client.0.smithi081.stdout:3/382: mknod d3/db/d1b/c89 0 2024-09-18T12:51:18.324 INFO:tasks.workunit.client.0.smithi081.stdout:3/383: unlink d3/db/df/d29/d13/d68/f6b 0 2024-09-18T12:51:18.325 INFO:tasks.workunit.client.0.smithi081.stdout:3/384: creat d3/db/f8a x:0 0 0 2024-09-18T12:51:18.327 INFO:tasks.workunit.client.0.smithi081.stdout:3/385: link d3/l6 d3/db/df/d29/d13/l8b 0 2024-09-18T12:51:18.335 INFO:tasks.workunit.client.1.smithi136.stdout:5/846: dwrite d5/d1a/d2d/d34/fa3 [0,4194304] 0 2024-09-18T12:51:18.337 INFO:tasks.workunit.client.1.smithi136.stdout:5/847: mknod d5/d1a/d2d/d34/d4e/db5/c10a 0 2024-09-18T12:51:18.345 INFO:tasks.workunit.client.1.smithi136.stdout:7/852: dwrite d0/d39/d4d/d9a/dee/ff5 [0,4194304] 0 2024-09-18T12:51:18.346 INFO:tasks.workunit.client.1.smithi136.stdout:7/853: dread - d0/d35/d41/d50/d113/d12e/f118 zero size 2024-09-18T12:51:18.347 INFO:tasks.workunit.client.1.smithi136.stdout:1/711: dwrite d2/d5/d2b/d9b/d2e/f31 [0,4194304] 0 2024-09-18T12:51:18.348 INFO:tasks.workunit.client.1.smithi136.stdout:1/712: fdatasync d2/f6c 0 2024-09-18T12:51:18.348 INFO:tasks.workunit.client.1.smithi136.stdout:9/763: dwrite d6/da/d3d/d4d/d91/d38/fa3 [0,4194304] 0 2024-09-18T12:51:18.348 INFO:tasks.workunit.client.1.smithi136.stdout:9/764: write d6/da/ff2 [727415,98535] 0 2024-09-18T12:51:18.348 INFO:tasks.workunit.client.1.smithi136.stdout:8/868: dwrite d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:3/386: dwrite d3/db/d1b/d57/f49 [0,4194304] 0 2024-09-18T12:51:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:3/387: chown d3/db/df/d29/f30 2604808 1 2024-09-18T12:51:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:3/388: write d3/f80 [261750,38594] 0 2024-09-18T12:51:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:3/389: readlink d3/db/d1b/l75 0 2024-09-18T12:51:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:3/390: rmdir d3/d84 39 2024-09-18T12:51:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/494: sync 2024-09-18T12:51:18.377 INFO:tasks.workunit.client.1.smithi136.stdout:8/869: dread d9/d14/d1a/d2b/d42/da4/db9/dc0/f77 [0,4194304] 0 2024-09-18T12:51:18.379 INFO:tasks.workunit.client.1.smithi136.stdout:8/870: creat d9/d14/d1a/d2b/d42/da4/de5/f137 x:0 0 0 2024-09-18T12:51:18.380 INFO:tasks.workunit.client.1.smithi136.stdout:1/713: dwrite d2/fe6 [0,4194304] 0 2024-09-18T12:51:18.380 INFO:tasks.workunit.client.1.smithi136.stdout:1/714: dread - d2/d5/d2b/d34/d5c/fe3 zero size 2024-09-18T12:51:18.380 INFO:tasks.workunit.client.1.smithi136.stdout:7/854: dwrite d0/d35/d41/d50/d5a/d98/dd0/fed [0,4194304] 0 2024-09-18T12:51:18.380 INFO:tasks.workunit.client.1.smithi136.stdout:9/765: dwrite d6/da/d3d/d4d/d91/d25/dee/df8/ffb [0,4194304] 0 2024-09-18T12:51:18.381 INFO:tasks.workunit.client.1.smithi136.stdout:5/848: dwrite d5/f1c [0,4194304] 0 2024-09-18T12:51:18.383 INFO:tasks.workunit.client.1.smithi136.stdout:1/715: link d2/d5/d2b/d63/lb1 d2/d5/d2b/d9b/dbe/dd3/d65/lec 0 2024-09-18T12:51:18.383 INFO:tasks.workunit.client.1.smithi136.stdout:1/716: write d2/d5/d2b/d9b/f58 [4729572,116586] 0 2024-09-18T12:51:18.385 INFO:tasks.workunit.client.1.smithi136.stdout:9/766: rename d6/cf0 to d6/da/d3d/d4d/d91/c108 0 2024-09-18T12:51:18.386 INFO:tasks.workunit.client.0.smithi081.stdout:3/391: dwrite d3/db/d1b/f34 [0,4194304] 0 2024-09-18T12:51:18.387 INFO:tasks.workunit.client.1.smithi136.stdout:5/849: getdents d5/d1a 0 2024-09-18T12:51:18.387 INFO:tasks.workunit.client.1.smithi136.stdout:5/850: chown d5/d1a/d4a/d79/f90 780106 1 2024-09-18T12:51:18.387 INFO:tasks.workunit.client.0.smithi081.stdout:3/392: creat d3/db/df/d29/d12/d44/d76/f8c x:0 0 0 2024-09-18T12:51:18.388 INFO:tasks.workunit.client.1.smithi136.stdout:7/855: getdents d0/d35/d36 0 2024-09-18T12:51:18.390 INFO:tasks.workunit.client.1.smithi136.stdout:1/717: creat d2/d5/d9/db4/dd0/fed x:0 0 0 2024-09-18T12:51:18.391 INFO:tasks.workunit.client.1.smithi136.stdout:8/871: dread d9/d14/d1a/d2b/f2e [0,4194304] 0 2024-09-18T12:51:18.391 INFO:tasks.workunit.client.1.smithi136.stdout:9/767: getdents d6/da/d3d/d4d/d91/d25/d55 0 2024-09-18T12:51:18.392 INFO:tasks.workunit.client.1.smithi136.stdout:7/856: rmdir d0/d35/d41/d50/d5a 39 2024-09-18T12:51:18.392 INFO:tasks.workunit.client.1.smithi136.stdout:7/857: truncate d0/d35/d41/d50/d9b/dc2/fff 35118 0 2024-09-18T12:51:18.393 INFO:tasks.workunit.client.1.smithi136.stdout:8/872: unlink d9/d14/d1a/d2b/d42/d9e/dda/dfa/l111 0 2024-09-18T12:51:18.393 INFO:tasks.workunit.client.1.smithi136.stdout:8/873: readlink d9/d14/d1a/d2b/d42/l55 0 2024-09-18T12:51:18.393 INFO:tasks.workunit.client.1.smithi136.stdout:8/874: read - d9/d14/d1a/d2b/d42/d6e/d75/db4/fc4 zero size 2024-09-18T12:51:18.394 INFO:tasks.workunit.client.1.smithi136.stdout:5/851: rmdir d5/d1a/d2d/d34/d88 39 2024-09-18T12:51:18.395 INFO:tasks.workunit.client.1.smithi136.stdout:7/858: rmdir d0/d35/d4f/dd5/d10f 0 2024-09-18T12:51:18.395 INFO:tasks.workunit.client.1.smithi136.stdout:7/859: dread - d0/d35/d41/df3/f111 zero size 2024-09-18T12:51:18.396 INFO:tasks.workunit.client.1.smithi136.stdout:7/860: creat d0/d35/d41/d50/f136 x:0 0 0 2024-09-18T12:51:18.396 INFO:tasks.workunit.client.1.smithi136.stdout:5/852: link d5/l14 d5/d1a/dfe/l10b 0 2024-09-18T12:51:18.397 INFO:tasks.workunit.client.1.smithi136.stdout:5/853: chown d5/d78/d105 12 1 2024-09-18T12:51:18.397 INFO:tasks.workunit.client.1.smithi136.stdout:5/854: chown d5/d1a/d2d/d3f/l5e 12 1 2024-09-18T12:51:18.397 INFO:tasks.workunit.client.1.smithi136.stdout:5/855: dread - d5/d1a/d2d/d34/d88/ff0 zero size 2024-09-18T12:51:18.398 INFO:tasks.workunit.client.1.smithi136.stdout:7/861: mknod d0/d12/d1a/dac/d102/c137 0 2024-09-18T12:51:18.399 INFO:tasks.workunit.client.1.smithi136.stdout:7/862: fdatasync d0/d35/d41/d50/f130 0 2024-09-18T12:51:18.404 INFO:tasks.workunit.client.1.smithi136.stdout:3/690: sync 2024-09-18T12:51:18.407 INFO:tasks.workunit.client.1.smithi136.stdout:3/691: rename d3/d14/dc5/f80 to d3/d2b/d6c/db4/fdf 0 2024-09-18T12:51:18.409 INFO:tasks.workunit.client.1.smithi136.stdout:3/692: getdents d3/d5/d31 0 2024-09-18T12:51:18.409 INFO:tasks.workunit.client.1.smithi136.stdout:3/693: chown d3/d14/d17/d8c/d96/fc0 53049994 1 2024-09-18T12:51:18.410 INFO:tasks.workunit.client.1.smithi136.stdout:3/694: symlink d3/le0 0 2024-09-18T12:51:18.411 INFO:tasks.workunit.client.1.smithi136.stdout:3/695: link d3/d5/d3c/f4c d3/d10/fe1 0 2024-09-18T12:51:18.412 INFO:tasks.workunit.client.1.smithi136.stdout:9/768: dwrite d6/db/d12/d62/fcb [0,4194304] 0 2024-09-18T12:51:18.412 INFO:tasks.workunit.client.1.smithi136.stdout:3/696: symlink d3/d5/d31/le2 0 2024-09-18T12:51:18.413 INFO:tasks.workunit.client.1.smithi136.stdout:3/697: truncate d3/d14/d17/d8c/d96/f9c 130743 0 2024-09-18T12:51:18.416 INFO:tasks.workunit.client.1.smithi136.stdout:3/698: mknod d3/d10/ce3 0 2024-09-18T12:51:18.417 INFO:tasks.workunit.client.1.smithi136.stdout:3/699: stat d3/d14/d18 0 2024-09-18T12:51:18.421 INFO:tasks.workunit.client.1.smithi136.stdout:3/700: write d3/d2b/f4b [1008039,53341] 0 2024-09-18T12:51:18.428 INFO:tasks.workunit.client.1.smithi136.stdout:9/769: dwrite d6/df/d75/f98 [0,4194304] 0 2024-09-18T12:51:18.429 INFO:tasks.workunit.client.1.smithi136.stdout:3/701: dread d3/d5/d3c/fde [0,4194304] 0 2024-09-18T12:51:18.431 INFO:tasks.workunit.client.1.smithi136.stdout:3/702: rmdir d3/d14/d18/d7f 39 2024-09-18T12:51:18.431 INFO:tasks.workunit.client.1.smithi136.stdout:3/703: dread - d3/d2b/fba zero size 2024-09-18T12:51:18.432 INFO:tasks.workunit.client.1.smithi136.stdout:3/704: dread d3/d14/d18/f88 [0,4194304] 0 2024-09-18T12:51:18.433 INFO:tasks.workunit.client.1.smithi136.stdout:3/705: creat d3/d14/d22/d2c/dd5/fe4 x:0 0 0 2024-09-18T12:51:18.433 INFO:tasks.workunit.client.1.smithi136.stdout:3/706: chown d3/d10/l8f 30 1 2024-09-18T12:51:18.434 INFO:tasks.workunit.client.1.smithi136.stdout:3/707: getdents d3/d14/d18 0 2024-09-18T12:51:18.435 INFO:tasks.workunit.client.1.smithi136.stdout:3/708: link d3/d14/d18/d7f/l67 d3/d10/d84/le5 0 2024-09-18T12:51:18.435 INFO:tasks.workunit.client.1.smithi136.stdout:3/709: read d3/d2b/f92 [1327787,18260] 0 2024-09-18T12:51:18.436 INFO:tasks.workunit.client.1.smithi136.stdout:3/710: write d3/d14/d17/d75/d86/fce [413523,31838] 0 2024-09-18T12:51:18.437 INFO:tasks.workunit.client.1.smithi136.stdout:3/711: dread d3/d14/d17/d8c/d96/fa4 [0,4194304] 0 2024-09-18T12:51:18.476 INFO:tasks.workunit.client.0.smithi081.stdout:3/393: dread d3/db/f56 [0,4194304] 0 2024-09-18T12:51:18.484 INFO:tasks.workunit.client.0.smithi081.stdout:3/394: write d3/db/d1b/d57/f49 [3431585,128631] 0 2024-09-18T12:51:18.492 INFO:tasks.workunit.client.1.smithi136.stdout:2/806: sync 2024-09-18T12:51:18.492 INFO:tasks.workunit.client.1.smithi136.stdout:6/738: sync 2024-09-18T12:51:18.492 INFO:tasks.workunit.client.1.smithi136.stdout:4/671: sync 2024-09-18T12:51:18.493 INFO:tasks.workunit.client.1.smithi136.stdout:2/807: creat d5/d7/d11/d34/f10a x:0 0 0 2024-09-18T12:51:18.494 INFO:tasks.workunit.client.1.smithi136.stdout:4/672: mkdir d0/dd7 0 2024-09-18T12:51:18.494 INFO:tasks.workunit.client.1.smithi136.stdout:4/673: dread - d0/d2/d85/da0/fd1 zero size 2024-09-18T12:51:18.495 INFO:tasks.workunit.client.1.smithi136.stdout:2/808: rename d5/d7/f1e to d5/d4a/f10b 0 2024-09-18T12:51:18.496 INFO:tasks.workunit.client.1.smithi136.stdout:4/674: mknod d0/d3/dae/cd8 0 2024-09-18T12:51:18.496 INFO:tasks.workunit.client.1.smithi136.stdout:4/675: write d0/d13/f69 [5205880,76221] 0 2024-09-18T12:51:18.496 INFO:tasks.workunit.client.1.smithi136.stdout:4/676: getdents d0/d5f/dd3 0 2024-09-18T12:51:18.496 INFO:tasks.workunit.client.1.smithi136.stdout:4/677: creat d0/d13/fd9 x:0 0 0 2024-09-18T12:51:18.497 INFO:tasks.workunit.client.1.smithi136.stdout:4/678: symlink d0/d8d/lda 0 2024-09-18T12:51:18.497 INFO:tasks.workunit.client.1.smithi136.stdout:4/679: creat d0/d2/d85/da0/fdb x:0 0 0 2024-09-18T12:51:18.501 INFO:tasks.workunit.client.1.smithi136.stdout:6/739: write d8/d9/de/d1c/f5e [2342248,17077] 0 2024-09-18T12:51:18.506 INFO:tasks.workunit.client.1.smithi136.stdout:4/680: dread d0/f15 [4194304,4194304] 0 2024-09-18T12:51:18.506 INFO:tasks.workunit.client.1.smithi136.stdout:4/681: creat d0/d3/d54/d88/db1/fdc x:0 0 0 2024-09-18T12:51:18.506 INFO:tasks.workunit.client.1.smithi136.stdout:4/682: fdatasync d0/d3/fa5 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:1/718: dwrite d2/d5/d2b/da9/fb6 [0,4194304] 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:1/719: chown d2/d5/d2b/da9/lc8 48 1 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:1/720: creat d2/d5/d2b/d9b/fee x:0 0 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:7/863: dwrite d0/d35/d41/dfe/d10c/f115 [0,4194304] 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:2/809: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:3/712: dwrite d3/d2b/d6c/fa2 [0,4194304] 0 2024-09-18T12:51:18.574 INFO:tasks.workunit.client.1.smithi136.stdout:2/810: creat d5/d4a/d67/f10c x:0 0 0 2024-09-18T12:51:18.581 INFO:tasks.workunit.client.1.smithi136.stdout:1/721: dread d2/d5/d2b/d9b/d2e/d4c/f1f [0,4194304] 0 2024-09-18T12:51:18.581 INFO:tasks.workunit.client.1.smithi136.stdout:1/722: chown d2/d5/d2b/d9b/d2e/d4c/dd9 3 1 2024-09-18T12:51:18.584 INFO:tasks.workunit.client.1.smithi136.stdout:1/723: mkdir d2/d5/d2b/da9/def 0 2024-09-18T12:51:18.585 INFO:tasks.workunit.client.1.smithi136.stdout:1/724: fsync d2/f42 0 2024-09-18T12:51:18.585 INFO:tasks.workunit.client.1.smithi136.stdout:1/725: truncate d2/d5/d2b/f80 1116026 0 2024-09-18T12:51:18.585 INFO:tasks.workunit.client.1.smithi136.stdout:7/864: dread d0/d35/d41/d50/d7b/fb6 [0,4194304] 0 2024-09-18T12:51:18.587 INFO:tasks.workunit.client.1.smithi136.stdout:1/726: mkdir d2/d5/d2b/d9b/d2e/df0 0 2024-09-18T12:51:18.588 INFO:tasks.workunit.client.1.smithi136.stdout:7/865: creat d0/da8/dcc/f138 x:0 0 0 2024-09-18T12:51:18.591 INFO:tasks.workunit.client.1.smithi136.stdout:1/727: rename d2/d5/d2b/d9b/c95 to d2/d5/cf1 0 2024-09-18T12:51:18.592 INFO:tasks.workunit.client.1.smithi136.stdout:1/728: creat d2/dc4/ff2 x:0 0 0 2024-09-18T12:51:18.604 INFO:tasks.workunit.client.1.smithi136.stdout:3/713: dwrite d3/d14/d18/d7f/f7a [4194304,4194304] 0 2024-09-18T12:51:18.604 INFO:tasks.workunit.client.1.smithi136.stdout:2/811: dwrite d5/fef [0,4194304] 0 2024-09-18T12:51:18.605 INFO:tasks.workunit.client.1.smithi136.stdout:0/771: sync 2024-09-18T12:51:18.605 INFO:tasks.workunit.client.1.smithi136.stdout:0/772: read - d1/d3/d1a/d98/d81/d35/f90 zero size 2024-09-18T12:51:18.605 INFO:tasks.workunit.client.1.smithi136.stdout:0/773: fsync d1/d46/d6c/f8a 0 2024-09-18T12:51:18.607 INFO:tasks.workunit.client.1.smithi136.stdout:1/729: rmdir d2/d5/d2b/d9b 39 2024-09-18T12:51:18.611 INFO:tasks.workunit.client.1.smithi136.stdout:2/812: link d5/d7/d11/d34/fda d5/f10d 0 2024-09-18T12:51:18.612 INFO:tasks.workunit.client.1.smithi136.stdout:0/774: creat d1/d17/dd1/dff/f108 x:0 0 0 2024-09-18T12:51:18.612 INFO:tasks.workunit.client.1.smithi136.stdout:0/775: creat d1/d3/d1a/d98/d81/d51/db3/f109 x:0 0 0 2024-09-18T12:51:18.612 INFO:tasks.workunit.client.1.smithi136.stdout:0/776: write d1/d46/fe0 [791725,20489] 0 2024-09-18T12:51:18.614 INFO:tasks.workunit.client.1.smithi136.stdout:0/777: link d1/d17/f6b d1/d3/d1a/d98/d81/d72/f10a 0 2024-09-18T12:51:18.614 INFO:tasks.workunit.client.1.smithi136.stdout:1/730: rmdir d2/d5/d2b/d34/d5c 39 2024-09-18T12:51:18.616 INFO:tasks.workunit.client.1.smithi136.stdout:0/778: creat d1/d3/d1a/d98/d81/d35/ddc/f10b x:0 0 0 2024-09-18T12:51:18.616 INFO:tasks.workunit.client.1.smithi136.stdout:0/779: truncate d1/d3/d1a/d62/fc8 1185819 0 2024-09-18T12:51:18.617 INFO:tasks.workunit.client.1.smithi136.stdout:0/780: mkdir d1/d60/d10c 0 2024-09-18T12:51:18.617 INFO:tasks.workunit.client.1.smithi136.stdout:0/781: chown d1/d3/d1a/d98/d81/d35/ddc/f10b 47558657 1 2024-09-18T12:51:18.619 INFO:tasks.workunit.client.1.smithi136.stdout:0/782: mkdir d1/d3/d1a/d62/d75/d10d 0 2024-09-18T12:51:18.620 INFO:tasks.workunit.client.1.smithi136.stdout:7/866: dwrite d0/d35/d41/d50/d7f/f42 [0,4194304] 0 2024-09-18T12:51:18.621 INFO:tasks.workunit.client.1.smithi136.stdout:2/813: dread d5/d7/f78 [0,4194304] 0 2024-09-18T12:51:18.621 INFO:tasks.workunit.client.1.smithi136.stdout:0/783: mknod d1/d3/d1a/d62/d75/d100/c10e 0 2024-09-18T12:51:18.622 INFO:tasks.workunit.client.1.smithi136.stdout:3/714: dwrite d3/d14/d22/d2c/dd5/fe4 [0,4194304] 0 2024-09-18T12:51:18.622 INFO:tasks.workunit.client.1.smithi136.stdout:3/715: truncate d3/d14/d22/f37 4990612 0 2024-09-18T12:51:18.622 INFO:tasks.workunit.client.1.smithi136.stdout:3/716: write d3/d14/d17/d75/d86/f9a [903522,130144] 0 2024-09-18T12:51:18.622 INFO:tasks.workunit.client.1.smithi136.stdout:3/717: fsync d3/d10/d4a/d51/fc7 0 2024-09-18T12:51:18.622 INFO:tasks.workunit.client.1.smithi136.stdout:7/867: getdents d0/d39/d4d/d69/dd1 0 2024-09-18T12:51:18.623 INFO:tasks.workunit.client.1.smithi136.stdout:3/718: dread d3/d14/d17/d8c/d96/fcf [0,4194304] 0 2024-09-18T12:51:18.623 INFO:tasks.workunit.client.1.smithi136.stdout:3/719: chown d3/d14/d17/db8 9 1 2024-09-18T12:51:18.623 INFO:tasks.workunit.client.1.smithi136.stdout:3/720: creat d3/d2b/d6c/db4/fe6 x:0 0 0 2024-09-18T12:51:18.624 INFO:tasks.workunit.client.1.smithi136.stdout:2/814: symlink d5/d7/d17/d48/db2/db8/l10e 0 2024-09-18T12:51:18.626 INFO:tasks.workunit.client.1.smithi136.stdout:7/868: mknod d0/c139 0 2024-09-18T12:51:18.626 INFO:tasks.workunit.client.1.smithi136.stdout:7/869: chown d0/d39/d4d/d9a/dee/d109/f12a 6172 1 2024-09-18T12:51:18.629 INFO:tasks.workunit.client.1.smithi136.stdout:3/721: link d3/d10/d84/le5 d3/d14/d17/d8c/d96/le7 0 2024-09-18T12:51:18.630 INFO:tasks.workunit.client.1.smithi136.stdout:7/870: mkdir d0/d35/d41/d50/d9b/dc2/de0/d13a 0 2024-09-18T12:51:18.632 INFO:tasks.workunit.client.1.smithi136.stdout:3/722: unlink d3/d14/dc5/f93 0 2024-09-18T12:51:18.634 INFO:tasks.workunit.client.1.smithi136.stdout:7/871: unlink d0/d35/d41/f5c 0 2024-09-18T12:51:18.635 INFO:tasks.workunit.client.1.smithi136.stdout:2/815: dread d5/d25/d2d/f6d [0,4194304] 0 2024-09-18T12:51:18.635 INFO:tasks.workunit.client.1.smithi136.stdout:1/731: dwrite d2/d5/d2b/d9b/d2e/d9a/fad [4194304,4194304] 0 2024-09-18T12:51:18.636 INFO:tasks.workunit.client.1.smithi136.stdout:3/723: mkdir d3/d14/d17/d53/de8 0 2024-09-18T12:51:18.637 INFO:tasks.workunit.client.1.smithi136.stdout:7/872: symlink d0/d35/d41/d11b/l13b 0 2024-09-18T12:51:18.637 INFO:tasks.workunit.client.1.smithi136.stdout:0/784: read d1/d60/d82/f93 [736705,56560] 0 2024-09-18T12:51:18.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/816: mkdir d5/d25/d2d/d10f 0 2024-09-18T12:51:18.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/817: read - d5/d4a/d67/f105 zero size 2024-09-18T12:51:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:6/365: sync 2024-09-18T12:51:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:6/366: creat d4/d12/d1c/d39/d40/f78 x:0 0 0 2024-09-18T12:51:18.641 INFO:tasks.workunit.client.0.smithi081.stdout:6/367: rmdir d4/d12/d1c/d39/d40/d54 39 2024-09-18T12:51:18.643 INFO:tasks.workunit.client.1.smithi136.stdout:2/818: rename d5/d25/d2d/d9d/da2/cfb to d5/d25/d2d/d10f/c110 0 2024-09-18T12:51:18.648 INFO:tasks.workunit.client.1.smithi136.stdout:2/819: link d5/d25/d2d/d9d/f107 d5/d25/d2d/d9d/f111 0 2024-09-18T12:51:18.648 INFO:tasks.workunit.client.1.smithi136.stdout:0/785: dread d1/d46/d6c/f8a [0,4194304] 0 2024-09-18T12:51:18.648 INFO:tasks.workunit.client.1.smithi136.stdout:2/820: mknod d5/d7/d17/c112 0 2024-09-18T12:51:18.649 INFO:tasks.workunit.client.1.smithi136.stdout:2/821: creat d5/d7/d17/d48/db2/db8/ddf/f113 x:0 0 0 2024-09-18T12:51:18.651 INFO:tasks.workunit.client.1.smithi136.stdout:7/873: dread d0/d35/d41/d50/d5a/f86 [0,4194304] 0 2024-09-18T12:51:18.651 INFO:tasks.workunit.client.1.smithi136.stdout:7/874: write d0/d2c/d2e/dc5/f124 [2644857,107178] 0 2024-09-18T12:51:18.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/724: dwrite d3/d14/d17/d8c/d96/f9c [0,4194304] 0 2024-09-18T12:51:18.656 INFO:tasks.workunit.client.1.smithi136.stdout:7/875: creat d0/d12/d5e/d10d/f13c x:0 0 0 2024-09-18T12:51:18.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/725: write d3/d14/f40 [66452,117346] 0 2024-09-18T12:51:18.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/726: fsync d3/d14/d22/fc6 0 2024-09-18T12:51:18.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/727: fdatasync d3/d10/d4a/d51/fa0 0 2024-09-18T12:51:18.657 INFO:tasks.workunit.client.1.smithi136.stdout:7/876: mknod d0/d35/d41/d50/d7b/c13d 0 2024-09-18T12:51:18.657 INFO:tasks.workunit.client.0.smithi081.stdout:6/368: dread d4/d12/d28/d2a/d2d/d31/f51 [0,4194304] 0 2024-09-18T12:51:18.658 INFO:tasks.workunit.client.1.smithi136.stdout:7/877: mknod d0/d12/c13e 0 2024-09-18T12:51:18.659 INFO:tasks.workunit.client.1.smithi136.stdout:7/878: getdents d0/d39/d4d/d9a 0 2024-09-18T12:51:18.664 INFO:tasks.workunit.client.1.smithi136.stdout:0/786: write d1/d17/f45 [2755392,78476] 0 2024-09-18T12:51:18.665 INFO:tasks.workunit.client.1.smithi136.stdout:0/787: read d1/d3/d1a/d98/d81/d35/f4d [129924,48204] 0 2024-09-18T12:51:18.668 INFO:tasks.workunit.client.1.smithi136.stdout:0/788: rename d1/d3/d1a/d98/d81/d35/f4d to d1/d60/d10c/f10f 0 2024-09-18T12:51:18.670 INFO:tasks.workunit.client.1.smithi136.stdout:0/789: rename d1/d17/dd1/ldb to d1/d3/d1a/d98/d81/d70/dbc/l110 0 2024-09-18T12:51:18.672 INFO:tasks.workunit.client.1.smithi136.stdout:0/790: rename d1/d3/d1a/d62/d75/cd9 to d1/db/d77/c111 0 2024-09-18T12:51:18.674 INFO:tasks.workunit.client.1.smithi136.stdout:7/879: dread d0/d35/d36/d7c/f9e [0,4194304] 0 2024-09-18T12:51:18.675 INFO:tasks.workunit.client.1.smithi136.stdout:7/880: write d0/f31 [245640,124690] 0 2024-09-18T12:51:18.677 INFO:tasks.workunit.client.1.smithi136.stdout:0/791: dread d1/d3/d1a/d98/d81/f53 [0,4194304] 0 2024-09-18T12:51:18.677 INFO:tasks.workunit.client.1.smithi136.stdout:0/792: chown d1/d3/d1a/d98/d81/d70/dbc/fe3 69909 1 2024-09-18T12:51:18.677 INFO:tasks.workunit.client.1.smithi136.stdout:7/881: rmdir d0/d12/d1a 39 2024-09-18T12:51:18.679 INFO:tasks.workunit.client.1.smithi136.stdout:7/882: mkdir d0/d39/d4d/d69/d13f 0 2024-09-18T12:51:18.679 INFO:tasks.workunit.client.1.smithi136.stdout:7/883: write d0/d2c/f45 [1638446,89290] 0 2024-09-18T12:51:18.679 INFO:tasks.workunit.client.1.smithi136.stdout:7/884: chown d0/d35/d41/dfe/d10c/f115 112706 1 2024-09-18T12:51:18.679 INFO:tasks.workunit.client.1.smithi136.stdout:7/885: write d0/d35/d41/d50/d113/d12e/f11f [3754604,124548] 0 2024-09-18T12:51:18.680 INFO:tasks.workunit.client.1.smithi136.stdout:7/886: creat d0/d35/d41/d50/d5a/f140 x:0 0 0 2024-09-18T12:51:18.683 INFO:tasks.workunit.client.1.smithi136.stdout:7/887: dread d0/d2c/d2e/f32 [4194304,4194304] 0 2024-09-18T12:51:18.683 INFO:tasks.workunit.client.1.smithi136.stdout:2/822: dwrite d5/d7/d41/f96 [0,4194304] 0 2024-09-18T12:51:18.683 INFO:tasks.workunit.client.1.smithi136.stdout:2/823: creat d5/d25/d2d/d9d/da2/f114 x:0 0 0 2024-09-18T12:51:18.683 INFO:tasks.workunit.client.0.smithi081.stdout:6/369: dwrite d4/d12/d28/d2a/f45 [0,4194304] 0 2024-09-18T12:51:18.683 INFO:tasks.workunit.client.1.smithi136.stdout:3/728: dwrite d3/d2b/f4b [0,4194304] 0 2024-09-18T12:51:18.684 INFO:tasks.workunit.client.1.smithi136.stdout:7/888: symlink d0/d39/dbf/l141 0 2024-09-18T12:51:18.684 INFO:tasks.workunit.client.1.smithi136.stdout:7/889: fdatasync d0/d35/d41/d50/f5d 0 2024-09-18T12:51:18.687 INFO:tasks.workunit.client.0.smithi081.stdout:6/370: dread d4/d12/d56/f63 [0,4194304] 0 2024-09-18T12:51:18.688 INFO:tasks.workunit.client.0.smithi081.stdout:6/371: symlink d4/l79 0 2024-09-18T12:51:18.691 INFO:tasks.workunit.client.1.smithi136.stdout:2/824: mknod d5/d25/d2d/d9d/da2/c115 0 2024-09-18T12:51:18.692 INFO:tasks.workunit.client.1.smithi136.stdout:2/825: creat d5/d7/d3b/f116 x:0 0 0 2024-09-18T12:51:18.692 INFO:tasks.workunit.client.1.smithi136.stdout:2/826: write d5/d25/d2d/d9d/da2/f101 [607371,76029] 0 2024-09-18T12:51:18.693 INFO:tasks.workunit.client.1.smithi136.stdout:9/770: sync 2024-09-18T12:51:18.693 INFO:tasks.workunit.client.1.smithi136.stdout:8/875: sync 2024-09-18T12:51:18.693 INFO:tasks.workunit.client.1.smithi136.stdout:4/683: sync 2024-09-18T12:51:18.693 INFO:tasks.workunit.client.1.smithi136.stdout:6/740: sync 2024-09-18T12:51:18.694 INFO:tasks.workunit.client.1.smithi136.stdout:5/856: sync 2024-09-18T12:51:18.694 INFO:tasks.workunit.client.1.smithi136.stdout:4/684: dread - d0/d2/fa8 zero size 2024-09-18T12:51:18.694 INFO:tasks.workunit.client.1.smithi136.stdout:4/685: chown d0/d2/c24 375082 1 2024-09-18T12:51:18.694 INFO:tasks.workunit.client.1.smithi136.stdout:3/729: creat d3/d14/d18/fe9 x:0 0 0 2024-09-18T12:51:18.694 INFO:tasks.workunit.client.1.smithi136.stdout:0/793: dwrite d1/db/f71 [0,4194304] 0 2024-09-18T12:51:18.695 INFO:tasks.workunit.client.1.smithi136.stdout:2/827: rename d5/d25/d43/fc5 to d5/d7/d17/d48/dc1/dea/f117 0 2024-09-18T12:51:18.695 INFO:tasks.workunit.client.1.smithi136.stdout:2/828: dread - d5/d7/d17/d48/fd6 zero size 2024-09-18T12:51:18.696 INFO:tasks.workunit.client.1.smithi136.stdout:9/771: truncate d6/df/d23/fa1 3640231 0 2024-09-18T12:51:18.696 INFO:tasks.workunit.client.1.smithi136.stdout:9/772: truncate d6/df/d23/d2b/d79/ffa 1022273 0 2024-09-18T12:51:18.696 INFO:tasks.workunit.client.1.smithi136.stdout:9/773: truncate d6/d59/f68 4959341 0 2024-09-18T12:51:18.697 INFO:tasks.workunit.client.1.smithi136.stdout:9/774: chown d6/df/d23/c8c 180193 1 2024-09-18T12:51:18.699 INFO:tasks.workunit.client.1.smithi136.stdout:6/741: symlink d8/le9 0 2024-09-18T12:51:18.699 INFO:tasks.workunit.client.1.smithi136.stdout:6/742: fsync d8/dc/f15 0 2024-09-18T12:51:18.699 INFO:tasks.workunit.client.1.smithi136.stdout:8/876: getdents d9/d14/d1a/d2b/d42/da4 0 2024-09-18T12:51:18.700 INFO:tasks.workunit.client.1.smithi136.stdout:5/857: getdents d5/d1a/d30/d7b 0 2024-09-18T12:51:18.701 INFO:tasks.workunit.client.1.smithi136.stdout:0/794: truncate d1/d3/d1a/d98/d81/d35/f49 3565413 0 2024-09-18T12:51:18.703 INFO:tasks.workunit.client.1.smithi136.stdout:9/775: symlink d6/df/d23/d2b/de5/l109 0 2024-09-18T12:51:18.703 INFO:tasks.workunit.client.1.smithi136.stdout:9/776: chown d6/d13/d4c/fa7 31104 1 2024-09-18T12:51:18.704 INFO:tasks.workunit.client.1.smithi136.stdout:0/795: read d1/d3/d1a/d62/fc8 [58771,23497] 0 2024-09-18T12:51:18.704 INFO:tasks.workunit.client.1.smithi136.stdout:0/796: stat d1/d3/d1a/d98/d81/d35/c80 0 2024-09-18T12:51:18.704 INFO:tasks.workunit.client.1.smithi136.stdout:0/797: fdatasync d1/d3/d1a/d62/d75/d100/f101 0 2024-09-18T12:51:18.705 INFO:tasks.workunit.client.1.smithi136.stdout:8/877: creat d9/d18/d34/d3d/d47/dbe/de3/f138 x:0 0 0 2024-09-18T12:51:18.705 INFO:tasks.workunit.client.1.smithi136.stdout:8/878: fsync d9/d18/d34/d3d/d47/dbe/de3/d101/f117 0 2024-09-18T12:51:18.705 INFO:tasks.workunit.client.1.smithi136.stdout:8/879: write d9/d18/f1c [959426,88330] 0 2024-09-18T12:51:18.708 INFO:tasks.workunit.client.1.smithi136.stdout:5/858: link d5/d1a/d2d/d3f/d7f/dbc/cd6 d5/d1a/d2d/d3f/d7f/dbc/dc8/c10c 0 2024-09-18T12:51:18.708 INFO:tasks.workunit.client.1.smithi136.stdout:3/730: rmdir d3/d10/d4a 39 2024-09-18T12:51:18.708 INFO:tasks.workunit.client.1.smithi136.stdout:3/731: creat d3/d14/d22/d2c/dd5/fea x:0 0 0 2024-09-18T12:51:18.710 INFO:tasks.workunit.client.1.smithi136.stdout:9/777: creat d6/df/d23/d2b/d79/d8b/f10a x:0 0 0 2024-09-18T12:51:18.710 INFO:tasks.workunit.client.1.smithi136.stdout:9/778: write d6/da/d3d/d4d/d91/d38/f81 [1587846,47369] 0 2024-09-18T12:51:18.710 INFO:tasks.workunit.client.1.smithi136.stdout:9/779: readlink d6/l18 0 2024-09-18T12:51:18.712 INFO:tasks.workunit.client.1.smithi136.stdout:0/798: rmdir d1/d3/d1a/d98 39 2024-09-18T12:51:18.712 INFO:tasks.workunit.client.1.smithi136.stdout:4/686: write d0/d2/f49 [776121,122728] 0 2024-09-18T12:51:18.713 INFO:tasks.workunit.client.1.smithi136.stdout:5/859: mknod d5/d78/c10d 0 2024-09-18T12:51:18.716 INFO:tasks.workunit.client.1.smithi136.stdout:3/732: truncate d3/d14/d17/d75/d87/fd1 772735 0 2024-09-18T12:51:18.716 INFO:tasks.workunit.client.1.smithi136.stdout:3/733: fdatasync d3/d14/d18/f88 0 2024-09-18T12:51:18.718 INFO:tasks.workunit.client.1.smithi136.stdout:0/799: creat d1/d3/d1a/d98/f112 x:0 0 0 2024-09-18T12:51:18.718 INFO:tasks.workunit.client.1.smithi136.stdout:0/800: chown d1/d3/d1a/d62/d75/d100/f101 7880605 1 2024-09-18T12:51:18.718 INFO:tasks.workunit.client.1.smithi136.stdout:4/687: stat d0/d25/db7/lbf 0 2024-09-18T12:51:18.720 INFO:tasks.workunit.client.0.smithi081.stdout:6/372: dwrite d4/d12/d1c/d39/d40/f78 [0,4194304] 0 2024-09-18T12:51:18.720 INFO:tasks.workunit.client.1.smithi136.stdout:7/890: dwrite d0/d39/d4d/d55/fef [0,4194304] 0 2024-09-18T12:51:18.720 INFO:tasks.workunit.client.1.smithi136.stdout:3/734: creat d3/d14/dc5/feb x:0 0 0 2024-09-18T12:51:18.720 INFO:tasks.workunit.client.1.smithi136.stdout:3/735: readlink d3/d14/d17/d8c/d96/le7 0 2024-09-18T12:51:18.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/373: creat d4/d12/d28/d2a/d2d/d31/f7a x:0 0 0 2024-09-18T12:51:18.721 INFO:tasks.workunit.client.1.smithi136.stdout:2/829: dread d5/d7/d3b/f51 [0,4194304] 0 2024-09-18T12:51:18.721 INFO:tasks.workunit.client.1.smithi136.stdout:8/880: read d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d [1964649,99221] 0 2024-09-18T12:51:18.722 INFO:tasks.workunit.client.1.smithi136.stdout:6/743: dwrite d8/d9/d64/f69 [0,4194304] 0 2024-09-18T12:51:18.722 INFO:tasks.workunit.client.1.smithi136.stdout:0/801: mkdir d1/d3/d1a/d98/d81/d72/de8/d113 0 2024-09-18T12:51:18.723 INFO:tasks.workunit.client.0.smithi081.stdout:8/367: sync 2024-09-18T12:51:18.723 INFO:tasks.workunit.client.0.smithi081.stdout:7/422: sync 2024-09-18T12:51:18.727 INFO:tasks.workunit.client.1.smithi136.stdout:3/736: stat d3/d14/d17/d75/d86/l97 0 2024-09-18T12:51:18.729 INFO:tasks.workunit.client.1.smithi136.stdout:5/860: write d5/d1a/f85 [1962319,112420] 0 2024-09-18T12:51:18.730 INFO:tasks.workunit.client.1.smithi136.stdout:5/861: creat d5/d78/d105/f10e x:0 0 0 2024-09-18T12:51:18.730 INFO:tasks.workunit.client.1.smithi136.stdout:5/862: dread - d5/d1a/d2d/d3f/fa8 zero size 2024-09-18T12:51:18.730 INFO:tasks.workunit.client.1.smithi136.stdout:5/863: chown d5/c69 167 1 2024-09-18T12:51:18.731 INFO:tasks.workunit.client.1.smithi136.stdout:2/830: mkdir d5/d25/d2d/d9d/d118 0 2024-09-18T12:51:18.735 INFO:tasks.workunit.client.0.smithi081.stdout:6/374: write d4/f5c [1482349,24792] 0 2024-09-18T12:51:18.735 INFO:tasks.workunit.client.0.smithi081.stdout:6/375: fdatasync d4/f13 0 2024-09-18T12:51:18.736 INFO:tasks.workunit.client.0.smithi081.stdout:6/376: truncate d4/f75 410683 0 2024-09-18T12:51:18.737 INFO:tasks.workunit.client.1.smithi136.stdout:8/881: symlink d9/d14/d1a/d2b/d42/d9e/l139 0 2024-09-18T12:51:18.737 INFO:tasks.workunit.client.1.smithi136.stdout:8/882: chown d9/d14/d1a/d7f/d8c 0 1 2024-09-18T12:51:18.740 INFO:tasks.workunit.client.1.smithi136.stdout:6/744: unlink d8/d9/de/f28 0 2024-09-18T12:51:18.742 INFO:tasks.workunit.client.0.smithi081.stdout:8/368: dread d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/737: creat d3/d14/d17/d53/d73/dbf/fec x:0 0 0 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/738: chown d3/d10/ce3 44070054 1 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/739: dread - d3/d2b/fba zero size 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/740: chown d3/d10/ce3 40 1 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/741: dread - d3/d14/d18/fe9 zero size 2024-09-18T12:51:18.743 INFO:tasks.workunit.client.1.smithi136.stdout:3/742: readlink d3/d5/d31/l5f 0 2024-09-18T12:51:18.744 INFO:tasks.workunit.client.0.smithi081.stdout:7/423: dread d2/d14/d21/f7e [0,4194304] 0 2024-09-18T12:51:18.744 INFO:tasks.workunit.client.0.smithi081.stdout:8/369: creat d3/f85 x:0 0 0 2024-09-18T12:51:18.744 INFO:tasks.workunit.client.0.smithi081.stdout:8/370: creat d3/f86 x:0 0 0 2024-09-18T12:51:18.746 INFO:tasks.workunit.client.1.smithi136.stdout:0/802: dwrite d1/d3/d1a/d62/d75/fcc [0,4194304] 0 2024-09-18T12:51:18.746 INFO:tasks.workunit.client.1.smithi136.stdout:0/803: write d1/d3/d1a/f33 [1825517,10705] 0 2024-09-18T12:51:18.747 INFO:tasks.workunit.client.1.smithi136.stdout:4/688: dwrite d0/d3/d54/d88/f8f [0,4194304] 0 2024-09-18T12:51:18.747 INFO:tasks.workunit.client.1.smithi136.stdout:5/864: mkdir d5/d1a/d2d/d34/d88/d10f 0 2024-09-18T12:51:18.749 INFO:tasks.workunit.client.1.smithi136.stdout:2/831: creat d5/d4a/d7a/f119 x:0 0 0 2024-09-18T12:51:18.749 INFO:tasks.workunit.client.1.smithi136.stdout:2/832: fdatasync d5/d25/f2e 0 2024-09-18T12:51:18.749 INFO:tasks.workunit.client.1.smithi136.stdout:2/833: write d5/d25/d43/d74/ff5 [511195,102539] 0 2024-09-18T12:51:18.751 INFO:tasks.workunit.client.1.smithi136.stdout:0/804: write d1/d3/d1a/d98/d81/d35/d84/fbe [436439,41042] 0 2024-09-18T12:51:18.752 INFO:tasks.workunit.client.0.smithi081.stdout:6/377: dread d4/d12/d28/d2a/d2d/d31/f3b [0,4194304] 0 2024-09-18T12:51:18.753 INFO:tasks.workunit.client.1.smithi136.stdout:8/883: mkdir d9/d14/d1a/d2b/d42/d13a 0 2024-09-18T12:51:18.753 INFO:tasks.workunit.client.1.smithi136.stdout:8/884: chown d9/d14/d1a/d7f/fa0 952820301 1 2024-09-18T12:51:18.753 INFO:tasks.workunit.client.1.smithi136.stdout:8/885: creat d9/d18/d34/d3d/d47/f13b x:0 0 0 2024-09-18T12:51:18.753 INFO:tasks.workunit.client.1.smithi136.stdout:8/886: readlink d9/d14/d1a/d2b/l3f 0 2024-09-18T12:51:18.753 INFO:tasks.workunit.client.1.smithi136.stdout:6/745: creat d8/d9/d3c/fea x:0 0 0 2024-09-18T12:51:18.754 INFO:tasks.workunit.client.0.smithi081.stdout:6/378: rename d4/d12/d1c/c2b to d4/d12/d28/d2a/c7b 0 2024-09-18T12:51:18.756 INFO:tasks.workunit.client.1.smithi136.stdout:5/865: write d5/d1a/d2d/d34/d4e/d7a/d9e/dad/fdf [741524,92191] 0 2024-09-18T12:51:18.757 INFO:tasks.workunit.client.1.smithi136.stdout:2/834: dread d5/d7/fc6 [0,4194304] 0 2024-09-18T12:51:18.759 INFO:tasks.workunit.client.1.smithi136.stdout:4/689: link d0/d3/l42 d0/d3/d54/dba/ldd 0 2024-09-18T12:51:18.760 INFO:tasks.workunit.client.0.smithi081.stdout:6/379: dread d4/f24 [0,4194304] 0 2024-09-18T12:51:18.760 INFO:tasks.workunit.client.0.smithi081.stdout:6/380: fsync d4/fe 0 2024-09-18T12:51:18.760 INFO:tasks.workunit.client.0.smithi081.stdout:6/381: dread - d4/d12/d28/d2a/f49 zero size 2024-09-18T12:51:18.760 INFO:tasks.workunit.client.0.smithi081.stdout:6/382: chown d4/d12/d28/c69 13 1 2024-09-18T12:51:18.761 INFO:tasks.workunit.client.1.smithi136.stdout:0/805: unlink d1/d3/d1a/f7c 0 2024-09-18T12:51:18.761 INFO:tasks.workunit.client.1.smithi136.stdout:0/806: write d1/d3/d1a/d62/d75/d100/f101 [611827,75341] 0 2024-09-18T12:51:18.761 INFO:tasks.workunit.client.1.smithi136.stdout:0/807: dread - d1/d17/dd1/ff6 zero size 2024-09-18T12:51:18.762 INFO:tasks.workunit.client.1.smithi136.stdout:7/891: truncate d0/d2c/f45 1683362 0 2024-09-18T12:51:18.765 INFO:tasks.workunit.client.1.smithi136.stdout:6/746: mknod d8/d9/de/d60/ceb 0 2024-09-18T12:51:18.767 INFO:tasks.workunit.client.1.smithi136.stdout:7/892: dread d0/d35/d41/d50/d7b/fb6 [0,4194304] 0 2024-09-18T12:51:18.767 INFO:tasks.workunit.client.1.smithi136.stdout:5/866: mknod d5/d1a/d2d/d34/d4e/d9b/c110 0 2024-09-18T12:51:18.767 INFO:tasks.workunit.client.1.smithi136.stdout:5/867: truncate d5/d1a/d2d/d34/d4e/d7a/f82 450746 0 2024-09-18T12:51:18.768 INFO:tasks.workunit.client.1.smithi136.stdout:5/868: write d5/d1a/d2d/d34/f95 [994029,53015] 0 2024-09-18T12:51:18.768 INFO:tasks.workunit.client.0.smithi081.stdout:7/424: dwrite d2/d7f/f88 [0,4194304] 0 2024-09-18T12:51:18.768 INFO:tasks.workunit.client.1.smithi136.stdout:2/835: symlink d5/d7/dbf/dd5/l11a 0 2024-09-18T12:51:18.769 INFO:tasks.workunit.client.1.smithi136.stdout:3/743: dwrite d3/d2b/f92 [0,4194304] 0 2024-09-18T12:51:18.770 INFO:tasks.workunit.client.1.smithi136.stdout:4/690: mknod d0/d25/cde 0 2024-09-18T12:51:18.770 INFO:tasks.workunit.client.1.smithi136.stdout:4/691: chown d0/d3/d54/d5c/c5e 14 1 2024-09-18T12:51:18.770 INFO:tasks.workunit.client.1.smithi136.stdout:4/692: chown d0/d5f/f93 42400022 1 2024-09-18T12:51:18.771 INFO:tasks.workunit.client.1.smithi136.stdout:0/808: mknod d1/db/d76/db9/de5/c114 0 2024-09-18T12:51:18.771 INFO:tasks.workunit.client.1.smithi136.stdout:8/887: dread d9/d18/f48 [0,4194304] 0 2024-09-18T12:51:18.772 INFO:tasks.workunit.client.1.smithi136.stdout:8/888: write d9/d18/d34/d3d/d47/fb7 [1306957,125060] 0 2024-09-18T12:51:18.773 INFO:tasks.workunit.client.1.smithi136.stdout:6/747: symlink d8/d9/d3c/lec 0 2024-09-18T12:51:18.776 INFO:tasks.workunit.client.1.smithi136.stdout:5/869: link d5/d1a/d2d/d34/d4e/d7a/d9e/dad/lff d5/db4/l111 0 2024-09-18T12:51:18.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/425: dread d2/d1d/d27/f50 [0,4194304] 0 2024-09-18T12:51:18.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/426: dread - d2/d14/d21/d62/f70 zero size 2024-09-18T12:51:18.786 INFO:tasks.workunit.client.0.smithi081.stdout:7/427: rename d2/d18/d3c/f99 to d2/d56/d73/f9a 0 2024-09-18T12:51:18.788 INFO:tasks.workunit.client.1.smithi136.stdout:0/809: mkdir d1/db/d76/db9/de5/d115 0 2024-09-18T12:51:18.789 INFO:tasks.workunit.client.1.smithi136.stdout:5/870: creat d5/d1a/d2d/d34/f112 x:0 0 0 2024-09-18T12:51:18.793 INFO:tasks.workunit.client.0.smithi081.stdout:6/383: dwrite d4/d12/d1c/f6b [0,4194304] 0 2024-09-18T12:51:18.794 INFO:tasks.workunit.client.1.smithi136.stdout:4/693: rename d0/d2/d85/da0 to d0/d45/d67/ddf 0 2024-09-18T12:51:18.794 INFO:tasks.workunit.client.1.smithi136.stdout:4/694: stat d0/d3/d90 0 2024-09-18T12:51:18.794 INFO:tasks.workunit.client.1.smithi136.stdout:4/695: stat d0/l78 0 2024-09-18T12:51:18.795 INFO:tasks.workunit.client.1.smithi136.stdout:0/810: rmdir d1/d3/d1a/d98/d81/d70/dbc 39 2024-09-18T12:51:18.797 INFO:tasks.workunit.client.1.smithi136.stdout:4/696: mknod d0/d5f/dd3/ce0 0 2024-09-18T12:51:18.797 INFO:tasks.workunit.client.0.smithi081.stdout:6/384: mknod d4/d12/d1c/d39/d40/c7c 0 2024-09-18T12:51:18.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/385: mkdir d4/d12/d56/d7d 0 2024-09-18T12:51:18.799 INFO:tasks.workunit.client.1.smithi136.stdout:2/836: dwrite d5/d25/f104 [0,4194304] 0 2024-09-18T12:51:18.799 INFO:tasks.workunit.client.1.smithi136.stdout:2/837: creat d5/d7/d17/d48/f11b x:0 0 0 2024-09-18T12:51:18.799 INFO:tasks.workunit.client.1.smithi136.stdout:2/838: creat d5/d4a/d67/f11c x:0 0 0 2024-09-18T12:51:18.799 INFO:tasks.workunit.client.1.smithi136.stdout:8/889: rename d9/d14/d1a/d2b/f2e to d9/d14/d1a/d2b/d42/d104/f13c 0 2024-09-18T12:51:18.801 INFO:tasks.workunit.client.1.smithi136.stdout:4/697: creat d0/d3/dae/fe1 x:0 0 0 2024-09-18T12:51:18.801 INFO:tasks.workunit.client.1.smithi136.stdout:4/698: stat d0/d45/c71 0 2024-09-18T12:51:18.806 INFO:tasks.workunit.client.1.smithi136.stdout:5/871: rename d5/d1a/d2d/d3f/l67 to d5/d1a/d4a/d79/l113 0 2024-09-18T12:51:18.806 INFO:tasks.workunit.client.1.smithi136.stdout:5/872: fdatasync d5/d1a/d2d/d3f/f8a 0 2024-09-18T12:51:18.807 INFO:tasks.workunit.client.1.smithi136.stdout:8/890: mknod d9/d14/d1a/d2b/d42/d6e/d75/c13d 0 2024-09-18T12:51:18.808 INFO:tasks.workunit.client.1.smithi136.stdout:6/748: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:18.808 INFO:tasks.workunit.client.1.smithi136.stdout:7/893: dwrite d0/d2c/d2e/f3f [0,4194304] 0 2024-09-18T12:51:18.809 INFO:tasks.workunit.client.1.smithi136.stdout:7/894: write d0/d12/d5e/d67/fcb [211699,120479] 0 2024-09-18T12:51:18.809 INFO:tasks.workunit.client.1.smithi136.stdout:4/699: symlink d0/d3/d54/dba/le2 0 2024-09-18T12:51:18.811 INFO:tasks.workunit.client.1.smithi136.stdout:0/811: rename d1/d3/d1a/d98/d81/d35/lf1 to d1/db/d76/db9/de5/d115/l116 0 2024-09-18T12:51:18.813 INFO:tasks.workunit.client.1.smithi136.stdout:7/895: symlink d0/d35/d4f/dd5/d94/l142 0 2024-09-18T12:51:18.815 INFO:tasks.workunit.client.1.smithi136.stdout:3/744: dwrite d3/d2b/d6c/db4/fc9 [0,4194304] 0 2024-09-18T12:51:18.816 INFO:tasks.workunit.client.1.smithi136.stdout:2/839: rename d5/d25/d2d/d10f/c110 to d5/d7/d41/d100/c11d 0 2024-09-18T12:51:18.821 INFO:tasks.workunit.client.1.smithi136.stdout:2/840: write d5/fa1 [5164332,51436] 0 2024-09-18T12:51:18.821 INFO:tasks.workunit.client.1.smithi136.stdout:3/745: dread d3/d14/d22/fc1 [0,4194304] 0 2024-09-18T12:51:18.825 INFO:tasks.workunit.client.0.smithi081.stdout:6/386: dwrite d4/d12/d28/d2a/d2d/d31/f67 [0,4194304] 0 2024-09-18T12:51:18.827 INFO:tasks.workunit.client.1.smithi136.stdout:1/732: sync 2024-09-18T12:51:18.828 INFO:tasks.workunit.client.1.smithi136.stdout:1/733: rename d2/d5/f1e to d2/d5/d2b/da9/def/ff3 0 2024-09-18T12:51:18.830 INFO:tasks.workunit.client.1.smithi136.stdout:3/746: dread d3/d10/d4a/d51/fa0 [0,4194304] 0 2024-09-18T12:51:18.830 INFO:tasks.workunit.client.1.smithi136.stdout:3/747: readlink d3/d5/d31/l52 0 2024-09-18T12:51:18.830 INFO:tasks.workunit.client.1.smithi136.stdout:3/748: fsync d3/d10/fe1 0 2024-09-18T12:51:18.830 INFO:tasks.workunit.client.1.smithi136.stdout:3/749: dread - d3/d14/d17/d53/d73/fcc zero size 2024-09-18T12:51:18.832 INFO:tasks.workunit.client.1.smithi136.stdout:6/749: write d8/d9/de/f18 [3297124,45701] 0 2024-09-18T12:51:18.833 INFO:tasks.workunit.client.1.smithi136.stdout:0/812: dread d1/d3/d1a/d98/d81/d35/f42 [0,4194304] 0 2024-09-18T12:51:18.836 INFO:tasks.workunit.client.1.smithi136.stdout:7/896: write d0/d35/d41/d50/d7f/d6b/f75 [976532,118661] 0 2024-09-18T12:51:18.838 INFO:tasks.workunit.client.1.smithi136.stdout:7/897: fdatasync d0/d35/d36/ff 0 2024-09-18T12:51:18.839 INFO:tasks.workunit.client.1.smithi136.stdout:7/898: rmdir d0/d35/d4f/d91/d122 0 2024-09-18T12:51:18.847 INFO:tasks.workunit.client.1.smithi136.stdout:4/700: dwrite d0/d25/f5a [0,4194304] 0 2024-09-18T12:51:18.848 INFO:tasks.workunit.client.1.smithi136.stdout:5/873: dwrite d5/d1a/d2d/fb9 [0,4194304] 0 2024-09-18T12:51:18.850 INFO:tasks.workunit.client.0.smithi081.stdout:7/428: dwrite d2/f13 [4194304,4194304] 0 2024-09-18T12:51:18.850 INFO:tasks.workunit.client.0.smithi081.stdout:6/387: dread d4/d12/f44 [0,4194304] 0 2024-09-18T12:51:18.850 INFO:tasks.workunit.client.0.smithi081.stdout:6/388: chown d4/d12/d1c/f48 52 1 2024-09-18T12:51:18.852 INFO:tasks.workunit.client.1.smithi136.stdout:3/750: write d3/d2b/f4b [23258,53186] 0 2024-09-18T12:51:18.852 INFO:tasks.workunit.client.1.smithi136.stdout:4/701: creat d0/d3/d90/fe3 x:0 0 0 2024-09-18T12:51:18.853 INFO:tasks.workunit.client.1.smithi136.stdout:5/874: symlink d5/d1a/d4a/l114 0 2024-09-18T12:51:18.853 INFO:tasks.workunit.client.0.smithi081.stdout:6/389: link d4/d12/d28/d2a/d2d/c66 d4/d12/d28/c7e 0 2024-09-18T12:51:18.853 INFO:tasks.workunit.client.0.smithi081.stdout:6/390: chown d4/d12/d56/d7d 179529525 1 2024-09-18T12:51:18.854 INFO:tasks.workunit.client.0.smithi081.stdout:7/429: symlink d2/d18/d22/d48/l9b 0 2024-09-18T12:51:18.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/875: truncate d5/d1a/d30/f40 1422325 0 2024-09-18T12:51:18.854 INFO:tasks.workunit.client.1.smithi136.stdout:5/876: fsync d5/d1a/d2d/d34/d88/ff8 0 2024-09-18T12:51:18.855 INFO:tasks.workunit.client.0.smithi081.stdout:6/391: symlink d4/d12/d1c/l7f 0 2024-09-18T12:51:18.856 INFO:tasks.workunit.client.1.smithi136.stdout:5/877: rmdir d5/d1a/dfe 39 2024-09-18T12:51:18.856 INFO:tasks.workunit.client.1.smithi136.stdout:7/899: read d0/d39/d4d/d69/f88 [2879769,89800] 0 2024-09-18T12:51:18.858 INFO:tasks.workunit.client.0.smithi081.stdout:6/392: symlink d4/d12/d28/d2a/l80 0 2024-09-18T12:51:18.858 INFO:tasks.workunit.client.0.smithi081.stdout:6/393: chown d4/d12/d1c/f57 872188 1 2024-09-18T12:51:18.858 INFO:tasks.workunit.client.0.smithi081.stdout:6/394: creat d4/d12/d1c/d64/f81 x:0 0 0 2024-09-18T12:51:18.859 INFO:tasks.workunit.client.0.smithi081.stdout:6/395: fdatasync d4/fa 0 2024-09-18T12:51:18.860 INFO:tasks.workunit.client.1.smithi136.stdout:9/780: sync 2024-09-18T12:51:18.860 INFO:tasks.workunit.client.1.smithi136.stdout:9/781: truncate d6/db/f2c 5031271 0 2024-09-18T12:51:18.860 INFO:tasks.workunit.client.1.smithi136.stdout:5/878: link d5/d1a/d2d/d34/lce d5/d6b/dc3/l115 0 2024-09-18T12:51:18.860 INFO:tasks.workunit.client.1.smithi136.stdout:5/879: stat d5/d1a/d30/f48 0 2024-09-18T12:51:18.862 INFO:tasks.workunit.client.1.smithi136.stdout:7/900: truncate d0/d35/feb 1583834 0 2024-09-18T12:51:18.863 INFO:tasks.workunit.client.1.smithi136.stdout:7/901: fsync d0/d39/d4d/f92 0 2024-09-18T12:51:18.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/782: mknod d6/da/dd1/c10b 0 2024-09-18T12:51:18.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/783: readlink d6/da/d3d/d4d/d91/d25/d55/la4 0 2024-09-18T12:51:18.864 INFO:tasks.workunit.client.1.smithi136.stdout:5/880: truncate d5/d1a/d2d/d3f/fcf 3831819 0 2024-09-18T12:51:18.864 INFO:tasks.workunit.client.1.smithi136.stdout:5/881: read - d5/d1a/d2d/d34/fe7 zero size 2024-09-18T12:51:18.865 INFO:tasks.workunit.client.1.smithi136.stdout:9/784: link d6/da/d3d/f90 d6/df/d23/d2b/d79/d8b/f10c 0 2024-09-18T12:51:18.869 INFO:tasks.workunit.client.1.smithi136.stdout:9/785: mknod d6/df/d75/c10d 0 2024-09-18T12:51:18.869 INFO:tasks.workunit.client.1.smithi136.stdout:9/786: write d6/d13/ff7 [576265,48187] 0 2024-09-18T12:51:18.872 INFO:tasks.workunit.client.1.smithi136.stdout:6/750: dwrite d8/d9/d56/d96/d9c/fd9 [0,4194304] 0 2024-09-18T12:51:18.872 INFO:tasks.workunit.client.1.smithi136.stdout:6/751: stat d8/d9/de/f18 0 2024-09-18T12:51:18.872 INFO:tasks.workunit.client.1.smithi136.stdout:6/752: readlink d8/d9/d3c/l8c 0 2024-09-18T12:51:18.876 INFO:tasks.workunit.client.1.smithi136.stdout:1/734: dwrite d2/d5/d2b/d34/d86/fb8 [0,4194304] 0 2024-09-18T12:51:18.876 INFO:tasks.workunit.client.1.smithi136.stdout:0/813: dwrite d1/d3/d1a/d98/d81/d51/fb4 [0,4194304] 0 2024-09-18T12:51:18.876 INFO:tasks.workunit.client.1.smithi136.stdout:1/735: creat d2/d5/d2b/ff4 x:0 0 0 2024-09-18T12:51:18.878 INFO:tasks.workunit.client.1.smithi136.stdout:6/753: rmdir d8/d9 39 2024-09-18T12:51:18.884 INFO:tasks.workunit.client.1.smithi136.stdout:1/736: symlink d2/d5/d2b/d9b/lf5 0 2024-09-18T12:51:18.884 INFO:tasks.workunit.client.1.smithi136.stdout:6/754: mkdir d8/d9/d56/d96/d9c/ded 0 2024-09-18T12:51:18.887 INFO:tasks.workunit.client.1.smithi136.stdout:6/755: getdents d8/d9/de/d60/d71/d76/d97 0 2024-09-18T12:51:18.887 INFO:tasks.workunit.client.1.smithi136.stdout:6/756: mknod d8/d9/cee 0 2024-09-18T12:51:18.899 INFO:tasks.workunit.client.1.smithi136.stdout:0/814: dread d1/d17/f45 [0,4194304] 0 2024-09-18T12:51:18.899 INFO:tasks.workunit.client.1.smithi136.stdout:0/815: truncate d1/d3/d1a/d98/d81/d35/ddc/f10b 379143 0 2024-09-18T12:51:18.899 INFO:tasks.workunit.client.1.smithi136.stdout:0/816: truncate d1/d17/f97 995050 0 2024-09-18T12:51:18.900 INFO:tasks.workunit.client.1.smithi136.stdout:0/817: symlink d1/d60/dcb/l117 0 2024-09-18T12:51:18.900 INFO:tasks.workunit.client.1.smithi136.stdout:0/818: dread - d1/d3/d1a/d98/d81/d72/fb8 zero size 2024-09-18T12:51:18.900 INFO:tasks.workunit.client.1.smithi136.stdout:0/819: creat d1/d3/d1a/d98/d81/d35/d54/f118 x:0 0 0 2024-09-18T12:51:18.901 INFO:tasks.workunit.client.1.smithi136.stdout:0/820: creat d1/db/d76/f119 x:0 0 0 2024-09-18T12:51:18.926 INFO:tasks.workunit.client.0.smithi081.stdout:7/430: dwrite d2/d18/d22/f2a [0,4194304] 0 2024-09-18T12:51:18.927 INFO:tasks.workunit.client.0.smithi081.stdout:7/431: mkdir d2/d18/d60/d85/d9c 0 2024-09-18T12:51:18.942 INFO:tasks.workunit.client.1.smithi136.stdout:7/902: dwrite d0/d35/d36/fb3 [4194304,4194304] 0 2024-09-18T12:51:18.942 INFO:tasks.workunit.client.1.smithi136.stdout:5/882: dwrite d5/d1a/f8d [0,4194304] 0 2024-09-18T12:51:18.942 INFO:tasks.workunit.client.1.smithi136.stdout:3/751: dwrite d3/d14/d17/d8c/d96/fc0 [0,4194304] 0 2024-09-18T12:51:18.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/702: dwrite d0/d3/d54/dba/fd0 [0,4194304] 0 2024-09-18T12:51:18.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/703: write d0/d25/db7/fc7 [95320,45002] 0 2024-09-18T12:51:18.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/704: write d0/d2/f77 [1876753,96417] 0 2024-09-18T12:51:18.945 INFO:tasks.workunit.client.1.smithi136.stdout:7/903: creat d0/d2c/d2e/dc5/f143 x:0 0 0 2024-09-18T12:51:18.945 INFO:tasks.workunit.client.1.smithi136.stdout:7/904: chown d0/d35/d4f/f78 764 1 2024-09-18T12:51:18.947 INFO:tasks.workunit.client.1.smithi136.stdout:5/883: rename d5/d1a/d2d/d34/d4e/d9b/ld4 to d5/d1a/d2d/d34/d88/l116 0 2024-09-18T12:51:18.947 INFO:tasks.workunit.client.1.smithi136.stdout:5/884: fsync d5/d1a/d2d/fb9 0 2024-09-18T12:51:18.947 INFO:tasks.workunit.client.1.smithi136.stdout:5/885: chown d5/d1a/d2d/d34/d4e/d7a/d9e/dad/cee 5794233 1 2024-09-18T12:51:18.949 INFO:tasks.workunit.client.1.smithi136.stdout:3/752: link d3/d14/d22/d2c/c7c d3/d14/ced 0 2024-09-18T12:51:18.952 INFO:tasks.workunit.client.1.smithi136.stdout:5/886: symlink d5/d1a/d2d/dc4/l117 0 2024-09-18T12:51:18.953 INFO:tasks.workunit.client.1.smithi136.stdout:3/753: getdents d3/d10/d4a 0 2024-09-18T12:51:18.953 INFO:tasks.workunit.client.1.smithi136.stdout:3/754: write d3/d14/d22/f37 [2605373,85930] 0 2024-09-18T12:51:18.953 INFO:tasks.workunit.client.1.smithi136.stdout:3/755: write d3/d14/f40 [1292525,110605] 0 2024-09-18T12:51:18.953 INFO:tasks.workunit.client.1.smithi136.stdout:5/887: read d5/d1a/d4a/d79/f94 [71302,60469] 0 2024-09-18T12:51:18.953 INFO:tasks.workunit.client.1.smithi136.stdout:5/888: creat d5/d1a/d2d/d34/d4e/d9b/f118 x:0 0 0 2024-09-18T12:51:18.954 INFO:tasks.workunit.client.1.smithi136.stdout:5/889: dread - d5/d1a/d2d/f99 zero size 2024-09-18T12:51:18.954 INFO:tasks.workunit.client.1.smithi136.stdout:5/890: write d5/d1a/d4a/d79/f98 [572885,3864] 0 2024-09-18T12:51:18.954 INFO:tasks.workunit.client.1.smithi136.stdout:3/756: unlink d3/d14/cd8 0 2024-09-18T12:51:18.954 INFO:tasks.workunit.client.1.smithi136.stdout:3/757: chown d3/d10 7980 1 2024-09-18T12:51:18.954 INFO:tasks.workunit.client.1.smithi136.stdout:3/758: creat d3/d14/d17/d53/d73/fee x:0 0 0 2024-09-18T12:51:18.956 INFO:tasks.workunit.client.0.smithi081.stdout:6/396: dwrite d4/f5c [0,4194304] 0 2024-09-18T12:51:18.956 INFO:tasks.workunit.client.1.smithi136.stdout:5/891: mknod d5/d1a/d2d/d34/d4e/d7a/d9e/da9/c119 0 2024-09-18T12:51:18.956 INFO:tasks.workunit.client.1.smithi136.stdout:9/787: dwrite d6/df/fe0 [0,4194304] 0 2024-09-18T12:51:18.957 INFO:tasks.workunit.client.1.smithi136.stdout:0/821: dwrite d1/db/d76/f83 [0,4194304] 0 2024-09-18T12:51:18.957 INFO:tasks.workunit.client.0.smithi081.stdout:7/432: dwrite d2/d14/f16 [4194304,4194304] 0 2024-09-18T12:51:18.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/841: dwrite d5/d4a/fe8 [0,4194304] 0 2024-09-18T12:51:18.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/842: creat d5/d4a/d7a/f11e x:0 0 0 2024-09-18T12:51:18.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/843: write d5/d7/d17/f24 [4471744,101296] 0 2024-09-18T12:51:18.958 INFO:tasks.workunit.client.1.smithi136.stdout:2/844: write d5/d7/d17/d48/fd6 [207283,77977] 0 2024-09-18T12:51:18.959 INFO:tasks.workunit.client.1.smithi136.stdout:3/759: symlink d3/lef 0 2024-09-18T12:51:18.959 INFO:tasks.workunit.client.1.smithi136.stdout:3/760: creat d3/d14/d17/d53/d73/ff0 x:0 0 0 2024-09-18T12:51:18.962 INFO:tasks.workunit.client.1.smithi136.stdout:5/892: symlink d5/d1a/d2d/d3f/d7f/dbc/dc8/l11a 0 2024-09-18T12:51:18.962 INFO:tasks.workunit.client.1.smithi136.stdout:5/893: fsync d5/d1a/d2d/d34/f35 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:1/737: dwrite d2/f41 [0,4194304] 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/705: write d0/d2/f16 [3059504,108211] 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/706: write d0/d13/f18 [3886595,85736] 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/707: creat d0/d3/d54/d5c/fe4 x:0 0 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/708: write d0/d3/d54/d88/db1/fdc [602640,89808] 0 2024-09-18T12:51:18.963 INFO:tasks.workunit.client.1.smithi136.stdout:4/709: chown d0/d5f/l96 31 1 2024-09-18T12:51:18.966 INFO:tasks.workunit.client.1.smithi136.stdout:9/788: mkdir d6/d13/d4c/d10e 0 2024-09-18T12:51:18.966 INFO:tasks.workunit.client.0.smithi081.stdout:9/357: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:4/333: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:0/432: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:8/371: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:5/440: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:0/433: dread - d7/d9/d4b/d33/d7d/f8d zero size 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:3/395: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:5/441: read d2/dd/d5e/f3a [30345,18640] 0 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:8/372: creat d3/d2f/f87 x:0 0 0 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:1/492: sync 2024-09-18T12:51:18.967 INFO:tasks.workunit.client.0.smithi081.stdout:2/495: sync 2024-09-18T12:51:18.973 INFO:tasks.workunit.client.0.smithi081.stdout:0/434: creat d7/d9/d4b/d3d/f91 x:0 0 0 2024-09-18T12:51:18.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/396: mknod d3/db/df/d3b/c8d 0 2024-09-18T12:51:18.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/397: chown d3/db/df/d29/d13/c54 168961937 1 2024-09-18T12:51:18.976 INFO:tasks.workunit.client.1.smithi136.stdout:9/789: dread d6/d59/f35 [0,4194304] 0 2024-09-18T12:51:18.976 INFO:tasks.workunit.client.1.smithi136.stdout:9/790: fsync d6/da/d3d/d4d/fa2 0 2024-09-18T12:51:18.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/442: truncate d2/d14/d33/d37/d3b/d6a/f25 3164104 0 2024-09-18T12:51:18.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/443: creat d2/d14/d1d/d1a/f85 x:0 0 0 2024-09-18T12:51:18.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/444: chown d2/d14/d33/d37/d3b/d16/f69 1418053363 1 2024-09-18T12:51:18.983 INFO:tasks.workunit.client.0.smithi081.stdout:2/496: mkdir d15/d16/d33/d53/d7a/d32/d6d/daf 0 2024-09-18T12:51:18.985 INFO:tasks.workunit.client.0.smithi081.stdout:3/398: unlink d3/db/d1b/c89 0 2024-09-18T12:51:18.985 INFO:tasks.workunit.client.0.smithi081.stdout:3/399: readlink d3/l21 0 2024-09-18T12:51:18.986 INFO:tasks.workunit.client.0.smithi081.stdout:5/445: symlink d2/d14/d33/d37/d3b/d16/d56/l86 0 2024-09-18T12:51:18.987 INFO:tasks.workunit.client.0.smithi081.stdout:2/497: mkdir d15/d16/d33/d53/db0 0 2024-09-18T12:51:18.990 INFO:tasks.workunit.client.0.smithi081.stdout:5/446: unlink d2/d14/d33/d37/d3b/d5f/f6e 0 2024-09-18T12:51:18.992 INFO:tasks.workunit.client.0.smithi081.stdout:3/400: rename d3/db/df/d29/d13/f2a to d3/db/dc/d1a/f8e 0 2024-09-18T12:51:18.992 INFO:tasks.workunit.client.1.smithi136.stdout:0/822: symlink d1/db/d76/db9/de5/db5/l11a 0 2024-09-18T12:51:18.993 INFO:tasks.workunit.client.0.smithi081.stdout:5/447: mknod d2/d14/d33/d37/d3b/d6a/d20/c87 0 2024-09-18T12:51:18.993 INFO:tasks.workunit.client.0.smithi081.stdout:5/448: dread - d2/d14/d33/d37/d3b/d16/d56/f65 zero size 2024-09-18T12:51:18.994 INFO:tasks.workunit.client.0.smithi081.stdout:5/449: rename d2/d14/f32 to d2/d14/d33/d37/d3b/d16/d56/f88 0 2024-09-18T12:51:18.994 INFO:tasks.workunit.client.0.smithi081.stdout:5/450: fdatasync d2/d14/d33/d37/d3b/d6a/f25 0 2024-09-18T12:51:18.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/433: dread d2/fe [0,4194304] 0 2024-09-18T12:51:18.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/434: readlink d2/d42/l6f 0 2024-09-18T12:51:19.000 INFO:tasks.workunit.client.1.smithi136.stdout:2/845: symlink d5/d7/d11/de0/l11f 0 2024-09-18T12:51:19.003 INFO:tasks.workunit.client.1.smithi136.stdout:3/761: rmdir d3/d2b/d6c/db4/dbc 0 2024-09-18T12:51:19.004 INFO:tasks.workunit.client.1.smithi136.stdout:5/894: mkdir d5/d1a/dfe/d11b 0 2024-09-18T12:51:19.007 INFO:tasks.workunit.client.1.smithi136.stdout:1/738: link d2/d5/d2b/d9b/d2e/d4c/f45 d2/d5/d2b/d34/d86/ff6 0 2024-09-18T12:51:19.010 INFO:tasks.workunit.client.1.smithi136.stdout:4/710: rename d0/d3/d54/f92 to d0/d5f/dd3/fe5 0 2024-09-18T12:51:19.010 INFO:tasks.workunit.client.1.smithi136.stdout:4/711: write d0/d3/f97 [4686993,95557] 0 2024-09-18T12:51:19.010 INFO:tasks.workunit.client.1.smithi136.stdout:9/791: write d6/da/d3d/d4d/fa2 [1095791,90371] 0 2024-09-18T12:51:19.013 INFO:tasks.workunit.client.1.smithi136.stdout:5/895: creat d5/d1a/d2d/dc4/f11c x:0 0 0 2024-09-18T12:51:19.013 INFO:tasks.workunit.client.1.smithi136.stdout:5/896: stat d5/d1a/d4a/da1/fef 0 2024-09-18T12:51:19.015 INFO:tasks.workunit.client.1.smithi136.stdout:9/792: mkdir d6/df/d23/d10f 0 2024-09-18T12:51:19.018 INFO:tasks.workunit.client.1.smithi136.stdout:0/823: getdents d1/d17/dd1/dff 0 2024-09-18T12:51:19.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/846: write d5/d7/d11/d34/fda [1621384,68067] 0 2024-09-18T12:51:19.018 INFO:tasks.workunit.client.1.smithi136.stdout:2/847: creat d5/d25/f120 x:0 0 0 2024-09-18T12:51:19.020 INFO:tasks.workunit.client.1.smithi136.stdout:5/897: mknod d5/d1a/c11d 0 2024-09-18T12:51:19.024 INFO:tasks.workunit.client.1.smithi136.stdout:2/848: unlink d5/d7/d17/d48/db1/lbb 0 2024-09-18T12:51:19.029 INFO:tasks.workunit.client.1.smithi136.stdout:2/849: dread d5/d4a/d67/fb4 [0,4194304] 0 2024-09-18T12:51:19.054 INFO:tasks.workunit.client.0.smithi081.stdout:3/401: dread f1 [0,4194304] 0 2024-09-18T12:51:19.055 INFO:tasks.workunit.client.0.smithi081.stdout:3/402: dread d3/db/df/d29/d13/f4c [0,4194304] 0 2024-09-18T12:51:19.057 INFO:tasks.workunit.client.0.smithi081.stdout:3/403: truncate d3/db/dc/d1a/f6a 4118267 0 2024-09-18T12:51:19.057 INFO:tasks.workunit.client.0.smithi081.stdout:3/404: write d3/db/df/d29/d12/d44/d51/f63 [899869,118257] 0 2024-09-18T12:51:19.057 INFO:tasks.workunit.client.0.smithi081.stdout:3/405: chown d3/db/df/d29/d12/d44/f62 7 1 2024-09-18T12:51:19.058 INFO:tasks.workunit.client.0.smithi081.stdout:3/406: creat d3/db/df/d29/d13/f8f x:0 0 0 2024-09-18T12:51:19.058 INFO:tasks.workunit.client.0.smithi081.stdout:3/407: stat d3/db/dc/l10 0 2024-09-18T12:51:19.086 INFO:tasks.workunit.client.0.smithi081.stdout:4/334: dwrite d3/db/f36 [4194304,4194304] 0 2024-09-18T12:51:19.087 INFO:tasks.workunit.client.0.smithi081.stdout:4/335: mknod d3/d20/d3d/d65/d45/d6c/c70 0 2024-09-18T12:51:19.094 INFO:tasks.workunit.client.0.smithi081.stdout:4/336: write d3/d20/d5b/f66 [842434,89932] 0 2024-09-18T12:51:19.095 INFO:tasks.workunit.client.0.smithi081.stdout:4/337: rmdir d3/d20/d3d/d65/d2f 39 2024-09-18T12:51:19.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/338: symlink d3/d20/d3d/d65/d45/d4f/l71 0 2024-09-18T12:51:19.097 INFO:tasks.workunit.client.0.smithi081.stdout:4/339: symlink d3/d20/d3d/d65/d14/d27/l72 0 2024-09-18T12:51:19.097 INFO:tasks.workunit.client.0.smithi081.stdout:4/340: chown d3/d20/d3d/d65/d45/d6c 21176 1 2024-09-18T12:51:19.098 INFO:tasks.workunit.client.0.smithi081.stdout:4/341: unlink d3/f1b 0 2024-09-18T12:51:19.099 INFO:tasks.workunit.client.0.smithi081.stdout:4/342: mknod d3/d20/d3d/d65/d14/d4b/c73 0 2024-09-18T12:51:19.099 INFO:tasks.workunit.client.0.smithi081.stdout:4/343: chown d3/d20/d3d/d65 858106 1 2024-09-18T12:51:19.100 INFO:tasks.workunit.client.0.smithi081.stdout:4/344: creat d3/d20/d3d/d65/d14/d4b/f74 x:0 0 0 2024-09-18T12:51:19.101 INFO:tasks.workunit.client.0.smithi081.stdout:4/345: symlink d3/d20/d3d/d65/d14/l75 0 2024-09-18T12:51:19.102 INFO:tasks.workunit.client.0.smithi081.stdout:4/346: creat d3/db/d35/f76 x:0 0 0 2024-09-18T12:51:19.102 INFO:tasks.workunit.client.0.smithi081.stdout:4/347: truncate d3/d20/d3d/d65/d14/f31 2695818 0 2024-09-18T12:51:19.106 INFO:tasks.workunit.client.1.smithi136.stdout:7/905: dwrite d0/d35/d4f/f82 [0,4194304] 0 2024-09-18T12:51:19.106 INFO:tasks.workunit.client.1.smithi136.stdout:4/712: dread d0/d3/f4 [0,4194304] 0 2024-09-18T12:51:19.107 INFO:tasks.workunit.client.1.smithi136.stdout:7/906: symlink d0/d35/d41/dfe/l144 0 2024-09-18T12:51:19.107 INFO:tasks.workunit.client.1.smithi136.stdout:7/907: chown d0/d2c/d2e/f32 47663550 1 2024-09-18T12:51:19.107 INFO:tasks.workunit.client.1.smithi136.stdout:7/908: chown d0/d35/d4f/dd5/l8f 992404009 1 2024-09-18T12:51:19.109 INFO:tasks.workunit.client.1.smithi136.stdout:4/713: rmdir d0/d45/d67/ddf/dcf 0 2024-09-18T12:51:19.109 INFO:tasks.workunit.client.1.smithi136.stdout:4/714: write d0/d3/f3b [1005145,62419] 0 2024-09-18T12:51:19.109 INFO:tasks.workunit.client.1.smithi136.stdout:7/909: mkdir d0/d35/d41/d50/d7f/d3b/d145 0 2024-09-18T12:51:19.110 INFO:tasks.workunit.client.1.smithi136.stdout:7/910: mkdir d0/d35/d4f/d107/d146 0 2024-09-18T12:51:19.114 INFO:tasks.workunit.client.1.smithi136.stdout:7/911: rename d0/d35/d36 to d0/d12/d1a/d46/d147 0 2024-09-18T12:51:19.118 INFO:tasks.workunit.client.0.smithi081.stdout:9/358: dwrite f7 [4194304,4194304] 0 2024-09-18T12:51:19.119 INFO:tasks.workunit.client.0.smithi081.stdout:9/359: stat dd/d1d/d1e/d2f/c58 0 2024-09-18T12:51:19.120 INFO:tasks.workunit.client.0.smithi081.stdout:9/360: mkdir dd/de/d7a 0 2024-09-18T12:51:19.121 INFO:tasks.workunit.client.0.smithi081.stdout:9/361: truncate dd/d15/d1a/f22 2062546 0 2024-09-18T12:51:19.124 INFO:tasks.workunit.client.0.smithi081.stdout:9/362: symlink dd/d1d/d1e/d24/l7b 0 2024-09-18T12:51:19.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/397: dwrite d4/d12/d1c/d39/d60/f6e [0,4194304] 0 2024-09-18T12:51:19.124 INFO:tasks.workunit.client.0.smithi081.stdout:6/398: fdatasync d4/fa 0 2024-09-18T12:51:19.125 INFO:tasks.workunit.client.0.smithi081.stdout:1/493: dwrite d0/db/f2b [0,4194304] 0 2024-09-18T12:51:19.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/399: link d4/d12/d1c/f57 d4/d12/d28/d2a/d2d/f82 0 2024-09-18T12:51:19.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/400: readlink d4/d12/d1c/d64/l6a 0 2024-09-18T12:51:19.150 INFO:tasks.workunit.client.0.smithi081.stdout:8/373: dwrite d3/f15 [0,4194304] 0 2024-09-18T12:51:19.151 INFO:tasks.workunit.client.1.smithi136.stdout:0/824: getdents d1/db/d76/db9/de5/db5 0 2024-09-18T12:51:19.151 INFO:tasks.workunit.client.1.smithi136.stdout:0/825: fsync d1/d3/f7b 0 2024-09-18T12:51:19.151 INFO:tasks.workunit.client.1.smithi136.stdout:3/762: dwrite d3/d14/d17/d8c/d96/f9c [4194304,4194304] 0 2024-09-18T12:51:19.153 INFO:tasks.workunit.client.1.smithi136.stdout:0/826: creat d1/d3/d1a/d98/d81/d72/f11b x:0 0 0 2024-09-18T12:51:19.155 INFO:tasks.workunit.client.1.smithi136.stdout:0/827: getdents d1/d3/d1a/d62 0 2024-09-18T12:51:19.156 INFO:tasks.workunit.client.1.smithi136.stdout:0/828: write d1/d3/d1a/fce [957367,50659] 0 2024-09-18T12:51:19.156 INFO:tasks.workunit.client.1.smithi136.stdout:0/829: write d1/d3/d1a/d98/d81/d35/d84/fbe [641717,38911] 0 2024-09-18T12:51:19.157 INFO:tasks.workunit.client.1.smithi136.stdout:0/830: truncate d1/db/f3e 237855 0 2024-09-18T12:51:19.162 INFO:tasks.workunit.client.0.smithi081.stdout:5/451: rename d2/d14/d33/d37/d3b/d16/d56 to d2/d14/d33/d37/d3b/d5f/d89 0 2024-09-18T12:51:19.163 INFO:tasks.workunit.client.1.smithi136.stdout:3/763: write d3/d14/d17/d53/f89 [2549876,17855] 0 2024-09-18T12:51:19.163 INFO:tasks.workunit.client.1.smithi136.stdout:3/764: creat d3/d5/d3c/ff1 x:0 0 0 2024-09-18T12:51:19.164 INFO:tasks.workunit.client.0.smithi081.stdout:4/348: rename d3/db/d2d/l4d to d3/d20/d3d/d65/d45/d6c/l77 0 2024-09-18T12:51:19.166 INFO:tasks.workunit.client.0.smithi081.stdout:9/363: rename dd/d1d/d1e/c6e to dd/de/d7a/c7c 0 2024-09-18T12:51:19.166 INFO:tasks.workunit.client.0.smithi081.stdout:9/364: write dd/d1d/d1e/d24/d2a/f2c [12952,75178] 0 2024-09-18T12:51:19.167 INFO:tasks.workunit.client.0.smithi081.stdout:9/365: chown dd/d1d/d1e/d39/f5d 21 1 2024-09-18T12:51:19.167 INFO:tasks.workunit.client.1.smithi136.stdout:3/765: mkdir d3/d14/d17/d75/d86/dd9/df2 0 2024-09-18T12:51:19.167 INFO:tasks.workunit.client.0.smithi081.stdout:4/349: rmdir d3/d20/d3d/d65/d45/d4f 39 2024-09-18T12:51:19.170 INFO:tasks.workunit.client.1.smithi136.stdout:3/766: rename d3/d14/d17/d8c/d96/cdc to d3/d14/d17/d53/de8/cf3 0 2024-09-18T12:51:19.170 INFO:tasks.workunit.client.0.smithi081.stdout:9/366: symlink dd/d15/l7d 0 2024-09-18T12:51:19.170 INFO:tasks.workunit.client.0.smithi081.stdout:9/367: chown dd/de/d4f/f75 54 1 2024-09-18T12:51:19.171 INFO:tasks.workunit.client.0.smithi081.stdout:4/350: link d3/d20/d3d/d65/d2f/c56 d3/db/d2d/c78 0 2024-09-18T12:51:19.171 INFO:tasks.workunit.client.0.smithi081.stdout:9/368: mknod dd/d1d/d1e/d77/c7e 0 2024-09-18T12:51:19.172 INFO:tasks.workunit.client.1.smithi136.stdout:3/767: dread d3/d14/d18/f88 [0,4194304] 0 2024-09-18T12:51:19.172 INFO:tasks.workunit.client.1.smithi136.stdout:3/768: stat d3/d14/cc8 0 2024-09-18T12:51:19.173 INFO:tasks.workunit.client.0.smithi081.stdout:4/351: mkdir d3/db/d35/d79 0 2024-09-18T12:51:19.173 INFO:tasks.workunit.client.0.smithi081.stdout:4/352: fsync d3/d20/d3d/d65/d14/d54/f57 0 2024-09-18T12:51:19.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/369: mknod dd/d1d/d1e/c7f 0 2024-09-18T12:51:19.173 INFO:tasks.workunit.client.0.smithi081.stdout:4/353: truncate d3/d20/d3d/d65/d14/d27/f3a 4045506 0 2024-09-18T12:51:19.174 INFO:tasks.workunit.client.1.smithi136.stdout:3/769: creat d3/ff4 x:0 0 0 2024-09-18T12:51:19.174 INFO:tasks.workunit.client.1.smithi136.stdout:3/770: fsync d3/f9 0 2024-09-18T12:51:19.174 INFO:tasks.workunit.client.1.smithi136.stdout:3/771: fdatasync d3/d2b/f4b 0 2024-09-18T12:51:19.174 INFO:tasks.workunit.client.1.smithi136.stdout:3/772: creat d3/d14/d17/d53/d73/dbf/ff5 x:0 0 0 2024-09-18T12:51:19.174 INFO:tasks.workunit.client.0.smithi081.stdout:9/370: mkdir dd/d15/d1a/d3d/d80 0 2024-09-18T12:51:19.175 INFO:tasks.workunit.client.0.smithi081.stdout:4/354: write d3/db/f25 [408474,94600] 0 2024-09-18T12:51:19.177 INFO:tasks.workunit.client.0.smithi081.stdout:3/408: dwrite d3/db/df/d29/d12/d44/f62 [0,4194304] 0 2024-09-18T12:51:19.177 INFO:tasks.workunit.client.1.smithi136.stdout:3/773: getdents d3/d14/d17 0 2024-09-18T12:51:19.179 INFO:tasks.workunit.client.1.smithi136.stdout:9/793: dwrite d6/da/d3d/f90 [0,4194304] 0 2024-09-18T12:51:19.179 INFO:tasks.workunit.client.1.smithi136.stdout:1/739: dwrite d2/d5/f73 [0,4194304] 0 2024-09-18T12:51:19.179 INFO:tasks.workunit.client.1.smithi136.stdout:9/794: fsync d6/df/d23/d2b/d79/d8b/f10c 0 2024-09-18T12:51:19.179 INFO:tasks.workunit.client.1.smithi136.stdout:9/795: truncate d6/ff6 778979 0 2024-09-18T12:51:19.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/409: rename d3/db/c40 to d3/db/df/d29/c90 0 2024-09-18T12:51:19.180 INFO:tasks.workunit.client.0.smithi081.stdout:7/435: dwrite d2/d1d/d27/f2e [0,4194304] 0 2024-09-18T12:51:19.180 INFO:tasks.workunit.client.0.smithi081.stdout:7/436: chown d2/d1d/l37 96373 1 2024-09-18T12:51:19.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/437: readlink d2/d42/l6f 0 2024-09-18T12:51:19.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/438: dread - d2/d18/d22/f6e zero size 2024-09-18T12:51:19.181 INFO:tasks.workunit.client.0.smithi081.stdout:3/410: mkdir d3/db/df/d29/d12/d44/d51/d91 0 2024-09-18T12:51:19.181 INFO:tasks.workunit.client.1.smithi136.stdout:4/715: dwrite d0/d13/fc0 [0,4194304] 0 2024-09-18T12:51:19.182 INFO:tasks.workunit.client.1.smithi136.stdout:4/716: fdatasync d0/d25/d83/f9e 0 2024-09-18T12:51:19.183 INFO:tasks.workunit.client.0.smithi081.stdout:0/435: dwrite d7/f80 [0,4194304] 0 2024-09-18T12:51:19.183 INFO:tasks.workunit.client.0.smithi081.stdout:0/436: write d7/d9/d4b/f63 [1078631,71826] 0 2024-09-18T12:51:19.183 INFO:tasks.workunit.client.0.smithi081.stdout:0/437: read - d7/d9/d4b/d33/d7d/f88 zero size 2024-09-18T12:51:19.184 INFO:tasks.workunit.client.1.smithi136.stdout:9/796: write d6/da/fd [4441051,32089] 0 2024-09-18T12:51:19.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/439: rename d2/c8b to d2/d7f/c9d 0 2024-09-18T12:51:19.187 INFO:tasks.workunit.client.0.smithi081.stdout:3/411: creat d3/db/df/d29/d12/f92 x:0 0 0 2024-09-18T12:51:19.187 INFO:tasks.workunit.client.0.smithi081.stdout:3/412: write d3/db/dc/d1a/f8e [629868,20944] 0 2024-09-18T12:51:19.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/438: mkdir d7/d9/d4b/d4a/d92 0 2024-09-18T12:51:19.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/439: creat d7/f93 x:0 0 0 2024-09-18T12:51:19.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/440: chown d7/d9/d4b/d33/l66 109 1 2024-09-18T12:51:19.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/441: write d7/d9/f3e [4239547,109682] 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:2/498: dwrite fd [0,4194304] 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:2/499: chown c8 2 1 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:2/500: fdatasync d15/d16/d20/d22/d8c/f7d 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:2/501: fsync d15/d16/d20/fa5 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:2/502: dread - d15/d16/d20/d22/d8c/f7c zero size 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:9/371: dread f0 [0,4194304] 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/440: rename d2/l5 to d2/d56/d73/d90/l9e 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/441: chown d2/d18/d22/f6e 65497709 1 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/442: creat d2/d18/d22/d48/f9f x:0 0 0 2024-09-18T12:51:19.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/443: dread - d2/f3a zero size 2024-09-18T12:51:19.198 INFO:tasks.workunit.client.0.smithi081.stdout:3/413: truncate d3/db/df/d3b/d47/f2f 1017723 0 2024-09-18T12:51:19.198 INFO:tasks.workunit.client.0.smithi081.stdout:3/414: fsync d3/db/df/d3b/d47/f7a 0 2024-09-18T12:51:19.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/503: mknod d15/d16/d33/d53/d7a/d2f/d61/d97/cb1 0 2024-09-18T12:51:19.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/504: chown d15/d16/d20/d22/d8c 243 1 2024-09-18T12:51:19.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/505: chown d15/d16/d20/d22/f2a 225 1 2024-09-18T12:51:19.203 INFO:tasks.workunit.client.0.smithi081.stdout:9/372: creat dd/d15/d1a/f81 x:0 0 0 2024-09-18T12:51:19.203 INFO:tasks.workunit.client.0.smithi081.stdout:9/373: chown dd/d1d/d1e/d24/d48/c70 1015471 1 2024-09-18T12:51:19.203 INFO:tasks.workunit.client.0.smithi081.stdout:9/374: creat dd/d1d/d1e/d24/f82 x:0 0 0 2024-09-18T12:51:19.203 INFO:tasks.workunit.client.0.smithi081.stdout:9/375: creat dd/d1d/d1e/d2f/f83 x:0 0 0 2024-09-18T12:51:19.203 INFO:tasks.workunit.client.0.smithi081.stdout:9/376: creat dd/de/d59/f84 x:0 0 0 2024-09-18T12:51:19.204 INFO:tasks.workunit.client.0.smithi081.stdout:9/377: stat dd/d1d/d1e/d24/d48 0 2024-09-18T12:51:19.204 INFO:tasks.workunit.client.0.smithi081.stdout:9/378: chown dd/de/d7a 1 1 2024-09-18T12:51:19.205 INFO:tasks.workunit.client.0.smithi081.stdout:7/444: creat d2/d14/fa0 x:0 0 0 2024-09-18T12:51:19.206 INFO:tasks.workunit.client.0.smithi081.stdout:3/415: mkdir d3/db/df/d29/d13/d93 0 2024-09-18T12:51:19.209 INFO:tasks.workunit.client.0.smithi081.stdout:2/506: rename d15/d16/f23 to d15/d16/d33/d53/fb2 0 2024-09-18T12:51:19.209 INFO:tasks.workunit.client.0.smithi081.stdout:2/507: dread - d15/d16/d20/fa4 zero size 2024-09-18T12:51:19.212 INFO:tasks.workunit.client.0.smithi081.stdout:3/416: creat d3/db/d1b/f94 x:0 0 0 2024-09-18T12:51:19.212 INFO:tasks.workunit.client.0.smithi081.stdout:3/417: creat d3/db/df/d29/d13/f95 x:0 0 0 2024-09-18T12:51:19.212 INFO:tasks.workunit.client.0.smithi081.stdout:3/418: chown d3/db/dc/d1a/l67 113577 1 2024-09-18T12:51:19.213 INFO:tasks.workunit.client.0.smithi081.stdout:9/379: rename dd/d1d/d1e/d24/d48/d6d to dd/d1d/d1e/d24/d2a/d55/d85 0 2024-09-18T12:51:19.216 INFO:tasks.workunit.client.1.smithi136.stdout:2/850: dwrite f3 [0,4194304] 0 2024-09-18T12:51:19.217 INFO:tasks.workunit.client.1.smithi136.stdout:7/912: dwrite d0/d35/d41/d50/d5a/d98/dd0/fed [0,4194304] 0 2024-09-18T12:51:19.217 INFO:tasks.workunit.client.1.smithi136.stdout:7/913: dread - d0/d35/d4f/dd5/fdb zero size 2024-09-18T12:51:19.219 INFO:tasks.workunit.client.1.smithi136.stdout:2/851: link d5/d7/d11/d34/f50 d5/d7/d17/f121 0 2024-09-18T12:51:19.220 INFO:tasks.workunit.client.1.smithi136.stdout:7/914: creat d0/d35/d41/dfe/d10c/f148 x:0 0 0 2024-09-18T12:51:19.220 INFO:tasks.workunit.client.1.smithi136.stdout:7/915: write d0/d39/d4d/f9c [1132387,84856] 0 2024-09-18T12:51:19.221 INFO:tasks.workunit.client.1.smithi136.stdout:2/852: mknod d5/d25/d43/c122 0 2024-09-18T12:51:19.221 INFO:tasks.workunit.client.1.smithi136.stdout:2/853: getdents d5/d4a/d64 0 2024-09-18T12:51:19.222 INFO:tasks.workunit.client.1.smithi136.stdout:2/854: mkdir d5/d7/d3b/df7/d123 0 2024-09-18T12:51:19.223 INFO:tasks.workunit.client.1.smithi136.stdout:7/916: rmdir d0/d12/d5e/d10d 39 2024-09-18T12:51:19.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/855: symlink d5/d4a/l124 0 2024-09-18T12:51:19.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/856: fsync d5/d25/d43/f52 0 2024-09-18T12:51:19.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/857: readlink d5/d7/d17/l61 0 2024-09-18T12:51:19.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/858: creat d5/d4a/d7a/f125 x:0 0 0 2024-09-18T12:51:19.224 INFO:tasks.workunit.client.1.smithi136.stdout:2/859: write d5/d25/d2d/d9d/f107 [942595,20641] 0 2024-09-18T12:51:19.225 INFO:tasks.workunit.client.1.smithi136.stdout:7/917: rmdir d0/d10a 0 2024-09-18T12:51:19.225 INFO:tasks.workunit.client.1.smithi136.stdout:7/918: fsync d0/d35/d4f/dd5/fda 0 2024-09-18T12:51:19.225 INFO:tasks.workunit.client.1.smithi136.stdout:7/919: readlink d0/d12/d1a/lad 0 2024-09-18T12:51:19.226 INFO:tasks.workunit.client.1.smithi136.stdout:2/860: unlink d5/d7/d17/fc7 0 2024-09-18T12:51:19.234 INFO:tasks.workunit.client.0.smithi081.stdout:1/494: dwrite d0/d6/d33/f61 [4194304,4194304] 0 2024-09-18T12:51:19.234 INFO:tasks.workunit.client.0.smithi081.stdout:6/401: dwrite d4/d12/d1c/f48 [0,4194304] 0 2024-09-18T12:51:19.235 INFO:tasks.workunit.client.0.smithi081.stdout:6/402: dread d4/d12/d28/d2a/d2d/d31/f3d [0,4194304] 0 2024-09-18T12:51:19.235 INFO:tasks.workunit.client.0.smithi081.stdout:6/403: fsync d4/f24 0 2024-09-18T12:51:19.236 INFO:tasks.workunit.client.0.smithi081.stdout:1/495: mkdir d0/db/d4f/dab 0 2024-09-18T12:51:19.236 INFO:tasks.workunit.client.0.smithi081.stdout:1/496: chown d0/db/f65 8080018 1 2024-09-18T12:51:19.237 INFO:tasks.workunit.client.1.smithi136.stdout:7/920: dread d0/d2c/f48 [0,4194304] 0 2024-09-18T12:51:19.237 INFO:tasks.workunit.client.1.smithi136.stdout:7/921: creat d0/d35/d4f/d91/f149 x:0 0 0 2024-09-18T12:51:19.237 INFO:tasks.workunit.client.1.smithi136.stdout:7/922: creat d0/d35/d41/d50/d5a/d98/f14a x:0 0 0 2024-09-18T12:51:19.238 INFO:tasks.workunit.client.1.smithi136.stdout:7/923: write d0/d35/d41/d50/faf [83611,102012] 0 2024-09-18T12:51:19.238 INFO:tasks.workunit.client.0.smithi081.stdout:6/404: rmdir d4/d12/d1c/d39/d60 39 2024-09-18T12:51:19.239 INFO:tasks.workunit.client.0.smithi081.stdout:6/405: symlink d4/d12/d1c/d39/d73/l83 0 2024-09-18T12:51:19.240 INFO:tasks.workunit.client.1.smithi136.stdout:7/924: creat d0/d39/d4d/d55/d101/f14b x:0 0 0 2024-09-18T12:51:19.240 INFO:tasks.workunit.client.1.smithi136.stdout:7/925: write d0/d35/d41/d50/d7b/fb6 [3338545,87859] 0 2024-09-18T12:51:19.240 INFO:tasks.workunit.client.1.smithi136.stdout:7/926: write d0/d12/d5e/d67/f104 [983103,37861] 0 2024-09-18T12:51:19.241 INFO:tasks.workunit.client.0.smithi081.stdout:6/406: write d4/d12/f32 [977985,6969] 0 2024-09-18T12:51:19.241 INFO:tasks.workunit.client.0.smithi081.stdout:6/407: mkdir d4/d12/d56/d7d/d84 0 2024-09-18T12:51:19.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/508: dread d15/d16/d33/d53/d7a/d2f/d61/f80 [0,4194304] 0 2024-09-18T12:51:19.260 INFO:tasks.workunit.client.0.smithi081.stdout:8/374: dwrite d3/d1d/d4a/d7f/f84 [0,4194304] 0 2024-09-18T12:51:19.265 INFO:tasks.workunit.client.0.smithi081.stdout:9/380: dread dd/d1d/d1e/f29 [0,4194304] 0 2024-09-18T12:51:19.265 INFO:tasks.workunit.client.0.smithi081.stdout:9/381: chown dd/de/c28 0 1 2024-09-18T12:51:19.267 INFO:tasks.workunit.client.1.smithi136.stdout:2/861: dread d5/d7/f3f [0,4194304] 0 2024-09-18T12:51:19.267 INFO:tasks.workunit.client.1.smithi136.stdout:2/862: write d5/d25/d43/d74/f76 [513556,12415] 0 2024-09-18T12:51:19.282 INFO:tasks.workunit.client.0.smithi081.stdout:5/452: dwrite d2/d47/f58 [0,4194304] 0 2024-09-18T12:51:19.282 INFO:tasks.workunit.client.0.smithi081.stdout:5/453: truncate d2/d47/f76 291429 0 2024-09-18T12:51:19.283 INFO:tasks.workunit.client.0.smithi081.stdout:5/454: truncate d2/fe 2196368 0 2024-09-18T12:51:19.283 INFO:tasks.workunit.client.0.smithi081.stdout:5/455: readlink d2/d14/d1d/l62 0 2024-09-18T12:51:19.287 INFO:tasks.workunit.client.1.smithi136.stdout:2/863: creat d5/d4a/d7a/f126 x:0 0 0 2024-09-18T12:51:19.288 INFO:tasks.workunit.client.0.smithi081.stdout:4/355: fdatasync d3/d20/d5b/f66 0 2024-09-18T12:51:19.288 INFO:tasks.workunit.client.1.smithi136.stdout:3/774: dwrite d3/d14/d17/d75/d87/fc3 [4194304,4194304] 0 2024-09-18T12:51:19.289 INFO:tasks.workunit.client.1.smithi136.stdout:0/831: dwrite d1/d3/d1a/d62/d75/fcc [4194304,4194304] 0 2024-09-18T12:51:19.306 INFO:tasks.workunit.client.0.smithi081.stdout:9/382: write f8 [3886886,43107] 0 2024-09-18T12:51:19.306 INFO:tasks.workunit.client.0.smithi081.stdout:9/383: read dd/d1b/f34 [786729,30825] 0 2024-09-18T12:51:19.306 INFO:tasks.workunit.client.0.smithi081.stdout:9/384: readlink dd/d1d/d1e/d24/l7b 0 2024-09-18T12:51:19.307 INFO:tasks.workunit.client.0.smithi081.stdout:9/385: link dd/l25 dd/l86 0 2024-09-18T12:51:19.312 INFO:tasks.workunit.client.0.smithi081.stdout:0/442: dwrite d7/d9/d4b/d4a/f29 [4194304,4194304] 0 2024-09-18T12:51:19.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/717: dwrite d0/f6a [0,4194304] 0 2024-09-18T12:51:19.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/718: creat d0/d3/dae/fe6 x:0 0 0 2024-09-18T12:51:19.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/719: creat d0/d3/dae/fe7 x:0 0 0 2024-09-18T12:51:19.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/720: write d0/d13/f69 [2820859,70807] 0 2024-09-18T12:51:19.313 INFO:tasks.workunit.client.1.smithi136.stdout:4/721: chown d0/d5f/dd3 0 1 2024-09-18T12:51:19.315 INFO:tasks.workunit.client.0.smithi081.stdout:0/443: mknod d7/d5d/c94 0 2024-09-18T12:51:19.319 INFO:tasks.workunit.client.0.smithi081.stdout:9/386: dread dd/d1b/f34 [4194304,4194304] 0 2024-09-18T12:51:19.320 INFO:tasks.workunit.client.0.smithi081.stdout:9/387: truncate dd/d15/d1a/f22 624424 0 2024-09-18T12:51:19.325 INFO:tasks.workunit.client.1.smithi136.stdout:8/891: sync 2024-09-18T12:51:19.325 INFO:tasks.workunit.client.1.smithi136.stdout:6/757: sync 2024-09-18T12:51:19.325 INFO:tasks.workunit.client.1.smithi136.stdout:6/758: write d8/dc/f4f [931822,9451] 0 2024-09-18T12:51:19.325 INFO:tasks.workunit.client.1.smithi136.stdout:6/759: chown d8/d9/d3c/fe4 2275046 1 2024-09-18T12:51:19.326 INFO:tasks.workunit.client.0.smithi081.stdout:9/388: dread f0 [0,4194304] 0 2024-09-18T12:51:19.326 INFO:tasks.workunit.client.0.smithi081.stdout:7/445: dwrite d2/d18/d22/f95 [0,4194304] 0 2024-09-18T12:51:19.326 INFO:tasks.workunit.client.0.smithi081.stdout:5/456: dwrite d2/d14/d1d/d1a/f2b [0,4194304] 0 2024-09-18T12:51:19.326 INFO:tasks.workunit.client.0.smithi081.stdout:5/457: write d2/d14/d33/d37/f50 [4036513,27148] 0 2024-09-18T12:51:19.326 INFO:tasks.workunit.client.1.smithi136.stdout:7/927: dwrite d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:51:19.327 INFO:tasks.workunit.client.0.smithi081.stdout:9/389: symlink dd/d1d/d1e/d24/d2a/d55/l87 0 2024-09-18T12:51:19.327 INFO:tasks.workunit.client.0.smithi081.stdout:9/390: truncate dd/f20 451615 0 2024-09-18T12:51:19.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/497: dwrite d0/d6/f1b [0,4194304] 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/375: dwrite d3/d1e/f34 [4194304,4194304] 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/376: creat d3/d1d/d4a/d7f/f88 x:0 0 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/377: fsync d3/d1d/d4a/d7f/f84 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/378: write d3/d1e/f2b [3244314,6183] 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/379: read d3/f32 [2351410,21352] 0 2024-09-18T12:51:19.329 INFO:tasks.workunit.client.0.smithi081.stdout:6/408: dwrite d4/d12/d28/d2a/d2d/d31/f51 [0,4194304] 0 2024-09-18T12:51:19.332 INFO:tasks.workunit.client.0.smithi081.stdout:7/446: symlink d2/d18/d22/d48/la1 0 2024-09-18T12:51:19.336 INFO:tasks.workunit.client.0.smithi081.stdout:3/419: dread d3/db/df/d29/d12/d44/d51/f63 [0,4194304] 0 2024-09-18T12:51:19.336 INFO:tasks.workunit.client.0.smithi081.stdout:3/420: chown d3/l32 35162268 1 2024-09-18T12:51:19.338 INFO:tasks.workunit.client.0.smithi081.stdout:5/458: link d2/dd/d5e/f40 d2/d47/f8a 0 2024-09-18T12:51:19.340 INFO:tasks.workunit.client.1.smithi136.stdout:2/864: mkdir d5/d7/d3b/df7/d127 0 2024-09-18T12:51:19.340 INFO:tasks.workunit.client.1.smithi136.stdout:2/865: chown d5/d7/d11/d34/f50 461795 1 2024-09-18T12:51:19.340 INFO:tasks.workunit.client.0.smithi081.stdout:9/391: creat dd/d1d/d1e/d24/d2a/f88 x:0 0 0 2024-09-18T12:51:19.342 INFO:tasks.workunit.client.0.smithi081.stdout:1/498: symlink d0/d6/d33/lac 0 2024-09-18T12:51:19.343 INFO:tasks.workunit.client.1.smithi136.stdout:3/775: mknod d3/d14/dc5/cf6 0 2024-09-18T12:51:19.344 INFO:tasks.workunit.client.1.smithi136.stdout:0/832: creat d1/d60/dcb/dee/f11c x:0 0 0 2024-09-18T12:51:19.345 INFO:tasks.workunit.client.1.smithi136.stdout:0/833: dread - d1/d3/d1a/d98/d81/d51/db3/f105 zero size 2024-09-18T12:51:19.345 INFO:tasks.workunit.client.1.smithi136.stdout:0/834: write d1/d60/d82/f9f [3298228,123805] 0 2024-09-18T12:51:19.351 INFO:tasks.workunit.client.0.smithi081.stdout:8/380: mkdir d3/d1d/d89 0 2024-09-18T12:51:19.351 INFO:tasks.workunit.client.0.smithi081.stdout:8/381: write d3/d1d/d4a/d7f/f88 [744749,12159] 0 2024-09-18T12:51:19.351 INFO:tasks.workunit.client.0.smithi081.stdout:8/382: chown d3/d1e/d4c/d68 1 1 2024-09-18T12:51:19.352 INFO:tasks.workunit.client.1.smithi136.stdout:4/722: dwrite d0/d45/f62 [0,4194304] 0 2024-09-18T12:51:19.353 INFO:tasks.workunit.client.0.smithi081.stdout:9/392: read dd/de/f13 [3589985,6332] 0 2024-09-18T12:51:19.354 INFO:tasks.workunit.client.0.smithi081.stdout:6/409: truncate f1 2968653 0 2024-09-18T12:51:19.355 INFO:tasks.workunit.client.0.smithi081.stdout:0/444: dwrite d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:19.355 INFO:tasks.workunit.client.0.smithi081.stdout:0/445: fdatasync d7/d9/d4b/d4a/f1a 0 2024-09-18T12:51:19.356 INFO:tasks.workunit.client.0.smithi081.stdout:7/447: unlink d2/d1d/f36 0 2024-09-18T12:51:19.358 INFO:tasks.workunit.client.0.smithi081.stdout:3/421: symlink d3/db/df/d3b/d47/l96 0 2024-09-18T12:51:19.358 INFO:tasks.workunit.client.0.smithi081.stdout:3/422: creat d3/d23/f97 x:0 0 0 2024-09-18T12:51:19.360 INFO:tasks.workunit.client.0.smithi081.stdout:5/459: creat d2/d14/d33/d37/d3b/d2a/f8b x:0 0 0 2024-09-18T12:51:19.362 INFO:tasks.workunit.client.0.smithi081.stdout:4/356: write d3/d20/d3d/d65/f2c [9154584,3684] 0 2024-09-18T12:51:19.364 INFO:tasks.workunit.client.0.smithi081.stdout:1/499: creat d0/d96/fad x:0 0 0 2024-09-18T12:51:19.366 INFO:tasks.workunit.client.0.smithi081.stdout:6/410: write d4/d12/d28/d2a/f45 [2841508,106322] 0 2024-09-18T12:51:19.366 INFO:tasks.workunit.client.0.smithi081.stdout:6/411: creat d4/d6/f85 x:0 0 0 2024-09-18T12:51:19.367 INFO:tasks.workunit.client.0.smithi081.stdout:9/393: symlink dd/d15/l89 0 2024-09-18T12:51:19.367 INFO:tasks.workunit.client.0.smithi081.stdout:9/394: write dd/d1d/d1e/d24/f82 [369035,131032] 0 2024-09-18T12:51:19.370 INFO:tasks.workunit.client.0.smithi081.stdout:3/423: unlink d3/db/df/d3b/d47/l96 0 2024-09-18T12:51:19.371 INFO:tasks.workunit.client.1.smithi136.stdout:0/835: dread d1/d3/d1a/d62/d75/fcf [0,4194304] 0 2024-09-18T12:51:19.372 INFO:tasks.workunit.client.1.smithi136.stdout:7/928: dwrite d0/d35/d41/d50/faf [0,4194304] 0 2024-09-18T12:51:19.372 INFO:tasks.workunit.client.1.smithi136.stdout:7/929: write d0/d35/d4f/dd5/fdb [788448,79922] 0 2024-09-18T12:51:19.373 INFO:tasks.workunit.client.0.smithi081.stdout:5/460: link d2/d14/d33/d37/f50 d2/d14/d33/f8c 0 2024-09-18T12:51:19.374 INFO:tasks.workunit.client.0.smithi081.stdout:5/461: dread d2/dd/f75 [0,4194304] 0 2024-09-18T12:51:19.374 INFO:tasks.workunit.client.0.smithi081.stdout:5/462: creat d2/f8d x:0 0 0 2024-09-18T12:51:19.374 INFO:tasks.workunit.client.0.smithi081.stdout:5/463: chown d2/d14/d1d/d1a/f4a 2614873 1 2024-09-18T12:51:19.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/357: dread d3/db/fe [0,4194304] 0 2024-09-18T12:51:19.375 INFO:tasks.workunit.client.1.smithi136.stdout:6/760: symlink d8/d9/d56/lef 0 2024-09-18T12:51:19.376 INFO:tasks.workunit.client.0.smithi081.stdout:7/448: write d2/d1d/d27/f47 [3979538,16732] 0 2024-09-18T12:51:19.378 INFO:tasks.workunit.client.0.smithi081.stdout:1/500: rmdir d0/db/d12/d2d/d99 0 2024-09-18T12:51:19.378 INFO:tasks.workunit.client.0.smithi081.stdout:1/501: truncate d0/d6/d7/d2e/d51/d2c/f45 1913343 0 2024-09-18T12:51:19.382 INFO:tasks.workunit.client.1.smithi136.stdout:2/866: fsync d5/d4a/d67/fa8 0 2024-09-18T12:51:19.383 INFO:tasks.workunit.client.0.smithi081.stdout:9/395: rename dd/d15/f51 to dd/de/d4f/f8a 0 2024-09-18T12:51:19.384 INFO:tasks.workunit.client.0.smithi081.stdout:9/396: write dd/d1d/d1e/d39/f5d [1039948,41288] 0 2024-09-18T12:51:19.384 INFO:tasks.workunit.client.0.smithi081.stdout:9/397: creat dd/d31/f8b x:0 0 0 2024-09-18T12:51:19.384 INFO:tasks.workunit.client.1.smithi136.stdout:0/836: dread d1/f16 [0,4194304] 0 2024-09-18T12:51:19.392 INFO:tasks.workunit.client.1.smithi136.stdout:6/761: symlink d8/d9/de/d60/d71/d76/d97/lf0 0 2024-09-18T12:51:19.392 INFO:tasks.workunit.client.0.smithi081.stdout:0/446: dwrite d7/f80 [0,4194304] 0 2024-09-18T12:51:19.393 INFO:tasks.workunit.client.0.smithi081.stdout:4/358: unlink d3/d20/l34 0 2024-09-18T12:51:19.394 INFO:tasks.workunit.client.1.smithi136.stdout:0/837: mknod d1/d3/d1a/d98/d81/d70/dbc/c11d 0 2024-09-18T12:51:19.395 INFO:tasks.workunit.client.0.smithi081.stdout:7/449: link d2/d18/d22/d48/l59 d2/d18/d3c/la2 0 2024-09-18T12:51:19.395 INFO:tasks.workunit.client.0.smithi081.stdout:7/450: creat d2/d42/fa3 x:0 0 0 2024-09-18T12:51:19.396 INFO:tasks.workunit.client.0.smithi081.stdout:3/424: rename d3/c35 to d3/db/df/d60/d58/c98 0 2024-09-18T12:51:19.397 INFO:tasks.workunit.client.0.smithi081.stdout:3/425: chown d3/d23/f97 398571202 1 2024-09-18T12:51:19.400 INFO:tasks.workunit.client.1.smithi136.stdout:8/892: rename d9/d18/d34/d3d/d47/dbe/de3 to d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e 0 2024-09-18T12:51:19.400 INFO:tasks.workunit.client.1.smithi136.stdout:7/930: read d0/d39/d4d/d9a/dee/d109/f12a [1241789,129419] 0 2024-09-18T12:51:19.400 INFO:tasks.workunit.client.1.smithi136.stdout:7/931: stat d0/d35/d41/d50/d5a/f6a 0 2024-09-18T12:51:19.400 INFO:tasks.workunit.client.1.smithi136.stdout:7/932: readlink d0/d2c/d2e/l63 0 2024-09-18T12:51:19.400 INFO:tasks.workunit.client.1.smithi136.stdout:0/838: symlink d1/db/d77/l11e 0 2024-09-18T12:51:19.401 INFO:tasks.workunit.client.0.smithi081.stdout:9/398: unlink dd/d1d/d1e/f29 0 2024-09-18T12:51:19.401 INFO:tasks.workunit.client.1.smithi136.stdout:2/867: dread d5/fef [0,4194304] 0 2024-09-18T12:51:19.402 INFO:tasks.workunit.client.0.smithi081.stdout:5/464: mkdir d2/d14/d33/d37/d3b/d2a/d8e 0 2024-09-18T12:51:19.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/839: unlink d1/d3/d1a/d98/d81/d51/lae 0 2024-09-18T12:51:19.405 INFO:tasks.workunit.client.1.smithi136.stdout:0/840: readlink d1/d60/lc1 0 2024-09-18T12:51:19.405 INFO:tasks.workunit.client.1.smithi136.stdout:2/868: mkdir d5/d7/d41/d100/d128 0 2024-09-18T12:51:19.405 INFO:tasks.workunit.client.1.smithi136.stdout:2/869: stat d5/d25/c7f 0 2024-09-18T12:51:19.406 INFO:tasks.workunit.client.0.smithi081.stdout:0/447: unlink d7/d9/d4b/d53/l74 0 2024-09-18T12:51:19.406 INFO:tasks.workunit.client.0.smithi081.stdout:4/359: write d3/d20/d3d/d65/f63 [862888,56732] 0 2024-09-18T12:51:19.406 INFO:tasks.workunit.client.1.smithi136.stdout:0/841: dread d1/d3/d1a/d98/d81/d70/dbc/fef [0,4194304] 0 2024-09-18T12:51:19.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/842: truncate d1/d3/d1a/d98/d81/d35/d54/ffc 2683713 0 2024-09-18T12:51:19.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/843: dread - d1/d17/dd1/ff6 zero size 2024-09-18T12:51:19.410 INFO:tasks.workunit.client.1.smithi136.stdout:2/870: unlink d5/d7/d3b/laf 0 2024-09-18T12:51:19.410 INFO:tasks.workunit.client.0.smithi081.stdout:7/451: rename d2/d14/d66/d8a to d2/d56/d73/da4 0 2024-09-18T12:51:19.413 INFO:tasks.workunit.client.1.smithi136.stdout:2/871: dread d5/d25/f62 [0,4194304] 0 2024-09-18T12:51:19.413 INFO:tasks.workunit.client.1.smithi136.stdout:2/872: chown d5/d7/d41/d53/cb3 0 1 2024-09-18T12:51:19.413 INFO:tasks.workunit.client.0.smithi081.stdout:3/426: creat d3/db/df/d29/d12/d44/d6f/f99 x:0 0 0 2024-09-18T12:51:19.413 INFO:tasks.workunit.client.0.smithi081.stdout:3/427: creat d3/db/df/d29/d12/d44/d6f/f9a x:0 0 0 2024-09-18T12:51:19.414 INFO:tasks.workunit.client.1.smithi136.stdout:0/844: truncate d1/d3/d1a/d98/d81/d51/fda 2559305 0 2024-09-18T12:51:19.415 INFO:tasks.workunit.client.1.smithi136.stdout:0/845: creat d1/d60/dcb/f11f x:0 0 0 2024-09-18T12:51:19.416 INFO:tasks.workunit.client.0.smithi081.stdout:0/448: unlink d7/l8 0 2024-09-18T12:51:19.416 INFO:tasks.workunit.client.0.smithi081.stdout:0/449: truncate d7/d9/d4b/d33/d43/f87 84584 0 2024-09-18T12:51:19.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/360: unlink d3/db/d2d/d4e/f5f 0 2024-09-18T12:51:19.418 INFO:tasks.workunit.client.1.smithi136.stdout:0/846: mkdir d1/d3/d1a/d98/d81/d72/de8/d120 0 2024-09-18T12:51:19.418 INFO:tasks.workunit.client.1.smithi136.stdout:0/847: fdatasync d1/d17/f6b 0 2024-09-18T12:51:19.419 INFO:tasks.workunit.client.0.smithi081.stdout:7/452: symlink d2/d1d/d27/la5 0 2024-09-18T12:51:19.420 INFO:tasks.workunit.client.1.smithi136.stdout:7/933: dread d0/d35/fa0 [0,4194304] 0 2024-09-18T12:51:19.421 INFO:tasks.workunit.client.0.smithi081.stdout:8/383: dwrite d3/f32 [0,4194304] 0 2024-09-18T12:51:19.421 INFO:tasks.workunit.client.0.smithi081.stdout:8/384: readlink d3/l20 0 2024-09-18T12:51:19.422 INFO:tasks.workunit.client.1.smithi136.stdout:0/848: creat d1/d3/d1a/d95/deb/f121 x:0 0 0 2024-09-18T12:51:19.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/385: creat d3/d2f/f8a x:0 0 0 2024-09-18T12:51:19.423 INFO:tasks.workunit.client.0.smithi081.stdout:3/428: symlink d3/db/df/d29/d12/l9b 0 2024-09-18T12:51:19.424 INFO:tasks.workunit.client.0.smithi081.stdout:9/399: rmdir dd/d1d/d1e/d39 39 2024-09-18T12:51:19.424 INFO:tasks.workunit.client.1.smithi136.stdout:7/934: getdents d0/d2c/d2e 0 2024-09-18T12:51:19.424 INFO:tasks.workunit.client.1.smithi136.stdout:7/935: stat d0/d12/d1a/d46/l119 0 2024-09-18T12:51:19.425 INFO:tasks.workunit.client.0.smithi081.stdout:4/361: symlink d3/db/d58/l7a 0 2024-09-18T12:51:19.426 INFO:tasks.workunit.client.1.smithi136.stdout:0/849: creat d1/d60/d82/f122 x:0 0 0 2024-09-18T12:51:19.427 INFO:tasks.workunit.client.0.smithi081.stdout:7/453: mkdir d2/d56/d73/d7c/d86/da6 0 2024-09-18T12:51:19.428 INFO:tasks.workunit.client.1.smithi136.stdout:7/936: getdents d0/d35/d41/dfe 0 2024-09-18T12:51:19.432 INFO:tasks.workunit.client.1.smithi136.stdout:0/850: mkdir d1/d3/d1a/d62/d75/d123 0 2024-09-18T12:51:19.432 INFO:tasks.workunit.client.1.smithi136.stdout:7/937: rmdir d0/d2c/d85 39 2024-09-18T12:51:19.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/465: read d2/dd/d5e/f7a [1303306,82665] 0 2024-09-18T12:51:19.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/429: rename d3/db/df/d29/d12/d44/d51/c5f to d3/db/df/d29/c9c 0 2024-09-18T12:51:19.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/430: chown d3/db/d1b/d57/l52 27791 1 2024-09-18T12:51:19.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/431: write d3/db/dc/d1a/f8e [1613731,40323] 0 2024-09-18T12:51:19.434 INFO:tasks.workunit.client.0.smithi081.stdout:9/400: mkdir dd/de/d4f/d8c 0 2024-09-18T12:51:19.434 INFO:tasks.workunit.client.1.smithi136.stdout:0/851: symlink d1/d60/d10c/l124 0 2024-09-18T12:51:19.434 INFO:tasks.workunit.client.1.smithi136.stdout:0/852: write d1/d60/dcb/ffa [588599,568] 0 2024-09-18T12:51:19.434 INFO:tasks.workunit.client.1.smithi136.stdout:0/853: chown d1/d3/d1a/f6e 3 1 2024-09-18T12:51:19.436 INFO:tasks.workunit.client.1.smithi136.stdout:0/854: link d1/d3/d1a/l52 d1/d3/d1a/d98/d81/d70/dbc/l125 0 2024-09-18T12:51:19.437 INFO:tasks.workunit.client.0.smithi081.stdout:5/466: truncate d2/dd/d5e/f40 939075 0 2024-09-18T12:51:19.437 INFO:tasks.workunit.client.0.smithi081.stdout:5/467: write d2/dd/f10 [5011864,8585] 0 2024-09-18T12:51:19.438 INFO:tasks.workunit.client.0.smithi081.stdout:9/401: mkdir dd/d15/d1a/d8d 0 2024-09-18T12:51:19.438 INFO:tasks.workunit.client.0.smithi081.stdout:1/502: dwrite d0/db/d12/d28/fa5 [0,4194304] 0 2024-09-18T12:51:19.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/468: symlink d2/d14/d1d/d1a/l8f 0 2024-09-18T12:51:19.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/469: chown d2/d14/d33/d37/d3b/d5f/d89/l7c 0 1 2024-09-18T12:51:19.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/470: readlink d2/d14/d33/d37/d3b/d16/l83 0 2024-09-18T12:51:19.444 INFO:tasks.workunit.client.1.smithi136.stdout:2/873: dread d5/d7/f10 [0,4194304] 0 2024-09-18T12:51:19.445 INFO:tasks.workunit.client.1.smithi136.stdout:4/723: creat d0/d3/d54/fe8 x:0 0 0 2024-09-18T12:51:19.448 INFO:tasks.workunit.client.0.smithi081.stdout:1/503: symlink d0/d6/d7/d2e/d51/d2c/d9f/lae 0 2024-09-18T12:51:19.451 INFO:tasks.workunit.client.0.smithi081.stdout:1/504: unlink d0/db/l48 0 2024-09-18T12:51:19.451 INFO:tasks.workunit.client.1.smithi136.stdout:2/874: rename d5/d25/d2d/d9d/da2/fb7 to d5/f129 0 2024-09-18T12:51:19.453 INFO:tasks.workunit.client.0.smithi081.stdout:1/505: creat d0/db/d4f/d50/faf x:0 0 0 2024-09-18T12:51:19.454 INFO:tasks.workunit.client.1.smithi136.stdout:7/938: dread d0/d35/d41/d50/d113/d12e/fdc [0,4194304] 0 2024-09-18T12:51:19.455 INFO:tasks.workunit.client.1.smithi136.stdout:2/875: read d5/d7/d17/f121 [1203497,4541] 0 2024-09-18T12:51:19.455 INFO:tasks.workunit.client.0.smithi081.stdout:1/506: mkdir d0/db/d12/d28/db0 0 2024-09-18T12:51:19.455 INFO:tasks.workunit.client.0.smithi081.stdout:1/507: dread - d0/d6/d33/d37/f94 zero size 2024-09-18T12:51:19.455 INFO:tasks.workunit.client.0.smithi081.stdout:1/508: readlink d0/db/d12/d55/l7c 0 2024-09-18T12:51:19.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/412: dread d4/d6/f27 [0,4194304] 0 2024-09-18T12:51:19.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/509: symlink d0/lb1 0 2024-09-18T12:51:19.457 INFO:tasks.workunit.client.0.smithi081.stdout:8/386: dwrite d3/d1e/d4c/f69 [4194304,4194304] 0 2024-09-18T12:51:19.457 INFO:tasks.workunit.client.0.smithi081.stdout:8/387: read d3/d1e/f78 [573744,12196] 0 2024-09-18T12:51:19.458 INFO:tasks.workunit.client.1.smithi136.stdout:7/939: creat d0/d39/f14c x:0 0 0 2024-09-18T12:51:19.458 INFO:tasks.workunit.client.0.smithi081.stdout:7/454: write d2/f4a [1221218,128236] 0 2024-09-18T12:51:19.458 INFO:tasks.workunit.client.0.smithi081.stdout:7/455: readlink d2/d1d/l5b 0 2024-09-18T12:51:19.459 INFO:tasks.workunit.client.0.smithi081.stdout:6/413: mknod d4/d6/c86 0 2024-09-18T12:51:19.459 INFO:tasks.workunit.client.1.smithi136.stdout:8/893: dwrite d9/d14/d1a/d2b/deb/d110/fbb [0,4194304] 0 2024-09-18T12:51:19.461 INFO:tasks.workunit.client.1.smithi136.stdout:2/876: truncate d5/d7/f5a 632563 0 2024-09-18T12:51:19.461 INFO:tasks.workunit.client.0.smithi081.stdout:1/510: truncate d0/d6/d33/f61 8232896 0 2024-09-18T12:51:19.463 INFO:tasks.workunit.client.1.smithi136.stdout:7/940: mknod d0/d35/d41/d50/d7f/d3b/d145/c14d 0 2024-09-18T12:51:19.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/388: creat d3/d1d/f8b x:0 0 0 2024-09-18T12:51:19.467 INFO:tasks.workunit.client.1.smithi136.stdout:8/894: mknod d9/d18/d34/d3d/d47/dbe/dd1/c13f 0 2024-09-18T12:51:19.467 INFO:tasks.workunit.client.1.smithi136.stdout:8/895: chown d9/d14/d1a/d2b/d42/da4/de5/l12e 3 1 2024-09-18T12:51:19.467 INFO:tasks.workunit.client.1.smithi136.stdout:8/896: write d9/d14/d1a/d2b/d42/d9e/fdf [2568776,5932] 0 2024-09-18T12:51:19.477 INFO:tasks.workunit.client.0.smithi081.stdout:5/471: dwrite d2/d14/d1d/d1a/f85 [0,4194304] 0 2024-09-18T12:51:19.477 INFO:tasks.workunit.client.0.smithi081.stdout:4/362: dwrite d3/d20/d3d/d65/d14/d27/f3a [4194304,4194304] 0 2024-09-18T12:51:19.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/414: creat d4/d12/d1c/d39/d73/f87 x:0 0 0 2024-09-18T12:51:19.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/415: chown d4/d12/d1c/l4c 228 1 2024-09-18T12:51:19.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/416: write d4/d6/fb [4518224,54130] 0 2024-09-18T12:51:19.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/417: dread d4/f75 [0,4194304] 0 2024-09-18T12:51:19.481 INFO:tasks.workunit.client.1.smithi136.stdout:5/898: sync 2024-09-18T12:51:19.482 INFO:tasks.workunit.client.0.smithi081.stdout:1/511: symlink d0/db/d12/d2d/lb2 0 2024-09-18T12:51:19.485 INFO:tasks.workunit.client.1.smithi136.stdout:5/899: truncate d5/d1a/f8d 3237249 0 2024-09-18T12:51:19.485 INFO:tasks.workunit.client.1.smithi136.stdout:5/900: truncate d5/d1a/d2d/d34/d88/ff0 973806 0 2024-09-18T12:51:19.485 INFO:tasks.workunit.client.1.smithi136.stdout:5/901: write d5/d1a/f27 [1699663,100523] 0 2024-09-18T12:51:19.488 INFO:tasks.workunit.client.0.smithi081.stdout:8/389: dread d3/f2d [0,4194304] 0 2024-09-18T12:51:19.491 INFO:tasks.workunit.client.1.smithi136.stdout:7/941: dread d0/fd3 [0,4194304] 0 2024-09-18T12:51:19.491 INFO:tasks.workunit.client.1.smithi136.stdout:7/942: dread - d0/d39/d4d/f135 zero size 2024-09-18T12:51:19.491 INFO:tasks.workunit.client.1.smithi136.stdout:7/943: fdatasync d0/d35/d41/d50/d9b/dc2/de0/f114 0 2024-09-18T12:51:19.495 INFO:tasks.workunit.client.1.smithi136.stdout:7/944: link d0/d35/fa0 d0/d12/d1a/dac/d102/f14e 0 2024-09-18T12:51:19.498 INFO:tasks.workunit.client.0.smithi081.stdout:8/390: mknod d3/d2f/c8c 0 2024-09-18T12:51:19.500 INFO:tasks.workunit.client.0.smithi081.stdout:4/363: creat d3/d20/d3d/d65/d45/d6c/f7b x:0 0 0 2024-09-18T12:51:19.503 INFO:tasks.workunit.client.0.smithi081.stdout:7/456: rename d2/d1d/d27 to d2/d14/d21/d62/da7 0 2024-09-18T12:51:19.508 INFO:tasks.workunit.client.0.smithi081.stdout:1/512: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:19.508 INFO:tasks.workunit.client.1.smithi136.stdout:7/945: dread d0/d35/d41/dfe/d10c/f115 [0,4194304] 0 2024-09-18T12:51:19.510 INFO:tasks.workunit.client.0.smithi081.stdout:1/513: stat d0/d6/d33/d42/l57 0 2024-09-18T12:51:19.511 INFO:tasks.workunit.client.1.smithi136.stdout:0/855: dwrite d1/d3/d1a/d98/d81/f55 [0,4194304] 0 2024-09-18T12:51:19.512 INFO:tasks.workunit.client.1.smithi136.stdout:7/946: mknod d0/d12/d1a/dac/c14f 0 2024-09-18T12:51:19.515 INFO:tasks.workunit.client.0.smithi081.stdout:4/364: dread d3/d20/d3d/d65/f19 [0,4194304] 0 2024-09-18T12:51:19.515 INFO:tasks.workunit.client.0.smithi081.stdout:4/365: write d3/f67 [188177,12055] 0 2024-09-18T12:51:19.515 INFO:tasks.workunit.client.0.smithi081.stdout:4/366: write d3/d20/d3d/d65/d45/d6c/f7b [437344,55128] 0 2024-09-18T12:51:19.518 INFO:tasks.workunit.client.0.smithi081.stdout:4/367: chown d3/d20/d3d/d65/d2f 63 1 2024-09-18T12:51:19.521 INFO:tasks.workunit.client.0.smithi081.stdout:4/368: dread d3/db/f25 [0,4194304] 0 2024-09-18T12:51:19.525 INFO:tasks.workunit.client.1.smithi136.stdout:4/724: dwrite d0/d13/f66 [0,4194304] 0 2024-09-18T12:51:19.528 INFO:tasks.workunit.client.1.smithi136.stdout:4/725: rename d0/d3/f4 to d0/d45/d67/d7b/fe9 0 2024-09-18T12:51:19.531 INFO:tasks.workunit.client.1.smithi136.stdout:4/726: rmdir d0/d2 39 2024-09-18T12:51:19.531 INFO:tasks.workunit.client.1.smithi136.stdout:4/727: creat d0/d13/fea x:0 0 0 2024-09-18T12:51:19.533 INFO:tasks.workunit.client.1.smithi136.stdout:4/728: truncate d0/f1 103447 0 2024-09-18T12:51:19.556 INFO:tasks.workunit.client.0.smithi081.stdout:7/457: dread d2/f13 [4194304,4194304] 0 2024-09-18T12:51:19.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/458: write d2/d1d/f2c [1933390,46523] 0 2024-09-18T12:51:19.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/459: truncate d2/d7f/f83 27356 0 2024-09-18T12:51:19.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/460: readlink d2/d42/l5a 0 2024-09-18T12:51:19.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/461: write d2/d42/f43 [1220116,50086] 0 2024-09-18T12:51:19.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/877: dwrite d5/d7/d17/f3c [0,4194304] 0 2024-09-18T12:51:19.563 INFO:tasks.workunit.client.1.smithi136.stdout:2/878: creat d5/d4a/d7a/f12a x:0 0 0 2024-09-18T12:51:19.563 INFO:tasks.workunit.client.1.smithi136.stdout:8/897: dwrite d9/d18/d34/d3d/d47/dbe/dd1/f136 [0,4194304] 0 2024-09-18T12:51:19.564 INFO:tasks.workunit.client.1.smithi136.stdout:2/879: creat d5/f12b x:0 0 0 2024-09-18T12:51:19.564 INFO:tasks.workunit.client.1.smithi136.stdout:8/898: write d9/d14/d1a/d2b/deb/d110/dd5/ffd [925506,25013] 0 2024-09-18T12:51:19.564 INFO:tasks.workunit.client.0.smithi081.stdout:7/462: mkdir d2/d18/d3c/da8 0 2024-09-18T12:51:19.570 INFO:tasks.workunit.client.1.smithi136.stdout:2/880: rmdir d5/d25 39 2024-09-18T12:51:19.579 INFO:tasks.workunit.client.0.smithi081.stdout:1/514: dread d0/ff [0,4194304] 0 2024-09-18T12:51:19.579 INFO:tasks.workunit.client.0.smithi081.stdout:1/515: dread - d0/d6/d33/d42/d83/f97 zero size 2024-09-18T12:51:19.581 INFO:tasks.workunit.client.0.smithi081.stdout:1/516: rename d0/db/d12/f24 to d0/db/d12/d55/fb3 0 2024-09-18T12:51:19.586 INFO:tasks.workunit.client.0.smithi081.stdout:1/517: write d0/d6/f36 [2505445,128754] 0 2024-09-18T12:51:19.593 INFO:tasks.workunit.client.0.smithi081.stdout:1/518: dread d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:19.595 INFO:tasks.workunit.client.0.smithi081.stdout:1/519: unlink d0/d6/d33/d42/d83/f97 0 2024-09-18T12:51:19.597 INFO:tasks.workunit.client.0.smithi081.stdout:1/520: symlink d0/d6/d7/d8/lb4 0 2024-09-18T12:51:19.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/521: mknod d0/d6/d7/d2e/d4e/cb5 0 2024-09-18T12:51:19.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/522: fsync d0/d6/d7/d2e/d51/d2c/f5c 0 2024-09-18T12:51:19.602 INFO:tasks.workunit.client.1.smithi136.stdout:7/947: read d0/d39/dbf/fc8 [532898,113973] 0 2024-09-18T12:51:19.602 INFO:tasks.workunit.client.1.smithi136.stdout:5/902: dwrite d5/d1a/d2d/d34/f42 [0,4194304] 0 2024-09-18T12:51:19.602 INFO:tasks.workunit.client.1.smithi136.stdout:7/948: write d0/d39/d4d/f135 [447122,129995] 0 2024-09-18T12:51:19.602 INFO:tasks.workunit.client.1.smithi136.stdout:5/903: stat d5/d1a/d2d/d34/l6f 0 2024-09-18T12:51:19.602 INFO:tasks.workunit.client.1.smithi136.stdout:5/904: dread - d5/d1a/d2d/d34/d4e/d7a/f89 zero size 2024-09-18T12:51:19.603 INFO:tasks.workunit.client.0.smithi081.stdout:4/369: dwrite d3/db/fc [4194304,4194304] 0 2024-09-18T12:51:19.603 INFO:tasks.workunit.client.0.smithi081.stdout:5/472: dwrite d2/d14/d1d/d1a/f4a [0,4194304] 0 2024-09-18T12:51:19.604 INFO:tasks.workunit.client.1.smithi136.stdout:7/949: creat d0/d35/d41/d50/d113/f150 x:0 0 0 2024-09-18T12:51:19.605 INFO:tasks.workunit.client.0.smithi081.stdout:4/370: link d3/d20/d3d/d65/d14/f29 d3/d20/d3d/d65/d14/d27/f7c 0 2024-09-18T12:51:19.606 INFO:tasks.workunit.client.0.smithi081.stdout:5/473: symlink d2/dd/d5e/l90 0 2024-09-18T12:51:19.607 INFO:tasks.workunit.client.0.smithi081.stdout:4/371: symlink d3/db/d2d/d4e/l7d 0 2024-09-18T12:51:19.607 INFO:tasks.workunit.client.0.smithi081.stdout:4/372: truncate d3/d20/d3d/d65/d45/f53 351370 0 2024-09-18T12:51:19.608 INFO:tasks.workunit.client.0.smithi081.stdout:4/373: mkdir d3/d20/d3d/d65/d45/d7e 0 2024-09-18T12:51:19.608 INFO:tasks.workunit.client.0.smithi081.stdout:4/374: chown d3/db/d2d/f3b 3204 1 2024-09-18T12:51:19.610 INFO:tasks.workunit.client.0.smithi081.stdout:4/375: rename d3/d20/d3d/d65/d14/d54/f57 to d3/db/d2d/f7f 0 2024-09-18T12:51:19.612 INFO:tasks.workunit.client.0.smithi081.stdout:4/376: symlink d3/d20/d3d/d65/d45/l80 0 2024-09-18T12:51:19.613 INFO:tasks.workunit.client.0.smithi081.stdout:4/377: read d3/d20/d5b/f66 [852233,10889] 0 2024-09-18T12:51:19.614 INFO:tasks.workunit.client.0.smithi081.stdout:4/378: creat d3/d20/d3d/d65/d45/f81 x:0 0 0 2024-09-18T12:51:19.614 INFO:tasks.workunit.client.0.smithi081.stdout:4/379: chown d3/db/d2d/l2e 1658 1 2024-09-18T12:51:19.629 INFO:tasks.workunit.client.0.smithi081.stdout:6/418: dwrite d4/d6/f42 [0,4194304] 0 2024-09-18T12:51:19.634 INFO:tasks.workunit.client.1.smithi136.stdout:7/950: dread d0/d35/feb [0,4194304] 0 2024-09-18T12:51:19.634 INFO:tasks.workunit.client.1.smithi136.stdout:7/951: chown d0/d12/d5e/d67/fcb 15 1 2024-09-18T12:51:19.638 INFO:tasks.workunit.client.1.smithi136.stdout:2/881: dread d5/d25/d43/d74/fcd [0,4194304] 0 2024-09-18T12:51:19.639 INFO:tasks.workunit.client.1.smithi136.stdout:2/882: truncate d5/d25/d2d/d9d/da2/f114 226922 0 2024-09-18T12:51:19.639 INFO:tasks.workunit.client.1.smithi136.stdout:2/883: write d5/d25/d2d/d9d/da2/fc9 [290738,73525] 0 2024-09-18T12:51:19.643 INFO:tasks.workunit.client.1.smithi136.stdout:2/884: rename d5/d7/d11/f31 to d5/d25/d2d/d9d/d118/f12c 0 2024-09-18T12:51:19.643 INFO:tasks.workunit.client.1.smithi136.stdout:2/885: stat d5/d7/d41/c68 0 2024-09-18T12:51:19.643 INFO:tasks.workunit.client.1.smithi136.stdout:9/797: sync 2024-09-18T12:51:19.643 INFO:tasks.workunit.client.1.smithi136.stdout:9/798: readlink d6/db/l36 0 2024-09-18T12:51:19.644 INFO:tasks.workunit.client.1.smithi136.stdout:0/856: dwrite d1/d3/d1a/f6e [0,4194304] 0 2024-09-18T12:51:19.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/463: dwrite d2/d56/d73/f9a [0,4194304] 0 2024-09-18T12:51:19.645 INFO:tasks.workunit.client.0.smithi081.stdout:4/380: write d3/d20/d3d/d65/d2f/f33 [756496,103966] 0 2024-09-18T12:51:19.647 INFO:tasks.workunit.client.1.smithi136.stdout:8/899: dwrite d9/d14/f1f [4194304,4194304] 0 2024-09-18T12:51:19.647 INFO:tasks.workunit.client.0.smithi081.stdout:8/391: dwrite d3/d1d/f21 [0,4194304] 0 2024-09-18T12:51:19.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/776: sync 2024-09-18T12:51:19.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/777: chown d3/d5/d31 111 1 2024-09-18T12:51:19.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/778: dread - d3/d14/dc5/fad zero size 2024-09-18T12:51:19.648 INFO:tasks.workunit.client.1.smithi136.stdout:1/740: sync 2024-09-18T12:51:19.648 INFO:tasks.workunit.client.1.smithi136.stdout:2/886: mkdir d5/d12d 0 2024-09-18T12:51:19.655 INFO:tasks.workunit.client.1.smithi136.stdout:1/741: creat d2/d5/d2b/d34/d5c/ff7 x:0 0 0 2024-09-18T12:51:19.655 INFO:tasks.workunit.client.0.smithi081.stdout:5/474: dwrite d2/d14/d33/d37/d3b/d5f/f60 [0,4194304] 0 2024-09-18T12:51:19.657 INFO:tasks.workunit.client.1.smithi136.stdout:1/742: getdents d2/d5/d2b/d9b/d2e/d9a 0 2024-09-18T12:51:19.660 INFO:tasks.workunit.client.0.smithi081.stdout:1/523: dread d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:19.663 INFO:tasks.workunit.client.1.smithi136.stdout:1/743: unlink d2/d5/d2b/d9b/d1b/fc6 0 2024-09-18T12:51:19.666 INFO:tasks.workunit.client.1.smithi136.stdout:8/900: read d9/d18/d34/f6f [1051487,94380] 0 2024-09-18T12:51:19.666 INFO:tasks.workunit.client.1.smithi136.stdout:1/744: unlink d2/d5/d2b/d34/d5c/faf 0 2024-09-18T12:51:19.669 INFO:tasks.workunit.client.1.smithi136.stdout:1/745: symlink d2/d5/d2b/d9b/d2e/d4c/d8e/lf8 0 2024-09-18T12:51:19.669 INFO:tasks.workunit.client.1.smithi136.stdout:1/746: readlink d2/d5/d2b/d34/l7f 0 2024-09-18T12:51:19.669 INFO:tasks.workunit.client.1.smithi136.stdout:1/747: write d2/d5/d2b/f4a [1667450,120618] 0 2024-09-18T12:51:19.669 INFO:tasks.workunit.client.1.smithi136.stdout:1/748: chown d2/d5/d2b/da9/fb6 1 1 2024-09-18T12:51:19.681 INFO:tasks.workunit.client.0.smithi081.stdout:5/475: write d2/d14/d1d/d1a/f4a [3372,61034] 0 2024-09-18T12:51:19.691 INFO:tasks.workunit.client.1.smithi136.stdout:7/952: dwrite d0/d2c/d2e/f32 [0,4194304] 0 2024-09-18T12:51:19.691 INFO:tasks.workunit.client.1.smithi136.stdout:7/953: stat d0/d35/d4f/dd5/d94/db0/l76 0 2024-09-18T12:51:19.694 INFO:tasks.workunit.client.1.smithi136.stdout:7/954: truncate d0/d35/d41/d50/d5a/fa7 228077 0 2024-09-18T12:51:19.694 INFO:tasks.workunit.client.0.smithi081.stdout:6/419: rmdir d4/d12/d1c/d64 39 2024-09-18T12:51:19.710 INFO:tasks.workunit.client.0.smithi081.stdout:8/392: unlink d3/d1d/d4a/l71 0 2024-09-18T12:51:19.717 INFO:tasks.workunit.client.1.smithi136.stdout:7/955: dread d0/d35/fa0 [0,4194304] 0 2024-09-18T12:51:19.728 INFO:tasks.workunit.client.1.smithi136.stdout:9/799: dwrite d6/db/d72/fb3 [0,4194304] 0 2024-09-18T12:51:19.728 INFO:tasks.workunit.client.1.smithi136.stdout:9/800: chown d6/db/d12/d62/lbe 109447 1 2024-09-18T12:51:19.728 INFO:tasks.workunit.client.1.smithi136.stdout:7/956: dread d0/d35/d4f/dd5/fda [0,4194304] 0 2024-09-18T12:51:19.730 INFO:tasks.workunit.client.1.smithi136.stdout:0/857: dwrite d1/db/f102 [0,4194304] 0 2024-09-18T12:51:19.730 INFO:tasks.workunit.client.1.smithi136.stdout:9/801: symlink d6/da/d3d/d4d/d91/d25/dee/l110 0 2024-09-18T12:51:19.733 INFO:tasks.workunit.client.1.smithi136.stdout:7/957: rmdir d0/d35/d4f/d107 39 2024-09-18T12:51:19.733 INFO:tasks.workunit.client.1.smithi136.stdout:7/958: fdatasync d0/d35/d4f/f78 0 2024-09-18T12:51:19.733 INFO:tasks.workunit.client.1.smithi136.stdout:7/959: chown d0/d39/d4d/d69 14 1 2024-09-18T12:51:19.733 INFO:tasks.workunit.client.1.smithi136.stdout:7/960: fsync d0/d35/d41/d50/d5a/f6a 0 2024-09-18T12:51:19.735 INFO:tasks.workunit.client.1.smithi136.stdout:1/749: dwrite d2/d5/d2b/d34/d5c/f9e [0,4194304] 0 2024-09-18T12:51:19.735 INFO:tasks.workunit.client.1.smithi136.stdout:1/750: read - d2/d5/d2b/d9b/d2e/d9a/fc1 zero size 2024-09-18T12:51:19.736 INFO:tasks.workunit.client.0.smithi081.stdout:6/420: dwrite d4/f75 [0,4194304] 0 2024-09-18T12:51:19.737 INFO:tasks.workunit.client.1.smithi136.stdout:2/887: dwrite d5/d7/dbf/f109 [0,4194304] 0 2024-09-18T12:51:19.739 INFO:tasks.workunit.client.0.smithi081.stdout:5/476: dwrite d2/d14/d33/d37/d3b/d5f/f60 [0,4194304] 0 2024-09-18T12:51:19.744 INFO:tasks.workunit.client.1.smithi136.stdout:2/888: getdents d5/d7/d17/d48/dc1 0 2024-09-18T12:51:19.747 INFO:tasks.workunit.client.1.smithi136.stdout:1/751: dread d2/d5/d2b/d9b/d2e/d4c/f45 [0,4194304] 0 2024-09-18T12:51:19.747 INFO:tasks.workunit.client.1.smithi136.stdout:1/752: truncate d2/d5/d2b/d34/feb 659062 0 2024-09-18T12:51:19.747 INFO:tasks.workunit.client.1.smithi136.stdout:1/753: readlink d2/d5/d9/l8f 0 2024-09-18T12:51:19.749 INFO:tasks.workunit.client.1.smithi136.stdout:2/889: rename d5/d25/d2d/d9d/da2/fc9 to d5/d7/d17/d48/dc1/f12e 0 2024-09-18T12:51:19.749 INFO:tasks.workunit.client.1.smithi136.stdout:7/961: write d0/d35/d41/d50/d5a/d98/fe7 [955074,35065] 0 2024-09-18T12:51:19.749 INFO:tasks.workunit.client.1.smithi136.stdout:1/754: mknod d2/d5/d2b/d9b/d2e/cf9 0 2024-09-18T12:51:19.750 INFO:tasks.workunit.client.1.smithi136.stdout:2/890: truncate d5/d25/d43/d74/ff5 128068 0 2024-09-18T12:51:19.750 INFO:tasks.workunit.client.1.smithi136.stdout:2/891: fdatasync f3 0 2024-09-18T12:51:19.751 INFO:tasks.workunit.client.1.smithi136.stdout:1/755: mknod d2/d5/d2b/d63/dda/cfa 0 2024-09-18T12:51:19.751 INFO:tasks.workunit.client.1.smithi136.stdout:1/756: fdatasync d2/d5/f73 0 2024-09-18T12:51:19.751 INFO:tasks.workunit.client.1.smithi136.stdout:1/757: write d2/d5/d2b/d9b/dbe/dd3/d65/f6e [674538,8536] 0 2024-09-18T12:51:19.751 INFO:tasks.workunit.client.1.smithi136.stdout:2/892: getdents d5/d7/d3b/df7 0 2024-09-18T12:51:19.751 INFO:tasks.workunit.client.1.smithi136.stdout:1/758: mkdir d2/d5/d9/dcb/dfb 0 2024-09-18T12:51:19.753 INFO:tasks.workunit.client.1.smithi136.stdout:1/759: creat d2/d5/d2b/d9b/dbe/dd3/d65/ddb/ffc x:0 0 0 2024-09-18T12:51:19.756 INFO:tasks.workunit.client.1.smithi136.stdout:0/858: dwrite d1/d46/d6c/f8a [4194304,4194304] 0 2024-09-18T12:51:19.756 INFO:tasks.workunit.client.1.smithi136.stdout:2/893: write d5/d25/d43/d74/fb0 [790639,81696] 0 2024-09-18T12:51:19.756 INFO:tasks.workunit.client.1.smithi136.stdout:0/859: write d1/db/d76/f119 [464069,31877] 0 2024-09-18T12:51:19.760 INFO:tasks.workunit.client.1.smithi136.stdout:6/762: sync 2024-09-18T12:51:19.762 INFO:tasks.workunit.client.1.smithi136.stdout:6/763: mknod d8/d9/d56/d96/d9c/cf1 0 2024-09-18T12:51:19.771 INFO:tasks.workunit.client.1.smithi136.stdout:0/860: write d1/d3/d1a/d98/d81/d35/f42 [1807381,122158] 0 2024-09-18T12:51:19.773 INFO:tasks.workunit.client.1.smithi136.stdout:0/861: symlink d1/d60/dcb/l126 0 2024-09-18T12:51:19.773 INFO:tasks.workunit.client.1.smithi136.stdout:0/862: fdatasync d1/d60/d82/f9f 0 2024-09-18T12:51:19.773 INFO:tasks.workunit.client.1.smithi136.stdout:1/760: dread d2/d5/d2b/d9b/f19 [0,4194304] 0 2024-09-18T12:51:19.774 INFO:tasks.workunit.client.1.smithi136.stdout:1/761: creat d2/d5/d9/ffd x:0 0 0 2024-09-18T12:51:19.775 INFO:tasks.workunit.client.1.smithi136.stdout:1/762: readlink d2/d5/d2b/d63/l8d 0 2024-09-18T12:51:19.777 INFO:tasks.workunit.client.1.smithi136.stdout:6/764: dread d8/d9/f34 [0,4194304] 0 2024-09-18T12:51:19.777 INFO:tasks.workunit.client.1.smithi136.stdout:9/802: dwrite d6/da/dd1/fea [0,4194304] 0 2024-09-18T12:51:19.777 INFO:tasks.workunit.client.1.smithi136.stdout:9/803: write d6/df/d23/d2b/d79/d53/d5c/fc8 [383417,29371] 0 2024-09-18T12:51:19.779 INFO:tasks.workunit.client.1.smithi136.stdout:6/765: mkdir d8/d9/de/d1c/d50/da8/df2 0 2024-09-18T12:51:19.784 INFO:tasks.workunit.client.1.smithi136.stdout:7/962: dwrite d0/d35/d4f/dd5/fda [0,4194304] 0 2024-09-18T12:51:19.785 INFO:tasks.workunit.client.1.smithi136.stdout:9/804: symlink d6/db/d12/l111 0 2024-09-18T12:51:19.785 INFO:tasks.workunit.client.1.smithi136.stdout:6/766: mknod d8/d9/de/d1c/d50/da8/df2/cf3 0 2024-09-18T12:51:19.786 INFO:tasks.workunit.client.1.smithi136.stdout:1/763: dread d2/f17 [0,4194304] 0 2024-09-18T12:51:19.789 INFO:tasks.workunit.client.1.smithi136.stdout:7/963: creat d0/d12/d5e/d10d/f151 x:0 0 0 2024-09-18T12:51:19.789 INFO:tasks.workunit.client.1.smithi136.stdout:7/964: write d0/d2c/f45 [2200408,68141] 0 2024-09-18T12:51:19.789 INFO:tasks.workunit.client.1.smithi136.stdout:7/965: write d0/d39/d4d/d55/d101/f14b [126322,45485] 0 2024-09-18T12:51:19.790 INFO:tasks.workunit.client.1.smithi136.stdout:9/805: symlink d6/l112 0 2024-09-18T12:51:19.790 INFO:tasks.workunit.client.1.smithi136.stdout:9/806: chown d6/df/d23/d2b/de5/feb 307 1 2024-09-18T12:51:19.790 INFO:tasks.workunit.client.1.smithi136.stdout:9/807: read d6/df/d23/d2b/d79/d53/f54 [486179,21655] 0 2024-09-18T12:51:19.791 INFO:tasks.workunit.client.1.smithi136.stdout:9/808: fdatasync d6/da/d3d/f69 0 2024-09-18T12:51:19.792 INFO:tasks.workunit.client.1.smithi136.stdout:6/767: unlink d8/d9/d3c/l8c 0 2024-09-18T12:51:19.795 INFO:tasks.workunit.client.1.smithi136.stdout:0/863: dwrite d1/d3/f1e [0,4194304] 0 2024-09-18T12:51:19.795 INFO:tasks.workunit.client.1.smithi136.stdout:7/966: rename d0/d39/lca to d0/d12/d1a/dac/d102/l152 0 2024-09-18T12:51:19.797 INFO:tasks.workunit.client.1.smithi136.stdout:6/768: creat d8/d9/d3c/ff4 x:0 0 0 2024-09-18T12:51:19.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/764: mknod d2/d5/d9/cfe 0 2024-09-18T12:51:19.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/765: write d2/f5b [1156903,21533] 0 2024-09-18T12:51:19.799 INFO:tasks.workunit.client.1.smithi136.stdout:1/766: stat d2/d5/d2b/d9b/d1b/f25 0 2024-09-18T12:51:19.801 INFO:tasks.workunit.client.1.smithi136.stdout:0/864: mknod d1/db/d76/db9/de5/c127 0 2024-09-18T12:51:19.803 INFO:tasks.workunit.client.1.smithi136.stdout:7/967: link d0/d35/d41/d50/d7b/c13d d0/d39/d4d/d69/dd1/c153 0 2024-09-18T12:51:19.805 INFO:tasks.workunit.client.1.smithi136.stdout:9/809: write d6/da/d3d/f90 [2500720,119056] 0 2024-09-18T12:51:19.805 INFO:tasks.workunit.client.1.smithi136.stdout:9/810: stat d6/da/d3d/d4d/d91/d25/dee/df8 0 2024-09-18T12:51:19.807 INFO:tasks.workunit.client.1.smithi136.stdout:6/769: unlink d8/d9/de/d60/d71/d76/fe0 0 2024-09-18T12:51:19.807 INFO:tasks.workunit.client.1.smithi136.stdout:6/770: write d8/dc/f14 [725744,4932] 0 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:1/767: symlink d2/d5/d9/dcb/dfb/lff 0 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:4/729: sync 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:4/730: readlink d0/d8d/lda 0 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:0/865: creat d1/d3/d1a/d98/f128 x:0 0 0 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:7/968: creat d0/d2c/d2e/f154 x:0 0 0 2024-09-18T12:51:19.810 INFO:tasks.workunit.client.1.smithi136.stdout:7/969: truncate d0/d39/d4d/f92 4219733 0 2024-09-18T12:51:19.812 INFO:tasks.workunit.client.1.smithi136.stdout:1/768: mknod d2/d5/d2b/d9b/d2e/df0/c100 0 2024-09-18T12:51:19.812 INFO:tasks.workunit.client.1.smithi136.stdout:1/769: stat d2/d5/d9/db4/dd0/fed 0 2024-09-18T12:51:19.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/731: getdents d0/d3 0 2024-09-18T12:51:19.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/732: dread - d0/d3/f7d zero size 2024-09-18T12:51:19.817 INFO:tasks.workunit.client.0.smithi081.stdout:7/464: creat d2/d18/fa9 x:0 0 0 2024-09-18T12:51:19.817 INFO:tasks.workunit.client.1.smithi136.stdout:0/866: rename d1/d60/d82/f122 to d1/d17/dd1/dff/f129 0 2024-09-18T12:51:19.817 INFO:tasks.workunit.client.1.smithi136.stdout:0/867: read - d1/d3/d1a/d98/d81/d35/f96 zero size 2024-09-18T12:51:19.819 INFO:tasks.workunit.client.0.smithi081.stdout:7/465: mkdir d2/d18/d60/daa 0 2024-09-18T12:51:19.819 INFO:tasks.workunit.client.0.smithi081.stdout:7/466: chown d2/d14/l40 44 1 2024-09-18T12:51:19.821 INFO:tasks.workunit.client.1.smithi136.stdout:1/770: creat d2/d5/d2b/d9b/d2e/f101 x:0 0 0 2024-09-18T12:51:19.824 INFO:tasks.workunit.client.1.smithi136.stdout:4/733: link d0/d45/d67/d7b/fe9 d0/d3/d90/feb 0 2024-09-18T12:51:19.826 INFO:tasks.workunit.client.1.smithi136.stdout:0/868: mknod d1/db/d76/db9/c12a 0 2024-09-18T12:51:19.826 INFO:tasks.workunit.client.1.smithi136.stdout:0/869: chown d1/d3/d1a/d62/fa5 160355 1 2024-09-18T12:51:19.830 INFO:tasks.workunit.client.0.smithi081.stdout:6/421: mkdir d4/d88 0 2024-09-18T12:51:19.835 INFO:tasks.workunit.client.0.smithi081.stdout:5/477: symlink d2/d14/d33/d37/d3b/l91 0 2024-09-18T12:51:19.835 INFO:tasks.workunit.client.0.smithi081.stdout:5/478: creat d2/d14/d33/d37/d3b/d6a/d20/f92 x:0 0 0 2024-09-18T12:51:19.835 INFO:tasks.workunit.client.0.smithi081.stdout:5/479: stat d2/d14/d33/d37/d3b/d2a/f4c 0 2024-09-18T12:51:19.835 INFO:tasks.workunit.client.0.smithi081.stdout:5/480: chown d2/dd/d5e/f7a 7 1 2024-09-18T12:51:19.836 INFO:tasks.workunit.client.1.smithi136.stdout:4/734: symlink d0/d25/lec 0 2024-09-18T12:51:19.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/422: dread d4/f21 [0,4194304] 0 2024-09-18T12:51:19.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/423: creat d4/d12/d1c/d39/f89 x:0 0 0 2024-09-18T12:51:19.839 INFO:tasks.workunit.client.1.smithi136.stdout:1/771: rename d2/d5/d2b/d9b/d2e/df0/c100 to d2/d5/d9/c102 0 2024-09-18T12:51:19.840 INFO:tasks.workunit.client.0.smithi081.stdout:6/424: symlink d4/d12/d1c/d64/l8a 0 2024-09-18T12:51:19.841 INFO:tasks.workunit.client.1.smithi136.stdout:1/772: write d2/d5/fa1 [1178250,57114] 0 2024-09-18T12:51:19.843 INFO:tasks.workunit.client.1.smithi136.stdout:1/773: mkdir d2/d5/d2b/d34/d103 0 2024-09-18T12:51:19.843 INFO:tasks.workunit.client.1.smithi136.stdout:1/774: creat d2/f104 x:0 0 0 2024-09-18T12:51:19.846 INFO:tasks.workunit.client.0.smithi081.stdout:6/425: rename d4/d12/d1c/d39/d40 to d4/d12/d28/d2a/d74/d8b 0 2024-09-18T12:51:19.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/771: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:19.855 INFO:tasks.workunit.client.1.smithi136.stdout:6/772: fsync f5 0 2024-09-18T12:51:19.858 INFO:tasks.workunit.client.1.smithi136.stdout:4/735: dwrite d0/d25/d83/fa3 [0,4194304] 0 2024-09-18T12:51:19.860 INFO:tasks.workunit.client.0.smithi081.stdout:7/467: dwrite d2/d14/d21/f7e [0,4194304] 0 2024-09-18T12:51:19.861 INFO:tasks.workunit.client.1.smithi136.stdout:4/736: symlink d0/d25/d83/led 0 2024-09-18T12:51:19.861 INFO:tasks.workunit.client.1.smithi136.stdout:4/737: fdatasync d0/d3/f3b 0 2024-09-18T12:51:19.862 INFO:tasks.workunit.client.1.smithi136.stdout:4/738: fdatasync d0/d45/f55 0 2024-09-18T12:51:19.864 INFO:tasks.workunit.client.1.smithi136.stdout:0/870: dwrite d1/d60/d82/f93 [0,4194304] 0 2024-09-18T12:51:19.865 INFO:tasks.workunit.client.0.smithi081.stdout:5/481: read d2/d14/d33/d37/d3b/d16/f73 [364094,12086] 0 2024-09-18T12:51:19.865 INFO:tasks.workunit.client.0.smithi081.stdout:5/482: fdatasync d2/d14/f4e 0 2024-09-18T12:51:19.866 INFO:tasks.workunit.client.1.smithi136.stdout:0/871: symlink d1/d17/dd1/dff/l12b 0 2024-09-18T12:51:19.867 INFO:tasks.workunit.client.0.smithi081.stdout:5/483: rmdir d2/d14/d1d/d1a 39 2024-09-18T12:51:19.867 INFO:tasks.workunit.client.0.smithi081.stdout:7/468: dread d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:19.868 INFO:tasks.workunit.client.1.smithi136.stdout:0/872: creat d1/d46/f12c x:0 0 0 2024-09-18T12:51:19.870 INFO:tasks.workunit.client.0.smithi081.stdout:7/469: creat d2/d18/fab x:0 0 0 2024-09-18T12:51:19.871 INFO:tasks.workunit.client.0.smithi081.stdout:7/470: truncate d2/d14/d66/f69 1472028 0 2024-09-18T12:51:19.871 INFO:tasks.workunit.client.1.smithi136.stdout:0/873: dread d1/d3/d1a/d98/d81/d35/d84/f8b [0,4194304] 0 2024-09-18T12:51:19.872 INFO:tasks.workunit.client.0.smithi081.stdout:6/426: fsync d4/d12/d1c/d39/f89 0 2024-09-18T12:51:19.873 INFO:tasks.workunit.client.0.smithi081.stdout:6/427: rmdir d4/d12/d28/d2a/d74/d8b/d54 39 2024-09-18T12:51:19.876 INFO:tasks.workunit.client.1.smithi136.stdout:0/874: dread d1/d46/d6c/fa9 [0,4194304] 0 2024-09-18T12:51:19.877 INFO:tasks.workunit.client.1.smithi136.stdout:0/875: symlink d1/db/d76/l12d 0 2024-09-18T12:51:19.878 INFO:tasks.workunit.client.1.smithi136.stdout:0/876: chown d1/d60/dcb/dee/f11c 1661765 1 2024-09-18T12:51:19.880 INFO:tasks.workunit.client.1.smithi136.stdout:0/877: rename d1/d3/d1a/d98/d81/d35/lea to d1/d3/d1a/l12e 0 2024-09-18T12:51:19.886 INFO:tasks.workunit.client.1.smithi136.stdout:5/905: sync 2024-09-18T12:51:19.889 INFO:tasks.workunit.client.1.smithi136.stdout:5/906: write d5/d1a/d2d/d34/f95 [214731,34350] 0 2024-09-18T12:51:19.889 INFO:tasks.workunit.client.1.smithi136.stdout:4/739: dread d0/f4a [0,4194304] 0 2024-09-18T12:51:19.889 INFO:tasks.workunit.client.1.smithi136.stdout:4/740: dread - d0/d3/d54/d5c/fe4 zero size 2024-09-18T12:51:19.892 INFO:tasks.workunit.client.1.smithi136.stdout:4/741: symlink d0/d25/db7/lee 0 2024-09-18T12:51:19.892 INFO:tasks.workunit.client.1.smithi136.stdout:4/742: write d0/d3/f73 [1527712,91305] 0 2024-09-18T12:51:19.893 INFO:tasks.workunit.client.1.smithi136.stdout:5/907: rmdir d5/d1a/d2d/d34/d4e/db5 39 2024-09-18T12:51:19.894 INFO:tasks.workunit.client.1.smithi136.stdout:5/908: read d5/d1a/d2d/d34/d4e/f70 [580651,42561] 0 2024-09-18T12:51:19.894 INFO:tasks.workunit.client.1.smithi136.stdout:5/909: stat d5/d1a/d2d/d3f/c46 0 2024-09-18T12:51:19.896 INFO:tasks.workunit.client.1.smithi136.stdout:5/910: link d5/d1a/d2d/d3f/d7f/ff7 d5/d1a/d4a/f11e 0 2024-09-18T12:51:19.897 INFO:tasks.workunit.client.1.smithi136.stdout:5/911: symlink d5/d1a/d2d/d34/d4e/d9b/l11f 0 2024-09-18T12:51:19.897 INFO:tasks.workunit.client.1.smithi136.stdout:5/912: creat d5/d1a/d2d/d34/d4e/d7a/d9e/da9/f120 x:0 0 0 2024-09-18T12:51:19.922 INFO:tasks.workunit.client.1.smithi136.stdout:6/773: dwrite d8/d9/de/f40 [4194304,4194304] 0 2024-09-18T12:51:19.939 INFO:tasks.workunit.client.0.smithi081.stdout:5/484: dwrite d2/d14/d33/f7e [0,4194304] 0 2024-09-18T12:51:19.939 INFO:tasks.workunit.client.0.smithi081.stdout:6/428: dwrite d4/f75 [4194304,4194304] 0 2024-09-18T12:51:19.939 INFO:tasks.workunit.client.1.smithi136.stdout:4/743: write d0/d25/fd6 [1982387,114047] 0 2024-09-18T12:51:19.940 INFO:tasks.workunit.client.0.smithi081.stdout:5/485: getdents d2/d14/d33/d37/d3b/d5f/d89 0 2024-09-18T12:51:19.940 INFO:tasks.workunit.client.0.smithi081.stdout:6/429: dread d4/d12/d56/f63 [0,4194304] 0 2024-09-18T12:51:19.941 INFO:tasks.workunit.client.1.smithi136.stdout:4/744: rmdir d0/d3/d54/d5c/dc3 0 2024-09-18T12:51:19.942 INFO:tasks.workunit.client.0.smithi081.stdout:5/486: symlink d2/d14/d33/d37/d3b/d6a/l93 0 2024-09-18T12:51:19.942 INFO:tasks.workunit.client.0.smithi081.stdout:5/487: dread - d2/d14/d33/d37/f54 zero size 2024-09-18T12:51:19.943 INFO:tasks.workunit.client.0.smithi081.stdout:6/430: creat d4/d12/d1c/d39/d60/f8c x:0 0 0 2024-09-18T12:51:19.943 INFO:tasks.workunit.client.1.smithi136.stdout:4/745: link d0/f82 d0/d45/d67/d7b/fef 0 2024-09-18T12:51:19.944 INFO:tasks.workunit.client.1.smithi136.stdout:4/746: creat d0/d3/d90/ff0 x:0 0 0 2024-09-18T12:51:19.944 INFO:tasks.workunit.client.1.smithi136.stdout:4/747: fdatasync d0/d3/d54/fe8 0 2024-09-18T12:51:19.944 INFO:tasks.workunit.client.0.smithi081.stdout:5/488: unlink d2/d14/d33/d37/d3b/d2a/l3e 0 2024-09-18T12:51:19.945 INFO:tasks.workunit.client.1.smithi136.stdout:4/748: mknod d0/d25/db7/cf1 0 2024-09-18T12:51:19.946 INFO:tasks.workunit.client.0.smithi081.stdout:6/431: link d4/d12/d28/d2a/d74/d8b/f78 d4/d12/d1c/f8d 0 2024-09-18T12:51:19.947 INFO:tasks.workunit.client.1.smithi136.stdout:4/749: getdents d0/d5f 0 2024-09-18T12:51:19.948 INFO:tasks.workunit.client.1.smithi136.stdout:4/750: mknod d0/d45/cf2 0 2024-09-18T12:51:19.948 INFO:tasks.workunit.client.1.smithi136.stdout:0/878: dwrite d1/d3/d1a/d62/fa5 [0,4194304] 0 2024-09-18T12:51:19.948 INFO:tasks.workunit.client.1.smithi136.stdout:5/913: dwrite d5/d1a/d2d/d34/d4e/f70 [0,4194304] 0 2024-09-18T12:51:19.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/774: write d8/d9/d64/f98 [3339054,111231] 0 2024-09-18T12:51:19.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/775: stat d8/d9/d64/dbb/fc5 0 2024-09-18T12:51:19.959 INFO:tasks.workunit.client.0.smithi081.stdout:5/489: read d2/d14/d33/f7e [1343843,5624] 0 2024-09-18T12:51:19.959 INFO:tasks.workunit.client.0.smithi081.stdout:7/471: dwrite d2/f13 [0,4194304] 0 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.1.smithi136.stdout:4/751: rmdir d0/d3/d54/d5c 39 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.1.smithi136.stdout:4/752: write d0/d25/d83/fa3 [4946738,53069] 0 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.1.smithi136.stdout:4/753: readlink d0/l2a 0 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.1.smithi136.stdout:4/754: dread - d0/d3/dae/fe6 zero size 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.1.smithi136.stdout:4/755: truncate d0/d3/d90/fe3 337998 0 2024-09-18T12:51:19.962 INFO:tasks.workunit.client.0.smithi081.stdout:5/490: creat d2/d14/d33/d37/d3b/d2a/f94 x:0 0 0 2024-09-18T12:51:19.964 INFO:tasks.workunit.client.0.smithi081.stdout:7/472: unlink d2/d14/fa0 0 2024-09-18T12:51:19.964 INFO:tasks.workunit.client.0.smithi081.stdout:7/473: chown d2/fe 9960 1 2024-09-18T12:51:19.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/474: rmdir d2/d14/d21 39 2024-09-18T12:51:19.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/475: chown d2/d14/d21/l6c 4 1 2024-09-18T12:51:19.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/476: chown d2/d18/d22/d48 7 1 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.1.smithi136.stdout:4/756: rename d0/d2/d85/lc5 to d0/d25/d79/lf3 0 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.0.smithi081.stdout:5/491: read d2/dd/d5e/f40 [350221,16930] 0 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.0.smithi081.stdout:5/492: write d2/d14/d33/d37/d3b/d5f/f79 [1030736,6544] 0 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.0.smithi081.stdout:5/493: chown d2/d14/d1d/d1a 62 1 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.0.smithi081.stdout:5/494: stat d2/d14/d33/d37/d3b/d5f/d89/l7c 0 2024-09-18T12:51:19.966 INFO:tasks.workunit.client.0.smithi081.stdout:7/477: symlink d2/d14/d21/d49/lac 0 2024-09-18T12:51:19.967 INFO:tasks.workunit.client.0.smithi081.stdout:5/495: creat d2/d14/d33/d37/f95 x:0 0 0 2024-09-18T12:51:19.968 INFO:tasks.workunit.client.0.smithi081.stdout:7/478: creat d2/d18/d60/fad x:0 0 0 2024-09-18T12:51:19.969 INFO:tasks.workunit.client.1.smithi136.stdout:4/757: creat d0/d25/d79/ff4 x:0 0 0 2024-09-18T12:51:19.969 INFO:tasks.workunit.client.0.smithi081.stdout:5/496: creat d2/d47/d7f/f96 x:0 0 0 2024-09-18T12:51:19.969 INFO:tasks.workunit.client.0.smithi081.stdout:5/497: creat d2/d14/d33/d37/d3b/d6a/d20/f97 x:0 0 0 2024-09-18T12:51:19.970 INFO:tasks.workunit.client.0.smithi081.stdout:5/498: dread - d2/d14/d1d/d1a/f81 zero size 2024-09-18T12:51:19.970 INFO:tasks.workunit.client.0.smithi081.stdout:7/479: symlink d2/d7f/lae 0 2024-09-18T12:51:19.970 INFO:tasks.workunit.client.0.smithi081.stdout:7/480: fdatasync d2/d14/d21/d62/da7/f47 0 2024-09-18T12:51:19.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/499: unlink d2/d14/d33/d37/d3b/d2a/f4c 0 2024-09-18T12:51:19.972 INFO:tasks.workunit.client.0.smithi081.stdout:5/500: write d2/d14/d33/d37/d3b/d5f/d89/f65 [14524,46971] 0 2024-09-18T12:51:19.972 INFO:tasks.workunit.client.0.smithi081.stdout:5/501: creat d2/d14/d33/d37/d3b/d6a/f98 x:0 0 0 2024-09-18T12:51:19.978 INFO:tasks.workunit.client.0.smithi081.stdout:7/481: dread d2/d14/d21/d62/da7/f50 [0,4194304] 0 2024-09-18T12:51:19.979 INFO:tasks.workunit.client.0.smithi081.stdout:7/482: symlink d2/d14/d66/laf 0 2024-09-18T12:51:19.979 INFO:tasks.workunit.client.0.smithi081.stdout:7/483: fdatasync d2/d14/f2f 0 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:0/450: sync 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:4/381: sync 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:9/402: sync 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:2/509: sync 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:4/382: readlink d3/d20/d3d/d65/d45/d6c/l77 0 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:4/383: dread - d3/d20/d3d/d65/d14/d4b/f74 zero size 2024-09-18T12:51:19.981 INFO:tasks.workunit.client.0.smithi081.stdout:9/403: write dd/d1d/d1e/d24/d2a/f68 [4748348,86443] 0 2024-09-18T12:51:19.983 INFO:tasks.workunit.client.0.smithi081.stdout:4/384: rename d3/db/fe to d3/d20/d3d/d65/d45/d4f/f82 0 2024-09-18T12:51:19.983 INFO:tasks.workunit.client.0.smithi081.stdout:3/432: sync 2024-09-18T12:51:19.983 INFO:tasks.workunit.client.0.smithi081.stdout:0/451: dread d7/d9/d12/f39 [0,4194304] 0 2024-09-18T12:51:19.983 INFO:tasks.workunit.client.0.smithi081.stdout:3/433: write d3/db/d1b/d57/f49 [2438472,74409] 0 2024-09-18T12:51:19.983 INFO:tasks.workunit.client.0.smithi081.stdout:3/434: write d3/db/d1b/d57/f49 [5115851,81735] 0 2024-09-18T12:51:19.984 INFO:tasks.workunit.client.1.smithi136.stdout:8/901: sync 2024-09-18T12:51:19.984 INFO:tasks.workunit.client.1.smithi136.stdout:2/894: sync 2024-09-18T12:51:19.984 INFO:tasks.workunit.client.1.smithi136.stdout:3/779: sync 2024-09-18T12:51:19.984 INFO:tasks.workunit.client.1.smithi136.stdout:2/895: write d5/f12b [857270,86086] 0 2024-09-18T12:51:19.984 INFO:tasks.workunit.client.1.smithi136.stdout:2/896: stat d5/d7/d11/d34/fa7 0 2024-09-18T12:51:19.985 INFO:tasks.workunit.client.1.smithi136.stdout:4/758: write d0/d3/f89 [5163980,45477] 0 2024-09-18T12:51:19.985 INFO:tasks.workunit.client.1.smithi136.stdout:4/759: fsync d0/d3/d54/d5c/fe4 0 2024-09-18T12:51:19.985 INFO:tasks.workunit.client.1.smithi136.stdout:6/776: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:19.985 INFO:tasks.workunit.client.1.smithi136.stdout:4/760: write d0/d3/dae/fb5 [3876654,66379] 0 2024-09-18T12:51:19.986 INFO:tasks.workunit.client.0.smithi081.stdout:9/404: link dd/f20 dd/d15/d1a/d8d/f8e 0 2024-09-18T12:51:19.989 INFO:tasks.workunit.client.0.smithi081.stdout:9/405: read dd/de/f13 [5057304,77432] 0 2024-09-18T12:51:19.990 INFO:tasks.workunit.client.1.smithi136.stdout:8/902: creat d9/d18/d34/d3d/d47/d65/d93/f140 x:0 0 0 2024-09-18T12:51:19.990 INFO:tasks.workunit.client.1.smithi136.stdout:3/780: mkdir d3/d5/d3c/df7 0 2024-09-18T12:51:19.992 INFO:tasks.workunit.client.0.smithi081.stdout:0/452: rename d7/c14 to d7/d9/d4b/d33/c95 0 2024-09-18T12:51:19.992 INFO:tasks.workunit.client.0.smithi081.stdout:0/453: chown d7/d9/d4b/d33/d43/c7b 109386 1 2024-09-18T12:51:19.992 INFO:tasks.workunit.client.1.smithi136.stdout:6/777: rmdir d8/d9/db1 0 2024-09-18T12:51:19.993 INFO:tasks.workunit.client.1.smithi136.stdout:4/761: rmdir d0/d2/d85 39 2024-09-18T12:51:19.993 INFO:tasks.workunit.client.0.smithi081.stdout:3/435: mkdir d3/db/df/d29/d13/d9d 0 2024-09-18T12:51:19.994 INFO:tasks.workunit.client.1.smithi136.stdout:3/781: mknod d3/d14/d17/d75/d87/cf8 0 2024-09-18T12:51:19.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/436: mknod d3/db/df/d29/d13/d93/c9e 0 2024-09-18T12:51:19.998 INFO:tasks.workunit.client.0.smithi081.stdout:9/406: getdents dd/d1d/d1e/d2f 0 2024-09-18T12:51:19.998 INFO:tasks.workunit.client.1.smithi136.stdout:8/903: creat d9/d14/d1a/d2b/d42/d104/f141 x:0 0 0 2024-09-18T12:51:19.998 INFO:tasks.workunit.client.1.smithi136.stdout:6/778: truncate d8/d9/de/d1c/f2b 3973970 0 2024-09-18T12:51:19.998 INFO:tasks.workunit.client.1.smithi136.stdout:8/904: creat d9/d18/d34/d3d/d47/dbe/f142 x:0 0 0 2024-09-18T12:51:19.998 INFO:tasks.workunit.client.1.smithi136.stdout:8/905: dread - d9/d18/d34/d3d/d47/d65/d93/d96/f11a zero size 2024-09-18T12:51:19.999 INFO:tasks.workunit.client.1.smithi136.stdout:8/906: chown d9/d14/d1a/d2b/deb/d110 31 1 2024-09-18T12:51:19.999 INFO:tasks.workunit.client.1.smithi136.stdout:4/762: truncate d0/d2/f3e 4567963 0 2024-09-18T12:51:19.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/407: getdents dd/d15/d1a/d35 0 2024-09-18T12:51:19.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/408: chown f8 523210232 1 2024-09-18T12:51:20.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/409: rmdir dd/d15/d1a/d3d/d80 0 2024-09-18T12:51:20.002 INFO:tasks.workunit.client.1.smithi136.stdout:6/779: mkdir d8/d9/de/d1c/d50/da8/df2/df5 0 2024-09-18T12:51:20.002 INFO:tasks.workunit.client.1.smithi136.stdout:6/780: truncate d8/d9/d64/fac 687270 0 2024-09-18T12:51:20.003 INFO:tasks.workunit.client.0.smithi081.stdout:2/510: read d15/d16/d20/d22/f34 [6281710,30378] 0 2024-09-18T12:51:20.005 INFO:tasks.workunit.client.1.smithi136.stdout:8/907: link d9/d18/d34/d3d/d47/c90 d9/d18/d34/c143 0 2024-09-18T12:51:20.005 INFO:tasks.workunit.client.1.smithi136.stdout:8/908: dread - d9/d18/d34/d3d/d47/d65/d93/d96/f11a zero size 2024-09-18T12:51:20.006 INFO:tasks.workunit.client.1.smithi136.stdout:6/781: creat d8/d9d/db4/ff6 x:0 0 0 2024-09-18T12:51:20.006 INFO:tasks.workunit.client.1.smithi136.stdout:6/782: stat d8/d9/l3a 0 2024-09-18T12:51:20.008 INFO:tasks.workunit.client.1.smithi136.stdout:8/909: truncate d9/d14/f11 1768918 0 2024-09-18T12:51:20.009 INFO:tasks.workunit.client.0.smithi081.stdout:0/454: dread d7/d9/d4b/d53/f70 [0,4194304] 0 2024-09-18T12:51:20.009 INFO:tasks.workunit.client.1.smithi136.stdout:6/783: mknod d8/d9/de/d60/d71/d7f/cf7 0 2024-09-18T12:51:20.009 INFO:tasks.workunit.client.1.smithi136.stdout:6/784: fsync d8/d9/d56/d96/d9c/fd9 0 2024-09-18T12:51:20.010 INFO:tasks.workunit.client.0.smithi081.stdout:2/511: rename d15/d16/d20/d22/d8c/d6b to d15/d16/d33/d53/d7a/d2f/db3 0 2024-09-18T12:51:20.010 INFO:tasks.workunit.client.0.smithi081.stdout:2/512: creat d15/d16/d33/d53/d7a/d2f/d61/fb4 x:0 0 0 2024-09-18T12:51:20.012 INFO:tasks.workunit.client.0.smithi081.stdout:0/455: rename d7/d5d/c5f to d7/d9/c96 0 2024-09-18T12:51:20.014 INFO:tasks.workunit.client.0.smithi081.stdout:2/513: creat d15/d16/d33/d53/d7a/fb5 x:0 0 0 2024-09-18T12:51:20.014 INFO:tasks.workunit.client.0.smithi081.stdout:2/514: write d15/d16/d20/d22/f2a [1232633,6200] 0 2024-09-18T12:51:20.014 INFO:tasks.workunit.client.0.smithi081.stdout:2/515: fsync d15/d16/f58 0 2024-09-18T12:51:20.015 INFO:tasks.workunit.client.0.smithi081.stdout:2/516: symlink d15/d16/d33/d53/d7a/d2f/d61/d97/lb6 0 2024-09-18T12:51:20.018 INFO:tasks.workunit.client.0.smithi081.stdout:2/517: rename d15/d16/d33/d53/d7a/d2f/d61/d97/lae to d15/d16/d20/lb7 0 2024-09-18T12:51:20.018 INFO:tasks.workunit.client.0.smithi081.stdout:2/518: write d15/d16/d20/d22/d8c/f7c [394542,14673] 0 2024-09-18T12:51:20.018 INFO:tasks.workunit.client.0.smithi081.stdout:2/519: fdatasync d15/d16/f58 0 2024-09-18T12:51:20.018 INFO:tasks.workunit.client.0.smithi081.stdout:2/520: stat d15/d26 0 2024-09-18T12:51:20.018 INFO:tasks.workunit.client.0.smithi081.stdout:2/521: mknod d15/d16/d33/d53/cb8 0 2024-09-18T12:51:20.023 INFO:tasks.workunit.client.0.smithi081.stdout:2/522: dread d15/d26/f92 [0,4194304] 0 2024-09-18T12:51:20.023 INFO:tasks.workunit.client.0.smithi081.stdout:2/523: readlink d15/d6e/l8f 0 2024-09-18T12:51:20.024 INFO:tasks.workunit.client.0.smithi081.stdout:2/524: symlink d15/d16/d20/d31/lb9 0 2024-09-18T12:51:20.025 INFO:tasks.workunit.client.0.smithi081.stdout:2/525: symlink d15/d16/d33/d53/d7a/d2f/db3/lba 0 2024-09-18T12:51:20.026 INFO:tasks.workunit.client.0.smithi081.stdout:2/526: mknod d15/d16/d33/d53/d7a/d32/d6d/cbb 0 2024-09-18T12:51:20.026 INFO:tasks.workunit.client.0.smithi081.stdout:2/527: creat d15/d16/d20/d59/fbc x:0 0 0 2024-09-18T12:51:20.028 INFO:tasks.workunit.client.0.smithi081.stdout:2/528: creat d15/d16/d20/fbd x:0 0 0 2024-09-18T12:51:20.028 INFO:tasks.workunit.client.0.smithi081.stdout:2/529: fdatasync d15/d16/f37 0 2024-09-18T12:51:20.028 INFO:tasks.workunit.client.0.smithi081.stdout:2/530: write d15/d16/d33/d53/d7a/d2f/db3/f6f [634876,90655] 0 2024-09-18T12:51:20.028 INFO:tasks.workunit.client.0.smithi081.stdout:2/531: write d15/d16/d20/fa4 [116426,21414] 0 2024-09-18T12:51:20.028 INFO:tasks.workunit.client.0.smithi081.stdout:0/456: dread d7/d9/d4b/d53/f61 [0,4194304] 0 2024-09-18T12:51:20.029 INFO:tasks.workunit.client.0.smithi081.stdout:2/532: symlink d15/d16/d33/d53/d7a/lbe 0 2024-09-18T12:51:20.030 INFO:tasks.workunit.client.0.smithi081.stdout:2/533: mknod d15/d16/d33/d53/d7a/d32/d6d/da0/cbf 0 2024-09-18T12:51:20.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/502: dwrite d2/d14/d33/d37/d3b/d6a/f35 [0,4194304] 0 2024-09-18T12:51:20.033 INFO:tasks.workunit.client.0.smithi081.stdout:5/503: creat d2/d14/d33/d37/d3b/d2a/d8e/f99 x:0 0 0 2024-09-18T12:51:20.033 INFO:tasks.workunit.client.0.smithi081.stdout:5/504: chown d2/d14/d33/d37/d3b/f13 578270844 1 2024-09-18T12:51:20.035 INFO:tasks.workunit.client.0.smithi081.stdout:5/505: unlink d2/dd/d5e/f70 0 2024-09-18T12:51:20.035 INFO:tasks.workunit.client.0.smithi081.stdout:5/506: chown d2/d14/d1d/d1a 44199851 1 2024-09-18T12:51:20.035 INFO:tasks.workunit.client.0.smithi081.stdout:5/507: creat d2/d14/d33/d37/d3b/d6a/d20/f9a x:0 0 0 2024-09-18T12:51:20.035 INFO:tasks.workunit.client.0.smithi081.stdout:5/508: creat d2/d14/d33/d37/d3b/d6a/f9b x:0 0 0 2024-09-18T12:51:20.037 INFO:tasks.workunit.client.0.smithi081.stdout:7/484: dwrite d2/d1d/f28 [0,4194304] 0 2024-09-18T12:51:20.037 INFO:tasks.workunit.client.0.smithi081.stdout:7/485: write d2/d14/d21/d62/da7/f3d [1521398,86603] 0 2024-09-18T12:51:20.040 INFO:tasks.workunit.client.0.smithi081.stdout:4/385: dwrite d3/db/f25 [0,4194304] 0 2024-09-18T12:51:20.041 INFO:tasks.workunit.client.0.smithi081.stdout:5/509: unlink d2/d14/d33/d37/d3b/d2a/f45 0 2024-09-18T12:51:20.042 INFO:tasks.workunit.client.0.smithi081.stdout:7/486: getdents d2/d56/d73/d7c/d86 0 2024-09-18T12:51:20.045 INFO:tasks.workunit.client.1.smithi136.stdout:3/782: dwrite d3/d14/d17/d53/fca [0,4194304] 0 2024-09-18T12:51:20.045 INFO:tasks.workunit.client.1.smithi136.stdout:3/783: creat d3/ff9 x:0 0 0 2024-09-18T12:51:20.048 INFO:tasks.workunit.client.0.smithi081.stdout:5/510: mknod d2/d14/d33/d37/d3b/d16/c9c 0 2024-09-18T12:51:20.049 INFO:tasks.workunit.client.0.smithi081.stdout:7/487: symlink d2/d18/d60/daa/lb0 0 2024-09-18T12:51:20.049 INFO:tasks.workunit.client.0.smithi081.stdout:7/488: write d2/d18/d60/d85/f89 [1019120,70160] 0 2024-09-18T12:51:20.051 INFO:tasks.workunit.client.0.smithi081.stdout:9/410: dwrite dd/d31/f8b [0,4194304] 0 2024-09-18T12:51:20.051 INFO:tasks.workunit.client.0.smithi081.stdout:9/411: stat dd/d1d/d1e/d24/d2a/d55/l61 0 2024-09-18T12:51:20.053 INFO:tasks.workunit.client.0.smithi081.stdout:3/437: dwrite d3/db/df/d29/d13/f95 [0,4194304] 0 2024-09-18T12:51:20.056 INFO:tasks.workunit.client.1.smithi136.stdout:8/910: dwrite d9/d14/d1a/d2b/d42/d9e/fc3 [0,4194304] 0 2024-09-18T12:51:20.056 INFO:tasks.workunit.client.1.smithi136.stdout:8/911: creat d9/d18/d34/d3d/d47/dbe/dd1/f144 x:0 0 0 2024-09-18T12:51:20.057 INFO:tasks.workunit.client.0.smithi081.stdout:9/412: rename dd/d15/l89 to dd/d1d/d1e/d39/d73/l8f 0 2024-09-18T12:51:20.058 INFO:tasks.workunit.client.0.smithi081.stdout:5/511: dread d2/d14/d33/d37/d3b/d5f/f60 [0,4194304] 0 2024-09-18T12:51:20.059 INFO:tasks.workunit.client.0.smithi081.stdout:3/438: mknod d3/db/df/d60/d58/c9f 0 2024-09-18T12:51:20.060 INFO:tasks.workunit.client.0.smithi081.stdout:9/413: symlink dd/de/d7a/l90 0 2024-09-18T12:51:20.061 INFO:tasks.workunit.client.0.smithi081.stdout:5/512: rename d2/d14/d33/d37/d3b/c72 to d2/d47/d7f/c9d 0 2024-09-18T12:51:20.062 INFO:tasks.workunit.client.0.smithi081.stdout:3/439: mknod d3/db/df/d29/d12/d44/d51/ca0 0 2024-09-18T12:51:20.062 INFO:tasks.workunit.client.1.smithi136.stdout:3/784: dread d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:20.063 INFO:tasks.workunit.client.0.smithi081.stdout:5/513: mkdir d2/dd/d9e 0 2024-09-18T12:51:20.063 INFO:tasks.workunit.client.0.smithi081.stdout:5/514: creat d2/d47/f9f x:0 0 0 2024-09-18T12:51:20.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/440: symlink d3/db/dc/la1 0 2024-09-18T12:51:20.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/441: creat d3/db/df/d29/d12/d44/d51/fa2 x:0 0 0 2024-09-18T12:51:20.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/442: fdatasync d3/db/d1b/f94 0 2024-09-18T12:51:20.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/443: readlink d3/db/df/d29/d12/l39 0 2024-09-18T12:51:20.065 INFO:tasks.workunit.client.1.smithi136.stdout:3/785: link d3/d14/d17/d53/d73/fa5 d3/d14/d17/d75/d86/ffa 0 2024-09-18T12:51:20.066 INFO:tasks.workunit.client.0.smithi081.stdout:5/515: creat d2/d14/d1d/d1a/fa0 x:0 0 0 2024-09-18T12:51:20.066 INFO:tasks.workunit.client.0.smithi081.stdout:5/516: creat d2/d14/d33/d37/d3b/d2a/d8e/fa1 x:0 0 0 2024-09-18T12:51:20.066 INFO:tasks.workunit.client.0.smithi081.stdout:5/517: truncate d2/d14/d33/d37/d3b/d16/f69 581518 0 2024-09-18T12:51:20.066 INFO:tasks.workunit.client.1.smithi136.stdout:3/786: symlink d3/d14/d17/d53/d73/dbf/lfb 0 2024-09-18T12:51:20.068 INFO:tasks.workunit.client.0.smithi081.stdout:5/518: symlink d2/d14/d33/d37/d3b/d5f/la2 0 2024-09-18T12:51:20.069 INFO:tasks.workunit.client.0.smithi081.stdout:5/519: mknod d2/d14/d33/d37/d3b/d5f/ca3 0 2024-09-18T12:51:20.076 INFO:tasks.workunit.client.0.smithi081.stdout:9/414: dread dd/d1d/d1e/d39/f3f [4194304,4194304] 0 2024-09-18T12:51:20.077 INFO:tasks.workunit.client.0.smithi081.stdout:9/415: getdents dd/d1d/d1e/d24 0 2024-09-18T12:51:20.078 INFO:tasks.workunit.client.0.smithi081.stdout:0/457: dwrite d7/d9/f11 [0,4194304] 0 2024-09-18T12:51:20.079 INFO:tasks.workunit.client.0.smithi081.stdout:0/458: rmdir d7/d9/d12 39 2024-09-18T12:51:20.098 INFO:tasks.workunit.client.1.smithi136.stdout:3/787: dwrite d3/d14/fb9 [0,4194304] 0 2024-09-18T12:51:20.100 INFO:tasks.workunit.client.1.smithi136.stdout:3/788: creat d3/d14/d18/ffc x:0 0 0 2024-09-18T12:51:20.101 INFO:tasks.workunit.client.1.smithi136.stdout:3/789: fdatasync d3/d14/fb9 0 2024-09-18T12:51:20.101 INFO:tasks.workunit.client.1.smithi136.stdout:3/790: write d3/d14/f9d [1513276,112457] 0 2024-09-18T12:51:20.109 INFO:tasks.workunit.client.1.smithi136.stdout:6/785: dwrite d8/d9/de/d1c/f2b [0,4194304] 0 2024-09-18T12:51:20.113 INFO:tasks.workunit.client.1.smithi136.stdout:6/786: creat d8/d9/de/ff8 x:0 0 0 2024-09-18T12:51:20.114 INFO:tasks.workunit.client.1.smithi136.stdout:6/787: symlink d8/d9/de/d60/lf9 0 2024-09-18T12:51:20.115 INFO:tasks.workunit.client.1.smithi136.stdout:6/788: readlink d8/d9/de/d1c/l4d 0 2024-09-18T12:51:20.116 INFO:tasks.workunit.client.0.smithi081.stdout:5/520: dwrite d2/dd/f75 [0,4194304] 0 2024-09-18T12:51:20.116 INFO:tasks.workunit.client.0.smithi081.stdout:5/521: dread - d2/d14/d33/d37/d3b/d2a/f94 zero size 2024-09-18T12:51:20.116 INFO:tasks.workunit.client.0.smithi081.stdout:5/522: chown d2/d14/d1d/d1a 540853511 1 2024-09-18T12:51:20.116 INFO:tasks.workunit.client.1.smithi136.stdout:6/789: creat d8/d9/de/d1c/d50/da8/df2/ffa x:0 0 0 2024-09-18T12:51:20.119 INFO:tasks.workunit.client.1.smithi136.stdout:6/790: unlink c6 0 2024-09-18T12:51:20.119 INFO:tasks.workunit.client.0.smithi081.stdout:2/534: rmdir d15/d16/d33/d53/d7a/d2f 39 2024-09-18T12:51:20.122 INFO:tasks.workunit.client.0.smithi081.stdout:0/459: dread d7/d9/f3e [4194304,4194304] 0 2024-09-18T12:51:20.124 INFO:tasks.workunit.client.0.smithi081.stdout:5/523: mkdir d2/d14/d1d/da4 0 2024-09-18T12:51:20.124 INFO:tasks.workunit.client.0.smithi081.stdout:5/524: write d2/d14/d33/d37/d3b/d2a/d8e/f99 [409567,121477] 0 2024-09-18T12:51:20.126 INFO:tasks.workunit.client.0.smithi081.stdout:4/386: dwrite d3/d20/d3d/d65/d14/d27/f37 [0,4194304] 0 2024-09-18T12:51:20.127 INFO:tasks.workunit.client.0.smithi081.stdout:5/525: symlink d2/la5 0 2024-09-18T12:51:20.127 INFO:tasks.workunit.client.0.smithi081.stdout:7/489: dwrite d2/f6 [0,4194304] 0 2024-09-18T12:51:20.127 INFO:tasks.workunit.client.0.smithi081.stdout:4/387: write d3/d20/d3d/d65/f63 [432521,50740] 0 2024-09-18T12:51:20.127 INFO:tasks.workunit.client.0.smithi081.stdout:3/444: dwrite d3/db/df/d29/d12/d44/d76/f8c [0,4194304] 0 2024-09-18T12:51:20.129 INFO:tasks.workunit.client.1.smithi136.stdout:3/791: dwrite d3/d14/f3a [0,4194304] 0 2024-09-18T12:51:20.129 INFO:tasks.workunit.client.1.smithi136.stdout:3/792: chown d3/d14/d22 692865789 1 2024-09-18T12:51:20.129 INFO:tasks.workunit.client.1.smithi136.stdout:3/793: chown d3/d14/d17/d75/d87/fc3 0 1 2024-09-18T12:51:20.132 INFO:tasks.workunit.client.0.smithi081.stdout:5/526: creat d2/d14/d33/d37/d3b/d16/fa6 x:0 0 0 2024-09-18T12:51:20.137 INFO:tasks.workunit.client.0.smithi081.stdout:7/490: unlink d2/f39 0 2024-09-18T12:51:20.138 INFO:tasks.workunit.client.1.smithi136.stdout:3/794: mknod d3/d5/d31/cfd 0 2024-09-18T12:51:20.141 INFO:tasks.workunit.client.1.smithi136.stdout:9/811: sync 2024-09-18T12:51:20.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/812: fdatasync d6/df/dd3/fe3 0 2024-09-18T12:51:20.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/813: getdents d6/da/d3d/d4d/d91/d25/df3 0 2024-09-18T12:51:20.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/814: write d6/da/d3d/d41/fb8 [839892,60938] 0 2024-09-18T12:51:20.142 INFO:tasks.workunit.client.1.smithi136.stdout:9/815: write d6/da/d3d/d4d/d91/d25/f39 [4974667,30780] 0 2024-09-18T12:51:20.143 INFO:tasks.workunit.client.1.smithi136.stdout:3/795: rename d3/d5/d3c to d3/d2b/d6c/db4/dfe 0 2024-09-18T12:51:20.145 INFO:tasks.workunit.client.1.smithi136.stdout:3/796: rename d3/d2b/d6c/f6f to d3/d14/d17/d75/d86/fff 0 2024-09-18T12:51:20.145 INFO:tasks.workunit.client.1.smithi136.stdout:3/797: dread - d3/d14/d17/fc2 zero size 2024-09-18T12:51:20.146 INFO:tasks.workunit.client.1.smithi136.stdout:3/798: mkdir d3/d14/d18/d7f/d100 0 2024-09-18T12:51:20.149 INFO:tasks.workunit.client.0.smithi081.stdout:3/445: write d3/db/df/d29/f19 [1897110,116243] 0 2024-09-18T12:51:20.149 INFO:tasks.workunit.client.0.smithi081.stdout:3/446: creat d3/db/df/d29/d13/d68/fa3 x:0 0 0 2024-09-18T12:51:20.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/535: dwrite d15/d16/d33/f5b [0,4194304] 0 2024-09-18T12:51:20.155 INFO:tasks.workunit.client.0.smithi081.stdout:7/491: dread d2/f12 [0,4194304] 0 2024-09-18T12:51:20.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/536: mknod d15/cc0 0 2024-09-18T12:51:20.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/537: creat d15/d16/d20/fc1 x:0 0 0 2024-09-18T12:51:20.157 INFO:tasks.workunit.client.0.smithi081.stdout:7/492: unlink d2/d18/d60/d85/l98 0 2024-09-18T12:51:20.161 INFO:tasks.workunit.client.0.smithi081.stdout:2/538: rename d15/d16/d20/d22/d8c to d15/d16/d33/d53/d7a/d2f/dc2 0 2024-09-18T12:51:20.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/539: symlink d15/d16/d20/d22/lc3 0 2024-09-18T12:51:20.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/540: read - d15/d16/d20/d59/f9b zero size 2024-09-18T12:51:20.179 INFO:tasks.workunit.client.1.smithi136.stdout:6/791: dwrite f5 [0,4194304] 0 2024-09-18T12:51:20.180 INFO:tasks.workunit.client.1.smithi136.stdout:6/792: truncate d8/d9/de/d1c/f38 219336 0 2024-09-18T12:51:20.180 INFO:tasks.workunit.client.1.smithi136.stdout:6/793: fdatasync d8/d9/de/d1c/fd2 0 2024-09-18T12:51:20.180 INFO:tasks.workunit.client.1.smithi136.stdout:6/794: chown d8/dc/c2c 1659 1 2024-09-18T12:51:20.181 INFO:tasks.workunit.client.1.smithi136.stdout:6/795: symlink d8/d9/de/d60/d94/lfb 0 2024-09-18T12:51:20.182 INFO:tasks.workunit.client.1.smithi136.stdout:6/796: getdents d8/d9d/db4 0 2024-09-18T12:51:20.184 INFO:tasks.workunit.client.1.smithi136.stdout:6/797: creat d8/d9/de/d60/d94/ffc x:0 0 0 2024-09-18T12:51:20.185 INFO:tasks.workunit.client.1.smithi136.stdout:6/798: mkdir d8/d9d/dfd 0 2024-09-18T12:51:20.185 INFO:tasks.workunit.client.1.smithi136.stdout:6/799: write d8/d9/d3c/f7a [397500,57623] 0 2024-09-18T12:51:20.194 INFO:tasks.workunit.client.0.smithi081.stdout:7/493: write d2/d1d/f28 [964974,19449] 0 2024-09-18T12:51:20.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/494: fsync d2/d18/f3b 0 2024-09-18T12:51:20.215 INFO:tasks.workunit.client.0.smithi081.stdout:5/527: dread d2/d14/f17 [0,4194304] 0 2024-09-18T12:51:20.217 INFO:tasks.workunit.client.0.smithi081.stdout:5/528: unlink d2/d14/d33/d37/d3b/d16/l51 0 2024-09-18T12:51:20.218 INFO:tasks.workunit.client.0.smithi081.stdout:5/529: unlink d2/d14/d33/d37/d3b/l91 0 2024-09-18T12:51:20.220 INFO:tasks.workunit.client.0.smithi081.stdout:2/541: read fd [2071806,101257] 0 2024-09-18T12:51:20.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/542: mknod d15/d16/d33/d53/d7a/d32/d6d/cc4 0 2024-09-18T12:51:20.222 INFO:tasks.workunit.client.0.smithi081.stdout:2/543: mkdir d15/d16/d33/d53/d7a/d2f/d61/dc5 0 2024-09-18T12:51:20.223 INFO:tasks.workunit.client.0.smithi081.stdout:0/460: dwrite d7/f80 [0,4194304] 0 2024-09-18T12:51:20.225 INFO:tasks.workunit.client.1.smithi136.stdout:6/800: write d8/d9/d56/f7e [294656,66136] 0 2024-09-18T12:51:20.226 INFO:tasks.workunit.client.1.smithi136.stdout:6/801: creat d8/ffe x:0 0 0 2024-09-18T12:51:20.227 INFO:tasks.workunit.client.1.smithi136.stdout:6/802: truncate d8/d9/d3c/f68 2439420 0 2024-09-18T12:51:20.228 INFO:tasks.workunit.client.1.smithi136.stdout:6/803: dread - d8/d9/d3c/d4a/f91 zero size 2024-09-18T12:51:20.228 INFO:tasks.workunit.client.0.smithi081.stdout:0/461: dread d7/d9/f3e [4194304,4194304] 0 2024-09-18T12:51:20.229 INFO:tasks.workunit.client.0.smithi081.stdout:0/462: mknod d7/d9/d4b/d33/d43/c97 0 2024-09-18T12:51:20.230 INFO:tasks.workunit.client.0.smithi081.stdout:0/463: fdatasync d7/d9/d4b/d33/d7d/f88 0 2024-09-18T12:51:20.230 INFO:tasks.workunit.client.0.smithi081.stdout:0/464: chown d7/d9/d4b/d4a/f72 243278 1 2024-09-18T12:51:20.230 INFO:tasks.workunit.client.0.smithi081.stdout:0/465: link d7/d9/d4b/d33/l66 d7/d9/d4b/d4a/l98 0 2024-09-18T12:51:20.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/466: rmdir d7/d4f/d8f 0 2024-09-18T12:51:20.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/467: mknod d7/d9/d4b/d4a/d77/c99 0 2024-09-18T12:51:20.233 INFO:tasks.workunit.client.0.smithi081.stdout:0/468: mkdir d7/d9/d4b/d33/d43/d9a 0 2024-09-18T12:51:20.234 INFO:tasks.workunit.client.0.smithi081.stdout:0/469: rename d7/d9/d12/f31 to d7/d9/d4b/d4a/d92/f9b 0 2024-09-18T12:51:20.234 INFO:tasks.workunit.client.0.smithi081.stdout:0/470: readlink d7/d9/d4b/d4a/l62 0 2024-09-18T12:51:20.235 INFO:tasks.workunit.client.0.smithi081.stdout:0/471: chown d7/d9/d12/l76 1617431 1 2024-09-18T12:51:20.235 INFO:tasks.workunit.client.0.smithi081.stdout:0/472: link l2 d7/l9c 0 2024-09-18T12:51:20.236 INFO:tasks.workunit.client.0.smithi081.stdout:0/473: rmdir d7/d7c 39 2024-09-18T12:51:20.236 INFO:tasks.workunit.client.0.smithi081.stdout:0/474: write d7/d9/d12/f39 [2554855,32884] 0 2024-09-18T12:51:20.237 INFO:tasks.workunit.client.0.smithi081.stdout:0/475: creat d7/d9/d4b/f9d x:0 0 0 2024-09-18T12:51:20.238 INFO:tasks.workunit.client.0.smithi081.stdout:0/476: write f0 [10218812,1039] 0 2024-09-18T12:51:20.238 INFO:tasks.workunit.client.0.smithi081.stdout:0/477: truncate d7/d9/d4b/d4a/f1e 599575 0 2024-09-18T12:51:20.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/478: rename d7/d9/d4b/d33/f34 to d7/d9/d4b/d33/d43/d9a/f9e 0 2024-09-18T12:51:20.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/479: chown d7/d5d/f7f 960236807 1 2024-09-18T12:51:20.242 INFO:tasks.workunit.client.0.smithi081.stdout:5/530: write d2/d47/f58 [3428677,91296] 0 2024-09-18T12:51:20.243 INFO:tasks.workunit.client.0.smithi081.stdout:5/531: mknod d2/d14/d33/d37/d3b/d6a/ca7 0 2024-09-18T12:51:20.245 INFO:tasks.workunit.client.0.smithi081.stdout:5/532: getdents d2/d14/d33/d37/d3b/d6a/d20 0 2024-09-18T12:51:20.246 INFO:tasks.workunit.client.0.smithi081.stdout:2/544: dread d15/d16/d33/d53/d7a/d2f/d61/f80 [0,4194304] 0 2024-09-18T12:51:20.246 INFO:tasks.workunit.client.0.smithi081.stdout:2/545: write d15/d16/d33/d53/d7a/d2f/fa6 [663835,100244] 0 2024-09-18T12:51:20.247 INFO:tasks.workunit.client.0.smithi081.stdout:2/546: link d15/d16/d33/d53/d7a/d2f/f5c d15/d16/d54/fc6 0 2024-09-18T12:51:20.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/547: unlink d15/d16/d33/d53/d7a/d2f/db3/f6f 0 2024-09-18T12:51:20.258 INFO:tasks.workunit.client.0.smithi081.stdout:7/495: dwrite d2/d56/d73/d7c/f63 [0,4194304] 0 2024-09-18T12:51:20.258 INFO:tasks.workunit.client.0.smithi081.stdout:7/496: chown d2/d1d/f38 1693705 1 2024-09-18T12:51:20.258 INFO:tasks.workunit.client.0.smithi081.stdout:7/497: chown d2/d56/d73/d7c/f63 77907 1 2024-09-18T12:51:20.258 INFO:tasks.workunit.client.0.smithi081.stdout:3/447: dwrite d3/d23/f79 [0,4194304] 0 2024-09-18T12:51:20.262 INFO:tasks.workunit.client.1.smithi136.stdout:3/799: dwrite d3/d14/d22/f37 [0,4194304] 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.1.smithi136.stdout:3/800: creat d3/d14/d17/d75/d86/dd9/df2/f101 x:0 0 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.1.smithi136.stdout:3/801: readlink d3/d14/d18/d7f/l6a 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/533: write d2/d14/d33/d37/d3b/f38 [944955,110701] 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/534: write d2/dd/d5e/f3a [13966,74612] 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/535: write d2/d14/d33/f8c [2980026,98669] 0 2024-09-18T12:51:20.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/536: chown d2/d14/d33/d37/d3b/d16/l83 2683 1 2024-09-18T12:51:20.270 INFO:tasks.workunit.client.0.smithi081.stdout:3/448: mkdir d3/db/da4 0 2024-09-18T12:51:20.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/802: rename d3/d14/d17/d75/d87 to d3/d5/d102 0 2024-09-18T12:51:20.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/803: getdents d3/d10/d4a 0 2024-09-18T12:51:20.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/804: truncate d3/d5/d31/f90 1296205 0 2024-09-18T12:51:20.272 INFO:tasks.workunit.client.1.smithi136.stdout:3/805: rename d3/d14 to d3/d14/d103 22 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:5/914: sync 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:2/897: sync 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:0/879: sync 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/970: sync 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:0/880: getdents d1/d3/d1a/d98/d81/d72/de8/d120 0 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/971: truncate d0/d12/d5e/d10d/f13c 756951 0 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:0/881: dread - d1/d3/d1a/d95/deb/f121 zero size 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/972: chown d0/l8 7960 1 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:7/973: creat d0/d39/d4d/d55/d101/f155 x:0 0 0 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/804: dwrite d8/d9/de/d1c/d50/da8/df2/ffa [0,4194304] 0 2024-09-18T12:51:20.275 INFO:tasks.workunit.client.1.smithi136.stdout:6/805: write d8/d9/de/d60/fa5 [662971,30213] 0 2024-09-18T12:51:20.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/449: symlink d3/d23/la5 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:3/450: dread - d3/db/df/d29/d12/d44/d51/fa2 zero size 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:3/451: creat d3/db/df/d29/d12/d44/d6f/fa6 x:0 0 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:2/548: dwrite d15/d16/d20/fc1 [0,4194304] 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:2/549: readlink d15/l1c 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:2/550: fsync d15/d16/d20/f4f 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:5/537: write d2/dd/f75 [2731089,116987] 0 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:5/538: chown d2/d14/d33/d37/d3b/d6a/d20/f97 77209 1 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:5/539: chown d2/d14/d33/d37/d3b/d2a 2 1 2024-09-18T12:51:20.277 INFO:tasks.workunit.client.0.smithi081.stdout:5/540: dread d2/d14/d33/d37/d3b/d16/f69 [0,4194304] 0 2024-09-18T12:51:20.278 INFO:tasks.workunit.client.1.smithi136.stdout:1/775: sync 2024-09-18T12:51:20.279 INFO:tasks.workunit.client.1.smithi136.stdout:4/763: sync 2024-09-18T12:51:20.280 INFO:tasks.workunit.client.1.smithi136.stdout:5/915: link d5/d1a/d2d/d34/d4e/db5/f108 d5/d1a/d4a/d79/f121 0 2024-09-18T12:51:20.281 INFO:tasks.workunit.client.1.smithi136.stdout:5/916: stat d5/f1c 0 2024-09-18T12:51:20.281 INFO:tasks.workunit.client.1.smithi136.stdout:2/898: symlink d5/d7/d41/d100/d128/l12f 0 2024-09-18T12:51:20.283 INFO:tasks.workunit.client.1.smithi136.stdout:4/764: creat d0/ff5 x:0 0 0 2024-09-18T12:51:20.285 INFO:tasks.workunit.client.1.smithi136.stdout:5/917: mkdir d5/d1a/d2d/d34/d4e/d7a/d122 0 2024-09-18T12:51:20.285 INFO:tasks.workunit.client.1.smithi136.stdout:5/918: creat d5/d1a/d2d/dc4/f123 x:0 0 0 2024-09-18T12:51:20.287 INFO:tasks.workunit.client.0.smithi081.stdout:3/452: rename d3/f7 to d3/db/df/d29/d12/d44/d51/fa7 0 2024-09-18T12:51:20.288 INFO:tasks.workunit.client.0.smithi081.stdout:3/453: chown d3/db/df/d29/d12/d44/d76/l78 446479836 1 2024-09-18T12:51:20.288 INFO:tasks.workunit.client.1.smithi136.stdout:4/765: getdents d0/d25/db7 0 2024-09-18T12:51:20.291 INFO:tasks.workunit.client.1.smithi136.stdout:4/766: rename d0/d2/d85/lb8 to d0/d3/dae/lf6 0 2024-09-18T12:51:20.291 INFO:tasks.workunit.client.1.smithi136.stdout:4/767: chown d0/d13/f6c 6814525 1 2024-09-18T12:51:20.294 INFO:tasks.workunit.client.1.smithi136.stdout:0/882: dread d1/d60/f6f [0,4194304] 0 2024-09-18T12:51:20.297 INFO:tasks.workunit.client.1.smithi136.stdout:4/768: creat d0/d5f/dd3/ff7 x:0 0 0 2024-09-18T12:51:20.299 INFO:tasks.workunit.client.1.smithi136.stdout:0/883: rmdir d1/db/d76/db9/de5 39 2024-09-18T12:51:20.300 INFO:tasks.workunit.client.0.smithi081.stdout:2/551: symlink d15/d16/d33/d53/d7a/d2f/lc7 0 2024-09-18T12:51:20.301 INFO:tasks.workunit.client.1.smithi136.stdout:4/769: mkdir d0/d3/d90/df8 0 2024-09-18T12:51:20.303 INFO:tasks.workunit.client.0.smithi081.stdout:5/541: creat d2/d14/d33/d37/d3b/d2a/fa8 x:0 0 0 2024-09-18T12:51:20.303 INFO:tasks.workunit.client.0.smithi081.stdout:5/542: readlink d2/l5 0 2024-09-18T12:51:20.303 INFO:tasks.workunit.client.1.smithi136.stdout:0/884: unlink d1/d46/fe0 0 2024-09-18T12:51:20.306 INFO:tasks.workunit.client.0.smithi081.stdout:0/480: getdents d7/d9/d12 0 2024-09-18T12:51:20.306 INFO:tasks.workunit.client.0.smithi081.stdout:0/481: stat d7/d9 0 2024-09-18T12:51:20.307 INFO:tasks.workunit.client.1.smithi136.stdout:0/885: rename d1/db/d76/db9/de5/db5/c106 to d1/d3/d1a/d62/c12f 0 2024-09-18T12:51:20.307 INFO:tasks.workunit.client.1.smithi136.stdout:0/886: chown d1/d3/l7f 291799 1 2024-09-18T12:51:20.311 INFO:tasks.workunit.client.0.smithi081.stdout:3/454: mkdir d3/db/df/da8 0 2024-09-18T12:51:20.313 INFO:tasks.workunit.client.0.smithi081.stdout:0/482: getdents d7/d9/d4b/d4a/d77 0 2024-09-18T12:51:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:19 smithi136 ceph-mon[35363]: pgmap v282: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 231 MiB/s rd, 285 MiB/s wr, 409 op/s 2024-09-18T12:51:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:19 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:20.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/455: creat d3/db/df/da8/fa9 x:0 0 0 2024-09-18T12:51:20.316 INFO:tasks.workunit.client.0.smithi081.stdout:3/456: chown d3/db/d1b/d57/c31 67559500 1 2024-09-18T12:51:20.316 INFO:tasks.workunit.client.0.smithi081.stdout:1/524: sync 2024-09-18T12:51:20.338 INFO:tasks.workunit.client.1.smithi136.stdout:2/899: dwrite d5/d25/f36 [0,4194304] 0 2024-09-18T12:51:20.338 INFO:tasks.workunit.client.1.smithi136.stdout:2/900: fsync d5/d4a/d7a/f126 0 2024-09-18T12:51:20.338 INFO:tasks.workunit.client.1.smithi136.stdout:2/901: creat d5/d25/d43/f130 x:0 0 0 2024-09-18T12:51:20.339 INFO:tasks.workunit.client.1.smithi136.stdout:2/902: truncate d5/d7/d17/f24 4354190 0 2024-09-18T12:51:20.346 INFO:tasks.workunit.client.1.smithi136.stdout:9/816: sync 2024-09-18T12:51:20.346 INFO:tasks.workunit.client.1.smithi136.stdout:8/912: sync 2024-09-18T12:51:20.348 INFO:tasks.workunit.client.1.smithi136.stdout:8/913: mkdir d9/d14/d1a/d2b/deb/d110/d145 0 2024-09-18T12:51:20.349 INFO:tasks.workunit.client.1.smithi136.stdout:9/817: creat d6/db/d12/d62/f113 x:0 0 0 2024-09-18T12:51:20.351 INFO:tasks.workunit.client.1.smithi136.stdout:8/914: link d9/d18/d34/d3d/d47/d65/ld3 d9/d14/d1a/d2b/deb/d110/dd5/dfc/l146 0 2024-09-18T12:51:20.351 INFO:tasks.workunit.client.1.smithi136.stdout:8/915: readlink d9/d18/l4c 0 2024-09-18T12:51:20.353 INFO:tasks.workunit.client.1.smithi136.stdout:3/806: dwrite d3/d2b/d6c/db4/dfe/ff1 [0,4194304] 0 2024-09-18T12:51:20.353 INFO:tasks.workunit.client.1.smithi136.stdout:7/974: dwrite d0/d35/d41/d50/d5a/d98/dd0/fed [4194304,4194304] 0 2024-09-18T12:51:20.353 INFO:tasks.workunit.client.0.smithi081.stdout:1/525: dread d0/d6/d33/d37/f6d [0,4194304] 0 2024-09-18T12:51:20.353 INFO:tasks.workunit.client.0.smithi081.stdout:1/526: chown d0/d96/fad 412 1 2024-09-18T12:51:20.354 INFO:tasks.workunit.client.1.smithi136.stdout:9/818: creat d6/df/d23/d2b/de5/f114 x:0 0 0 2024-09-18T12:51:20.354 INFO:tasks.workunit.client.1.smithi136.stdout:9/819: creat d6/df/d23/d2b/d79/d8b/f115 x:0 0 0 2024-09-18T12:51:20.354 INFO:tasks.workunit.client.1.smithi136.stdout:9/820: stat d6/db/f2c 0 2024-09-18T12:51:20.354 INFO:tasks.workunit.client.1.smithi136.stdout:8/916: mkdir d9/d14/d1a/d2b/deb/d126/d147 0 2024-09-18T12:51:20.355 INFO:tasks.workunit.client.0.smithi081.stdout:1/527: getdents d0/db/d32 0 2024-09-18T12:51:20.355 INFO:tasks.workunit.client.0.smithi081.stdout:1/528: read - d0/fa7 zero size 2024-09-18T12:51:20.355 INFO:tasks.workunit.client.0.smithi081.stdout:1/529: fdatasync d0/db/d4f/f6e 0 2024-09-18T12:51:20.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:19 smithi081 ceph-mon[27646]: pgmap v282: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 231 MiB/s rd, 285 MiB/s wr, 409 op/s 2024-09-18T12:51:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:19 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:20.357 INFO:tasks.workunit.client.1.smithi136.stdout:7/975: mkdir d0/d35/d41/d50/d5a/d98/dd0/d156 0 2024-09-18T12:51:20.358 INFO:tasks.workunit.client.1.smithi136.stdout:9/821: symlink d6/db/de8/d101/l116 0 2024-09-18T12:51:20.360 INFO:tasks.workunit.client.1.smithi136.stdout:8/917: creat d9/d18/d34/d3d/f148 x:0 0 0 2024-09-18T12:51:20.360 INFO:tasks.workunit.client.1.smithi136.stdout:8/918: dread - d9/d14/d1a/d2b/d42/d104/f141 zero size 2024-09-18T12:51:20.361 INFO:tasks.workunit.client.1.smithi136.stdout:7/976: truncate d0/d2c/d2e/f3f 835201 0 2024-09-18T12:51:20.361 INFO:tasks.workunit.client.1.smithi136.stdout:7/977: chown d0/d2c/f45 3785 1 2024-09-18T12:51:20.363 INFO:tasks.workunit.client.1.smithi136.stdout:9/822: link d6/da/d3d/d4d/d91/d25/d55/f5b d6/df/d23/d10f/f117 0 2024-09-18T12:51:20.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/823: unlink d6/df/d23/d2b/d79/d53/d5c/fdd 0 2024-09-18T12:51:20.365 INFO:tasks.workunit.client.1.smithi136.stdout:9/824: readlink d6/d13/l87 0 2024-09-18T12:51:20.365 INFO:tasks.workunit.client.1.smithi136.stdout:3/807: write d3/d2b/d6c/db4/fdf [4024494,109891] 0 2024-09-18T12:51:20.366 INFO:tasks.workunit.client.1.smithi136.stdout:9/825: symlink d6/db/d12/d62/l118 0 2024-09-18T12:51:20.366 INFO:tasks.workunit.client.1.smithi136.stdout:9/826: readlink d6/df/d23/d2b/de5/l109 0 2024-09-18T12:51:20.366 INFO:tasks.workunit.client.1.smithi136.stdout:3/808: symlink d3/d5/d31/l104 0 2024-09-18T12:51:20.367 INFO:tasks.workunit.client.1.smithi136.stdout:3/809: dread - d3/d14/d17/d53/d73/dbf/fec zero size 2024-09-18T12:51:20.369 INFO:tasks.workunit.client.1.smithi136.stdout:9/827: unlink d6/d13/d4c/f50 0 2024-09-18T12:51:20.370 INFO:tasks.workunit.client.1.smithi136.stdout:3/810: truncate d3/d14/d17/d8c/d96/f9c 8013395 0 2024-09-18T12:51:20.370 INFO:tasks.workunit.client.1.smithi136.stdout:8/919: write d9/d18/d34/d3d/d47/dbe/dd1/f136 [1078567,45718] 0 2024-09-18T12:51:20.370 INFO:tasks.workunit.client.1.smithi136.stdout:8/920: chown l7 108847120 1 2024-09-18T12:51:20.370 INFO:tasks.workunit.client.1.smithi136.stdout:8/921: dread - d9/d18/d34/d3d/d47/f130 zero size 2024-09-18T12:51:20.371 INFO:tasks.workunit.client.1.smithi136.stdout:9/828: mkdir d6/df/d23/d2b/d79/d119 0 2024-09-18T12:51:20.371 INFO:tasks.workunit.client.1.smithi136.stdout:1/776: dwrite d2/d5/d2b/d9b/d2e/f31 [4194304,4194304] 0 2024-09-18T12:51:20.372 INFO:tasks.workunit.client.0.smithi081.stdout:2/552: dwrite d15/d16/f18 [4194304,4194304] 0 2024-09-18T12:51:20.373 INFO:tasks.workunit.client.0.smithi081.stdout:2/553: creat d15/d16/d20/d59/fc8 x:0 0 0 2024-09-18T12:51:20.373 INFO:tasks.workunit.client.1.smithi136.stdout:3/811: mkdir d3/d14/d17/d75/d86/dd9/df2/d105 0 2024-09-18T12:51:20.374 INFO:tasks.workunit.client.1.smithi136.stdout:6/806: dwrite d8/d9/d3c/fba [0,4194304] 0 2024-09-18T12:51:20.375 INFO:tasks.workunit.client.1.smithi136.stdout:1/777: unlink d2/d5/d2b/d9b/d1b/c7d 0 2024-09-18T12:51:20.379 INFO:tasks.workunit.client.1.smithi136.stdout:1/778: dread d2/d5/d2b/f4a [0,4194304] 0 2024-09-18T12:51:20.379 INFO:tasks.workunit.client.0.smithi081.stdout:2/554: dread d15/d16/d20/d59/f77 [0,4194304] 0 2024-09-18T12:51:20.381 INFO:tasks.workunit.client.0.smithi081.stdout:2/555: dread d15/d16/d33/d53/d7a/d2f/db3/f9d [0,4194304] 0 2024-09-18T12:51:20.381 INFO:tasks.workunit.client.1.smithi136.stdout:3/812: symlink d3/d14/d18/d7f/d100/l106 0 2024-09-18T12:51:20.382 INFO:tasks.workunit.client.1.smithi136.stdout:6/807: unlink d8/c66 0 2024-09-18T12:51:20.382 INFO:tasks.workunit.client.1.smithi136.stdout:6/808: chown d8/d9/d56/cc2 33527 1 2024-09-18T12:51:20.384 INFO:tasks.workunit.client.1.smithi136.stdout:6/809: mkdir d8/d9/d3c/d45/dff 0 2024-09-18T12:51:20.384 INFO:tasks.workunit.client.1.smithi136.stdout:6/810: dread - d8/d9/de/d1c/fd2 zero size 2024-09-18T12:51:20.384 INFO:tasks.workunit.client.1.smithi136.stdout:6/811: write d8/d9/d64/dbb/fc5 [40574,77517] 0 2024-09-18T12:51:20.387 INFO:tasks.workunit.client.1.smithi136.stdout:7/978: dwrite d0/d35/d41/d50/fe6 [0,4194304] 0 2024-09-18T12:51:20.388 INFO:tasks.workunit.client.1.smithi136.stdout:2/903: dwrite d5/f21 [0,4194304] 0 2024-09-18T12:51:20.388 INFO:tasks.workunit.client.1.smithi136.stdout:2/904: truncate d5/d25/d2d/d9d/f111 1946396 0 2024-09-18T12:51:20.390 INFO:tasks.workunit.client.0.smithi081.stdout:5/543: dwrite d2/dd/d5e/f42 [0,4194304] 0 2024-09-18T12:51:20.390 INFO:tasks.workunit.client.0.smithi081.stdout:5/544: write d2/d47/d7f/f96 [943907,11835] 0 2024-09-18T12:51:20.390 INFO:tasks.workunit.client.0.smithi081.stdout:5/545: truncate d2/f8d 584257 0 2024-09-18T12:51:20.391 INFO:tasks.workunit.client.0.smithi081.stdout:3/457: dwrite d3/d23/f97 [0,4194304] 0 2024-09-18T12:51:20.391 INFO:tasks.workunit.client.1.smithi136.stdout:0/887: dwrite d1/d46/f66 [0,4194304] 0 2024-09-18T12:51:20.391 INFO:tasks.workunit.client.1.smithi136.stdout:0/888: stat d1/db/faa 0 2024-09-18T12:51:20.391 INFO:tasks.workunit.client.1.smithi136.stdout:0/889: write d1/d60/f68 [871984,13307] 0 2024-09-18T12:51:20.395 INFO:tasks.workunit.client.1.smithi136.stdout:7/979: creat d0/f157 x:0 0 0 2024-09-18T12:51:20.395 INFO:tasks.workunit.client.0.smithi081.stdout:0/483: dwrite d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:20.396 INFO:tasks.workunit.client.0.smithi081.stdout:1/530: write d0/db/d32/f87 [2184143,92696] 0 2024-09-18T12:51:20.399 INFO:tasks.workunit.client.0.smithi081.stdout:5/546: link d2/d14/d33/d37/d3b/d6a/d20/f30 d2/d14/d1d/da4/fa9 0 2024-09-18T12:51:20.399 INFO:tasks.workunit.client.0.smithi081.stdout:5/547: chown d2/d14/d33/d37/d3b/d5f/d89/l86 27109356 1 2024-09-18T12:51:20.401 INFO:tasks.workunit.client.1.smithi136.stdout:2/905: mknod d5/d7/dbf/dd5/c131 0 2024-09-18T12:51:20.402 INFO:tasks.workunit.client.0.smithi081.stdout:0/484: unlink d7/d9/l59 0 2024-09-18T12:51:20.402 INFO:tasks.workunit.client.0.smithi081.stdout:8/393: sync 2024-09-18T12:51:20.402 INFO:tasks.workunit.client.0.smithi081.stdout:8/394: fsync d3/d1d/d4a/d7f/f84 0 2024-09-18T12:51:20.403 INFO:tasks.workunit.client.1.smithi136.stdout:7/980: dread d0/d39/d4d/f9c [0,4194304] 0 2024-09-18T12:51:20.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/531: creat d0/d6/d7/d2e/d51/fb6 x:0 0 0 2024-09-18T12:51:20.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/532: fsync d0/d6/d7/d8/f29 0 2024-09-18T12:51:20.405 INFO:tasks.workunit.client.1.smithi136.stdout:2/906: dread d5/d4a/d67/fb4 [0,4194304] 0 2024-09-18T12:51:20.406 INFO:tasks.workunit.client.1.smithi136.stdout:2/907: fsync d5/d25/f6c 0 2024-09-18T12:51:20.406 INFO:tasks.workunit.client.1.smithi136.stdout:2/908: creat d5/d7/d17/d48/db2/db8/ddf/f132 x:0 0 0 2024-09-18T12:51:20.406 INFO:tasks.workunit.client.1.smithi136.stdout:2/909: fdatasync d5/f12b 0 2024-09-18T12:51:20.407 INFO:tasks.workunit.client.1.smithi136.stdout:0/890: rename d1/d3/d1a/d98/d81/ffe to d1/d3/d1a/d98/d81/d72/de8/d113/f130 0 2024-09-18T12:51:20.407 INFO:tasks.workunit.client.1.smithi136.stdout:6/812: dread d8/d9/de/f3d [0,4194304] 0 2024-09-18T12:51:20.409 INFO:tasks.workunit.client.0.smithi081.stdout:5/548: creat d2/d14/d1d/da4/faa x:0 0 0 2024-09-18T12:51:20.410 INFO:tasks.workunit.client.0.smithi081.stdout:0/485: mkdir d7/d5d/d9f 0 2024-09-18T12:51:20.410 INFO:tasks.workunit.client.0.smithi081.stdout:0/486: write d7/f93 [622582,126552] 0 2024-09-18T12:51:20.411 INFO:tasks.workunit.client.0.smithi081.stdout:1/533: mkdir d0/d18/db7 0 2024-09-18T12:51:20.411 INFO:tasks.workunit.client.1.smithi136.stdout:6/813: rename d8/d9/de/d60/fdb to d8/d9/de/d60/d71/d76/d97/f100 0 2024-09-18T12:51:20.412 INFO:tasks.workunit.client.0.smithi081.stdout:0/487: mknod d7/d9/d4b/d4a/d77/ca0 0 2024-09-18T12:51:20.412 INFO:tasks.workunit.client.1.smithi136.stdout:6/814: mknod d8/d9/de/d1c/d50/da8/c101 0 2024-09-18T12:51:20.413 INFO:tasks.workunit.client.1.smithi136.stdout:6/815: dread - d8/d9/d56/fd3 zero size 2024-09-18T12:51:20.413 INFO:tasks.workunit.client.0.smithi081.stdout:0/488: symlink d7/d9/la1 0 2024-09-18T12:51:20.414 INFO:tasks.workunit.client.0.smithi081.stdout:0/489: mknod d7/d9/d4b/d4a/d92/ca2 0 2024-09-18T12:51:20.414 INFO:tasks.workunit.client.0.smithi081.stdout:0/490: creat d7/d9/d4b/fa3 x:0 0 0 2024-09-18T12:51:20.414 INFO:tasks.workunit.client.1.smithi136.stdout:6/816: symlink d8/d9/de/d1c/d50/da8/df2/df5/l102 0 2024-09-18T12:51:20.416 INFO:tasks.workunit.client.1.smithi136.stdout:6/817: dread d8/d9/f34 [4194304,4194304] 0 2024-09-18T12:51:20.417 INFO:tasks.workunit.client.1.smithi136.stdout:2/910: read d5/f21 [921332,112874] 0 2024-09-18T12:51:20.418 INFO:tasks.workunit.client.1.smithi136.stdout:6/818: mkdir d8/d9/d3c/d45/dff/d103 0 2024-09-18T12:51:20.418 INFO:tasks.workunit.client.1.smithi136.stdout:6/819: write d8/d9/d64/f69 [4213181,85355] 0 2024-09-18T12:51:20.420 INFO:tasks.workunit.client.1.smithi136.stdout:6/820: mknod d8/d9/de/d1c/d50/da8/df2/c104 0 2024-09-18T12:51:20.422 INFO:tasks.workunit.client.1.smithi136.stdout:8/922: dwrite d9/d18/f44 [0,4194304] 0 2024-09-18T12:51:20.423 INFO:tasks.workunit.client.1.smithi136.stdout:6/821: unlink d8/d9/d3c/d4a/c9e 0 2024-09-18T12:51:20.426 INFO:tasks.workunit.client.0.smithi081.stdout:0/491: write d7/d9/d4b/d4a/f29 [6614726,128366] 0 2024-09-18T12:51:20.439 INFO:tasks.workunit.client.0.smithi081.stdout:2/556: dwrite d15/d16/d33/d53/d7a/d2f/dc2/f94 [0,4194304] 0 2024-09-18T12:51:20.440 INFO:tasks.workunit.client.0.smithi081.stdout:8/395: dread d3/f2d [0,4194304] 0 2024-09-18T12:51:20.442 INFO:tasks.workunit.client.0.smithi081.stdout:8/396: mkdir d3/d1d/d4a/d8d 0 2024-09-18T12:51:20.442 INFO:tasks.workunit.client.0.smithi081.stdout:8/397: chown d3/d1e/d4c/d53/f5f 500238580 1 2024-09-18T12:51:20.442 INFO:tasks.workunit.client.0.smithi081.stdout:8/398: creat d3/d1d/d4a/f8e x:0 0 0 2024-09-18T12:51:20.447 INFO:tasks.workunit.client.0.smithi081.stdout:3/458: dwrite d3/f4e [0,4194304] 0 2024-09-18T12:51:20.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/459: link d3/l24 d3/db/df/d29/d12/d44/d51/laa 0 2024-09-18T12:51:20.449 INFO:tasks.workunit.client.0.smithi081.stdout:3/460: creat d3/d84/fab x:0 0 0 2024-09-18T12:51:20.449 INFO:tasks.workunit.client.0.smithi081.stdout:3/461: dread - d3/db/f8a zero size 2024-09-18T12:51:20.449 INFO:tasks.workunit.client.0.smithi081.stdout:3/462: read - d3/db/df/d29/d12/f92 zero size 2024-09-18T12:51:20.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/463: mkdir d3/db/df/d29/d13/d68/dac 0 2024-09-18T12:51:20.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/464: write d3/d23/f79 [4527752,12258] 0 2024-09-18T12:51:20.453 INFO:tasks.workunit.client.0.smithi081.stdout:3/465: write d3/db/df/d3b/d47/f7a [249059,111601] 0 2024-09-18T12:51:20.459 INFO:tasks.workunit.client.1.smithi136.stdout:0/891: write d1/d46/f66 [1987825,58301] 0 2024-09-18T12:51:20.460 INFO:tasks.workunit.client.1.smithi136.stdout:1/779: dwrite d2/d5/d2b/d9b/d2e/f31 [0,4194304] 0 2024-09-18T12:51:20.460 INFO:tasks.workunit.client.1.smithi136.stdout:1/780: readlink d2/d5/d9/db4/ld5 0 2024-09-18T12:51:20.460 INFO:tasks.workunit.client.1.smithi136.stdout:1/781: rename d2/d5/d2b to d2/d5/d2b/da9/def/d105 22 2024-09-18T12:51:20.478 INFO:tasks.workunit.client.0.smithi081.stdout:1/534: write d0/db/d12/f22 [2617994,100833] 0 2024-09-18T12:51:20.485 INFO:tasks.workunit.client.0.smithi081.stdout:1/535: dread d0/db/f2b [0,4194304] 0 2024-09-18T12:51:20.485 INFO:tasks.workunit.client.0.smithi081.stdout:1/536: rmdir d0/d6/d7/d8 39 2024-09-18T12:51:20.486 INFO:tasks.workunit.client.0.smithi081.stdout:1/537: symlink d0/d6/d33/d42/d83/lb8 0 2024-09-18T12:51:20.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/538: creat d0/d6/d7/d2e/fb9 x:0 0 0 2024-09-18T12:51:20.488 INFO:tasks.workunit.client.0.smithi081.stdout:1/539: link d0/d6/d7/d2e/d51/fb6 d0/db/fba 0 2024-09-18T12:51:20.489 INFO:tasks.workunit.client.0.smithi081.stdout:1/540: creat d0/d6/d7/d8/fbb x:0 0 0 2024-09-18T12:51:20.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/541: getdents d0/d6/d33/d37/d98 0 2024-09-18T12:51:20.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/542: stat d0/d6/d7/d2e/d51/d2c/f45 0 2024-09-18T12:51:20.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/543: mkdir d0/d6/d33/d37/dbc 0 2024-09-18T12:51:20.491 INFO:tasks.workunit.client.0.smithi081.stdout:1/544: rmdir d0 39 2024-09-18T12:51:20.491 INFO:tasks.workunit.client.0.smithi081.stdout:1/545: stat d0/f93 0 2024-09-18T12:51:20.503 INFO:tasks.workunit.client.0.smithi081.stdout:2/557: dread d15/d16/d20/fc1 [0,4194304] 0 2024-09-18T12:51:20.504 INFO:tasks.workunit.client.0.smithi081.stdout:2/558: mkdir d15/d16/d33/d53/d7a/d2f/d61/d97/dc9 0 2024-09-18T12:51:20.505 INFO:tasks.workunit.client.0.smithi081.stdout:2/559: creat d15/d16/d54/fca x:0 0 0 2024-09-18T12:51:20.505 INFO:tasks.workunit.client.0.smithi081.stdout:2/560: stat d15/d16/d33/d53/d7a/d32/d6d 0 2024-09-18T12:51:20.506 INFO:tasks.workunit.client.0.smithi081.stdout:2/561: creat d15/d16/d33/fcb x:0 0 0 2024-09-18T12:51:20.509 INFO:tasks.workunit.client.0.smithi081.stdout:2/562: dread d15/d16/d33/f8b [0,4194304] 0 2024-09-18T12:51:20.510 INFO:tasks.workunit.client.0.smithi081.stdout:2/563: write d15/d16/fa7 [338606,69686] 0 2024-09-18T12:51:20.511 INFO:tasks.workunit.client.0.smithi081.stdout:2/564: creat d15/d16/d33/d53/d7a/d32/d6d/da0/fcc x:0 0 0 2024-09-18T12:51:20.511 INFO:tasks.workunit.client.0.smithi081.stdout:3/466: write d3/db/df/d29/d12/d44/d76/f8c [3293911,82911] 0 2024-09-18T12:51:20.512 INFO:tasks.workunit.client.0.smithi081.stdout:2/565: creat d15/d6e/fcd x:0 0 0 2024-09-18T12:51:20.513 INFO:tasks.workunit.client.0.smithi081.stdout:3/467: unlink d3/d23/c86 0 2024-09-18T12:51:20.513 INFO:tasks.workunit.client.0.smithi081.stdout:3/468: dread - d3/db/df/d29/d12/d44/d6f/f99 zero size 2024-09-18T12:51:20.514 INFO:tasks.workunit.client.0.smithi081.stdout:2/566: rename d15/d26/f65 to d15/d16/d33/d53/d7a/d32/d6d/da0/fce 0 2024-09-18T12:51:20.514 INFO:tasks.workunit.client.0.smithi081.stdout:2/567: write fe [1490938,114691] 0 2024-09-18T12:51:20.516 INFO:tasks.workunit.client.0.smithi081.stdout:2/568: creat d15/d16/d33/d53/d7a/d2f/d61/d97/fcf x:0 0 0 2024-09-18T12:51:20.516 INFO:tasks.workunit.client.0.smithi081.stdout:2/569: symlink d15/d16/d33/d53/d7a/ld0 0 2024-09-18T12:51:20.518 INFO:tasks.workunit.client.0.smithi081.stdout:2/570: link d15/d26/f29 d15/d16/d33/d53/d7a/d2f/d61/fd1 0 2024-09-18T12:51:20.518 INFO:tasks.workunit.client.0.smithi081.stdout:2/571: chown d15/d16/f44 22914 1 2024-09-18T12:51:20.518 INFO:tasks.workunit.client.0.smithi081.stdout:2/572: readlink d15/d16/d20/d22/lc3 0 2024-09-18T12:51:20.518 INFO:tasks.workunit.client.1.smithi136.stdout:3/813: dwrite d3/d14/d18/f7d [0,4194304] 0 2024-09-18T12:51:20.519 INFO:tasks.workunit.client.1.smithi136.stdout:3/814: chown d3/d14/d17/d53/l81 3 1 2024-09-18T12:51:20.519 INFO:tasks.workunit.client.1.smithi136.stdout:3/815: write d3/d14/d17/d75/d86/fce [1010421,3662] 0 2024-09-18T12:51:20.519 INFO:tasks.workunit.client.0.smithi081.stdout:2/573: dread d15/d16/d33/d53/d7a/d2f/dc2/f7c [0,4194304] 0 2024-09-18T12:51:20.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/816: link d3/d14/d17/d53/d73/dbf/ff5 d3/d14/d17/db8/f107 0 2024-09-18T12:51:20.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/817: write d3/d14/d17/d8c/d96/fcf [566779,41644] 0 2024-09-18T12:51:20.520 INFO:tasks.workunit.client.0.smithi081.stdout:2/574: creat d15/d16/d33/d53/d7a/d2f/dc2/fd2 x:0 0 0 2024-09-18T12:51:20.524 INFO:tasks.workunit.client.1.smithi136.stdout:3/818: dread d3/d14/d18/f50 [0,4194304] 0 2024-09-18T12:51:20.528 INFO:tasks.workunit.client.1.smithi136.stdout:1/782: write d2/d5/d2b/da9/fb6 [2596996,12824] 0 2024-09-18T12:51:20.536 INFO:tasks.workunit.client.1.smithi136.stdout:1/783: read d2/d5/d2b/d9b/dbe/dd3/f6d [278625,97853] 0 2024-09-18T12:51:20.541 INFO:tasks.workunit.client.1.smithi136.stdout:6/822: dwrite d8/d9/de/d1c/d50/f7c [0,4194304] 0 2024-09-18T12:51:20.549 INFO:tasks.workunit.client.0.smithi081.stdout:3/469: write f1 [2875305,703] 0 2024-09-18T12:51:20.551 INFO:tasks.workunit.client.1.smithi136.stdout:0/892: dwrite d1/d3/d1a/d98/d81/d51/fd7 [0,4194304] 0 2024-09-18T12:51:20.551 INFO:tasks.workunit.client.1.smithi136.stdout:2/911: dwrite d5/d25/d2d/f6d [0,4194304] 0 2024-09-18T12:51:20.551 INFO:tasks.workunit.client.1.smithi136.stdout:0/893: fsync d1/f16 0 2024-09-18T12:51:20.555 INFO:tasks.workunit.client.0.smithi081.stdout:1/546: dwrite d0/f20 [0,4194304] 0 2024-09-18T12:51:20.555 INFO:tasks.workunit.client.1.smithi136.stdout:3/819: dwrite d3/d5/fa1 [0,4194304] 0 2024-09-18T12:51:20.556 INFO:tasks.workunit.client.0.smithi081.stdout:9/416: sync 2024-09-18T12:51:20.556 INFO:tasks.workunit.client.0.smithi081.stdout:6/432: sync 2024-09-18T12:51:20.556 INFO:tasks.workunit.client.0.smithi081.stdout:9/417: fdatasync dd/de/d4f/f65 0 2024-09-18T12:51:20.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/784: read d2/fe6 [2096007,95310] 0 2024-09-18T12:51:20.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/785: fdatasync d2/d5/d2b/ff4 0 2024-09-18T12:51:20.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/786: write d2/f104 [700387,72838] 0 2024-09-18T12:51:20.557 INFO:tasks.workunit.client.1.smithi136.stdout:1/787: chown d2/d5/d2b/d9b/d2e/d4c 140720 1 2024-09-18T12:51:20.558 INFO:tasks.workunit.client.1.smithi136.stdout:8/923: dwrite d9/d18/d34/d3d/d47/dbe/dd1/f136 [0,4194304] 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.0.smithi081.stdout:1/547: mknod d0/d6/d66/cbd 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/399: dwrite d3/d1d/f49 [0,4194304] 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/400: readlink d3/d2f/l61 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/401: stat d3/l56 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.1.smithi136.stdout:3/820: mkdir d3/d14/d108 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.1.smithi136.stdout:3/821: creat d3/d14/d17/d53/d73/f109 x:0 0 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.1.smithi136.stdout:3/822: fdatasync d3/d14/d17/d8c/d96/fc0 0 2024-09-18T12:51:20.559 INFO:tasks.workunit.client.1.smithi136.stdout:3/823: readlink d3/lef 0 2024-09-18T12:51:20.560 INFO:tasks.workunit.client.1.smithi136.stdout:3/824: write d3/d5/d102/fd1 [1693129,69027] 0 2024-09-18T12:51:20.560 INFO:tasks.workunit.client.1.smithi136.stdout:0/894: dread d1/d17/f2b [0,4194304] 0 2024-09-18T12:51:20.560 INFO:tasks.workunit.client.0.smithi081.stdout:5/549: dwrite d2/d14/d33/d37/d3b/f38 [0,4194304] 0 2024-09-18T12:51:20.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/433: symlink d4/d12/l8e 0 2024-09-18T12:51:20.562 INFO:tasks.workunit.client.1.smithi136.stdout:6/823: dread d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:20.562 INFO:tasks.workunit.client.0.smithi081.stdout:1/548: symlink d0/d6/d7/d2e/d4e/lbe 0 2024-09-18T12:51:20.562 INFO:tasks.workunit.client.0.smithi081.stdout:1/549: fdatasync d0/db/d12/d2d/f2f 0 2024-09-18T12:51:20.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/418: dread dd/d31/f8b [0,4194304] 0 2024-09-18T12:51:20.566 INFO:tasks.workunit.client.1.smithi136.stdout:3/825: stat d3/d5/cb 0 2024-09-18T12:51:20.567 INFO:tasks.workunit.client.1.smithi136.stdout:0/895: symlink d1/d3/d1a/d98/l131 0 2024-09-18T12:51:20.568 INFO:tasks.workunit.client.1.smithi136.stdout:0/896: readlink d1/d3/d1a/d98/d81/ldf 0 2024-09-18T12:51:20.571 INFO:tasks.workunit.client.1.smithi136.stdout:6/824: mkdir d8/d9d/d9f/d105 0 2024-09-18T12:51:20.572 INFO:tasks.workunit.client.0.smithi081.stdout:4/388: sync 2024-09-18T12:51:20.573 INFO:tasks.workunit.client.1.smithi136.stdout:0/897: mknod d1/d3/d1a/d98/d81/d51/db3/c132 0 2024-09-18T12:51:20.573 INFO:tasks.workunit.client.1.smithi136.stdout:0/898: truncate d1/d3/d1a/d98/d81/d51/db3/f109 682318 0 2024-09-18T12:51:20.574 INFO:tasks.workunit.client.1.smithi136.stdout:6/825: mkdir d8/d9/d56/db6/d106 0 2024-09-18T12:51:20.575 INFO:tasks.workunit.client.0.smithi081.stdout:9/419: mkdir dd/d1d/d91 0 2024-09-18T12:51:20.576 INFO:tasks.workunit.client.1.smithi136.stdout:6/826: symlink d8/d9d/d9f/l107 0 2024-09-18T12:51:20.577 INFO:tasks.workunit.client.0.smithi081.stdout:5/550: symlink d2/d14/d33/d37/d3b/d2a/lab 0 2024-09-18T12:51:20.577 INFO:tasks.workunit.client.0.smithi081.stdout:5/551: creat d2/d14/d33/d37/d3b/d6a/fac x:0 0 0 2024-09-18T12:51:20.577 INFO:tasks.workunit.client.0.smithi081.stdout:5/552: chown d2/d14/d33/d37/d3b/d6a/d20/c26 14311770 1 2024-09-18T12:51:20.577 INFO:tasks.workunit.client.0.smithi081.stdout:6/434: rmdir d4/d12/d1c/d39/d73 39 2024-09-18T12:51:20.577 INFO:tasks.workunit.client.0.smithi081.stdout:6/435: stat d4/d12/d1c/f48 0 2024-09-18T12:51:20.578 INFO:tasks.workunit.client.0.smithi081.stdout:6/436: chown d4/d12/d1c/f48 140167652 1 2024-09-18T12:51:20.581 INFO:tasks.workunit.client.1.smithi136.stdout:6/827: unlink d8/d9/de/d60/lf9 0 2024-09-18T12:51:20.581 INFO:tasks.workunit.client.0.smithi081.stdout:4/389: unlink d3/db/d58/c6e 0 2024-09-18T12:51:20.581 INFO:tasks.workunit.client.0.smithi081.stdout:4/390: truncate d3/f7 4691811 0 2024-09-18T12:51:20.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/437: mkdir d4/d12/d1c/d8f 0 2024-09-18T12:51:20.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/438: write d4/d12/d1c/f72 [528555,54655] 0 2024-09-18T12:51:20.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/439: write d4/d12/d1c/d39/f89 [666685,110118] 0 2024-09-18T12:51:20.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/440: stat d4/f24 0 2024-09-18T12:51:20.584 INFO:tasks.workunit.client.1.smithi136.stdout:6/828: mknod d8/d9d/c108 0 2024-09-18T12:51:20.584 INFO:tasks.workunit.client.1.smithi136.stdout:3/826: write d3/d14/d18/d7f/f7a [5075967,103784] 0 2024-09-18T12:51:20.584 INFO:tasks.workunit.client.1.smithi136.stdout:3/827: dread - d3/ff4 zero size 2024-09-18T12:51:20.584 INFO:tasks.workunit.client.1.smithi136.stdout:3/828: chown d3/d14/d17/fc2 76341491 1 2024-09-18T12:51:20.585 INFO:tasks.workunit.client.0.smithi081.stdout:8/402: read d3/f11 [8266453,90929] 0 2024-09-18T12:51:20.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/391: getdents d3/d20/d3d/d65/d14/d3e 0 2024-09-18T12:51:20.587 INFO:tasks.workunit.client.1.smithi136.stdout:6/829: rename d8/d9d/d9f/fa7 to d8/d9/de/d1c/d50/f109 0 2024-09-18T12:51:20.587 INFO:tasks.workunit.client.0.smithi081.stdout:4/392: getdents d3/db/d2d 0 2024-09-18T12:51:20.587 INFO:tasks.workunit.client.0.smithi081.stdout:1/550: dread d0/db/d32/f87 [0,4194304] 0 2024-09-18T12:51:20.587 INFO:tasks.workunit.client.0.smithi081.stdout:1/551: fsync d0/db/d12/d28/fa5 0 2024-09-18T12:51:20.588 INFO:tasks.workunit.client.1.smithi136.stdout:3/829: mknod d3/d14/d18/d7f/c10a 0 2024-09-18T12:51:20.589 INFO:tasks.workunit.client.1.smithi136.stdout:6/830: unlink d8/d9/de/d1c/cd7 0 2024-09-18T12:51:20.590 INFO:tasks.workunit.client.1.smithi136.stdout:3/830: rmdir d3/d10 39 2024-09-18T12:51:20.590 INFO:tasks.workunit.client.1.smithi136.stdout:3/831: readlink d3/d10/l8f 0 2024-09-18T12:51:20.590 INFO:tasks.workunit.client.1.smithi136.stdout:3/832: write d3/d14/d17/d75/d86/f9a [988063,4698] 0 2024-09-18T12:51:20.590 INFO:tasks.workunit.client.1.smithi136.stdout:0/899: dread d1/d3/d1a/d62/fa5 [0,4194304] 0 2024-09-18T12:51:20.590 INFO:tasks.workunit.client.0.smithi081.stdout:1/552: creat d0/db/d4f/dab/fbf x:0 0 0 2024-09-18T12:51:20.592 INFO:tasks.workunit.client.0.smithi081.stdout:1/553: rename d0/d18/d6a/d91 to d0/db/d12/d2d/d75/dc0 0 2024-09-18T12:51:20.592 INFO:tasks.workunit.client.0.smithi081.stdout:1/554: write d0/fa7 [83212,18682] 0 2024-09-18T12:51:20.592 INFO:tasks.workunit.client.1.smithi136.stdout:6/831: rename d8/d9/d3c/d45/cb7 to d8/d9d/c10a 0 2024-09-18T12:51:20.593 INFO:tasks.workunit.client.1.smithi136.stdout:6/832: mkdir d8/d9/de/d1c/db9/d10b 0 2024-09-18T12:51:20.595 INFO:tasks.workunit.client.0.smithi081.stdout:1/555: unlink d0/d6/d7/d8/f29 0 2024-09-18T12:51:20.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/556: write d0/f93 [602638,31315] 0 2024-09-18T12:51:20.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/557: chown d0/db/f14 112798027 1 2024-09-18T12:51:20.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/558: dread - d0/d6/d33/d37/f94 zero size 2024-09-18T12:51:20.596 INFO:tasks.workunit.client.0.smithi081.stdout:1/559: chown d0/f93 1139 1 2024-09-18T12:51:20.598 INFO:tasks.workunit.client.0.smithi081.stdout:8/403: write d3/d1e/f2b [2944280,50135] 0 2024-09-18T12:51:20.599 INFO:tasks.workunit.client.1.smithi136.stdout:2/912: dwrite d5/f1c [4194304,4194304] 0 2024-09-18T12:51:20.599 INFO:tasks.workunit.client.1.smithi136.stdout:2/913: chown d5/d7/d17/f47 161765986 1 2024-09-18T12:51:20.599 INFO:tasks.workunit.client.1.smithi136.stdout:2/914: fsync d5/d7/d11/d34/f9e 0 2024-09-18T12:51:20.600 INFO:tasks.workunit.client.1.smithi136.stdout:2/915: readlink d5/d7/d3b/lf3 0 2024-09-18T12:51:20.600 INFO:tasks.workunit.client.1.smithi136.stdout:6/833: mkdir d8/d9/de/d1c/db9/d10c 0 2024-09-18T12:51:20.601 INFO:tasks.workunit.client.0.smithi081.stdout:8/404: creat d3/d1d/d4a/d8d/f8f x:0 0 0 2024-09-18T12:51:20.601 INFO:tasks.workunit.client.0.smithi081.stdout:8/405: readlink d3/d1d/l2c 0 2024-09-18T12:51:20.601 INFO:tasks.workunit.client.0.smithi081.stdout:8/406: fsync d3/d1d/d4a/d7f/f88 0 2024-09-18T12:51:20.601 INFO:tasks.workunit.client.0.smithi081.stdout:8/407: stat d3/d1e/f27 0 2024-09-18T12:51:20.602 INFO:tasks.workunit.client.1.smithi136.stdout:6/834: read d8/d9/de/d60/d94/fa1 [356614,79963] 0 2024-09-18T12:51:20.602 INFO:tasks.workunit.client.1.smithi136.stdout:6/835: stat d8/dc/l1f 0 2024-09-18T12:51:20.603 INFO:tasks.workunit.client.0.smithi081.stdout:5/553: write d2/d14/d33/d37/d3b/d6a/f35 [281592,68504] 0 2024-09-18T12:51:20.603 INFO:tasks.workunit.client.0.smithi081.stdout:4/393: dread d3/f67 [0,4194304] 0 2024-09-18T12:51:20.607 INFO:tasks.workunit.client.0.smithi081.stdout:5/554: mknod d2/d14/d33/d37/d3b/d6a/cad 0 2024-09-18T12:51:20.609 INFO:tasks.workunit.client.0.smithi081.stdout:4/394: rename d3/f6f to d3/db/d35/f83 0 2024-09-18T12:51:20.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/555: symlink d2/d14/d1d/lae 0 2024-09-18T12:51:20.614 INFO:tasks.workunit.client.0.smithi081.stdout:8/408: dread d3/d1e/f27 [4194304,4194304] 0 2024-09-18T12:51:20.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/556: link d2/d14/d33/d37/d3b/d16/c9c d2/dd/d5e/caf 0 2024-09-18T12:51:20.616 INFO:tasks.workunit.client.1.smithi136.stdout:1/788: dwrite d2/d5/fa [0,4194304] 0 2024-09-18T12:51:20.617 INFO:tasks.workunit.client.1.smithi136.stdout:1/789: truncate d2/d5/d2b/d9b/d2e/d4c/d8e/fa6 479653 0 2024-09-18T12:51:20.617 INFO:tasks.workunit.client.1.smithi136.stdout:1/790: chown d2/d5/d2b/d9b/dbe/dd3/d65/ddb 26456553 1 2024-09-18T12:51:20.617 INFO:tasks.workunit.client.1.smithi136.stdout:1/791: truncate d2/d5/d2b/da9/fb6 4669026 0 2024-09-18T12:51:20.617 INFO:tasks.workunit.client.0.smithi081.stdout:6/441: dread d4/d12/d1c/d39/d60/f6e [0,4194304] 0 2024-09-18T12:51:20.617 INFO:tasks.workunit.client.0.smithi081.stdout:8/409: truncate d3/f25 993250 0 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.0.smithi081.stdout:6/442: write d4/f18 [2981543,39511] 0 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/410: read d3/f13 [6564463,36300] 0 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/411: chown d3/c67 0 1 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/412: chown d3/d1e/f27 4939 1 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/413: write d3/d1d/d4a/f8e [972552,47950] 0 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.1.smithi136.stdout:6/836: dread d8/d9/de/d60/fa5 [0,4194304] 0 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.1.smithi136.stdout:6/837: dread - d8/d9/de/d1c/db9/fc3 zero size 2024-09-18T12:51:20.618 INFO:tasks.workunit.client.1.smithi136.stdout:1/792: mkdir d2/d5/d2b/d9b/dbe/dd3/d65/d106 0 2024-09-18T12:51:20.620 INFO:tasks.workunit.client.0.smithi081.stdout:8/414: dread d3/d1e/d4c/d68/f82 [0,4194304] 0 2024-09-18T12:51:20.620 INFO:tasks.workunit.client.0.smithi081.stdout:8/415: chown d3/d1e/d4c/d53/c6d 75 1 2024-09-18T12:51:20.620 INFO:tasks.workunit.client.0.smithi081.stdout:8/416: write d3/d2f/f31 [314614,116113] 0 2024-09-18T12:51:20.620 INFO:tasks.workunit.client.0.smithi081.stdout:8/417: chown d3/d2f/f31 255 1 2024-09-18T12:51:20.621 INFO:tasks.workunit.client.0.smithi081.stdout:8/418: chown d3/l60 9 1 2024-09-18T12:51:20.622 INFO:tasks.workunit.client.1.smithi136.stdout:1/793: mkdir d2/d5/d9/dcb/dfb/d107 0 2024-09-18T12:51:20.623 INFO:tasks.workunit.client.1.smithi136.stdout:1/794: chown d2/d5/d2b/d9b/d1b/ca5 27 1 2024-09-18T12:51:20.623 INFO:tasks.workunit.client.1.smithi136.stdout:1/795: write d2/d5/d2b/d34/d5c/fe3 [281767,11538] 0 2024-09-18T12:51:20.624 INFO:tasks.workunit.client.1.smithi136.stdout:1/796: mkdir d2/d5/d2b/d34/d86/d108 0 2024-09-18T12:51:20.624 INFO:tasks.workunit.client.1.smithi136.stdout:1/797: chown d2/fe6 2 1 2024-09-18T12:51:20.624 INFO:tasks.workunit.client.0.smithi081.stdout:5/557: rename d2/d14/d33/d37/d3b/d5f/d89 to d2/d14/d33/d37/d3b/d2a/db0 0 2024-09-18T12:51:20.627 INFO:tasks.workunit.client.0.smithi081.stdout:9/420: dwrite dd/d1d/d1e/d24/d48/f6c [0,4194304] 0 2024-09-18T12:51:20.628 INFO:tasks.workunit.client.1.smithi136.stdout:5/919: sync 2024-09-18T12:51:20.628 INFO:tasks.workunit.client.1.smithi136.stdout:8/924: dwrite d9/d18/d34/d3d/d47/d65/d93/d96/f12c [0,4194304] 0 2024-09-18T12:51:20.628 INFO:tasks.workunit.client.1.smithi136.stdout:9/829: sync 2024-09-18T12:51:20.628 INFO:tasks.workunit.client.1.smithi136.stdout:4/770: sync 2024-09-18T12:51:20.629 INFO:tasks.workunit.client.1.smithi136.stdout:8/925: truncate d9/d14/d1a/d2b/d42/da4/de5/f137 1020097 0 2024-09-18T12:51:20.629 INFO:tasks.workunit.client.1.smithi136.stdout:8/926: fsync d9/d18/f41 0 2024-09-18T12:51:20.629 INFO:tasks.workunit.client.0.smithi081.stdout:4/395: read d3/f7 [730581,112547] 0 2024-09-18T12:51:20.629 INFO:tasks.workunit.client.0.smithi081.stdout:4/396: write d3/d20/d3d/d65/d45/f4a [70634,128779] 0 2024-09-18T12:51:20.633 INFO:tasks.workunit.client.0.smithi081.stdout:5/558: symlink d2/d14/d1d/lb1 0 2024-09-18T12:51:20.634 INFO:tasks.workunit.client.1.smithi136.stdout:5/920: mkdir d5/d1a/dfe/d11b/d124 0 2024-09-18T12:51:20.634 INFO:tasks.workunit.client.1.smithi136.stdout:5/921: write d5/d1a/d30/d7b/fca [793753,129794] 0 2024-09-18T12:51:20.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/421: symlink dd/de/d7a/l92 0 2024-09-18T12:51:20.635 INFO:tasks.workunit.client.1.smithi136.stdout:5/922: read d5/d1a/d2d/d3f/d7f/faf [749011,90488] 0 2024-09-18T12:51:20.635 INFO:tasks.workunit.client.1.smithi136.stdout:5/923: truncate d5/d1a/d4a/da1/fef 144088 0 2024-09-18T12:51:20.637 INFO:tasks.workunit.client.0.smithi081.stdout:8/419: dread d3/f18 [0,4194304] 0 2024-09-18T12:51:20.639 INFO:tasks.workunit.client.1.smithi136.stdout:0/900: dwrite d1/d60/f99 [0,4194304] 0 2024-09-18T12:51:20.639 INFO:tasks.workunit.client.1.smithi136.stdout:3/833: dwrite d3/d14/d17/d53/f89 [0,4194304] 0 2024-09-18T12:51:20.640 INFO:tasks.workunit.client.0.smithi081.stdout:4/397: symlink d3/d20/d5b/l84 0 2024-09-18T12:51:20.640 INFO:tasks.workunit.client.0.smithi081.stdout:4/398: rename d3 to d3/d20/d3d/d65/d45/d85 22 2024-09-18T12:51:20.641 INFO:tasks.workunit.client.1.smithi136.stdout:4/771: creat d0/d3/ff9 x:0 0 0 2024-09-18T12:51:20.641 INFO:tasks.workunit.client.1.smithi136.stdout:4/772: readlink d0/d25/lec 0 2024-09-18T12:51:20.644 INFO:tasks.workunit.client.1.smithi136.stdout:3/834: mknod d3/d14/d17/d53/de8/c10b 0 2024-09-18T12:51:20.646 INFO:tasks.workunit.client.1.smithi136.stdout:4/773: mkdir d0/d3/dfa 0 2024-09-18T12:51:20.647 INFO:tasks.workunit.client.1.smithi136.stdout:3/835: unlink d3/f9 0 2024-09-18T12:51:20.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/836: mknod d3/d2b/d6c/db4/dfe/df7/c10c 0 2024-09-18T12:51:20.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/422: creat dd/d31/d4a/f93 x:0 0 0 2024-09-18T12:51:20.649 INFO:tasks.workunit.client.0.smithi081.stdout:8/420: mknod d3/d1d/d4a/d8d/c90 0 2024-09-18T12:51:20.650 INFO:tasks.workunit.client.0.smithi081.stdout:5/559: getdents d2/d14/d33/d37 0 2024-09-18T12:51:20.652 INFO:tasks.workunit.client.0.smithi081.stdout:9/423: mkdir dd/de/d4f/d8c/d94 0 2024-09-18T12:51:20.652 INFO:tasks.workunit.client.0.smithi081.stdout:9/424: chown dd/d1d/d1e/d2f/f83 0 1 2024-09-18T12:51:20.657 INFO:tasks.workunit.client.0.smithi081.stdout:8/421: unlink d3/d1e/d4c/d53/l7a 0 2024-09-18T12:51:20.657 INFO:tasks.workunit.client.0.smithi081.stdout:8/422: readlink d3/d1e/d4c/l62 0 2024-09-18T12:51:20.657 INFO:tasks.workunit.client.0.smithi081.stdout:9/425: write dd/de/f40 [284708,91785] 0 2024-09-18T12:51:20.657 INFO:tasks.workunit.client.0.smithi081.stdout:9/426: creat dd/de/d4f/f95 x:0 0 0 2024-09-18T12:51:20.657 INFO:tasks.workunit.client.1.smithi136.stdout:0/901: dread d1/d3/d1a/d62/fa5 [0,4194304] 0 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:0/902: readlink d1/d3/l7f 0 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:0/903: chown d1/d3/d1a/d98/d81/d35/f96 597 1 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:0/904: read - d1/d3/d1a/d98/d81/d72/de8/d113/f130 zero size 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:0/905: creat d1/d3/d1a/d62/d75/d123/f133 x:0 0 0 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:5/924: write d5/d1a/d2d/d34/d4e/d7a/d9e/dad/f84 [148710,89865] 0 2024-09-18T12:51:20.658 INFO:tasks.workunit.client.1.smithi136.stdout:0/906: symlink d1/l134 0 2024-09-18T12:51:20.659 INFO:tasks.workunit.client.0.smithi081.stdout:5/560: link d2/d14/d33/d37/d3b/d6a/f98 d2/dd/fb2 0 2024-09-18T12:51:20.659 INFO:tasks.workunit.client.0.smithi081.stdout:8/423: mknod d3/d1d/c91 0 2024-09-18T12:51:20.661 INFO:tasks.workunit.client.1.smithi136.stdout:5/925: mkdir d5/d1a/d2d/d34/d4e/d7a/d122/d125 0 2024-09-18T12:51:20.662 INFO:tasks.workunit.client.1.smithi136.stdout:5/926: dread - d5/d1a/d4a/f11e zero size 2024-09-18T12:51:20.662 INFO:tasks.workunit.client.1.smithi136.stdout:5/927: truncate d5/d1a/d2d/dc4/f11c 715320 0 2024-09-18T12:51:20.663 INFO:tasks.workunit.client.1.smithi136.stdout:2/916: dwrite d5/d25/d43/d74/f76 [0,4194304] 0 2024-09-18T12:51:20.663 INFO:tasks.workunit.client.0.smithi081.stdout:5/561: mknod d2/d14/d33/d37/d3b/d6a/d20/cb3 0 2024-09-18T12:51:20.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/562: chown d2/d14/d33/d37/d3b/d6a/fac 303811 1 2024-09-18T12:51:20.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/563: write d2/d14/d33/d37/f54 [631211,68730] 0 2024-09-18T12:51:20.665 INFO:tasks.workunit.client.1.smithi136.stdout:6/838: dwrite d8/d9/de/d1c/d50/f109 [0,4194304] 0 2024-09-18T12:51:20.665 INFO:tasks.workunit.client.1.smithi136.stdout:1/798: dwrite d2/d5/d2b/d34/d86/ff6 [0,4194304] 0 2024-09-18T12:51:20.666 INFO:tasks.workunit.client.0.smithi081.stdout:6/443: dwrite d4/d12/d28/d2a/f45 [0,4194304] 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.0.smithi081.stdout:8/424: link d3/d1d/f55 d3/d1d/d4a/f92 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/399: dread d3/db/d2d/f3b [0,4194304] 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/400: stat d3/d20/d3d/d65/d14/d3e/f51 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/401: readlink d3/db/d2d/l2e 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/402: readlink d3/d20/d3d/d65/d45/l80 0 2024-09-18T12:51:20.667 INFO:tasks.workunit.client.1.smithi136.stdout:0/907: rename d1/db/faa to d1/d3/d1a/d62/d75/d100/f135 0 2024-09-18T12:51:20.668 INFO:tasks.workunit.client.1.smithi136.stdout:8/927: dwrite d9/d18/f1c [0,4194304] 0 2024-09-18T12:51:20.668 INFO:tasks.workunit.client.1.smithi136.stdout:4/774: write d0/d2/f3e [4032564,66616] 0 2024-09-18T12:51:20.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/564: truncate d2/dd/d5e/f42 1887859 0 2024-09-18T12:51:20.671 INFO:tasks.workunit.client.1.smithi136.stdout:2/917: symlink d5/d7/dbf/dd5/l133 0 2024-09-18T12:51:20.674 INFO:tasks.workunit.client.1.smithi136.stdout:5/928: dread d5/f18 [0,4194304] 0 2024-09-18T12:51:20.674 INFO:tasks.workunit.client.1.smithi136.stdout:5/929: dread - d5/d1a/d2d/d34/d4e/d7a/fec zero size 2024-09-18T12:51:20.674 INFO:tasks.workunit.client.1.smithi136.stdout:5/930: creat d5/db4/f126 x:0 0 0 2024-09-18T12:51:20.676 INFO:tasks.workunit.client.0.smithi081.stdout:9/427: dwrite dd/d1d/f6b [0,4194304] 0 2024-09-18T12:51:20.676 INFO:tasks.workunit.client.0.smithi081.stdout:9/428: write dd/de/d4f/f66 [137346,104529] 0 2024-09-18T12:51:20.678 INFO:tasks.workunit.client.1.smithi136.stdout:6/839: mknod d8/d9/d3c/d45/dff/d103/c10d 0 2024-09-18T12:51:20.678 INFO:tasks.workunit.client.1.smithi136.stdout:6/840: write d8/d9/fb [2426157,25650] 0 2024-09-18T12:51:20.678 INFO:tasks.workunit.client.1.smithi136.stdout:6/841: truncate d8/d9/d64/f69 4678938 0 2024-09-18T12:51:20.683 INFO:tasks.workunit.client.1.smithi136.stdout:1/799: write d2/d5/d2b/d9b/d2e/d4c/f2f [1603469,61445] 0 2024-09-18T12:51:20.686 INFO:tasks.workunit.client.1.smithi136.stdout:0/908: unlink d1/d3/d1a/l3b 0 2024-09-18T12:51:20.687 INFO:tasks.workunit.client.0.smithi081.stdout:6/444: mkdir d4/d12/d1c/d39/d60/d90 0 2024-09-18T12:51:20.690 INFO:tasks.workunit.client.0.smithi081.stdout:8/425: link d3/d1d/d4a/f92 d3/d1d/d89/f93 0 2024-09-18T12:51:20.690 INFO:tasks.workunit.client.0.smithi081.stdout:8/426: creat d3/d2f/f94 x:0 0 0 2024-09-18T12:51:20.690 INFO:tasks.workunit.client.0.smithi081.stdout:9/429: write dd/d31/f3b [2941575,25986] 0 2024-09-18T12:51:20.691 INFO:tasks.workunit.client.0.smithi081.stdout:4/403: rename d3/d20/d3d/f5d to d3/d20/d3d/d65/d45/f86 0 2024-09-18T12:51:20.694 INFO:tasks.workunit.client.1.smithi136.stdout:4/775: link d0/d45/f55 d0/d45/ffb 0 2024-09-18T12:51:20.695 INFO:tasks.workunit.client.1.smithi136.stdout:5/931: mknod d5/d1a/d2d/d34/c127 0 2024-09-18T12:51:20.695 INFO:tasks.workunit.client.0.smithi081.stdout:6/445: mkdir d4/d12/d56/d7d/d91 0 2024-09-18T12:51:20.695 INFO:tasks.workunit.client.0.smithi081.stdout:6/446: write d4/f58 [2338587,102417] 0 2024-09-18T12:51:20.696 INFO:tasks.workunit.client.0.smithi081.stdout:6/447: stat d4/d6/c1d 0 2024-09-18T12:51:20.696 INFO:tasks.workunit.client.1.smithi136.stdout:5/932: read d5/d1a/d2d/fa6 [151392,69491] 0 2024-09-18T12:51:20.696 INFO:tasks.workunit.client.1.smithi136.stdout:6/842: mknod d8/d9/d3c/c10e 0 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:7/981: sync 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:7/982: dread - d0/d35/d41/d50/d113/f150 zero size 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:5/933: write d5/d1a/d2d/d34/d4e/d7a/d9e/dad/fdf [4939970,129508] 0 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:5/934: creat d5/d78/d105/f128 x:0 0 0 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:5/935: dread - d5/d1a/d2d/d34/d4e/d7a/d9e/da9/fdc zero size 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:1/800: mknod d2/d5/d2b/d34/c109 0 2024-09-18T12:51:20.698 INFO:tasks.workunit.client.1.smithi136.stdout:1/801: truncate d2/d5/d2b/d9b/d2e/d4c/f45 4560683 0 2024-09-18T12:51:20.699 INFO:tasks.workunit.client.1.smithi136.stdout:0/909: symlink d1/db/d76/db9/de5/d115/l136 0 2024-09-18T12:51:20.699 INFO:tasks.workunit.client.0.smithi081.stdout:8/427: truncate d3/d1d/d4a/f4f 740489 0 2024-09-18T12:51:20.699 INFO:tasks.workunit.client.0.smithi081.stdout:8/428: chown d3/l10 1 1 2024-09-18T12:51:20.699 INFO:tasks.workunit.client.0.smithi081.stdout:8/429: chown d3/f11 2250543 1 2024-09-18T12:51:20.700 INFO:tasks.workunit.client.0.smithi081.stdout:9/430: getdents dd/d1d/d1e/d39/d73 0 2024-09-18T12:51:20.700 INFO:tasks.workunit.client.0.smithi081.stdout:9/431: write dd/de/d59/f84 [775273,62097] 0 2024-09-18T12:51:20.700 INFO:tasks.workunit.client.0.smithi081.stdout:9/432: fdatasync dd/d1d/d1e/d24/d2a/f88 0 2024-09-18T12:51:20.700 INFO:tasks.workunit.client.0.smithi081.stdout:9/433: chown dd/d1d/d1e/d39/d73/c76 22 1 2024-09-18T12:51:20.700 INFO:tasks.workunit.client.0.smithi081.stdout:9/434: write dd/de/d59/f84 [923370,122415] 0 2024-09-18T12:51:20.701 INFO:tasks.workunit.client.1.smithi136.stdout:4/776: mknod d0/dd7/cfc 0 2024-09-18T12:51:20.701 INFO:tasks.workunit.client.1.smithi136.stdout:8/928: dwrite d9/d18/d34/d3d/d47/d65/d93/d96/fc8 [0,4194304] 0 2024-09-18T12:51:20.701 INFO:tasks.workunit.client.1.smithi136.stdout:8/929: fsync d9/d14/d1a/d2b/d42/d6e/d75/db4/f135 0 2024-09-18T12:51:20.701 INFO:tasks.workunit.client.1.smithi136.stdout:2/918: dwrite d5/d7/faa [0,4194304] 0 2024-09-18T12:51:20.703 INFO:tasks.workunit.client.0.smithi081.stdout:4/404: truncate d3/db/fc 4585310 0 2024-09-18T12:51:20.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/430: symlink d3/d2f/l95 0 2024-09-18T12:51:20.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/431: chown d3/d1d/d4a/c4b 988031 1 2024-09-18T12:51:20.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/432: fdatasync d3/d1e/d4c/d53/f74 0 2024-09-18T12:51:20.705 INFO:tasks.workunit.client.1.smithi136.stdout:7/983: dread d0/d39/d4d/fc9 [0,4194304] 0 2024-09-18T12:51:20.706 INFO:tasks.workunit.client.1.smithi136.stdout:6/843: creat d8/d9/de/d1c/dc9/f10f x:0 0 0 2024-09-18T12:51:20.707 INFO:tasks.workunit.client.0.smithi081.stdout:6/448: dread d4/d12/d28/d2a/d74/d8b/f78 [0,4194304] 0 2024-09-18T12:51:20.707 INFO:tasks.workunit.client.0.smithi081.stdout:9/435: rmdir dd/d1d/d1e/d39/d73 39 2024-09-18T12:51:20.707 INFO:tasks.workunit.client.0.smithi081.stdout:9/436: truncate dd/d1d/d1e/d2f/f83 103726 0 2024-09-18T12:51:20.707 INFO:tasks.workunit.client.0.smithi081.stdout:9/437: fdatasync dd/d31/d4a/f62 0 2024-09-18T12:51:20.707 INFO:tasks.workunit.client.0.smithi081.stdout:9/438: read dd/d31/f3b [2253468,114939] 0 2024-09-18T12:51:20.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/405: symlink d3/d20/d3d/d65/d2f/l87 0 2024-09-18T12:51:20.713 INFO:tasks.workunit.client.0.smithi081.stdout:4/406: truncate d3/d20/d3d/d65/f2c 5249015 0 2024-09-18T12:51:20.720 INFO:tasks.workunit.client.1.smithi136.stdout:5/936: symlink d5/d78/d105/l129 0 2024-09-18T12:51:20.720 INFO:tasks.workunit.client.1.smithi136.stdout:1/802: link d2/d5/d9/db4/ld5 d2/d5/d2b/d9b/d2e/d9a/l10a 0 2024-09-18T12:51:20.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/498: sync 2024-09-18T12:51:20.722 INFO:tasks.workunit.client.1.smithi136.stdout:0/910: unlink d1/d3/d1a/d62/d75/c79 0 2024-09-18T12:51:20.722 INFO:tasks.workunit.client.1.smithi136.stdout:0/911: chown d1/d3/l7f 23 1 2024-09-18T12:51:20.727 INFO:tasks.workunit.client.0.smithi081.stdout:4/407: dread d3/d20/d3d/d65/d14/f1e [0,4194304] 0 2024-09-18T12:51:20.729 INFO:tasks.workunit.client.0.smithi081.stdout:4/408: creat d3/d20/d3d/d65/d14/f88 x:0 0 0 2024-09-18T12:51:20.729 INFO:tasks.workunit.client.0.smithi081.stdout:9/439: dwrite dd/d15/d1a/f81 [0,4194304] 0 2024-09-18T12:51:20.729 INFO:tasks.workunit.client.0.smithi081.stdout:9/440: chown dd/de/d4f 43997635 1 2024-09-18T12:51:20.730 INFO:tasks.workunit.client.1.smithi136.stdout:5/937: dread d5/d1a/f27 [0,4194304] 0 2024-09-18T12:51:20.730 INFO:tasks.workunit.client.1.smithi136.stdout:2/919: truncate d5/f21 903885 0 2024-09-18T12:51:20.730 INFO:tasks.workunit.client.1.smithi136.stdout:2/920: truncate d5/d4a/d7a/f126 288187 0 2024-09-18T12:51:20.731 INFO:tasks.workunit.client.1.smithi136.stdout:7/984: creat d0/d35/d41/d50/d133/f158 x:0 0 0 2024-09-18T12:51:20.732 INFO:tasks.workunit.client.0.smithi081.stdout:7/499: dread d2/d18/d22/f2a [0,4194304] 0 2024-09-18T12:51:20.733 INFO:tasks.workunit.client.0.smithi081.stdout:9/441: creat dd/d1d/d1e/d24/d2a/f96 x:0 0 0 2024-09-18T12:51:20.734 INFO:tasks.workunit.client.1.smithi136.stdout:6/844: symlink d8/dcf/l110 0 2024-09-18T12:51:20.734 INFO:tasks.workunit.client.1.smithi136.stdout:6/845: creat d8/d9/de/d60/d94/f111 x:0 0 0 2024-09-18T12:51:20.738 INFO:tasks.workunit.client.0.smithi081.stdout:9/442: dread f0 [0,4194304] 0 2024-09-18T12:51:20.740 INFO:tasks.workunit.client.1.smithi136.stdout:1/803: creat d2/d5/d2b/d9b/f10b x:0 0 0 2024-09-18T12:51:20.740 INFO:tasks.workunit.client.1.smithi136.stdout:0/912: mknod d1/d60/d82/c137 0 2024-09-18T12:51:20.741 INFO:tasks.workunit.client.1.smithi136.stdout:5/938: mkdir d5/d1a/d2d/d34/d12a 0 2024-09-18T12:51:20.742 INFO:tasks.workunit.client.1.smithi136.stdout:2/921: creat d5/d4a/f134 x:0 0 0 2024-09-18T12:51:20.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/443: dread dd/d31/f8b [0,4194304] 0 2024-09-18T12:51:20.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/444: creat dd/de/f97 x:0 0 0 2024-09-18T12:51:20.743 INFO:tasks.workunit.client.1.smithi136.stdout:7/985: creat d0/d35/d4f/dd5/d94/d11e/f159 x:0 0 0 2024-09-18T12:51:20.746 INFO:tasks.workunit.client.1.smithi136.stdout:6/846: creat d8/d9/de/d60/d71/d76/d97/f112 x:0 0 0 2024-09-18T12:51:20.747 INFO:tasks.workunit.client.1.smithi136.stdout:6/847: truncate d8/d9/de/d1c/f38 932003 0 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:2/922: creat d5/d25/d2d/d9d/f135 x:0 0 0 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:5/939: creat d5/d1a/d4a/d79/f12b x:0 0 0 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:5/940: chown d5/d1a/d2d/d34/d4e/f70 19475 1 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:5/941: chown d5/d1a/d2d/d3f/l6a 5 1 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:7/986: rename d0/d35/d4f/dd5/d94/db0/l76 to d0/d35/d41/d50/d5a/d98/dd0/l15a 0 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:7/987: creat d0/d2c/d2e/dc5/f15b x:0 0 0 2024-09-18T12:51:20.750 INFO:tasks.workunit.client.1.smithi136.stdout:7/988: creat d0/d35/d41/d50/d5a/d98/f15c x:0 0 0 2024-09-18T12:51:20.753 INFO:tasks.workunit.client.1.smithi136.stdout:5/942: link d5/d1a/d30/f48 d5/d1a/d2d/d3f/d7f/dbc/dc8/f12c 0 2024-09-18T12:51:20.755 INFO:tasks.workunit.client.1.smithi136.stdout:2/923: write d5/d7/d11/f32 [245930,83160] 0 2024-09-18T12:51:20.755 INFO:tasks.workunit.client.1.smithi136.stdout:2/924: chown d5/d25/d43/d74/f76 158 1 2024-09-18T12:51:20.756 INFO:tasks.workunit.client.1.smithi136.stdout:7/989: rename d0/d35/d41/d50/d113/d12e to d0/d35/d41/d50/d7f/d3b/d15d 0 2024-09-18T12:51:20.758 INFO:tasks.workunit.client.1.smithi136.stdout:5/943: mknod d5/d1a/d2d/d34/d88/c12d 0 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 -- 172.21.15.81:0/4293415264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 msgr2=0x7f3450102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 --2- 172.21.15.81:0/4293415264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450102310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3444009910 tx=0x7f3444009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 -- 172.21.15.81:0/4293415264 shutdown_connections 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 --2- 172.21.15.81:0/4293415264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450102310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 --2- 172.21.15.81:0/4293415264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 -- 172.21.15.81:0/4293415264 >> 172.21.15.81:0/4293415264 conn(0x7f34500fc230 msgr2=0x7f34500fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.759+0000 7f3456953700 1 -- 172.21.15.81:0/4293415264 shutdown_connections 2024-09-18T12:51:20.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.760+0000 7f3456953700 1 -- 172.21.15.81:0/4293415264 wait complete. 2024-09-18T12:51:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.761+0000 7f3456953700 1 Processor -- start 2024-09-18T12:51:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.762+0000 7f3456953700 1 -- start start 2024-09-18T12:51:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.762+0000 7f3456953700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.762+0000 7f3456953700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.762+0000 7f3456953700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450197020 con 0x7f3450101eb0 2024-09-18T12:51:20.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.762+0000 7f3456953700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450197160 con 0x7f3450100cb0 2024-09-18T12:51:20.764 INFO:tasks.workunit.client.0.smithi081.stdout:4/409: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:20.764 INFO:tasks.workunit.client.0.smithi081.stdout:4/410: write d3/db/d35/f76 [927746,48637] 0 2024-09-18T12:51:20.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.763+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:20.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/411: truncate d3/d20/d3d/d65/d14/f88 242463 0 2024-09-18T12:51:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.763+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47038/0 (socket says 172.21.15.81:47038) 2024-09-18T12:51:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.763+0000 7f344f7fe700 1 -- 172.21.15.81:0/1775863891 learned_addr learned my addr 172.21.15.81:0/1775863891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344f7fe700 1 -- 172.21.15.81:0/1775863891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 msgr2=0x7f34501964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.763+0000 7f344ffff700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344f7fe700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344f7fe700 1 -- 172.21.15.81:0/1775863891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440095f0 con 0x7f3450101eb0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344ffff700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344f7fe700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f344400bd70 tx=0x7f344400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f344401d070 con 0x7f3450101eb0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345019bbb0 con 0x7f3450101eb0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.764+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3444022470 con 0x7f3450101eb0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.765+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f344400f670 con 0x7f3450101eb0 2024-09-18T12:51:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.765+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345019c0a0 con 0x7f3450101eb0 2024-09-18T12:51:20.769 INFO:tasks.workunit.client.0.smithi081.stdout:4/412: truncate d3/d20/d3d/d65/d14/d27/f3a 6405499 0 2024-09-18T12:51:20.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.767+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34501098b0 con 0x7f3450101eb0 2024-09-18T12:51:20.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.768+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f3444004b10 con 0x7f3450101eb0 2024-09-18T12:51:20.770 INFO:tasks.workunit.client.1.smithi136.stdout:2/925: dread d5/d4a/d67/fe4 [0,4194304] 0 2024-09-18T12:51:20.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.768+0000 7f344d7fa700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 0x7f343806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:20.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.769+0000 7f344ffff700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 0x7f343806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:20.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.769+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f344408cf00 con 0x7f3450101eb0 2024-09-18T12:51:20.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.770+0000 7f344ffff700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 0x7f343806e9a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3440006fd0 tx=0x7f3440008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:20.773 INFO:tasks.workunit.client.0.smithi081.stdout:4/413: dread d3/db/d2d/f3b [0,4194304] 0 2024-09-18T12:51:20.774 INFO:tasks.workunit.client.0.smithi081.stdout:4/414: mknod d3/d20/d3d/d65/d14/d3e/c89 0 2024-09-18T12:51:20.776 INFO:tasks.workunit.client.0.smithi081.stdout:4/415: symlink d3/d20/d3d/d65/d45/d6c/l8a 0 2024-09-18T12:51:20.776 INFO:tasks.workunit.client.0.smithi081.stdout:4/416: write d3/d20/d3d/d65/d2f/f33 [2565592,129113] 0 2024-09-18T12:51:20.776 INFO:tasks.workunit.client.0.smithi081.stdout:4/417: chown d3/d20/d3d/d65/c28 0 1 2024-09-18T12:51:20.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.776+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f344405b250 con 0x7f3450101eb0 2024-09-18T12:51:20.778 INFO:tasks.workunit.client.0.smithi081.stdout:4/418: creat d3/d20/d3d/d65/d2f/f8b x:0 0 0 2024-09-18T12:51:20.778 INFO:tasks.workunit.client.0.smithi081.stdout:4/419: chown d3/d20/d3d/d65/c28 2955391 1 2024-09-18T12:51:20.778 INFO:tasks.workunit.client.0.smithi081.stdout:4/420: mkdir d3/d20/d3d/d65/d2f/d8c 0 2024-09-18T12:51:20.793 INFO:tasks.workunit.client.1.smithi136.stdout:4/777: dwrite d0/d13/f18 [4194304,4194304] 0 2024-09-18T12:51:20.795 INFO:tasks.workunit.client.0.smithi081.stdout:9/445: dread dd/de/d59/f84 [0,4194304] 0 2024-09-18T12:51:20.798 INFO:tasks.workunit.client.0.smithi081.stdout:9/446: truncate dd/d31/d4a/f62 3727938 0 2024-09-18T12:51:20.799 INFO:tasks.workunit.client.0.smithi081.stdout:9/447: creat dd/d1d/d1e/d39/f98 x:0 0 0 2024-09-18T12:51:20.799 INFO:tasks.workunit.client.0.smithi081.stdout:9/448: creat dd/d15/d1a/f99 x:0 0 0 2024-09-18T12:51:20.814 INFO:tasks.workunit.client.0.smithi081.stdout:8/433: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:20.815 INFO:tasks.workunit.client.0.smithi081.stdout:8/434: dread d3/d1e/d4c/d53/f74 [0,4194304] 0 2024-09-18T12:51:20.817 INFO:tasks.workunit.client.1.smithi136.stdout:0/913: dwrite d1/d3/d1a/d98/f112 [0,4194304] 0 2024-09-18T12:51:20.817 INFO:tasks.workunit.client.1.smithi136.stdout:0/914: readlink d1/d46/lf2 0 2024-09-18T12:51:20.818 INFO:tasks.workunit.client.0.smithi081.stdout:7/500: dwrite d2/d18/d22/d48/f9f [0,4194304] 0 2024-09-18T12:51:20.820 INFO:tasks.workunit.client.0.smithi081.stdout:4/421: dread d3/db/f23 [0,4194304] 0 2024-09-18T12:51:20.822 INFO:tasks.workunit.client.1.smithi136.stdout:7/990: dwrite d0/d35/feb [0,4194304] 0 2024-09-18T12:51:20.822 INFO:tasks.workunit.client.1.smithi136.stdout:2/926: dread d5/fef [0,4194304] 0 2024-09-18T12:51:20.822 INFO:tasks.workunit.client.1.smithi136.stdout:2/927: write d5/d25/d43/d74/fb0 [1489191,65547] 0 2024-09-18T12:51:20.826 INFO:tasks.workunit.client.0.smithi081.stdout:7/501: link d2/d18/d3c/f65 d2/d1d/d4e/d84/fb1 0 2024-09-18T12:51:20.827 INFO:tasks.workunit.client.0.smithi081.stdout:4/422: mkdir d3/db/d2d/d4e/d8d 0 2024-09-18T12:51:20.827 INFO:tasks.workunit.client.0.smithi081.stdout:4/423: chown d3/d20/d3d/d65/d45/c46 0 1 2024-09-18T12:51:20.829 INFO:tasks.workunit.client.1.smithi136.stdout:2/928: rmdir d5/d25/d43 39 2024-09-18T12:51:20.829 INFO:tasks.workunit.client.1.smithi136.stdout:2/929: chown d5/d7/f5a 0 1 2024-09-18T12:51:20.829 INFO:tasks.workunit.client.0.smithi081.stdout:4/424: creat d3/db/d35/d79/f8e x:0 0 0 2024-09-18T12:51:20.830 INFO:tasks.workunit.client.0.smithi081.stdout:4/425: read - d3/db/d35/d79/f8e zero size 2024-09-18T12:51:20.830 INFO:tasks.workunit.client.0.smithi081.stdout:4/426: chown d3/d20/d5b/f66 280463203 1 2024-09-18T12:51:20.830 INFO:tasks.workunit.client.0.smithi081.stdout:8/435: write d3/d1e/d4c/f64 [3374928,125045] 0 2024-09-18T12:51:20.831 INFO:tasks.workunit.client.1.smithi136.stdout:2/930: symlink d5/d25/d2d/l136 0 2024-09-18T12:51:20.831 INFO:tasks.workunit.client.1.smithi136.stdout:2/931: truncate d5/d4a/d7a/f125 766403 0 2024-09-18T12:51:20.831 INFO:tasks.workunit.client.1.smithi136.stdout:2/932: write d5/d7/d11/fa0 [214366,56658] 0 2024-09-18T12:51:20.834 INFO:tasks.workunit.client.1.smithi136.stdout:2/933: rmdir d5/d25/d43 39 2024-09-18T12:51:20.836 INFO:tasks.workunit.client.1.smithi136.stdout:2/934: stat d5/d7/d17/d48/db2/db8/cbe 0 2024-09-18T12:51:20.838 INFO:tasks.workunit.client.1.smithi136.stdout:5/944: dwrite d5/d1a/d30/f81 [4194304,4194304] 0 2024-09-18T12:51:20.840 INFO:tasks.workunit.client.1.smithi136.stdout:2/935: mknod d5/d7/d17/d48/dc1/c137 0 2024-09-18T12:51:20.842 INFO:tasks.workunit.client.1.smithi136.stdout:5/945: mknod d5/d1a/d2d/d34/d4e/d7a/d122/d125/c12e 0 2024-09-18T12:51:20.842 INFO:tasks.workunit.client.1.smithi136.stdout:2/936: mknod d5/d25/d2d/d9d/c138 0 2024-09-18T12:51:20.843 INFO:tasks.workunit.client.1.smithi136.stdout:5/946: creat d5/d1a/d2d/d34/d4e/d7a/d122/d125/f12f x:0 0 0 2024-09-18T12:51:20.844 INFO:tasks.workunit.client.1.smithi136.stdout:2/937: link d5/d7/d3b/c4b d5/d7/d11/d34/c139 0 2024-09-18T12:51:20.845 INFO:tasks.workunit.client.1.smithi136.stdout:5/947: creat d5/f130 x:0 0 0 2024-09-18T12:51:20.845 INFO:tasks.workunit.client.1.smithi136.stdout:2/938: symlink d5/d7/dbf/l13a 0 2024-09-18T12:51:20.845 INFO:tasks.workunit.client.1.smithi136.stdout:2/939: truncate d5/fa1 5662454 0 2024-09-18T12:51:20.846 INFO:tasks.workunit.client.1.smithi136.stdout:5/948: rename d5/d1a/d2d/d34/d4e/d9b/c110 to d5/d78/c131 0 2024-09-18T12:51:20.847 INFO:tasks.workunit.client.1.smithi136.stdout:5/949: creat d5/d78/f132 x:0 0 0 2024-09-18T12:51:20.847 INFO:tasks.workunit.client.1.smithi136.stdout:5/950: truncate d5/d1a/d2d/d34/d4e/d7a/d122/d125/f12f 628882 0 2024-09-18T12:51:20.848 INFO:tasks.workunit.client.1.smithi136.stdout:6/848: dwrite d8/f3b [4194304,4194304] 0 2024-09-18T12:51:20.849 INFO:tasks.workunit.client.1.smithi136.stdout:5/951: mknod d5/d6b/dac/c133 0 2024-09-18T12:51:20.850 INFO:tasks.workunit.client.1.smithi136.stdout:5/952: read d5/d1a/d4a/d79/f90 [4270133,85858] 0 2024-09-18T12:51:20.850 INFO:tasks.workunit.client.1.smithi136.stdout:5/953: fsync d5/d1a/d2d/d34/d4e/d9b/f102 0 2024-09-18T12:51:20.850 INFO:tasks.workunit.client.1.smithi136.stdout:5/954: read - d5/d78/f132 zero size 2024-09-18T12:51:20.851 INFO:tasks.workunit.client.1.smithi136.stdout:2/940: dread d5/d25/ff8 [0,4194304] 0 2024-09-18T12:51:20.851 INFO:tasks.workunit.client.1.smithi136.stdout:2/941: write d5/d7/d11/d34/f9e [4221945,118578] 0 2024-09-18T12:51:20.851 INFO:tasks.workunit.client.1.smithi136.stdout:7/991: dread d0/d12/d1a/f20 [0,4194304] 0 2024-09-18T12:51:20.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/915: dwrite d1/d3/d1a/d98/d81/d35/d54/f118 [0,4194304] 0 2024-09-18T12:51:20.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/916: creat d1/d3/d1a/d98/f138 x:0 0 0 2024-09-18T12:51:20.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/917: fsync d1/d46/f12c 0 2024-09-18T12:51:20.856 INFO:tasks.workunit.client.1.smithi136.stdout:0/918: chown d1/d17/f2b 1966474 1 2024-09-18T12:51:20.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/427: dread d3/d20/d3d/d65/d45/f86 [0,4194304] 0 2024-09-18T12:51:20.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/428: read d3/db/f23 [1385743,93916] 0 2024-09-18T12:51:20.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/429: creat d3/d20/d3d/f8f x:0 0 0 2024-09-18T12:51:20.862 INFO:tasks.workunit.client.1.smithi136.stdout:6/849: unlink d8/d9/d64/dbb/fc5 0 2024-09-18T12:51:20.864 INFO:tasks.workunit.client.1.smithi136.stdout:5/955: mkdir d5/d1a/d2d/d34/d4e/d7a/d122/d134 0 2024-09-18T12:51:20.864 INFO:tasks.workunit.client.1.smithi136.stdout:5/956: stat d5/d1a/d2d/d34/d4e/d7a/d9e/dad/laa 0 2024-09-18T12:51:20.865 INFO:tasks.workunit.client.1.smithi136.stdout:4/778: dwrite d0/d2/f28 [0,4194304] 0 2024-09-18T12:51:20.865 INFO:tasks.workunit.client.1.smithi136.stdout:6/850: dread d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:20.865 INFO:tasks.workunit.client.1.smithi136.stdout:6/851: stat d8/d9/d3c/c49 0 2024-09-18T12:51:20.866 INFO:tasks.workunit.client.0.smithi081.stdout:9/449: dwrite f6 [4194304,4194304] 0 2024-09-18T12:51:20.866 INFO:tasks.workunit.client.0.smithi081.stdout:7/502: dwrite d2/f10 [4194304,4194304] 0 2024-09-18T12:51:20.870 INFO:tasks.workunit.client.0.smithi081.stdout:4/430: read d3/d20/d3d/d65/d14/f88 [73633,3185] 0 2024-09-18T12:51:20.870 INFO:tasks.workunit.client.0.smithi081.stdout:8/436: dwrite d3/d1e/d4c/f69 [4194304,4194304] 0 2024-09-18T12:51:20.870 INFO:tasks.workunit.client.0.smithi081.stdout:8/437: readlink d3/d1e/d4c/d68/l7b 0 2024-09-18T12:51:20.871 INFO:tasks.workunit.client.0.smithi081.stdout:4/431: mkdir d3/d20/d3d/d90 0 2024-09-18T12:51:20.872 INFO:tasks.workunit.client.1.smithi136.stdout:7/992: creat d0/d39/d4d/d9a/f15e x:0 0 0 2024-09-18T12:51:20.872 INFO:tasks.workunit.client.1.smithi136.stdout:0/919: write d1/d3/d1a/d98/d81/d72/f10a [663390,99317] 0 2024-09-18T12:51:20.878 INFO:tasks.workunit.client.1.smithi136.stdout:2/942: dwrite d5/d7/f5a [0,4194304] 0 2024-09-18T12:51:20.882 INFO:tasks.workunit.client.1.smithi136.stdout:5/957: mknod d5/d1a/d2d/d34/d88/c135 0 2024-09-18T12:51:20.885 INFO:tasks.workunit.client.0.smithi081.stdout:8/438: dread d3/d1d/f49 [0,4194304] 0 2024-09-18T12:51:20.886 INFO:tasks.workunit.client.1.smithi136.stdout:4/779: symlink d0/d25/d83/lfd 0 2024-09-18T12:51:20.890 INFO:tasks.workunit.client.1.smithi136.stdout:0/920: mknod d1/db/d77/c139 0 2024-09-18T12:51:20.898 INFO:tasks.workunit.client.1.smithi136.stdout:2/943: stat d5/d7/d41/d53/cad 0 2024-09-18T12:51:20.899 INFO:tasks.workunit.client.0.smithi081.stdout:9/450: dwrite dd/de/f97 [0,4194304] 0 2024-09-18T12:51:20.906 INFO:tasks.workunit.client.1.smithi136.stdout:5/958: mknod d5/d1a/d2d/d3f/c136 0 2024-09-18T12:51:20.906 INFO:tasks.workunit.client.1.smithi136.stdout:5/959: readlink d5/d1a/d2d/d34/lce 0 2024-09-18T12:51:20.906 INFO:tasks.workunit.client.1.smithi136.stdout:7/993: getdents d0/d35/d41/dbb 0 2024-09-18T12:51:20.906 INFO:tasks.workunit.client.1.smithi136.stdout:7/994: fsync d0/d35/d41/d50/faf 0 2024-09-18T12:51:20.906 INFO:tasks.workunit.client.1.smithi136.stdout:2/944: write d5/d4a/fe6 [581102,5043] 0 2024-09-18T12:51:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:20.903+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f3444057b90 con 0x7f3450101eb0 2024-09-18T12:51:20.907 INFO:tasks.workunit.client.1.smithi136.stdout:0/921: dread d1/db/d76/f83 [0,4194304] 0 2024-09-18T12:51:20.909 INFO:tasks.workunit.client.1.smithi136.stdout:5/960: symlink d5/d1a/d4a/da1/l137 0 2024-09-18T12:51:20.909 INFO:tasks.workunit.client.0.smithi081.stdout:9/451: rmdir dd/d1d/d1e/d2f 39 2024-09-18T12:51:20.910 INFO:tasks.workunit.client.0.smithi081.stdout:9/452: mknod dd/de/c9a 0 2024-09-18T12:51:20.910 INFO:tasks.workunit.client.0.smithi081.stdout:9/453: creat dd/de/f9b x:0 0 0 2024-09-18T12:51:20.911 INFO:tasks.workunit.client.1.smithi136.stdout:7/995: mkdir d0/d2c/d15f 0 2024-09-18T12:51:20.911 INFO:tasks.workunit.client.1.smithi136.stdout:7/996: stat d0/d35/d41/c97 0 2024-09-18T12:51:20.912 INFO:tasks.workunit.client.1.smithi136.stdout:7/997: rmdir d0/d35/d41/dfe 39 2024-09-18T12:51:20.922 INFO:tasks.workunit.client.0.smithi081.stdout:9/454: dread dd/d1d/f6b [0,4194304] 0 2024-09-18T12:51:20.922 INFO:tasks.workunit.client.0.smithi081.stdout:9/455: write dd/d15/d1a/d35/f53 [1215031,41476] 0 2024-09-18T12:51:20.922 INFO:tasks.workunit.client.0.smithi081.stdout:9/456: truncate dd/de/d4f/f65 759525 0 2024-09-18T12:51:20.923 INFO:tasks.workunit.client.0.smithi081.stdout:9/457: truncate dd/d31/d4a/f93 42860 0 2024-09-18T12:51:20.924 INFO:tasks.workunit.client.1.smithi136.stdout:3/837: sync 2024-09-18T12:51:20.924 INFO:tasks.workunit.client.1.smithi136.stdout:9/830: sync 2024-09-18T12:51:20.925 INFO:tasks.workunit.client.1.smithi136.stdout:3/838: mknod d3/d14/d18/d7f/d100/c10d 0 2024-09-18T12:51:20.928 INFO:tasks.workunit.client.1.smithi136.stdout:8/930: sync 2024-09-18T12:51:20.928 INFO:tasks.workunit.client.1.smithi136.stdout:8/931: chown d9/d18/d34/d3d/d8b/c132 838 1 2024-09-18T12:51:20.929 INFO:tasks.workunit.client.1.smithi136.stdout:1/804: sync 2024-09-18T12:51:20.929 INFO:tasks.workunit.client.1.smithi136.stdout:1/805: creat d2/d5/d2b/d9b/f10c x:0 0 0 2024-09-18T12:51:20.929 INFO:tasks.workunit.client.1.smithi136.stdout:1/806: write d2/d5/d2b/ff4 [690095,3193] 0 2024-09-18T12:51:20.929 INFO:tasks.workunit.client.1.smithi136.stdout:8/932: truncate d9/d18/d34/d3d/d47/d65/f66 3474934 0 2024-09-18T12:51:20.930 INFO:tasks.workunit.client.1.smithi136.stdout:8/933: symlink d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e/l149 0 2024-09-18T12:51:20.934 INFO:tasks.workunit.client.0.smithi081.stdout:0/492: sync 2024-09-18T12:51:20.934 INFO:tasks.workunit.client.1.smithi136.stdout:0/922: write d1/d60/f99 [1389188,28694] 0 2024-09-18T12:51:20.935 INFO:tasks.workunit.client.1.smithi136.stdout:0/923: read d1/d60/f68 [139807,50425] 0 2024-09-18T12:51:20.935 INFO:tasks.workunit.client.1.smithi136.stdout:0/924: creat d1/d3/d1a/d98/f13a x:0 0 0 2024-09-18T12:51:20.935 INFO:tasks.workunit.client.1.smithi136.stdout:0/925: stat d1/c30 0 2024-09-18T12:51:20.936 INFO:tasks.workunit.client.0.smithi081.stdout:0/493: link d7/d9/d4b/d4a/d68/c81 d7/d9/d4b/d4a/d77/ca4 0 2024-09-18T12:51:20.936 INFO:tasks.workunit.client.0.smithi081.stdout:4/432: dwrite d3/d20/d3d/d65/d45/f86 [0,4194304] 0 2024-09-18T12:51:20.938 INFO:tasks.workunit.client.1.smithi136.stdout:3/839: dread d3/d5/d102/fc3 [4194304,4194304] 0 2024-09-18T12:51:20.938 INFO:tasks.workunit.client.1.smithi136.stdout:5/961: dread d5/d1a/d2d/d34/d88/f75 [0,4194304] 0 2024-09-18T12:51:20.938 INFO:tasks.workunit.client.1.smithi136.stdout:5/962: readlink d5/d1a/d30/d7b/lfb 0 2024-09-18T12:51:20.938 INFO:tasks.workunit.client.1.smithi136.stdout:5/963: chown d5/d1a/c107 616314 1 2024-09-18T12:51:20.938 INFO:tasks.workunit.client.1.smithi136.stdout:2/945: dwrite d5/d7/f55 [0,4194304] 0 2024-09-18T12:51:20.940 INFO:tasks.workunit.client.0.smithi081.stdout:0/494: dread d7/d9/d4b/f63 [8388608,4194304] 0 2024-09-18T12:51:20.941 INFO:tasks.workunit.client.1.smithi136.stdout:3/840: mkdir d3/d14/d17/d75/d86/d10e 0 2024-09-18T12:51:20.946 INFO:tasks.workunit.client.1.smithi136.stdout:2/946: creat d5/d7/d41/d100/f13b x:0 0 0 2024-09-18T12:51:20.946 INFO:tasks.workunit.client.1.smithi136.stdout:2/947: chown d5/d25/f8d 269089 1 2024-09-18T12:51:20.947 INFO:tasks.workunit.client.1.smithi136.stdout:3/841: symlink d3/d14/d17/d53/l10f 0 2024-09-18T12:51:20.947 INFO:tasks.workunit.client.0.smithi081.stdout:8/439: dwrite d3/d2f/f31 [0,4194304] 0 2024-09-18T12:51:20.947 INFO:tasks.workunit.client.0.smithi081.stdout:8/440: dread - d3/f85 zero size 2024-09-18T12:51:20.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/948: getdents d5/d25/d2d 0 2024-09-18T12:51:20.950 INFO:tasks.workunit.client.1.smithi136.stdout:2/949: dread - d5/d4a/d67/f105 zero size 2024-09-18T12:51:20.950 INFO:tasks.workunit.client.1.smithi136.stdout:3/842: rmdir d3/d14/d17/d75/d86/d10e 0 2024-09-18T12:51:20.952 INFO:tasks.workunit.client.1.smithi136.stdout:4/780: dwrite d0/d3/f97 [0,4194304] 0 2024-09-18T12:51:20.953 INFO:tasks.workunit.client.1.smithi136.stdout:4/781: chown d0/d2/f3e 15 1 2024-09-18T12:51:20.953 INFO:tasks.workunit.client.1.smithi136.stdout:3/843: mkdir d3/d14/d17/d53/d110 0 2024-09-18T12:51:20.953 INFO:tasks.workunit.client.1.smithi136.stdout:3/844: fsync d3/d14/d17/db8/f107 0 2024-09-18T12:51:20.953 INFO:tasks.workunit.client.1.smithi136.stdout:1/807: write d2/d5/f73 [298710,86516] 0 2024-09-18T12:51:20.955 INFO:tasks.workunit.client.0.smithi081.stdout:7/503: dwrite d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:20.958 INFO:tasks.workunit.client.1.smithi136.stdout:3/845: getdents d3/d14/d17/d53/de8 0 2024-09-18T12:51:20.958 INFO:tasks.workunit.client.1.smithi136.stdout:3/846: truncate d3/d14/d17/d75/d86/fff 1664940 0 2024-09-18T12:51:20.961 INFO:tasks.workunit.client.1.smithi136.stdout:1/808: mkdir d2/d5/d9/db4/dd0/d10d 0 2024-09-18T12:51:20.962 INFO:tasks.workunit.client.1.smithi136.stdout:3/847: symlink d3/d10/d4a/l111 0 2024-09-18T12:51:20.962 INFO:tasks.workunit.client.1.smithi136.stdout:3/848: chown d3/d10/d4a/cb6 30471993 1 2024-09-18T12:51:20.965 INFO:tasks.workunit.client.1.smithi136.stdout:6/852: write d8/d9/de/d1c/f46 [1165996,6125] 0 2024-09-18T12:51:20.966 INFO:tasks.workunit.client.1.smithi136.stdout:3/849: rmdir d3/d14/dc5 39 2024-09-18T12:51:20.966 INFO:tasks.workunit.client.0.smithi081.stdout:8/441: write d3/d1e/d4c/d53/f5f [380641,85429] 0 2024-09-18T12:51:20.967 INFO:tasks.workunit.client.0.smithi081.stdout:8/442: symlink d3/d2f/l96 0 2024-09-18T12:51:20.969 INFO:tasks.workunit.client.0.smithi081.stdout:8/443: link d3/d1e/d4c/f69 d3/d1d/d4a/f97 0 2024-09-18T12:51:20.976 INFO:tasks.workunit.client.1.smithi136.stdout:4/782: dread d0/d3/f48 [0,4194304] 0 2024-09-18T12:51:20.977 INFO:tasks.workunit.client.1.smithi136.stdout:1/809: write d2/d5/d2b/d63/fac [814921,82005] 0 2024-09-18T12:51:20.978 INFO:tasks.workunit.client.1.smithi136.stdout:4/783: creat d0/d45/d67/d7b/ffe x:0 0 0 2024-09-18T12:51:20.979 INFO:tasks.workunit.client.1.smithi136.stdout:1/810: mkdir d2/d5/d9/dcb/d10e 0 2024-09-18T12:51:20.980 INFO:tasks.workunit.client.1.smithi136.stdout:4/784: truncate d0/d2/f50 1587365 0 2024-09-18T12:51:20.980 INFO:tasks.workunit.client.1.smithi136.stdout:1/811: mknod d2/d5/d2b/d34/d86/c10f 0 2024-09-18T12:51:20.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/444: dread d3/f3f [0,4194304] 0 2024-09-18T12:51:20.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/445: rename d3/d1d/d4a/f8e to d3/f98 0 2024-09-18T12:51:20.987 INFO:tasks.workunit.client.1.smithi136.stdout:8/934: dwrite d9/d18/d34/d3d/d47/f130 [0,4194304] 0 2024-09-18T12:51:20.987 INFO:tasks.workunit.client.1.smithi136.stdout:9/831: dwrite d6/da/d3d/d4d/d91/fbf [0,4194304] 0 2024-09-18T12:51:20.988 INFO:tasks.workunit.client.0.smithi081.stdout:8/446: mknod d3/d73/c99 0 2024-09-18T12:51:20.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/447: symlink d3/d1e/d4c/l9a 0 2024-09-18T12:51:20.992 INFO:tasks.workunit.client.1.smithi136.stdout:3/850: write d3/d2b/d6c/db4/dfe/ff1 [901455,49704] 0 2024-09-18T12:51:20.993 INFO:tasks.workunit.client.1.smithi136.stdout:8/935: symlink d9/d14/d1a/d2b/d42/d13a/l14a 0 2024-09-18T12:51:20.994 INFO:tasks.workunit.client.1.smithi136.stdout:2/950: dwrite d5/d25/f40 [0,4194304] 0 2024-09-18T12:51:20.994 INFO:tasks.workunit.client.0.smithi081.stdout:8/448: symlink d3/d1d/d4a/l9b 0 2024-09-18T12:51:20.994 INFO:tasks.workunit.client.0.smithi081.stdout:8/449: fdatasync d3/d1e/f36 0 2024-09-18T12:51:20.995 INFO:tasks.workunit.client.1.smithi136.stdout:7/998: dwrite d0/d35/d41/d50/d5a/d98/f15c [0,4194304] 0 2024-09-18T12:51:20.995 INFO:tasks.workunit.client.1.smithi136.stdout:7/999: chown d0/fa 47475 1 2024-09-18T12:51:20.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/450: creat d3/d1e/f9c x:0 0 0 2024-09-18T12:51:20.998 INFO:tasks.workunit.client.1.smithi136.stdout:8/936: unlink d9/d14/d1a/d2b/d42/da4/db9/dc0/f9d 0 2024-09-18T12:51:20.998 INFO:tasks.workunit.client.1.smithi136.stdout:8/937: creat d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/f14b x:0 0 0 2024-09-18T12:51:20.999 INFO:tasks.workunit.client.1.smithi136.stdout:4/785: dread d0/d25/d83/fa3 [0,4194304] 0 2024-09-18T12:51:20.999 INFO:tasks.workunit.client.1.smithi136.stdout:4/786: truncate d0/d3/d90/feb 978200 0 2024-09-18T12:51:20.999 INFO:tasks.workunit.client.1.smithi136.stdout:4/787: chown d0/d3/l42 14944460 1 2024-09-18T12:51:21.000 INFO:tasks.workunit.client.1.smithi136.stdout:0/926: dwrite d1/d3/d1a/d98/d81/d51/fc6 [4194304,4194304] 0 2024-09-18T12:51:21.001 INFO:tasks.workunit.client.0.smithi081.stdout:0/495: dwrite d7/d9/d4b/d33/d7d/f8d [0,4194304] 0 2024-09-18T12:51:21.004 INFO:tasks.workunit.client.1.smithi136.stdout:6/853: dwrite d8/d9/de/d60/d71/d76/d97/f112 [0,4194304] 0 2024-09-18T12:51:21.004 INFO:tasks.workunit.client.1.smithi136.stdout:6/854: chown d8/d9/de/d1c/f38 1026 1 2024-09-18T12:51:21.006 INFO:tasks.workunit.client.1.smithi136.stdout:8/938: truncate d9/d18/d34/d3d/d47/d65/fab 4074242 0 2024-09-18T12:51:21.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/851: dread d3/d14/fb9 [0,4194304] 0 2024-09-18T12:51:21.011 INFO:tasks.workunit.client.1.smithi136.stdout:3/852: dread - d3/d2b/fba zero size 2024-09-18T12:51:21.015 INFO:tasks.workunit.client.1.smithi136.stdout:5/964: dwrite d5/d1a/d30/f40 [0,4194304] 0 2024-09-18T12:51:21.015 INFO:tasks.workunit.client.1.smithi136.stdout:2/951: dread d5/fa1 [0,4194304] 0 2024-09-18T12:51:21.015 INFO:tasks.workunit.client.1.smithi136.stdout:0/927: rmdir d1/d60 39 2024-09-18T12:51:21.016 INFO:tasks.workunit.client.0.smithi081.stdout:8/451: write d3/f15 [3212610,34255] 0 2024-09-18T12:51:21.017 INFO:tasks.workunit.client.1.smithi136.stdout:1/812: dwrite d2/f17 [0,4194304] 0 2024-09-18T12:51:21.017 INFO:tasks.workunit.client.1.smithi136.stdout:1/813: write d2/d5/d2b/d9b/fee [521541,23169] 0 2024-09-18T12:51:21.018 INFO:tasks.workunit.client.0.smithi081.stdout:8/452: truncate d3/f32 1453732 0 2024-09-18T12:51:21.018 INFO:tasks.workunit.client.0.smithi081.stdout:8/453: write d3/d1d/f51 [105763,68141] 0 2024-09-18T12:51:21.024 INFO:tasks.workunit.client.0.smithi081.stdout:0/496: rmdir d7/d9 39 2024-09-18T12:51:21.024 INFO:tasks.workunit.client.0.smithi081.stdout:0/497: stat d7/d9/f90 0 2024-09-18T12:51:21.024 INFO:tasks.workunit.client.0.smithi081.stdout:0/498: write d7/d9/f10 [5609173,95833] 0 2024-09-18T12:51:21.024 INFO:tasks.workunit.client.0.smithi081.stdout:0/499: read - d7/d9/d4b/d3d/f5e zero size 2024-09-18T12:51:21.025 INFO:tasks.workunit.client.1.smithi136.stdout:3/853: link d3/d14/dc5/l66 d3/d14/d17/d75/d86/dd9/df2/d105/l112 0 2024-09-18T12:51:21.028 INFO:tasks.workunit.client.1.smithi136.stdout:5/965: dread d5/d1a/d2d/f8e [0,4194304] 0 2024-09-18T12:51:21.031 INFO:tasks.workunit.client.1.smithi136.stdout:1/814: write d2/d5/d2b/d9b/d2e/d4c/d8e/fcc [3332523,63784] 0 2024-09-18T12:51:21.031 INFO:tasks.workunit.client.1.smithi136.stdout:3/854: dread d3/d5/d31/f90 [0,4194304] 0 2024-09-18T12:51:21.031 INFO:tasks.workunit.client.1.smithi136.stdout:3/855: fsync d3/d14/d17/d75/d86/f9a 0 2024-09-18T12:51:21.033 INFO:tasks.workunit.client.1.smithi136.stdout:2/952: mknod d5/d25/d2d/d9d/da2/c13c 0 2024-09-18T12:51:21.036 INFO:tasks.workunit.client.1.smithi136.stdout:8/939: dwrite d9/f133 [4194304,4194304] 0 2024-09-18T12:51:21.036 INFO:tasks.workunit.client.1.smithi136.stdout:8/940: stat d9/d18/d34/d3d/d47/d65/d92/d12a 0 2024-09-18T12:51:21.038 INFO:tasks.workunit.client.1.smithi136.stdout:5/966: read d5/d1a/d30/f48 [3728185,76314] 0 2024-09-18T12:51:21.043 INFO:tasks.workunit.client.1.smithi136.stdout:1/815: link d2/f78 d2/d5/d2b/d34/d103/f110 0 2024-09-18T12:51:21.043 INFO:tasks.workunit.client.1.smithi136.stdout:4/788: dread d0/d3/d54/fa4 [0,4194304] 0 2024-09-18T12:51:21.043 INFO:tasks.workunit.client.1.smithi136.stdout:4/789: chown d0/d2/f77 22473 1 2024-09-18T12:51:21.043 INFO:tasks.workunit.client.1.smithi136.stdout:1/816: creat d2/d5/d2b/d9b/dbe/dd3/d65/ddb/f111 x:0 0 0 2024-09-18T12:51:21.044 INFO:tasks.workunit.client.1.smithi136.stdout:4/790: dread d0/d3/d90/fe3 [0,4194304] 0 2024-09-18T12:51:21.045 INFO:tasks.workunit.client.1.smithi136.stdout:6/855: dwrite d8/d9/d3c/fb5 [0,4194304] 0 2024-09-18T12:51:21.045 INFO:tasks.workunit.client.0.smithi081.stdout:8/454: dwrite d3/d2f/f87 [0,4194304] 0 2024-09-18T12:51:21.046 INFO:tasks.workunit.client.1.smithi136.stdout:3/856: creat d3/d5/d102/f113 x:0 0 0 2024-09-18T12:51:21.046 INFO:tasks.workunit.client.0.smithi081.stdout:0/500: dwrite d7/d9/d4b/d4a/f8a [0,4194304] 0 2024-09-18T12:51:21.049 INFO:tasks.workunit.client.1.smithi136.stdout:2/953: unlink d5/d4a/d7a/f126 0 2024-09-18T12:51:21.050 INFO:tasks.workunit.client.0.smithi081.stdout:8/455: link d3/d1e/d4c/d53/c70 d3/d1e/d4c/d68/c9d 0 2024-09-18T12:51:21.052 INFO:tasks.workunit.client.1.smithi136.stdout:1/817: dread d2/fe5 [0,4194304] 0 2024-09-18T12:51:21.055 INFO:tasks.workunit.client.1.smithi136.stdout:8/941: symlink d9/d18/d34/d3d/d47/dbe/dd1/l14c 0 2024-09-18T12:51:21.060 INFO:tasks.workunit.client.1.smithi136.stdout:5/967: unlink d5/d1a/d2d/d34/l3d 0 2024-09-18T12:51:21.060 INFO:tasks.workunit.client.1.smithi136.stdout:5/968: dread - d5/d1a/d30/d7b/fde zero size 2024-09-18T12:51:21.060 INFO:tasks.workunit.client.1.smithi136.stdout:5/969: write d5/d1a/d2d/d3f/fa8 [37442,40027] 0 2024-09-18T12:51:21.060 INFO:tasks.workunit.client.1.smithi136.stdout:5/970: getdents d5/d1a/d2d/d34/d88/d10f 0 2024-09-18T12:51:21.060 INFO:tasks.workunit.client.1.smithi136.stdout:5/971: write d5/d1a/d2d/fa6 [483831,67869] 0 2024-09-18T12:51:21.063 INFO:tasks.workunit.client.1.smithi136.stdout:2/954: write d5/d4a/d67/fe4 [2787198,73484] 0 2024-09-18T12:51:21.068 INFO:tasks.workunit.client.1.smithi136.stdout:1/818: creat d2/d5/d2b/d9b/d2e/df0/f112 x:0 0 0 2024-09-18T12:51:21.068 INFO:tasks.workunit.client.1.smithi136.stdout:8/942: mknod d9/d18/dc5/c14d 0 2024-09-18T12:51:21.068 INFO:tasks.workunit.client.1.smithi136.stdout:5/972: unlink d5/d6b/dc3/lda 0 2024-09-18T12:51:21.069 INFO:tasks.workunit.client.1.smithi136.stdout:4/791: getdents d0/d3/d90 0 2024-09-18T12:51:21.070 INFO:tasks.workunit.client.1.smithi136.stdout:2/955: rename d5/d7/dbf/l13a to d5/d25/l13d 0 2024-09-18T12:51:21.070 INFO:tasks.workunit.client.1.smithi136.stdout:2/956: creat d5/d4a/d67/f13e x:0 0 0 2024-09-18T12:51:21.072 INFO:tasks.workunit.client.0.smithi081.stdout:8/456: dread d3/d1d/f51 [0,4194304] 0 2024-09-18T12:51:21.073 INFO:tasks.workunit.client.0.smithi081.stdout:8/457: symlink d3/d1d/d4a/l9e 0 2024-09-18T12:51:21.074 INFO:tasks.workunit.client.1.smithi136.stdout:1/819: link d2/d5/d2b/d34/d86/f48 d2/d5/d2b/d63/f113 0 2024-09-18T12:51:21.074 INFO:tasks.workunit.client.1.smithi136.stdout:1/820: write d2/d5/d2b/d63/fac [1624096,79850] 0 2024-09-18T12:51:21.075 INFO:tasks.workunit.client.0.smithi081.stdout:8/458: mkdir d3/d1d/d9f 0 2024-09-18T12:51:21.075 INFO:tasks.workunit.client.0.smithi081.stdout:8/459: write d3/d1d/f51 [870943,125188] 0 2024-09-18T12:51:21.075 INFO:tasks.workunit.client.1.smithi136.stdout:4/792: mkdir d0/d45/dff 0 2024-09-18T12:51:21.075 INFO:tasks.workunit.client.1.smithi136.stdout:4/793: write d0/d25/fd6 [1607808,89214] 0 2024-09-18T12:51:21.076 INFO:tasks.workunit.client.0.smithi081.stdout:8/460: rmdir d3/d1e/d4c 39 2024-09-18T12:51:21.077 INFO:tasks.workunit.client.0.smithi081.stdout:8/461: creat d3/d1d/d89/fa0 x:0 0 0 2024-09-18T12:51:21.079 INFO:tasks.workunit.client.1.smithi136.stdout:2/957: mknod d5/d7/d3b/df7/d123/c13f 0 2024-09-18T12:51:21.079 INFO:tasks.workunit.client.0.smithi081.stdout:8/462: creat d3/d1e/d4c/fa1 x:0 0 0 2024-09-18T12:51:21.079 INFO:tasks.workunit.client.0.smithi081.stdout:8/463: fsync d3/d1e/f34 0 2024-09-18T12:51:21.079 INFO:tasks.workunit.client.0.smithi081.stdout:8/464: truncate d3/d1d/d89/fa0 394185 0 2024-09-18T12:51:21.080 INFO:tasks.workunit.client.1.smithi136.stdout:6/856: dwrite d8/d9/de/d1c/d50/f7c [4194304,4194304] 0 2024-09-18T12:51:21.080 INFO:tasks.workunit.client.1.smithi136.stdout:6/857: dread - d8/d9/d3c/fea zero size 2024-09-18T12:51:21.081 INFO:tasks.workunit.client.1.smithi136.stdout:5/973: rename d5/d6b/f6c to d5/d1a/d2d/d34/d4e/d7a/d122/f138 0 2024-09-18T12:51:21.081 INFO:tasks.workunit.client.1.smithi136.stdout:5/974: write d5/d1a/d4a/d79/f12b [662769,83063] 0 2024-09-18T12:51:21.083 INFO:tasks.workunit.client.1.smithi136.stdout:1/821: truncate d2/d5/d9/f3b 5385337 0 2024-09-18T12:51:21.084 INFO:tasks.workunit.client.1.smithi136.stdout:5/975: dread d5/d1a/d2d/d34/d4e/fd1 [4194304,4194304] 0 2024-09-18T12:51:21.084 INFO:tasks.workunit.client.1.smithi136.stdout:5/976: write d5/d78/f132 [720426,130523] 0 2024-09-18T12:51:21.084 INFO:tasks.workunit.client.1.smithi136.stdout:5/977: chown d5/d1a/d2d/d34/c25 36892 1 2024-09-18T12:51:21.086 INFO:tasks.workunit.client.0.smithi081.stdout:0/501: dwrite f0 [0,4194304] 0 2024-09-18T12:51:21.087 INFO:tasks.workunit.client.1.smithi136.stdout:2/958: symlink d5/d7/d41/d100/l140 0 2024-09-18T12:51:21.087 INFO:tasks.workunit.client.1.smithi136.stdout:2/959: write d5/f21 [1605003,84608] 0 2024-09-18T12:51:21.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/857: dwrite d3/d14/dc5/f91 [0,4194304] 0 2024-09-18T12:51:21.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/858: readlink d3/d10/l60 0 2024-09-18T12:51:21.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/859: fsync d3/d2b/f4b 0 2024-09-18T12:51:21.089 INFO:tasks.workunit.client.0.smithi081.stdout:8/465: write d3/d1d/f49 [1492897,96035] 0 2024-09-18T12:51:21.089 INFO:tasks.workunit.client.1.smithi136.stdout:6/858: mkdir d8/dcf/d113 0 2024-09-18T12:51:21.090 INFO:tasks.workunit.client.1.smithi136.stdout:1/822: rename d2/d5/d2b/d9b/d2e/d9a to d2/d5/d9/dcb/dfb/d107/d114 0 2024-09-18T12:51:21.090 INFO:tasks.workunit.client.1.smithi136.stdout:1/823: chown d2/d5/d2b/da9/lc8 120412191 1 2024-09-18T12:51:21.090 INFO:tasks.workunit.client.1.smithi136.stdout:1/824: getdents d2/d5/d9/db4 0 2024-09-18T12:51:21.092 INFO:tasks.workunit.client.0.smithi081.stdout:0/502: dread d7/d9/d4b/d4a/f16 [4194304,4194304] 0 2024-09-18T12:51:21.093 INFO:tasks.workunit.client.1.smithi136.stdout:3/860: symlink d3/d14/d17/d75/d86/l114 0 2024-09-18T12:51:21.096 INFO:tasks.workunit.client.0.smithi081.stdout:0/503: rename d7/d9/f11 to d7/d9/d4b/d4a/d77/fa5 0 2024-09-18T12:51:21.096 INFO:tasks.workunit.client.1.smithi136.stdout:8/943: dwrite d9/d14/d1a/d7f/fa0 [0,4194304] 0 2024-09-18T12:51:21.096 INFO:tasks.workunit.client.1.smithi136.stdout:4/794: dwrite d0/d5f/dd3/fe5 [0,4194304] 0 2024-09-18T12:51:21.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/466: dread d3/d1d/f51 [0,4194304] 0 2024-09-18T12:51:21.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/467: chown d3/f86 1216 1 2024-09-18T12:51:21.097 INFO:tasks.workunit.client.0.smithi081.stdout:0/504: mknod d7/d9/d4b/d4a/d77/ca6 0 2024-09-18T12:51:21.097 INFO:tasks.workunit.client.0.smithi081.stdout:0/505: truncate d7/d9/d4b/d4a/f1b 8956569 0 2024-09-18T12:51:21.098 INFO:tasks.workunit.client.0.smithi081.stdout:0/506: getdents d7/d9/d4b/d33/d7d 0 2024-09-18T12:51:21.098 INFO:tasks.workunit.client.0.smithi081.stdout:8/468: read d3/d1d/d4a/f4e [115589,124511] 0 2024-09-18T12:51:21.099 INFO:tasks.workunit.client.1.smithi136.stdout:5/978: rename d5/d1a/d2d/d3f/c5c to d5/c139 0 2024-09-18T12:51:21.099 INFO:tasks.workunit.client.1.smithi136.stdout:5/979: truncate d5/d78/d105/f10e 132770 0 2024-09-18T12:51:21.099 INFO:tasks.workunit.client.1.smithi136.stdout:5/980: truncate d5/d1a/d2d/d34/d4e/d9b/f118 596604 0 2024-09-18T12:51:21.100 INFO:tasks.workunit.client.1.smithi136.stdout:2/960: read d5/d25/d43/d74/f8e [1947977,114621] 0 2024-09-18T12:51:21.100 INFO:tasks.workunit.client.0.smithi081.stdout:0/507: link d7/d4f/l6c d7/d9/d4b/d4a/d77/la7 0 2024-09-18T12:51:21.102 INFO:tasks.workunit.client.0.smithi081.stdout:8/469: rmdir d3/d1d 39 2024-09-18T12:51:21.102 INFO:tasks.workunit.client.0.smithi081.stdout:8/470: fsync d3/f32 0 2024-09-18T12:51:21.103 INFO:tasks.workunit.client.1.smithi136.stdout:6/859: dread d8/d9/de/d1c/d50/da8/df2/ffa [0,4194304] 0 2024-09-18T12:51:21.104 INFO:tasks.workunit.client.0.smithi081.stdout:0/508: symlink d7/d9/d4b/d33/d7d/la8 0 2024-09-18T12:51:21.104 INFO:tasks.workunit.client.1.smithi136.stdout:4/795: creat d0/d45/dff/f100 x:0 0 0 2024-09-18T12:51:21.104 INFO:tasks.workunit.client.1.smithi136.stdout:4/796: write d0/d3/ff9 [458586,99939] 0 2024-09-18T12:51:21.105 INFO:tasks.workunit.client.1.smithi136.stdout:3/861: rmdir d3/d10/d84 39 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:51:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:20 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:21.108 INFO:tasks.workunit.client.0.smithi081.stdout:8/471: creat d3/d73/fa2 x:0 0 0 2024-09-18T12:51:21.108 INFO:tasks.workunit.client.1.smithi136.stdout:8/944: dread d9/d14/d1a/f4e [0,4194304] 0 2024-09-18T12:51:21.109 INFO:tasks.workunit.client.1.smithi136.stdout:5/981: rename d5/d1a/d2d/dc4/l101 to d5/d1a/dfe/d11b/l13a 0 2024-09-18T12:51:21.111 INFO:tasks.workunit.client.1.smithi136.stdout:2/961: mkdir d5/d7/d17/d48/dc1/d141 0 2024-09-18T12:51:21.111 INFO:tasks.workunit.client.1.smithi136.stdout:2/962: write d5/d4a/d67/fd7 [953656,13670] 0 2024-09-18T12:51:21.111 INFO:tasks.workunit.client.0.smithi081.stdout:8/472: getdents d3/d1e/d4c/d68 0 2024-09-18T12:51:21.112 INFO:tasks.workunit.client.0.smithi081.stdout:8/473: fsync d3/d1d/f21 0 2024-09-18T12:51:21.112 INFO:tasks.workunit.client.1.smithi136.stdout:2/963: read d5/d7/d11/fa0 [16882,10] 0 2024-09-18T12:51:21.112 INFO:tasks.workunit.client.1.smithi136.stdout:2/964: chown d5/d7/dbf/dd5 1868 1 2024-09-18T12:51:21.113 INFO:tasks.workunit.client.0.smithi081.stdout:0/509: dread d7/d9/d4b/d33/f52 [0,4194304] 0 2024-09-18T12:51:21.113 INFO:tasks.workunit.client.0.smithi081.stdout:0/510: chown d7/d9/d4b/d33/f86 742469218 1 2024-09-18T12:51:21.113 INFO:tasks.workunit.client.0.smithi081.stdout:0/511: chown d7/d9/d4b/f9d 773171437 1 2024-09-18T12:51:21.114 INFO:tasks.workunit.client.1.smithi136.stdout:8/945: getdents d9/d14/d1a/d7f 0 2024-09-18T12:51:21.114 INFO:tasks.workunit.client.1.smithi136.stdout:8/946: creat d9/d14/d1a/d2b/d42/d6e/d75/db4/f14e x:0 0 0 2024-09-18T12:51:21.115 INFO:tasks.workunit.client.0.smithi081.stdout:0/512: getdents d7/d9/d4b/d33/d43/d9a 0 2024-09-18T12:51:21.116 INFO:tasks.workunit.client.0.smithi081.stdout:3/470: sync 2024-09-18T12:51:21.116 INFO:tasks.workunit.client.0.smithi081.stdout:2/575: sync 2024-09-18T12:51:21.116 INFO:tasks.workunit.client.0.smithi081.stdout:3/471: chown d3/db/d1b 310 1 2024-09-18T12:51:21.117 INFO:tasks.workunit.client.1.smithi136.stdout:3/862: rename d3/lef to d3/d14/d17/d53/l115 0 2024-09-18T12:51:21.117 INFO:tasks.workunit.client.1.smithi136.stdout:3/863: read - d3/d14/d17/d75/d86/dd9/df2/f101 zero size 2024-09-18T12:51:21.118 INFO:tasks.workunit.client.0.smithi081.stdout:3/472: write d3/db/df/d29/d13/f61 [403664,113886] 0 2024-09-18T12:51:21.120 INFO:tasks.workunit.client.0.smithi081.stdout:2/576: creat d15/d16/d33/d53/fd3 x:0 0 0 2024-09-18T12:51:21.121 INFO:tasks.workunit.client.0.smithi081.stdout:2/577: read d15/f17 [2096727,50011] 0 2024-09-18T12:51:21.122 INFO:tasks.workunit.client.1.smithi136.stdout:2/965: creat d5/d7/f142 x:0 0 0 2024-09-18T12:51:21.126 INFO:tasks.workunit.client.1.smithi136.stdout:8/947: dread d9/f133 [4194304,4194304] 0 2024-09-18T12:51:21.129 INFO:tasks.workunit.client.1.smithi136.stdout:3/864: creat d3/d14/d22/d2c/dd5/f116 x:0 0 0 2024-09-18T12:51:21.130 INFO:tasks.workunit.client.1.smithi136.stdout:8/948: unlink d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e/d10d/lec 0 2024-09-18T12:51:21.130 INFO:tasks.workunit.client.1.smithi136.stdout:8/949: fsync d9/d18/d34/d3d/d47/dbe/ff8 0 2024-09-18T12:51:21.132 INFO:tasks.workunit.client.1.smithi136.stdout:3/865: truncate d3/d5/d102/fc3 1156138 0 2024-09-18T12:51:21.133 INFO:tasks.workunit.client.1.smithi136.stdout:8/950: creat d9/d18/d34/d3d/d47/f14f x:0 0 0 2024-09-18T12:51:21.135 INFO:tasks.workunit.client.1.smithi136.stdout:8/951: rmdir d9/d18/d34/d3d/d47/d65 39 2024-09-18T12:51:21.135 INFO:tasks.workunit.client.1.smithi136.stdout:1/825: dwrite d2/d5/f5a [4194304,4194304] 0 2024-09-18T12:51:21.136 INFO:tasks.workunit.client.0.smithi081.stdout:3/473: dread d3/f4e [0,4194304] 0 2024-09-18T12:51:21.136 INFO:tasks.workunit.client.0.smithi081.stdout:3/474: write d3/db/f8a [1016149,18653] 0 2024-09-18T12:51:21.136 INFO:tasks.workunit.client.0.smithi081.stdout:3/475: read - d3/db/df/d29/d12/d44/d51/fa2 zero size 2024-09-18T12:51:21.137 INFO:tasks.workunit.client.0.smithi081.stdout:3/476: write d3/db/dc/d1a/f8e [1847963,1227] 0 2024-09-18T12:51:21.138 INFO:tasks.workunit.client.1.smithi136.stdout:6/860: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:21.139 INFO:tasks.workunit.client.1.smithi136.stdout:5/982: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:51:21.139 INFO:tasks.workunit.client.1.smithi136.stdout:5/983: write d5/d1a/d30/d7b/fca [1320712,81446] 0 2024-09-18T12:51:21.141 INFO:tasks.workunit.client.1.smithi136.stdout:2/966: dread d5/d7/d17/d48/f97 [0,4194304] 0 2024-09-18T12:51:21.141 INFO:tasks.workunit.client.0.smithi081.stdout:0/513: dread d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:21.142 INFO:tasks.workunit.client.0.smithi081.stdout:3/477: rename d3/db/d1b/l75 to d3/db/df/d29/d12/d44/d76/lad 0 2024-09-18T12:51:21.145 INFO:tasks.workunit.client.1.smithi136.stdout:4/797: getdents d0/d45/dff 0 2024-09-18T12:51:21.145 INFO:tasks.workunit.client.1.smithi136.stdout:4/798: fsync d0/d3/f73 0 2024-09-18T12:51:21.146 INFO:tasks.workunit.client.0.smithi081.stdout:2/578: dwrite d15/d16/d33/d53/fb2 [0,4194304] 0 2024-09-18T12:51:21.149 INFO:tasks.workunit.client.1.smithi136.stdout:2/967: dread d5/d7/d11/d34/fcf [0,4194304] 0 2024-09-18T12:51:21.153 INFO:tasks.workunit.client.1.smithi136.stdout:5/984: mknod d5/d1a/d30/d7b/c13b 0 2024-09-18T12:51:21.153 INFO:tasks.workunit.client.1.smithi136.stdout:8/952: getdents d9/d14/d1a/d2b/d42/d9e/dda/dfa 0 2024-09-18T12:51:21.153 INFO:tasks.workunit.client.1.smithi136.stdout:5/985: creat d5/d1a/d2d/d34/d88/d10f/f13c x:0 0 0 2024-09-18T12:51:21.153 INFO:tasks.workunit.client.1.smithi136.stdout:1/826: read d2/d5/d9/f3b [4030267,69343] 0 2024-09-18T12:51:21.155 INFO:tasks.workunit.client.1.smithi136.stdout:8/953: creat d9/d14/d1a/d2b/deb/d110/dd5/dfc/f150 x:0 0 0 2024-09-18T12:51:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.155+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3450106800 con 0x7f343806c4e0 2024-09-18T12:51:21.157 INFO:tasks.workunit.client.1.smithi136.stdout:5/986: link d5/d1a/d2d/d3f/fa8 d5/d1a/d2d/d34/d12a/f13d 0 2024-09-18T12:51:21.157 INFO:tasks.workunit.client.1.smithi136.stdout:5/987: truncate d5/db4/ffd 257159 0 2024-09-18T12:51:21.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.157+0000 7f344d7fa700 1 -- 172.21.15.81:0/1775863891 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f3450106800 con 0x7f343806c4e0 2024-09-18T12:51:21.159 INFO:tasks.workunit.client.1.smithi136.stdout:1/827: mkdir d2/d5/d2b/d9b/d115 0 2024-09-18T12:51:21.161 INFO:tasks.workunit.client.1.smithi136.stdout:5/988: rmdir d5/d1a/d2d/d34/d4e/d7a/d9e/dad 39 2024-09-18T12:51:21.161 INFO:tasks.workunit.client.1.smithi136.stdout:3/866: dwrite d3/d14/d22/fc6 [0,4194304] 0 2024-09-18T12:51:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.161+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 msgr2=0x7f343806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.161+0000 7f3456953700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 0x7f343806e9a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3440006fd0 tx=0x7f3440008040 comp rx=0 tx=0).stop 2024-09-18T12:51:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 msgr2=0x7f3450196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f344400bd70 tx=0x7f344400be50 comp rx=0 tx=0).stop 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 shutdown_connections 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3450100cb0 0x7f34501964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f343806c4e0 0x7f343806e9a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 --2- 172.21.15.81:0/1775863891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450101eb0 0x7f3450196a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 >> 172.21.15.81:0/1775863891 conn(0x7f34500fc230 msgr2=0x7f34501050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 shutdown_connections 2024-09-18T12:51:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.162+0000 7f3456953700 1 -- 172.21.15.81:0/1775863891 wait complete. 2024-09-18T12:51:21.168 INFO:tasks.workunit.client.1.smithi136.stdout:6/861: dwrite d8/d9/d3c/ff4 [0,4194304] 0 2024-09-18T12:51:21.168 INFO:tasks.workunit.client.1.smithi136.stdout:6/862: write d8/d9/de/d60/d94/f111 [738945,92885] 0 2024-09-18T12:51:21.168 INFO:tasks.workunit.client.1.smithi136.stdout:6/863: write d8/d9/de/f6a [925776,98435] 0 2024-09-18T12:51:21.169 INFO:tasks.workunit.client.0.smithi081.stdout:3/478: dread d3/db/f8a [0,4194304] 0 2024-09-18T12:51:21.169 INFO:tasks.workunit.client.0.smithi081.stdout:3/479: chown d3/f4e 991 1 2024-09-18T12:51:21.170 INFO:tasks.workunit.client.1.smithi136.stdout:3/867: creat d3/d14/d17/db8/f117 x:0 0 0 2024-09-18T12:51:21.171 INFO:tasks.workunit.client.0.smithi081.stdout:3/480: rename d3/db/d1b/f34 to d3/db/df/d29/d12/fae 0 2024-09-18T12:51:21.171 INFO:tasks.workunit.client.0.smithi081.stdout:3/481: chown d3/db/df/d29/f48 8564 1 2024-09-18T12:51:21.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/482: symlink d3/db/df/d29/d12/d44/d76/laf 0 2024-09-18T12:51:21.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/483: dread - d3/db/df/d29/d13/d68/fa3 zero size 2024-09-18T12:51:21.175 INFO:tasks.workunit.client.0.smithi081.stdout:3/484: write d3/db/df/d29/d13/f61 [21804,105147] 0 2024-09-18T12:51:21.176 INFO:tasks.workunit.client.1.smithi136.stdout:9/832: sync 2024-09-18T12:51:21.177 INFO:tasks.workunit.client.1.smithi136.stdout:4/799: dwrite d0/d25/db7/fc7 [0,4194304] 0 2024-09-18T12:51:21.177 INFO:tasks.workunit.client.1.smithi136.stdout:4/800: stat d0/d3/d54/f74 0 2024-09-18T12:51:21.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/485: link d3/db/d1b/d57/c1c d3/db/df/d29/d13/d65/cb0 0 2024-09-18T12:51:21.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/486: chown d3/db/df/d29/d13/d68/f7b 25620537 1 2024-09-18T12:51:21.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/487: chown d3/db/dc/c77 4 1 2024-09-18T12:51:21.179 INFO:tasks.workunit.client.1.smithi136.stdout:0/928: sync 2024-09-18T12:51:21.182 INFO:tasks.workunit.client.1.smithi136.stdout:4/801: rename d0/d3/d54/d88/fd5 to d0/d3/d54/d5c/f101 0 2024-09-18T12:51:21.183 INFO:tasks.workunit.client.1.smithi136.stdout:9/833: mknod d6/da/d3d/d4d/d91/d25/d55/c11a 0 2024-09-18T12:51:21.186 INFO:tasks.workunit.client.1.smithi136.stdout:0/929: rename d1/d3/d1a/fce to d1/d17/dd1/dff/f13b 0 2024-09-18T12:51:21.188 INFO:tasks.workunit.client.1.smithi136.stdout:4/802: dread d0/d13/f7f [0,4194304] 0 2024-09-18T12:51:21.188 INFO:tasks.workunit.client.1.smithi136.stdout:0/930: mknod d1/c13c 0 2024-09-18T12:51:21.188 INFO:tasks.workunit.client.1.smithi136.stdout:0/931: chown d1/d3/d1a/d98/d81/d51/db3/f105 1654417 1 2024-09-18T12:51:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:51:21.190 INFO:tasks.workunit.client.1.smithi136.stdout:2/968: dwrite d5/d7/fc6 [0,4194304] 0 2024-09-18T12:51:21.190 INFO:tasks.workunit.client.1.smithi136.stdout:0/932: rename d1/d46/d6c/f8a to d1/db/d76/db9/de5/f13d 0 2024-09-18T12:51:21.194 INFO:tasks.workunit.client.1.smithi136.stdout:2/969: mkdir d5/d7/d17/d48/db2/db8/d143 0 2024-09-18T12:51:21.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/970: read - d5/d4a/d67/f105 zero size 2024-09-18T12:51:21.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/971: chown d5/d25/d2d/d9d/c138 512231659 1 2024-09-18T12:51:21.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/972: creat d5/d7/d17/d48/f144 x:0 0 0 2024-09-18T12:51:21.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/973: write d5/d25/f28 [1205377,16264] 0 2024-09-18T12:51:21.195 INFO:tasks.workunit.client.1.smithi136.stdout:2/974: creat d5/d7/dbf/dd5/f145 x:0 0 0 2024-09-18T12:51:21.197 INFO:tasks.workunit.client.1.smithi136.stdout:2/975: mknod d5/d4a/d67/c146 0 2024-09-18T12:51:21.197 INFO:tasks.workunit.client.1.smithi136.stdout:2/976: write d5/d25/f120 [376321,76164] 0 2024-09-18T12:51:21.198 INFO:tasks.workunit.client.1.smithi136.stdout:4/803: dread d0/d8d/f8e [0,4194304] 0 2024-09-18T12:51:21.199 INFO:tasks.workunit.client.1.smithi136.stdout:4/804: chown d0/d3/l65 694 1 2024-09-18T12:51:21.199 INFO:tasks.workunit.client.1.smithi136.stdout:8/954: dwrite d9/d14/d1a/d2b/d42/da4/de5/f137 [0,4194304] 0 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/805: creat d0/d45/d67/ddf/f102 x:0 0 0 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/806: creat d0/d45/d67/ddf/f103 x:0 0 0 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/807: write d0/d5f/dd3/ff7 [1016742,96429] 0 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/808: chown d0/d2/c1a 723276 1 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/809: readlink d0/d3/d54/d88/db1/lcb 0 2024-09-18T12:51:21.201 INFO:tasks.workunit.client.1.smithi136.stdout:4/810: stat d0/d25/db7 0 2024-09-18T12:51:21.202 INFO:tasks.workunit.client.1.smithi136.stdout:8/955: symlink d9/l151 0 2024-09-18T12:51:21.203 INFO:tasks.workunit.client.1.smithi136.stdout:8/956: getdents d9/d14 0 2024-09-18T12:51:21.203 INFO:tasks.workunit.client.1.smithi136.stdout:8/957: chown d9/d14/d1a/d7f/fe6 11 1 2024-09-18T12:51:21.204 INFO:tasks.workunit.client.1.smithi136.stdout:8/958: rename d9/d18/d34/d3d/d47/l5b to d9/l152 0 2024-09-18T12:51:21.207 INFO:tasks.workunit.client.1.smithi136.stdout:0/933: write d1/db/d76/f92 [1152468,128789] 0 2024-09-18T12:51:21.207 INFO:tasks.workunit.client.0.smithi081.stdout:3/488: dwrite d3/db/df/d29/d12/fae [0,4194304] 0 2024-09-18T12:51:21.208 INFO:tasks.workunit.client.1.smithi136.stdout:8/959: rmdir d9/d14/d1a/d2b/d42/d6e/d75/db4 39 2024-09-18T12:51:21.208 INFO:tasks.workunit.client.0.smithi081.stdout:3/489: mknod d3/db/dc/cb1 0 2024-09-18T12:51:21.208 INFO:tasks.workunit.client.0.smithi081.stdout:3/490: read - d3/db/d1b/f43 zero size 2024-09-18T12:51:21.210 INFO:tasks.workunit.client.0.smithi081.stdout:3/491: mknod d3/db/dc/d1a/cb2 0 2024-09-18T12:51:21.212 INFO:tasks.workunit.client.0.smithi081.stdout:3/492: rename d3/db/df/d29/d13/d68/f7b to d3/db/df/d29/d13/d65/fb3 0 2024-09-18T12:51:21.213 INFO:tasks.workunit.client.1.smithi136.stdout:8/960: mkdir d9/d14/d1a/d2b/d42/d153 0 2024-09-18T12:51:21.213 INFO:tasks.workunit.client.1.smithi136.stdout:2/977: dread d5/d25/d2d/f6d [0,4194304] 0 2024-09-18T12:51:21.214 INFO:tasks.workunit.client.1.smithi136.stdout:2/978: fdatasync d5/d7/d17/f3c 0 2024-09-18T12:51:21.214 INFO:tasks.workunit.client.1.smithi136.stdout:2/979: chown d5/d4a/d67/f10c 1532 1 2024-09-18T12:51:21.214 INFO:tasks.workunit.client.1.smithi136.stdout:0/934: getdents d1/d3/d1a/d98/d81 0 2024-09-18T12:51:21.214 INFO:tasks.workunit.client.0.smithi081.stdout:3/493: symlink d3/db/dc/lb4 0 2024-09-18T12:51:21.214 INFO:tasks.workunit.client.0.smithi081.stdout:3/494: readlink d3/d23/la5 0 2024-09-18T12:51:21.215 INFO:tasks.workunit.client.0.smithi081.stdout:0/514: dwrite d7/d9/d4b/d4a/f29 [0,4194304] 0 2024-09-18T12:51:21.216 INFO:tasks.workunit.client.1.smithi136.stdout:8/961: unlink d9/d18/d34/f6f 0 2024-09-18T12:51:21.217 INFO:tasks.workunit.client.1.smithi136.stdout:5/989: dwrite d5/d1a/d2d/d34/d4e/db5/f108 [0,4194304] 0 2024-09-18T12:51:21.217 INFO:tasks.workunit.client.1.smithi136.stdout:5/990: read d5/d1a/d2d/d34/f95 [452415,73887] 0 2024-09-18T12:51:21.217 INFO:tasks.workunit.client.1.smithi136.stdout:6/864: dwrite d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:21.217 INFO:tasks.workunit.client.1.smithi136.stdout:5/991: dread - d5/d1a/d2d/d34/d4e/d7a/d9e/da9/f104 zero size 2024-09-18T12:51:21.220 INFO:tasks.workunit.client.1.smithi136.stdout:2/980: rename d5/d7/d17/l61 to d5/d7/d17/d48/db2/l147 0 2024-09-18T12:51:21.220 INFO:tasks.workunit.client.1.smithi136.stdout:0/935: getdents d1/d3/d1a/d98/d81/d70/dbc 0 2024-09-18T12:51:21.225 INFO:tasks.workunit.client.1.smithi136.stdout:8/962: mknod d9/d14/d1a/d7f/d8c/dcb/c154 0 2024-09-18T12:51:21.227 INFO:tasks.workunit.client.1.smithi136.stdout:4/811: dwrite d0/d3/d54/d8a/faa [0,4194304] 0 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.1.smithi136.stdout:6/865: dread d8/d9/de/d1c/d50/da8/fc0 [0,4194304] 0 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.1.smithi136.stdout:9/834: dwrite d6/da/d3d/f69 [0,4194304] 0 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.1.smithi136.stdout:9/835: read - d6/da/d3d/fff zero size 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.0.smithi081.stdout:3/495: dread d3/db/df/d29/d12/fae [0,4194304] 0 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.0.smithi081.stdout:3/496: dread - d3/d23/f55 zero size 2024-09-18T12:51:21.228 INFO:tasks.workunit.client.0.smithi081.stdout:3/497: chown d3/db/dc/cb1 1334410 1 2024-09-18T12:51:21.231 INFO:tasks.workunit.client.0.smithi081.stdout:3/498: getdents d3/db/df/d29/d13 0 2024-09-18T12:51:21.231 INFO:tasks.workunit.client.0.smithi081.stdout:3/499: chown d3/db/df/d29/d13/f4c 1691183 1 2024-09-18T12:51:21.232 INFO:tasks.workunit.client.0.smithi081.stdout:3/500: rmdir d3/d84 39 2024-09-18T12:51:21.233 INFO:tasks.workunit.client.1.smithi136.stdout:5/992: link d5/d1a/d2d/d34/d4e/f70 d5/d1a/d2d/d34/d4e/d7a/d9e/f13e 0 2024-09-18T12:51:21.233 INFO:tasks.workunit.client.1.smithi136.stdout:5/993: getdents d5/d1a/d30/ded 0 2024-09-18T12:51:21.233 INFO:tasks.workunit.client.0.smithi081.stdout:3/501: creat d3/db/dc/d1a/fb5 x:0 0 0 2024-09-18T12:51:21.234 INFO:tasks.workunit.client.0.smithi081.stdout:3/502: link d3/f4e d3/db/df/d29/d13/d9d/fb6 0 2024-09-18T12:51:21.237 INFO:tasks.workunit.client.1.smithi136.stdout:4/812: rmdir d0/d5f 39 2024-09-18T12:51:21.237 INFO:tasks.workunit.client.1.smithi136.stdout:4/813: chown d0/d2/c1a 47280 1 2024-09-18T12:51:21.237 INFO:tasks.workunit.client.1.smithi136.stdout:4/814: stat d0/d3/d54/d88 0 2024-09-18T12:51:21.237 INFO:tasks.workunit.client.1.smithi136.stdout:4/815: write d0/d13/f7f [1255760,80895] 0 2024-09-18T12:51:21.238 INFO:tasks.workunit.client.0.smithi081.stdout:0/515: dwrite d7/f93 [0,4194304] 0 2024-09-18T12:51:21.244 INFO:tasks.workunit.client.1.smithi136.stdout:6/866: creat d8/dcf/d113/f114 x:0 0 0 2024-09-18T12:51:21.244 INFO:tasks.workunit.client.1.smithi136.stdout:6/867: readlink d8/d9/de/d1c/l36 0 2024-09-18T12:51:21.245 INFO:tasks.workunit.client.0.smithi081.stdout:0/516: dread d7/d9/f23 [0,4194304] 0 2024-09-18T12:51:21.245 INFO:tasks.workunit.client.0.smithi081.stdout:0/517: chown d7/d9/d4b/d33/d43/c97 3 1 2024-09-18T12:51:21.245 INFO:tasks.workunit.client.0.smithi081.stdout:0/518: fdatasync d7/d9/d4b/d4a/d77/fa5 0 2024-09-18T12:51:21.246 INFO:tasks.workunit.client.0.smithi081.stdout:0/519: symlink d7/d9/d4b/d33/d43/la9 0 2024-09-18T12:51:21.247 INFO:tasks.workunit.client.0.smithi081.stdout:0/520: write d7/d9/d4b/d53/f64 [20249,93453] 0 2024-09-18T12:51:21.248 INFO:tasks.workunit.client.1.smithi136.stdout:9/836: stat d6/da/d3d/d4d/d91/c4b 0 2024-09-18T12:51:21.249 INFO:tasks.workunit.client.0.smithi081.stdout:0/521: rename d7/f80 to d7/d9/d4b/d33/d43/d9a/faa 0 2024-09-18T12:51:21.249 INFO:tasks.workunit.client.1.smithi136.stdout:5/994: mknod d5/d1a/d2d/d34/d12a/c13f 0 2024-09-18T12:51:21.250 INFO:tasks.workunit.client.0.smithi081.stdout:0/522: dread d7/d9/d4b/d33/d43/f87 [0,4194304] 0 2024-09-18T12:51:21.251 INFO:tasks.workunit.client.1.smithi136.stdout:4/816: truncate d0/d13/f18 1921487 0 2024-09-18T12:51:21.251 INFO:tasks.workunit.client.0.smithi081.stdout:0/523: symlink d7/d9/d4b/d4a/d92/lab 0 2024-09-18T12:51:21.252 INFO:tasks.workunit.client.1.smithi136.stdout:1/828: dwrite d2/d5/d2b/d9b/d2e/d4c/d8e/fa6 [0,4194304] 0 2024-09-18T12:51:21.252 INFO:tasks.workunit.client.1.smithi136.stdout:6/868: symlink d8/d9/d3c/d45/dff/l115 0 2024-09-18T12:51:21.254 INFO:tasks.workunit.client.1.smithi136.stdout:0/936: dwrite d1/d3/d1a/d62/d75/fcc [4194304,4194304] 0 2024-09-18T12:51:21.255 INFO:tasks.workunit.client.1.smithi136.stdout:0/937: write d1/d3/d1a/d62/fa4 [973732,31969] 0 2024-09-18T12:51:21.255 INFO:tasks.workunit.client.1.smithi136.stdout:0/938: fdatasync d1/d3/d1a/d95/deb/f121 0 2024-09-18T12:51:21.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/503: dwrite d3/db/df/d29/d12/d44/d51/fa2 [0,4194304] 0 2024-09-18T12:51:21.255 INFO:tasks.workunit.client.1.smithi136.stdout:5/995: mkdir d5/d6b/d140 0 2024-09-18T12:51:21.258 INFO:tasks.workunit.client.1.smithi136.stdout:6/869: symlink d8/d9/de/d60/l116 0 2024-09-18T12:51:21.259 INFO:tasks.workunit.client.0.smithi081.stdout:3/504: link d3/db/df/d29/d13/d65/c83 d3/db/df/d29/cb7 0 2024-09-18T12:51:21.259 INFO:tasks.workunit.client.0.smithi081.stdout:3/505: dread - d3/db/df/d29/f48 zero size 2024-09-18T12:51:21.259 INFO:tasks.workunit.client.0.smithi081.stdout:3/506: readlink d3/db/dc/d1a/l67 0 2024-09-18T12:51:21.259 INFO:tasks.workunit.client.1.smithi136.stdout:9/837: creat d6/da/d3d/d4d/d91/d38/f11b x:0 0 0 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/838: truncate d6/d96/dbb/fdf 462663 0 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/839: chown d6/df/d23/d2b/d79/d53/d5c 1365973 1 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/840: dread - d6/df/d23/d2b/de5/f114 zero size 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/841: write d6/df/d23/d2b/de5/feb [1014347,131012] 0 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/842: chown d6/d96/dbb 129641936 1 2024-09-18T12:51:21.261 INFO:tasks.workunit.client.1.smithi136.stdout:9/843: write d6/df/d75/dde/fe6 [41378,2458] 0 2024-09-18T12:51:21.262 INFO:tasks.workunit.client.1.smithi136.stdout:1/829: dread d2/d5/f73 [0,4194304] 0 2024-09-18T12:51:21.262 INFO:tasks.workunit.client.1.smithi136.stdout:1/830: write d2/d5/d2b/d9b/d2e/f79 [268578,64441] 0 2024-09-18T12:51:21.264 INFO:tasks.workunit.client.1.smithi136.stdout:6/870: symlink d8/d9d/d9f/d105/l117 0 2024-09-18T12:51:21.270 INFO:tasks.workunit.client.0.smithi081.stdout:3/507: write d3/d23/f97 [2134922,86922] 0 2024-09-18T12:51:21.273 INFO:tasks.workunit.client.1.smithi136.stdout:1/831: unlink d2/d5/d9/ca3 0 2024-09-18T12:51:21.284 INFO:tasks.workunit.client.0.smithi081.stdout:3/508: dread d3/db/d1b/f7d [0,4194304] 0 2024-09-18T12:51:21.286 INFO:tasks.workunit.client.0.smithi081.stdout:3/509: write d3/db/df/d29/d13/f4c [120645,1674] 0 2024-09-18T12:51:21.288 INFO:tasks.workunit.client.0.smithi081.stdout:3/510: getdents d3/db/df/d60/d58 0 2024-09-18T12:51:21.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/511: creat d3/db/df/d29/fb8 x:0 0 0 2024-09-18T12:51:21.291 INFO:tasks.workunit.client.0.smithi081.stdout:3/512: fdatasync d3/db/df/d29/d13/f8f 0 2024-09-18T12:51:21.291 INFO:tasks.workunit.client.0.smithi081.stdout:3/513: rename d3/d23/f5e to d3/db/df/fb9 0 2024-09-18T12:51:21.291 INFO:tasks.workunit.client.0.smithi081.stdout:3/514: creat d3/db/df/da8/fba x:0 0 0 2024-09-18T12:51:21.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/515: mknod d3/db/df/d60/cbb 0 2024-09-18T12:51:21.293 INFO:tasks.workunit.client.0.smithi081.stdout:3/516: truncate d3/db/df/fb9 1669691 0 2024-09-18T12:51:21.293 INFO:tasks.workunit.client.0.smithi081.stdout:3/517: stat d3/db/df/da8/fba 0 2024-09-18T12:51:21.293 INFO:tasks.workunit.client.0.smithi081.stdout:3/518: symlink d3/db/da4/lbc 0 2024-09-18T12:51:21.294 INFO:tasks.workunit.client.0.smithi081.stdout:3/519: write d3/db/df/d29/d12/d44/d51/fa7 [4147868,50465] 0 2024-09-18T12:51:21.308 INFO:tasks.workunit.client.1.smithi136.stdout:1/832: dwrite d2/f5b [0,4194304] 0 2024-09-18T12:51:21.308 INFO:tasks.workunit.client.1.smithi136.stdout:1/833: creat d2/d5/d9/db4/dd0/f116 x:0 0 0 2024-09-18T12:51:21.308 INFO:tasks.workunit.client.1.smithi136.stdout:1/834: write d2/f6c [680245,31035] 0 2024-09-18T12:51:21.308 INFO:tasks.workunit.client.1.smithi136.stdout:1/835: fsync d2/d5/f73 0 2024-09-18T12:51:21.308 INFO:tasks.workunit.client.1.smithi136.stdout:5/996: dwrite d5/d1a/d2d/fa6 [0,4194304] 0 2024-09-18T12:51:21.309 INFO:tasks.workunit.client.0.smithi081.stdout:0/524: dwrite d7/d9/d4b/d3d/f5e [0,4194304] 0 2024-09-18T12:51:21.309 INFO:tasks.workunit.client.1.smithi136.stdout:6/871: dwrite d8/d9/de/d1c/db9/fc3 [0,4194304] 0 2024-09-18T12:51:21.310 INFO:tasks.workunit.client.1.smithi136.stdout:0/939: dwrite d1/d60/f68 [0,4194304] 0 2024-09-18T12:51:21.310 INFO:tasks.workunit.client.1.smithi136.stdout:0/940: readlink d1/d3/d1a/lc7 0 2024-09-18T12:51:21.312 INFO:tasks.workunit.client.1.smithi136.stdout:1/836: mknod d2/d5/d9/db4/c117 0 2024-09-18T12:51:21.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:51:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:51:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:51:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:51:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:20 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:21.314 INFO:tasks.workunit.client.1.smithi136.stdout:5/997: mkdir d5/d1a/d2d/d34/d88/d10f/d141 0 2024-09-18T12:51:21.314 INFO:tasks.workunit.client.1.smithi136.stdout:5/998: write d5/d78/d105/f128 [521177,56881] 0 2024-09-18T12:51:21.315 INFO:tasks.workunit.client.1.smithi136.stdout:5/999: truncate d5/d1a/d2d/d34/d4e/db5/f108 4976220 0 2024-09-18T12:51:21.315 INFO:tasks.workunit.client.0.smithi081.stdout:0/525: creat d7/d9/fac x:0 0 0 2024-09-18T12:51:21.315 INFO:tasks.workunit.client.0.smithi081.stdout:0/526: write d7/d9/f90 [1042104,35248] 0 2024-09-18T12:51:21.316 INFO:tasks.workunit.client.0.smithi081.stdout:3/520: dwrite d3/db/f4b [0,4194304] 0 2024-09-18T12:51:21.316 INFO:tasks.workunit.client.0.smithi081.stdout:0/527: creat d7/d9/d4b/d53/fad x:0 0 0 2024-09-18T12:51:21.317 INFO:tasks.workunit.client.1.smithi136.stdout:0/941: creat d1/d60/d10c/f13e x:0 0 0 2024-09-18T12:51:21.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/521: symlink d3/db/df/da8/lbd 0 2024-09-18T12:51:21.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/522: truncate d3/db/df/d29/d12/d44/d51/fa7 4953953 0 2024-09-18T12:51:21.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/523: fdatasync d3/db/d1b/f7d 0 2024-09-18T12:51:21.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/524: creat d3/db/df/d29/d12/d44/d76/fbe x:0 0 0 2024-09-18T12:51:21.320 INFO:tasks.workunit.client.1.smithi136.stdout:1/837: mkdir d2/d5/d2b/d34/d118 0 2024-09-18T12:51:21.320 INFO:tasks.workunit.client.1.smithi136.stdout:1/838: write d2/d5/d2b/da9/def/ff3 [1453075,114696] 0 2024-09-18T12:51:21.320 INFO:tasks.workunit.client.1.smithi136.stdout:6/872: dread d8/d9/fb [0,4194304] 0 2024-09-18T12:51:21.320 INFO:tasks.workunit.client.0.smithi081.stdout:0/528: mknod d7/d9/cae 0 2024-09-18T12:51:21.320 INFO:tasks.workunit.client.1.smithi136.stdout:0/942: dread d1/d3/d1a/d62/d75/d100/f101 [0,4194304] 0 2024-09-18T12:51:21.321 INFO:tasks.workunit.client.1.smithi136.stdout:1/839: creat d2/d5/d2b/d34/f119 x:0 0 0 2024-09-18T12:51:21.322 INFO:tasks.workunit.client.1.smithi136.stdout:6/873: mknod d8/d9/de/d1c/dc9/c118 0 2024-09-18T12:51:21.323 INFO:tasks.workunit.client.1.smithi136.stdout:6/874: write d8/d9/d3c/fa2 [507284,20527] 0 2024-09-18T12:51:21.323 INFO:tasks.workunit.client.1.smithi136.stdout:6/875: stat d8/d9/de/d1c/db9/d10b 0 2024-09-18T12:51:21.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/529: link d7/d9/d4b/d53/f64 d7/d9/d4b/d33/d7d/faf 0 2024-09-18T12:51:21.324 INFO:tasks.workunit.client.0.smithi081.stdout:0/530: truncate d7/d9/fac 276745 0 2024-09-18T12:51:21.324 INFO:tasks.workunit.client.0.smithi081.stdout:0/531: dread - d7/d9/d4b/d33/d7d/f88 zero size 2024-09-18T12:51:21.325 INFO:tasks.workunit.client.0.smithi081.stdout:0/532: creat d7/d9/d4b/d4a/d77/fb0 x:0 0 0 2024-09-18T12:51:21.326 INFO:tasks.workunit.client.1.smithi136.stdout:1/840: dread d2/d5/d2b/d9b/d2e/d4c/d8e/fcc [0,4194304] 0 2024-09-18T12:51:21.327 INFO:tasks.workunit.client.1.smithi136.stdout:1/841: chown d2/d5/d2b/d34/d5c/fe3 95846 1 2024-09-18T12:51:21.331 INFO:tasks.workunit.client.0.smithi081.stdout:1/560: sync 2024-09-18T12:51:21.331 INFO:tasks.workunit.client.0.smithi081.stdout:6/449: sync 2024-09-18T12:51:21.332 INFO:tasks.workunit.client.0.smithi081.stdout:5/565: sync 2024-09-18T12:51:21.332 INFO:tasks.workunit.client.1.smithi136.stdout:1/842: rmdir d2/d5/d2b/d9b/dbe 39 2024-09-18T12:51:21.332 INFO:tasks.workunit.client.1.smithi136.stdout:0/943: dread d1/d3/d1a/d62/fa5 [0,4194304] 0 2024-09-18T12:51:21.332 INFO:tasks.workunit.client.0.smithi081.stdout:1/561: read d0/db/f14 [645876,117319] 0 2024-09-18T12:51:21.333 INFO:tasks.workunit.client.0.smithi081.stdout:3/525: dread d3/db/df/d29/f64 [0,4194304] 0 2024-09-18T12:51:21.333 INFO:tasks.workunit.client.0.smithi081.stdout:6/450: symlink d4/d12/d1c/d39/d60/d90/l92 0 2024-09-18T12:51:21.333 INFO:tasks.workunit.client.1.smithi136.stdout:1/843: getdents d2/d5/d9/dcb 0 2024-09-18T12:51:21.334 INFO:tasks.workunit.client.1.smithi136.stdout:0/944: symlink d1/d3/d1a/d98/d81/d70/l13f 0 2024-09-18T12:51:21.335 INFO:tasks.workunit.client.0.smithi081.stdout:1/562: link d0/db/d12/d2d/faa d0/d6/d33/d42/d83/fc1 0 2024-09-18T12:51:21.336 INFO:tasks.workunit.client.1.smithi136.stdout:1/844: link d2/d5/d2b/ff4 d2/d5/d2b/d9b/d2e/df0/f11a 0 2024-09-18T12:51:21.336 INFO:tasks.workunit.client.1.smithi136.stdout:6/876: dread d8/d9/d64/f69 [0,4194304] 0 2024-09-18T12:51:21.336 INFO:tasks.workunit.client.1.smithi136.stdout:0/945: mknod d1/d3/d1a/d62/d75/d100/c140 0 2024-09-18T12:51:21.336 INFO:tasks.workunit.client.0.smithi081.stdout:3/526: mknod d3/db/df/d29/d12/d44/d51/d91/cbf 0 2024-09-18T12:51:21.338 INFO:tasks.workunit.client.0.smithi081.stdout:1/563: getdents d0/db/d4f 0 2024-09-18T12:51:21.341 INFO:tasks.workunit.client.0.smithi081.stdout:6/451: rmdir d4/d12/d28/d59 0 2024-09-18T12:51:21.343 INFO:tasks.workunit.client.1.smithi136.stdout:1/845: mknod d2/d5/d2b/d9b/dbe/dd3/d65/c11b 0 2024-09-18T12:51:21.344 INFO:tasks.workunit.client.1.smithi136.stdout:6/877: getdents d8/d9d 0 2024-09-18T12:51:21.345 INFO:tasks.workunit.client.1.smithi136.stdout:6/878: truncate d8/d9/f74 304577 0 2024-09-18T12:51:21.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/452: mknod d4/d12/d28/d2a/d2d/d31/c93 0 2024-09-18T12:51:21.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/453: chown d4/d6/f26 708 1 2024-09-18T12:51:21.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/454: write d4/d12/d1c/d64/f81 [57668,69027] 0 2024-09-18T12:51:21.346 INFO:tasks.workunit.client.1.smithi136.stdout:0/946: rename d1/d3/d1a/d98/l131 to d1/d3/d1a/d98/l141 0 2024-09-18T12:51:21.347 INFO:tasks.workunit.client.0.smithi081.stdout:3/527: write d3/db/f4b [3130157,123926] 0 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 -- 172.21.15.81:0/2313701975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 msgr2=0x7f47081076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 --2- 172.21.15.81:0/2313701975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f47081076e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009910 tx=0x7f46f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 -- 172.21.15.81:0/2313701975 shutdown_connections 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 --2- 172.21.15.81:0/2313701975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f4708108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 --2- 172.21.15.81:0/2313701975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f47081076e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.346+0000 7f470f63d700 1 -- 172.21.15.81:0/2313701975 >> 172.21.15.81:0/2313701975 conn(0x7f47080763d0 msgr2=0x7f4708078830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.347+0000 7f470f63d700 1 -- 172.21.15.81:0/2313701975 shutdown_connections 2024-09-18T12:51:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.347+0000 7f470f63d700 1 -- 172.21.15.81:0/2313701975 wait complete. 2024-09-18T12:51:21.349 INFO:tasks.workunit.client.0.smithi081.stdout:6/455: symlink d4/d12/d56/l94 0 2024-09-18T12:51:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.347+0000 7f470f63d700 1 Processor -- start 2024-09-18T12:51:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.347+0000 7f470f63d700 1 -- start start 2024-09-18T12:51:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470f63d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f470819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470f63d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f470819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470f63d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470819d700 con 0x7f47081072c0 2024-09-18T12:51:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470f63d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470819d840 con 0x7f47081084c0 2024-09-18T12:51:21.351 INFO:tasks.workunit.client.0.smithi081.stdout:0/533: dwrite d7/d9/d4b/d4a/f1a [0,4194304] 0 2024-09-18T12:51:21.351 INFO:tasks.workunit.client.0.smithi081.stdout:1/564: write d0/d6/d33/d42/f5b [85527,108792] 0 2024-09-18T12:51:21.351 INFO:tasks.workunit.client.0.smithi081.stdout:1/565: chown d0/d6/f17 6 1 2024-09-18T12:51:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470d3d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f470819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470d3d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f470819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47060/0 (socket says 172.21.15.81:47060) 2024-09-18T12:51:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470cbd8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f470819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.348+0000 7f470d3d9700 1 -- 172.21.15.81:0/3708932958 learned_addr learned my addr 172.21.15.81:0/3708932958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f470cbd8700 1 -- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 msgr2=0x7f470819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f470cbd8700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f470819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f470cbd8700 1 -- 172.21.15.81:0/3708932958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00095f0 con 0x7f47081084c0 2024-09-18T12:51:21.352 INFO:tasks.workunit.client.0.smithi081.stdout:6/456: mkdir d4/d6/d95 0 2024-09-18T12:51:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f470cbd8700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f470819d0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f470000bb00 tx=0x7f470000be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470000ca00 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.349+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f470000cb60 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.350+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4700012640 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.350+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47081a22f0 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.350+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47081a2840 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.352+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470810fec0 con 0x7f47081084c0 2024-09-18T12:51:21.354 INFO:tasks.workunit.client.0.smithi081.stdout:1/566: rename d0/db/d12/d28/fa5 to d0/d6/d7/d2e/fc2 0 2024-09-18T12:51:21.354 INFO:tasks.workunit.client.1.smithi136.stdout:1/846: unlink d2/d5/d2b/f80 0 2024-09-18T12:51:21.354 INFO:tasks.workunit.client.1.smithi136.stdout:1/847: read d2/d5/d2b/d9b/d2e/df0/f11a [499321,56195] 0 2024-09-18T12:51:21.354 INFO:tasks.workunit.client.1.smithi136.stdout:1/848: write d2/d5/d2b/d34/d5c/ff7 [944944,27963] 0 2024-09-18T12:51:21.354 INFO:tasks.workunit.client.1.smithi136.stdout:6/879: mknod d8/daa/c119 0 2024-09-18T12:51:21.355 INFO:tasks.workunit.client.1.smithi136.stdout:6/880: chown d8/d9/fb 26 1 2024-09-18T12:51:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.353+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f470000ccd0 con 0x7f47081084c0 2024-09-18T12:51:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.354+0000 7f47067fc700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 0x7f46f4075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.356 INFO:tasks.workunit.client.1.smithi136.stdout:6/881: rename d8/d9/d56/db6 to d8/daa/d11a 0 2024-09-18T12:51:21.356 INFO:tasks.workunit.client.1.smithi136.stdout:6/882: write d8/d9/de/d60/fa5 [785032,106540] 0 2024-09-18T12:51:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.355+0000 7f470d3d9700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 0x7f46f4075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.355+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f47000946d0 con 0x7f47081084c0 2024-09-18T12:51:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.355+0000 7f470d3d9700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 0x7f46f4075f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009fd0 tx=0x7f46f000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:21.357 INFO:tasks.workunit.client.0.smithi081.stdout:3/528: dread d3/db/df/d29/d12/d44/d6f/f7c [0,4194304] 0 2024-09-18T12:51:21.357 INFO:tasks.workunit.client.1.smithi136.stdout:1/849: dread d2/d5/d2b/d9b/d2e/f6b [0,4194304] 0 2024-09-18T12:51:21.361 INFO:tasks.workunit.client.0.smithi081.stdout:0/534: dread d7/d9/d4b/d33/d43/d9a/faa [0,4194304] 0 2024-09-18T12:51:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.362+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4700062aa0 con 0x7f47081084c0 2024-09-18T12:51:21.371 INFO:tasks.workunit.client.1.smithi136.stdout:3/868: sync 2024-09-18T12:51:21.371 INFO:tasks.workunit.client.1.smithi136.stdout:3/869: stat d3/d14/f3a 0 2024-09-18T12:51:21.372 INFO:tasks.workunit.client.1.smithi136.stdout:1/850: dread d2/d5/d2b/d34/d5c/fe8 [4194304,4194304] 0 2024-09-18T12:51:21.373 INFO:tasks.workunit.client.1.smithi136.stdout:3/870: rename d3/d14/d18/d7f/d100/l106 to d3/d14/d18/d7f/l118 0 2024-09-18T12:51:21.374 INFO:tasks.workunit.client.1.smithi136.stdout:1/851: rename d2/d5/d2b/d9b/cca to d2/d5/d2b/da9/c11c 0 2024-09-18T12:51:21.377 INFO:tasks.workunit.client.1.smithi136.stdout:0/947: getdents d1/d3/d1a/d98 0 2024-09-18T12:51:21.377 INFO:tasks.workunit.client.1.smithi136.stdout:3/871: rmdir d3/d5/d102 39 2024-09-18T12:51:21.377 INFO:tasks.workunit.client.1.smithi136.stdout:3/872: dread - d3/d14/d17/db8/f107 zero size 2024-09-18T12:51:21.377 INFO:tasks.workunit.client.1.smithi136.stdout:3/873: write d3/d2b/d6c/db4/fc4 [234963,96650] 0 2024-09-18T12:51:21.378 INFO:tasks.workunit.client.1.smithi136.stdout:1/852: dread d2/d5/d2b/d34/d86/f48 [0,4194304] 0 2024-09-18T12:51:21.380 INFO:tasks.workunit.client.0.smithi081.stdout:6/457: dwrite d4/f5c [0,4194304] 0 2024-09-18T12:51:21.381 INFO:tasks.workunit.client.0.smithi081.stdout:6/458: mkdir d4/d12/d56/d7d/d96 0 2024-09-18T12:51:21.383 INFO:tasks.workunit.client.1.smithi136.stdout:1/853: link d2/d5/d2b/cc3 d2/d5/c11d 0 2024-09-18T12:51:21.383 INFO:tasks.workunit.client.1.smithi136.stdout:1/854: chown d2/d5/d2b/f4a 7758616 1 2024-09-18T12:51:21.383 INFO:tasks.workunit.client.1.smithi136.stdout:1/855: chown d2/d5/fa1 712628 1 2024-09-18T12:51:21.383 INFO:tasks.workunit.client.1.smithi136.stdout:6/883: dwrite d8/ffe [0,4194304] 0 2024-09-18T12:51:21.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/459: mkdir d4/d12/d28/d2a/d97 0 2024-09-18T12:51:21.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/567: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-18T12:51:21.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/568: fdatasync d0/d6/d7/d2e/d4e/f9b 0 2024-09-18T12:51:21.385 INFO:tasks.workunit.client.0.smithi081.stdout:1/569: readlink d0/db/d32/l3b 0 2024-09-18T12:51:21.385 INFO:tasks.workunit.client.1.smithi136.stdout:1/856: link d2/d5/d9/dcb/dfb/d107/d114/cc0 d2/c11e 0 2024-09-18T12:51:21.385 INFO:tasks.workunit.client.0.smithi081.stdout:6/460: unlink d4/f75 0 2024-09-18T12:51:21.386 INFO:tasks.workunit.client.0.smithi081.stdout:1/570: mknod d0/d6/d33/d37/dbc/cc3 0 2024-09-18T12:51:21.387 INFO:tasks.workunit.client.0.smithi081.stdout:6/461: mkdir d4/d12/d28/d2a/d98 0 2024-09-18T12:51:21.388 INFO:tasks.workunit.client.0.smithi081.stdout:6/462: rename d4/d12/d1c/d64/l8a to d4/d6/d95/l99 0 2024-09-18T12:51:21.389 INFO:tasks.workunit.client.0.smithi081.stdout:6/463: creat d4/d12/d1c/d39/f9a x:0 0 0 2024-09-18T12:51:21.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/948: write d1/d3/f8 [2316723,119591] 0 2024-09-18T12:51:21.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/949: fdatasync d1/d3/d1a/d98/d81/d35/d84/f91 0 2024-09-18T12:51:21.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/950: creat d1/db/d77/f142 x:0 0 0 2024-09-18T12:51:21.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/951: write d1/d3/f7b [312357,57972] 0 2024-09-18T12:51:21.393 INFO:tasks.workunit.client.1.smithi136.stdout:0/952: fdatasync d1/d3/d1a/d98/d81/d35/d54/f118 0 2024-09-18T12:51:21.394 INFO:tasks.workunit.client.1.smithi136.stdout:6/884: unlink d8/c51 0 2024-09-18T12:51:21.395 INFO:tasks.workunit.client.1.smithi136.stdout:0/953: mknod d1/d17/c143 0 2024-09-18T12:51:21.396 INFO:tasks.workunit.client.1.smithi136.stdout:6/885: mknod d8/d9/c11b 0 2024-09-18T12:51:21.396 INFO:tasks.workunit.client.1.smithi136.stdout:6/886: creat d8/dcf/d113/f11c x:0 0 0 2024-09-18T12:51:21.396 INFO:tasks.workunit.client.1.smithi136.stdout:0/954: mknod d1/d60/d10c/c144 0 2024-09-18T12:51:21.398 INFO:tasks.workunit.client.1.smithi136.stdout:6/887: rename d8/d9/de/d60/d71/d76/la3 to d8/d9/de/d1c/d50/da8/df2/l11d 0 2024-09-18T12:51:21.398 INFO:tasks.workunit.client.1.smithi136.stdout:0/955: creat d1/d3/d1a/f145 x:0 0 0 2024-09-18T12:51:21.399 INFO:tasks.workunit.client.1.smithi136.stdout:6/888: symlink d8/d9/de/d60/d71/d7f/l11e 0 2024-09-18T12:51:21.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/529: dwrite d3/db/df/d3b/d47/f7a [0,4194304] 0 2024-09-18T12:51:21.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/530: fsync d3/db/df/d29/f64 0 2024-09-18T12:51:21.405 INFO:tasks.workunit.client.1.smithi136.stdout:1/857: write d2/d5/d2b/f4a [1128104,40919] 0 2024-09-18T12:51:21.405 INFO:tasks.workunit.client.1.smithi136.stdout:1/858: write d2/d5/d2b/d34/feb [705570,1231] 0 2024-09-18T12:51:21.406 INFO:tasks.workunit.client.0.smithi081.stdout:0/535: dwrite d7/d9/d4b/d53/f64 [0,4194304] 0 2024-09-18T12:51:21.409 INFO:tasks.workunit.client.1.smithi136.stdout:1/859: mknod d2/d5/d2b/d34/c11f 0 2024-09-18T12:51:21.409 INFO:tasks.workunit.client.1.smithi136.stdout:1/860: write d2/d5/d9/ffd [402483,42202] 0 2024-09-18T12:51:21.409 INFO:tasks.workunit.client.0.smithi081.stdout:0/536: mkdir d7/d9/d4b/d33/db1 0 2024-09-18T12:51:21.410 INFO:tasks.workunit.client.1.smithi136.stdout:1/861: mkdir d2/d5/d2b/d63/dda/d120 0 2024-09-18T12:51:21.411 INFO:tasks.workunit.client.1.smithi136.stdout:1/862: chown d2/d5/d2b/d9b/d2e/d4c/d8e/ce2 3596143 1 2024-09-18T12:51:21.411 INFO:tasks.workunit.client.0.smithi081.stdout:0/537: symlink d7/d9/lb2 0 2024-09-18T12:51:21.411 INFO:tasks.workunit.client.0.smithi081.stdout:0/538: write d7/d9/d4b/f9d [624364,65767] 0 2024-09-18T12:51:21.411 INFO:tasks.workunit.client.0.smithi081.stdout:0/539: write d7/d9/d4b/d4a/f72 [4141746,5754] 0 2024-09-18T12:51:21.411 INFO:tasks.workunit.client.0.smithi081.stdout:0/540: truncate d7/d9/d4b/d4a/f1e 1491606 0 2024-09-18T12:51:21.412 INFO:tasks.workunit.client.1.smithi136.stdout:1/863: mknod d2/c121 0 2024-09-18T12:51:21.413 INFO:tasks.workunit.client.0.smithi081.stdout:0/541: truncate d7/d9/d4b/d53/f69 443385 0 2024-09-18T12:51:21.413 INFO:tasks.workunit.client.1.smithi136.stdout:0/956: dread d1/d3/d1a/d95/fc3 [0,4194304] 0 2024-09-18T12:51:21.414 INFO:tasks.workunit.client.1.smithi136.stdout:1/864: mkdir d2/d5/d2b/d63/dda/d120/d122 0 2024-09-18T12:51:21.416 INFO:tasks.workunit.client.1.smithi136.stdout:0/957: rename d1/d3/d1a/d98/lec to d1/d3/d1a/d98/d81/d51/l146 0 2024-09-18T12:51:21.416 INFO:tasks.workunit.client.1.smithi136.stdout:0/958: write d1/d60/d82/fcd [1051314,95816] 0 2024-09-18T12:51:21.416 INFO:tasks.workunit.client.1.smithi136.stdout:0/959: write d1/d46/f66 [2070404,53562] 0 2024-09-18T12:51:21.417 INFO:tasks.workunit.client.0.smithi081.stdout:1/571: dread d0/db/d12/f22 [0,4194304] 0 2024-09-18T12:51:21.417 INFO:tasks.workunit.client.0.smithi081.stdout:1/572: read - d0/db/d4f/dab/fbf zero size 2024-09-18T12:51:21.418 INFO:tasks.workunit.client.1.smithi136.stdout:1/865: mknod d2/d5/d2b/d9b/d2e/c123 0 2024-09-18T12:51:21.418 INFO:tasks.workunit.client.0.smithi081.stdout:1/573: symlink d0/db/d12/d28/lc4 0 2024-09-18T12:51:21.420 INFO:tasks.workunit.client.1.smithi136.stdout:0/960: mknod d1/d3/d1a/d62/d75/d10d/c147 0 2024-09-18T12:51:21.421 INFO:tasks.workunit.client.1.smithi136.stdout:0/961: dread d1/d3/d1a/d98/d81/d51/db3/f109 [0,4194304] 0 2024-09-18T12:51:21.421 INFO:tasks.workunit.client.1.smithi136.stdout:0/962: creat d1/d60/d10c/f148 x:0 0 0 2024-09-18T12:51:21.423 INFO:tasks.workunit.client.1.smithi136.stdout:1/866: rename d2/d5/d2b/d34/d118 to d2/d5/d2b/d63/dda/d120/d124 0 2024-09-18T12:51:21.424 INFO:tasks.workunit.client.0.smithi081.stdout:0/542: dread d7/d9/d4b/d4a/d77/fa5 [0,4194304] 0 2024-09-18T12:51:21.425 INFO:tasks.workunit.client.1.smithi136.stdout:2/981: sync 2024-09-18T12:51:21.425 INFO:tasks.workunit.client.1.smithi136.stdout:6/889: dwrite d8/d9/de/d60/d94/f111 [0,4194304] 0 2024-09-18T12:51:21.425 INFO:tasks.workunit.client.0.smithi081.stdout:6/464: dwrite d4/d12/d28/d2a/d2d/f4f [0,4194304] 0 2024-09-18T12:51:21.428 INFO:tasks.workunit.client.1.smithi136.stdout:1/867: rename d2/d5/d2b/d34/d103/f110 to d2/d5/d2b/d34/f125 0 2024-09-18T12:51:21.428 INFO:tasks.workunit.client.1.smithi136.stdout:1/868: readlink d2/l1d 0 2024-09-18T12:51:21.429 INFO:tasks.workunit.client.1.smithi136.stdout:2/982: mkdir d5/d7/d11/de0/d148 0 2024-09-18T12:51:21.431 INFO:tasks.workunit.client.0.smithi081.stdout:6/465: symlink d4/d88/l9b 0 2024-09-18T12:51:21.433 INFO:tasks.workunit.client.0.smithi081.stdout:1/574: dread d0/db/d32/f87 [0,4194304] 0 2024-09-18T12:51:21.434 INFO:tasks.workunit.client.1.smithi136.stdout:6/890: link d8/d9/de/d60/d94/fc4 d8/d9/de/d1c/db9/d10c/f11f 0 2024-09-18T12:51:21.434 INFO:tasks.workunit.client.1.smithi136.stdout:6/891: write d8/d9/d3c/d4a/fbf [639056,63833] 0 2024-09-18T12:51:21.436 INFO:tasks.workunit.client.0.smithi081.stdout:6/466: mknod d4/d12/d56/d7d/c9c 0 2024-09-18T12:51:21.437 INFO:tasks.workunit.client.0.smithi081.stdout:6/467: write d4/fa [1015838,124384] 0 2024-09-18T12:51:21.439 INFO:tasks.workunit.client.1.smithi136.stdout:1/869: symlink d2/d5/d2b/d63/dda/d120/l126 0 2024-09-18T12:51:21.439 INFO:tasks.workunit.client.1.smithi136.stdout:1/870: dread - d2/d5/d2b/d9b/fdd zero size 2024-09-18T12:51:21.441 INFO:tasks.workunit.client.1.smithi136.stdout:0/963: dwrite d1/d3/d1a/d95/deb/f121 [0,4194304] 0 2024-09-18T12:51:21.446 INFO:tasks.workunit.client.1.smithi136.stdout:6/892: mknod d8/d9/de/d60/d71/d7f/c120 0 2024-09-18T12:51:21.448 INFO:tasks.workunit.client.1.smithi136.stdout:1/871: creat d2/d5/d9/dcb/dfb/d107/f127 x:0 0 0 2024-09-18T12:51:21.448 INFO:tasks.workunit.client.1.smithi136.stdout:1/872: write d2/d5/d2b/f81 [552271,50923] 0 2024-09-18T12:51:21.448 INFO:tasks.workunit.client.1.smithi136.stdout:1/873: truncate d2/d5/d2b/d9b/d1b/f25 4450262 0 2024-09-18T12:51:21.449 INFO:tasks.workunit.client.0.smithi081.stdout:1/575: write d0/d6/d7/d2e/d51/d2c/f7b [2447351,77383] 0 2024-09-18T12:51:21.450 INFO:tasks.workunit.client.1.smithi136.stdout:2/983: getdents d5/d4a/d7a 0 2024-09-18T12:51:21.450 INFO:tasks.workunit.client.0.smithi081.stdout:1/576: unlink d0/d6/d7/d8/fc 0 2024-09-18T12:51:21.451 INFO:tasks.workunit.client.0.smithi081.stdout:1/577: creat d0/db/d12/d2d/d75/dc0/da0/fc5 x:0 0 0 2024-09-18T12:51:21.454 INFO:tasks.workunit.client.0.smithi081.stdout:1/578: truncate d0/f7d 3101022 0 2024-09-18T12:51:21.454 INFO:tasks.workunit.client.0.smithi081.stdout:1/579: chown d0/d6/d7/d8/f11 82844500 1 2024-09-18T12:51:21.455 INFO:tasks.workunit.client.0.smithi081.stdout:1/580: mknod d0/d6/d33/d42/d83/cc6 0 2024-09-18T12:51:21.455 INFO:tasks.workunit.client.0.smithi081.stdout:1/581: creat d0/db/d4f/dab/fc7 x:0 0 0 2024-09-18T12:51:21.458 INFO:tasks.workunit.client.0.smithi081.stdout:6/468: dwrite d4/d12/d1c/d39/f9a [0,4194304] 0 2024-09-18T12:51:21.459 INFO:tasks.workunit.client.1.smithi136.stdout:0/964: rename d1/db/d76/lb7 to d1/d3/d1a/d98/d81/d51/db3/l149 0 2024-09-18T12:51:21.460 INFO:tasks.workunit.client.0.smithi081.stdout:1/582: unlink d0/d6/d33/d42/d83/lb8 0 2024-09-18T12:51:21.462 INFO:tasks.workunit.client.0.smithi081.stdout:1/583: dread d0/db/d12/d2d/f2f [0,4194304] 0 2024-09-18T12:51:21.462 INFO:tasks.workunit.client.0.smithi081.stdout:1/584: chown d0/f7e 1824061629 1 2024-09-18T12:51:21.462 INFO:tasks.workunit.client.1.smithi136.stdout:6/893: unlink d8/d9/fb 0 2024-09-18T12:51:21.463 INFO:tasks.workunit.client.0.smithi081.stdout:1/585: symlink d0/d18/d1a/da3/lc8 0 2024-09-18T12:51:21.466 INFO:tasks.workunit.client.0.smithi081.stdout:1/586: mknod d0/d6/d7/d2e/cc9 0 2024-09-18T12:51:21.466 INFO:tasks.workunit.client.0.smithi081.stdout:1/587: fdatasync d0/d6/fe 0 2024-09-18T12:51:21.466 INFO:tasks.workunit.client.0.smithi081.stdout:1/588: creat d0/d6/d7/d2e/d51/fca x:0 0 0 2024-09-18T12:51:21.466 INFO:tasks.workunit.client.1.smithi136.stdout:0/965: creat d1/d3/d1a/d98/d81/d72/de8/d113/f14a x:0 0 0 2024-09-18T12:51:21.466 INFO:tasks.workunit.client.1.smithi136.stdout:0/966: readlink d1/d60/dcb/l126 0 2024-09-18T12:51:21.472 INFO:tasks.workunit.client.1.smithi136.stdout:2/984: dwrite d5/d7/dbf/f109 [0,4194304] 0 2024-09-18T12:51:21.472 INFO:tasks.workunit.client.0.smithi081.stdout:6/469: read d4/d12/d28/d2a/d2d/d31/f51 [2304698,31143] 0 2024-09-18T12:51:21.476 INFO:tasks.workunit.client.0.smithi081.stdout:6/470: link d4/d12/d28/f4e d4/d12/d1c/d39/d60/f9d 0 2024-09-18T12:51:21.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/589: write d0/d6/d7/d2e/fc2 [1695308,46686] 0 2024-09-18T12:51:21.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/590: write d0/f15 [2381757,119406] 0 2024-09-18T12:51:21.478 INFO:tasks.workunit.client.1.smithi136.stdout:4/817: sync 2024-09-18T12:51:21.478 INFO:tasks.workunit.client.1.smithi136.stdout:8/963: sync 2024-09-18T12:51:21.478 INFO:tasks.workunit.client.1.smithi136.stdout:8/964: dread - d9/d14/d1a/d2b/ff9 zero size 2024-09-18T12:51:21.479 INFO:tasks.workunit.client.0.smithi081.stdout:6/471: unlink d4/d12/d1c/d39/d60/f6e 0 2024-09-18T12:51:21.479 INFO:tasks.workunit.client.1.smithi136.stdout:9/844: sync 2024-09-18T12:51:21.481 INFO:tasks.workunit.client.1.smithi136.stdout:9/845: getdents d6/da/d3d/d4d/d91/d25/d55 0 2024-09-18T12:51:21.482 INFO:tasks.workunit.client.1.smithi136.stdout:9/846: readlink d6/d59/lfc 0 2024-09-18T12:51:21.482 INFO:tasks.workunit.client.0.smithi081.stdout:1/591: read d0/d6/d7/d2e/d51/d2c/f5c [1064777,55718] 0 2024-09-18T12:51:21.487 INFO:tasks.workunit.client.1.smithi136.stdout:0/967: dwrite d1/d3/d1a/d98/d81/d35/f42 [0,4194304] 0 2024-09-18T12:51:21.489 INFO:tasks.workunit.client.1.smithi136.stdout:3/874: sync 2024-09-18T12:51:21.493 INFO:tasks.workunit.client.1.smithi136.stdout:0/968: unlink d1/d17/dd1/dff/f13b 0 2024-09-18T12:51:21.493 INFO:tasks.workunit.client.1.smithi136.stdout:3/875: link d3/d14/l5b d3/d14/d108/l119 0 2024-09-18T12:51:21.493 INFO:tasks.workunit.client.1.smithi136.stdout:4/818: read d0/d25/f39 [2414155,24080] 0 2024-09-18T12:51:21.493 INFO:tasks.workunit.client.1.smithi136.stdout:4/819: write d0/d3/d54/d5c/f101 [168369,34462] 0 2024-09-18T12:51:21.494 INFO:tasks.workunit.client.1.smithi136.stdout:4/820: chown d0/f4a 5894661 1 2024-09-18T12:51:21.494 INFO:tasks.workunit.client.1.smithi136.stdout:4/821: creat d0/d5f/dd3/f104 x:0 0 0 2024-09-18T12:51:21.494 INFO:tasks.workunit.client.1.smithi136.stdout:4/822: chown d0/d25/lc1 6558 1 2024-09-18T12:51:21.495 INFO:tasks.workunit.client.1.smithi136.stdout:6/894: dwrite d8/d9/de/f6a [0,4194304] 0 2024-09-18T12:51:21.495 INFO:tasks.workunit.client.1.smithi136.stdout:0/969: mkdir d1/d3/d1a/d98/d81/d35/d54/d14b 0 2024-09-18T12:51:21.496 INFO:tasks.workunit.client.0.smithi081.stdout:6/472: unlink d4/d12/d1c/f8d 0 2024-09-18T12:51:21.497 INFO:tasks.workunit.client.1.smithi136.stdout:3/876: mkdir d3/d14/d17/d11a 0 2024-09-18T12:51:21.500 INFO:tasks.workunit.client.1.smithi136.stdout:0/970: symlink d1/d3/d1a/d62/d75/d123/l14c 0 2024-09-18T12:51:21.500 INFO:tasks.workunit.client.1.smithi136.stdout:0/971: chown d1/db/d76/lbd 41318070 1 2024-09-18T12:51:21.500 INFO:tasks.workunit.client.1.smithi136.stdout:3/877: unlink d3/d14/l5b 0 2024-09-18T12:51:21.501 INFO:tasks.workunit.client.1.smithi136.stdout:3/878: dread - d3/d14/dc5/feb zero size 2024-09-18T12:51:21.501 INFO:tasks.workunit.client.1.smithi136.stdout:3/879: truncate d3/d14/d17/d53/f89 4558719 0 2024-09-18T12:51:21.504 INFO:tasks.workunit.client.1.smithi136.stdout:3/880: rename d3/c2a to d3/d2b/d6c/db4/c11b 0 2024-09-18T12:51:21.512 INFO:tasks.workunit.client.1.smithi136.stdout:1/874: dwrite f1 [0,4194304] 0 2024-09-18T12:51:21.515 INFO:tasks.workunit.client.1.smithi136.stdout:1/875: creat d2/d5/d9/ddf/f128 x:0 0 0 2024-09-18T12:51:21.519 INFO:tasks.workunit.client.1.smithi136.stdout:3/881: write d3/d2b/d6c/db4/dfe/fa9 [2685950,10501] 0 2024-09-18T12:51:21.520 INFO:tasks.workunit.client.1.smithi136.stdout:1/876: read d2/d5/d2b/d34/d5c/ff7 [657120,83970] 0 2024-09-18T12:51:21.521 INFO:tasks.workunit.client.1.smithi136.stdout:3/882: symlink d3/d14/d17/d11a/l11c 0 2024-09-18T12:51:21.522 INFO:tasks.workunit.client.1.smithi136.stdout:1/877: truncate d2/d5/d2b/d63/f113 212996 0 2024-09-18T12:51:21.522 INFO:tasks.workunit.client.1.smithi136.stdout:1/878: write d2/d5/d2b/d34/f119 [670547,11722] 0 2024-09-18T12:51:21.522 INFO:tasks.workunit.client.1.smithi136.stdout:1/879: fdatasync d2/d5/d2b/ff4 0 2024-09-18T12:51:21.523 INFO:tasks.workunit.client.1.smithi136.stdout:3/883: symlink d3/d10/l11d 0 2024-09-18T12:51:21.523 INFO:tasks.workunit.client.1.smithi136.stdout:3/884: truncate d3/d14/f3a 5238783 0 2024-09-18T12:51:21.524 INFO:tasks.workunit.client.1.smithi136.stdout:1/880: mkdir d2/d5/d2b/d9b/d2e/d4c/d129 0 2024-09-18T12:51:21.525 INFO:tasks.workunit.client.1.smithi136.stdout:2/985: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:21.525 INFO:tasks.workunit.client.1.smithi136.stdout:3/885: creat d3/d14/d17/d53/de8/f11e x:0 0 0 2024-09-18T12:51:21.525 INFO:tasks.workunit.client.1.smithi136.stdout:3/886: write d3/d14/d17/d53/de8/f11e [26677,109165] 0 2024-09-18T12:51:21.526 INFO:tasks.workunit.client.1.smithi136.stdout:3/887: fsync d3/d14/d17/d75/d86/fff 0 2024-09-18T12:51:21.526 INFO:tasks.workunit.client.1.smithi136.stdout:3/888: chown d3/d14/d17/f4d 1629096 1 2024-09-18T12:51:21.526 INFO:tasks.workunit.client.1.smithi136.stdout:8/965: dwrite d9/d14/d1a/d2b/f51 [4194304,4194304] 0 2024-09-18T12:51:21.526 INFO:tasks.workunit.client.1.smithi136.stdout:1/881: creat d2/d5/d2b/d9b/dbe/dd3/d65/f12a x:0 0 0 2024-09-18T12:51:21.527 INFO:tasks.workunit.client.1.smithi136.stdout:2/986: truncate d5/d25/d2d/d9d/f111 467608 0 2024-09-18T12:51:21.527 INFO:tasks.workunit.client.1.smithi136.stdout:2/987: fsync d5/d25/f120 0 2024-09-18T12:51:21.527 INFO:tasks.workunit.client.1.smithi136.stdout:2/988: getdents d5/d12d 0 2024-09-18T12:51:21.529 INFO:tasks.workunit.client.1.smithi136.stdout:3/889: rename d3/d14/f3a to d3/d5/d102/f11f 0 2024-09-18T12:51:21.529 INFO:tasks.workunit.client.1.smithi136.stdout:1/882: dread d2/f78 [0,4194304] 0 2024-09-18T12:51:21.531 INFO:tasks.workunit.client.1.smithi136.stdout:2/989: symlink d5/d4a/d67/l149 0 2024-09-18T12:51:21.533 INFO:tasks.workunit.client.1.smithi136.stdout:8/966: rename d9/d14/f11 to d9/d14/d1a/d2b/d42/d153/f155 0 2024-09-18T12:51:21.533 INFO:tasks.workunit.client.1.smithi136.stdout:1/883: mknod d2/d5/d9/dcb/c12b 0 2024-09-18T12:51:21.533 INFO:tasks.workunit.client.1.smithi136.stdout:9/847: dwrite d6/df/dd3/fe3 [0,4194304] 0 2024-09-18T12:51:21.534 INFO:tasks.workunit.client.0.smithi081.stdout:1/592: dwrite d0/d6/fe [8388608,4194304] 0 2024-09-18T12:51:21.534 INFO:tasks.workunit.client.1.smithi136.stdout:8/967: link d9/d18/d34/d3d/d47/c90 d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e/c156 0 2024-09-18T12:51:21.537 INFO:tasks.workunit.client.0.smithi081.stdout:1/593: getdents d0/d6/d33/d37/d98/d79 0 2024-09-18T12:51:21.537 INFO:tasks.workunit.client.0.smithi081.stdout:1/594: creat d0/db/d12/d2d/fcb x:0 0 0 2024-09-18T12:51:21.537 INFO:tasks.workunit.client.0.smithi081.stdout:1/595: write d0/db/d12/d28/f8e [191041,53189] 0 2024-09-18T12:51:21.537 INFO:tasks.workunit.client.0.smithi081.stdout:1/596: chown d0/db/d32/l3b 360116719 1 2024-09-18T12:51:21.538 INFO:tasks.workunit.client.1.smithi136.stdout:1/884: link d2/d5/d2b/d34/f4b d2/d5/d9/dcb/d10e/f12c 0 2024-09-18T12:51:21.538 INFO:tasks.workunit.client.1.smithi136.stdout:2/990: write d5/f65 [1983912,21076] 0 2024-09-18T12:51:21.538 INFO:tasks.workunit.client.1.smithi136.stdout:2/991: dread - d5/d4a/d7a/f11e zero size 2024-09-18T12:51:21.538 INFO:tasks.workunit.client.0.smithi081.stdout:6/473: dwrite d4/f13 [0,4194304] 0 2024-09-18T12:51:21.538 INFO:tasks.workunit.client.0.smithi081.stdout:6/474: truncate d4/d12/d28/f3c 2368335 0 2024-09-18T12:51:21.540 INFO:tasks.workunit.client.0.smithi081.stdout:1/597: creat d0/d6/d33/fcc x:0 0 0 2024-09-18T12:51:21.540 INFO:tasks.workunit.client.1.smithi136.stdout:0/972: dread d1/d60/d82/fcd [0,4194304] 0 2024-09-18T12:51:21.540 INFO:tasks.workunit.client.1.smithi136.stdout:0/973: fsync d1/d3/d1a/d98/d81/f44 0 2024-09-18T12:51:21.541 INFO:tasks.workunit.client.1.smithi136.stdout:6/895: dwrite d8/dcf/d113/f11c [0,4194304] 0 2024-09-18T12:51:21.541 INFO:tasks.workunit.client.0.smithi081.stdout:6/475: link d4/d6/c68 d4/d12/d1c/c9e 0 2024-09-18T12:51:21.542 INFO:tasks.workunit.client.0.smithi081.stdout:6/476: fdatasync d4/d12/d28/d2a/d2d/d31/f51 0 2024-09-18T12:51:21.543 INFO:tasks.workunit.client.0.smithi081.stdout:6/477: mkdir d4/d12/d56/d7d/d9f 0 2024-09-18T12:51:21.543 INFO:tasks.workunit.client.1.smithi136.stdout:9/848: symlink d6/db/de8/d101/l11c 0 2024-09-18T12:51:21.543 INFO:tasks.workunit.client.1.smithi136.stdout:9/849: read - d6/df/d23/d2b/d79/d8b/f115 zero size 2024-09-18T12:51:21.546 INFO:tasks.workunit.client.1.smithi136.stdout:1/885: chown d2/d5/d9/c5f 1 1 2024-09-18T12:51:21.548 INFO:tasks.workunit.client.1.smithi136.stdout:2/992: rmdir d5/d7/d17/d48/dc1/dea 39 2024-09-18T12:51:21.553 INFO:tasks.workunit.client.0.smithi081.stdout:4/433: sync 2024-09-18T12:51:21.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/458: sync 2024-09-18T12:51:21.555 INFO:tasks.workunit.client.1.smithi136.stdout:3/890: dwrite d3/d5/f9f [0,4194304] 0 2024-09-18T12:51:21.555 INFO:tasks.workunit.client.1.smithi136.stdout:3/891: fdatasync d3/d14/d22/d2c/dd5/fe4 0 2024-09-18T12:51:21.556 INFO:tasks.workunit.client.0.smithi081.stdout:4/434: mknod d3/db/d35/d79/c91 0 2024-09-18T12:51:21.556 INFO:tasks.workunit.client.0.smithi081.stdout:4/435: write d3/f22 [5477782,2955] 0 2024-09-18T12:51:21.556 INFO:tasks.workunit.client.0.smithi081.stdout:4/436: creat d3/db/d35/d79/f92 x:0 0 0 2024-09-18T12:51:21.556 INFO:tasks.workunit.client.0.smithi081.stdout:4/437: truncate d3/db/d2d/f3b 2841549 0 2024-09-18T12:51:21.556 INFO:tasks.workunit.client.0.smithi081.stdout:1/598: dread d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:21.557 INFO:tasks.workunit.client.0.smithi081.stdout:6/478: dread d4/d12/d1c/f23 [0,4194304] 0 2024-09-18T12:51:21.559 INFO:tasks.workunit.client.0.smithi081.stdout:1/599: stat d0/d6/d66/c9a 0 2024-09-18T12:51:21.559 INFO:tasks.workunit.client.0.smithi081.stdout:1/600: creat d0/db/d4f/dab/fcd x:0 0 0 2024-09-18T12:51:21.559 INFO:tasks.workunit.client.1.smithi136.stdout:0/974: write d1/d3/d1a/d98/d81/d70/dbc/ff5 [2880181,54858] 0 2024-09-18T12:51:21.561 INFO:tasks.workunit.client.0.smithi081.stdout:1/601: mkdir d0/d6/d7/d2e/d4e/dce 0 2024-09-18T12:51:21.568 INFO:tasks.workunit.client.0.smithi081.stdout:4/438: write d3/db/f36 [4842626,24991] 0 2024-09-18T12:51:21.568 INFO:tasks.workunit.client.0.smithi081.stdout:9/459: dread dd/d1b/f34 [4194304,4194304] 0 2024-09-18T12:51:21.569 INFO:tasks.workunit.client.0.smithi081.stdout:9/460: creat dd/de/d4f/f9c x:0 0 0 2024-09-18T12:51:21.569 INFO:tasks.workunit.client.0.smithi081.stdout:9/461: stat dd/de/d59/f84 0 2024-09-18T12:51:21.569 INFO:tasks.workunit.client.0.smithi081.stdout:9/462: chown dd/d1d/d1e/d24/f33 22800 1 2024-09-18T12:51:21.574 INFO:tasks.workunit.client.1.smithi136.stdout:1/886: link d2/d5/f5a d2/d5/d2b/d9b/dbe/dd3/d65/ddb/f12d 0 2024-09-18T12:51:21.574 INFO:tasks.workunit.client.1.smithi136.stdout:1/887: chown d2/d5/d2b/d9b/d2e/fb5 148690257 1 2024-09-18T12:51:21.580 INFO:tasks.workunit.client.0.smithi081.stdout:4/439: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:21.581 INFO:tasks.workunit.client.0.smithi081.stdout:4/440: mkdir d3/db/d35/d79/d93 0 2024-09-18T12:51:21.582 INFO:tasks.workunit.client.0.smithi081.stdout:9/463: dread dd/d1d/d1e/d24/d2a/f68 [0,4194304] 0 2024-09-18T12:51:21.582 INFO:tasks.workunit.client.1.smithi136.stdout:3/892: write d3/d14/d22/f42 [923916,51113] 0 2024-09-18T12:51:21.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/441: creat d3/d20/d3d/d65/d14/d27/f94 x:0 0 0 2024-09-18T12:51:21.583 INFO:tasks.workunit.client.1.smithi136.stdout:0/975: mkdir d1/d3/d1a/d98/d81/d51/db3/d14d 0 2024-09-18T12:51:21.584 INFO:tasks.workunit.client.0.smithi081.stdout:9/464: creat dd/de/d4f/d8c/d94/f9d x:0 0 0 2024-09-18T12:51:21.584 INFO:tasks.workunit.client.0.smithi081.stdout:9/465: chown dd/de/l11 2616 1 2024-09-18T12:51:21.585 INFO:tasks.workunit.client.1.smithi136.stdout:2/993: dwrite d5/d25/f40 [0,4194304] 0 2024-09-18T12:51:21.586 INFO:tasks.workunit.client.0.smithi081.stdout:4/442: mkdir d3/db/d35/d79/d95 0 2024-09-18T12:51:21.586 INFO:tasks.workunit.client.1.smithi136.stdout:6/896: getdents d8/d9/de 0 2024-09-18T12:51:21.586 INFO:tasks.workunit.client.1.smithi136.stdout:6/897: chown d8/dc/f15 26 1 2024-09-18T12:51:21.588 INFO:tasks.workunit.client.0.smithi081.stdout:6/479: dwrite d4/d12/d1c/d39/f9a [0,4194304] 0 2024-09-18T12:51:21.589 INFO:tasks.workunit.client.0.smithi081.stdout:4/443: rename d3/d20/d3d/d65/f63 to d3/d20/f96 0 2024-09-18T12:51:21.593 INFO:tasks.workunit.client.1.smithi136.stdout:0/976: dread d1/d17/f34 [0,4194304] 0 2024-09-18T12:51:21.594 INFO:tasks.workunit.client.1.smithi136.stdout:9/850: rmdir d6/df 39 2024-09-18T12:51:21.597 INFO:tasks.workunit.client.1.smithi136.stdout:2/994: symlink d5/d7/d3b/df7/d127/l14a 0 2024-09-18T12:51:21.597 INFO:tasks.workunit.client.1.smithi136.stdout:2/995: truncate d5/d7/d17/d48/db1/fc2 1317834 0 2024-09-18T12:51:21.597 INFO:tasks.workunit.client.1.smithi136.stdout:2/996: creat d5/d25/d2d/d9d/f14b x:0 0 0 2024-09-18T12:51:21.598 INFO:tasks.workunit.client.1.smithi136.stdout:6/898: symlink d8/d9/d3c/l121 0 2024-09-18T12:51:21.600 INFO:tasks.workunit.client.0.smithi081.stdout:4/444: dread d3/db/f25 [0,4194304] 0 2024-09-18T12:51:21.601 INFO:tasks.workunit.client.1.smithi136.stdout:0/977: symlink d1/d17/dd1/l14e 0 2024-09-18T12:51:21.604 INFO:tasks.workunit.client.1.smithi136.stdout:9/851: symlink d6/da/d3d/d4d/d91/d38/l11d 0 2024-09-18T12:51:21.604 INFO:tasks.workunit.client.1.smithi136.stdout:9/852: chown d6/d13/l1b 0 1 2024-09-18T12:51:21.604 INFO:tasks.workunit.client.1.smithi136.stdout:9/853: write d6/d59/f2a [2647134,37978] 0 2024-09-18T12:51:21.605 INFO:tasks.workunit.client.1.smithi136.stdout:3/893: symlink d3/d14/d22/l120 0 2024-09-18T12:51:21.607 INFO:tasks.workunit.client.1.smithi136.stdout:2/997: stat d5/d25/l7b 0 2024-09-18T12:51:21.607 INFO:tasks.workunit.client.1.smithi136.stdout:2/998: dread - d5/d25/d43/fc3 zero size 2024-09-18T12:51:21.609 INFO:tasks.workunit.client.0.smithi081.stdout:9/466: dwrite dd/d1d/d1e/d24/f67 [0,4194304] 0 2024-09-18T12:51:21.609 INFO:tasks.workunit.client.1.smithi136.stdout:9/854: dread d6/f42 [0,4194304] 0 2024-09-18T12:51:21.610 INFO:tasks.workunit.client.1.smithi136.stdout:3/894: mknod d3/d5/d31/c121 0 2024-09-18T12:51:21.612 INFO:tasks.workunit.client.1.smithi136.stdout:9/855: write d6/df/d23/d2b/de5/feb [972829,119808] 0 2024-09-18T12:51:21.613 INFO:tasks.workunit.client.0.smithi081.stdout:9/467: mkdir dd/de/d7a/d9e 0 2024-09-18T12:51:21.613 INFO:tasks.workunit.client.1.smithi136.stdout:2/999: unlink d5/d7/l33 0 2024-09-18T12:51:21.614 INFO:tasks.workunit.client.1.smithi136.stdout:6/899: dread d8/d9/d3c/f62 [0,4194304] 0 2024-09-18T12:51:21.615 INFO:tasks.workunit.client.0.smithi081.stdout:6/480: dwrite d4/d12/d1c/f5b [0,4194304] 0 2024-09-18T12:51:21.617 INFO:tasks.workunit.client.1.smithi136.stdout:6/900: getdents d8/d9/d3c/d45 0 2024-09-18T12:51:21.618 INFO:tasks.workunit.client.0.smithi081.stdout:6/481: unlink d4/d12/d28/d2a/l46 0 2024-09-18T12:51:21.622 INFO:tasks.workunit.client.1.smithi136.stdout:6/901: rename d8/d9/d3c/d45 to d8/d9d/d9f/d122 0 2024-09-18T12:51:21.622 INFO:tasks.workunit.client.1.smithi136.stdout:6/902: dread - d8/d9/de/d60/d94/ffc zero size 2024-09-18T12:51:21.622 INFO:tasks.workunit.client.1.smithi136.stdout:6/903: chown d8/d9d/d9f/d122/c5b 90 1 2024-09-18T12:51:21.623 INFO:tasks.workunit.client.1.smithi136.stdout:6/904: chown d8/d9/de/l22 21421119 1 2024-09-18T12:51:21.623 INFO:tasks.workunit.client.1.smithi136.stdout:6/905: write d8/d9/d56/d96/d9c/fde [443486,104928] 0 2024-09-18T12:51:21.623 INFO:tasks.workunit.client.0.smithi081.stdout:6/482: getdents d4/d12/d28/d2a/d2d/d31 0 2024-09-18T12:51:21.625 INFO:tasks.workunit.client.1.smithi136.stdout:0/978: write d1/d17/f37 [1786419,21417] 0 2024-09-18T12:51:21.631 INFO:tasks.workunit.client.1.smithi136.stdout:9/856: dread d6/da/d3d/d4d/d91/d25/f39 [0,4194304] 0 2024-09-18T12:51:21.631 INFO:tasks.workunit.client.1.smithi136.stdout:9/857: stat d6/da/d3d/d4d/d91/d38/fa3 0 2024-09-18T12:51:21.631 INFO:tasks.workunit.client.1.smithi136.stdout:9/858: write d6/d13/ff7 [678160,104597] 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/445: dwrite d3/d20/d3d/d65/d2f/f33 [0,4194304] 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/446: mkdir d3/db/d2d/d4e/d8d/d97 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/447: getdents d3/d20/d3d/d6b 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/448: fdatasync d3/d20/d3d/d65/d14/f1e 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/449: readlink d3/d20/d3d/d65/d14/d4b/l55 0 2024-09-18T12:51:21.633 INFO:tasks.workunit.client.1.smithi136.stdout:0/979: rename d1/d60/dcb/dee to d1/d3/d1a/d98/d81/d51/d14f 0 2024-09-18T12:51:21.634 INFO:tasks.workunit.client.1.smithi136.stdout:0/980: symlink d1/d60/d10c/l150 0 2024-09-18T12:51:21.636 INFO:tasks.workunit.client.0.smithi081.stdout:4/450: mknod d3/d20/d3d/d65/c98 0 2024-09-18T12:51:21.636 INFO:tasks.workunit.client.1.smithi136.stdout:0/981: creat d1/d3/f151 x:0 0 0 2024-09-18T12:51:21.637 INFO:tasks.workunit.client.0.smithi081.stdout:4/451: mknod d3/d20/c99 0 2024-09-18T12:51:21.637 INFO:tasks.workunit.client.0.smithi081.stdout:4/452: creat d3/d20/d3d/d65/d14/f9a x:0 0 0 2024-09-18T12:51:21.643 INFO:tasks.workunit.client.0.smithi081.stdout:9/468: dwrite dd/d1d/d1e/d24/f33 [0,4194304] 0 2024-09-18T12:51:21.643 INFO:tasks.workunit.client.0.smithi081.stdout:9/469: write dd/d1d/d1e/f43 [1562038,101136] 0 2024-09-18T12:51:21.643 INFO:tasks.workunit.client.0.smithi081.stdout:9/470: truncate dd/d31/d4a/f93 968969 0 2024-09-18T12:51:21.646 INFO:tasks.workunit.client.0.smithi081.stdout:9/471: truncate dd/de/f13 3776575 0 2024-09-18T12:51:21.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/895: dwrite d3/d14/d17/d53/f77 [0,4194304] 0 2024-09-18T12:51:21.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/896: write d3/d14/d17/db8/f107 [102153,110916] 0 2024-09-18T12:51:21.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/897: chown d3/d14/d17/d8c/cd6 0 1 2024-09-18T12:51:21.648 INFO:tasks.workunit.client.1.smithi136.stdout:3/898: readlink d3/le0 0 2024-09-18T12:51:21.656 INFO:tasks.workunit.client.1.smithi136.stdout:3/899: mknod d3/d5/d31/c122 0 2024-09-18T12:51:21.657 INFO:tasks.workunit.client.1.smithi136.stdout:3/900: getdents d3/d14/d17/d53/d73/dbf 0 2024-09-18T12:51:21.657 INFO:tasks.workunit.client.1.smithi136.stdout:3/901: write d3/d2b/d6c/fa2 [5161393,18695] 0 2024-09-18T12:51:21.658 INFO:tasks.workunit.client.1.smithi136.stdout:3/902: write d3/d14/d22/fc1 [379259,107181] 0 2024-09-18T12:51:21.660 INFO:tasks.workunit.client.0.smithi081.stdout:6/483: dwrite d4/d12/d28/d2a/f45 [0,4194304] 0 2024-09-18T12:51:21.663 INFO:tasks.workunit.client.1.smithi136.stdout:9/859: dwrite d6/db/d72/fb3 [0,4194304] 0 2024-09-18T12:51:21.664 INFO:tasks.workunit.client.1.smithi136.stdout:6/906: dwrite d8/d9/d56/f72 [0,4194304] 0 2024-09-18T12:51:21.664 INFO:tasks.workunit.client.1.smithi136.stdout:6/907: chown d8/d9d/d9f/cbd 5022346 1 2024-09-18T12:51:21.664 INFO:tasks.workunit.client.1.smithi136.stdout:6/908: write d8/daa/fb0 [767403,86158] 0 2024-09-18T12:51:21.668 INFO:tasks.workunit.client.1.smithi136.stdout:6/909: symlink d8/d9/de/d60/d71/d76/l123 0 2024-09-18T12:51:21.668 INFO:tasks.workunit.client.1.smithi136.stdout:6/910: stat d8/d9/de/d1c/d50/cd0 0 2024-09-18T12:51:21.669 INFO:tasks.workunit.client.1.smithi136.stdout:6/911: chown d8/d9/d3c/d4a/c55 5517 1 2024-09-18T12:51:21.671 INFO:tasks.workunit.client.1.smithi136.stdout:6/912: mkdir d8/d9d/d9f/d122/d124 0 2024-09-18T12:51:21.671 INFO:tasks.workunit.client.1.smithi136.stdout:6/913: stat d8/d9/de/d60/f81 0 2024-09-18T12:51:21.671 INFO:tasks.workunit.client.1.smithi136.stdout:6/914: readlink d8/d9/de/d60/l116 0 2024-09-18T12:51:21.672 INFO:tasks.workunit.client.0.smithi081.stdout:9/472: dwrite dd/d1d/f2e [4194304,4194304] 0 2024-09-18T12:51:21.672 INFO:tasks.workunit.client.0.smithi081.stdout:9/473: chown dd/de/f9b 6 1 2024-09-18T12:51:21.674 INFO:tasks.workunit.client.1.smithi136.stdout:0/982: dwrite d1/d3/d1a/d98/d81/d51/d14f/f11c [0,4194304] 0 2024-09-18T12:51:21.674 INFO:tasks.workunit.client.1.smithi136.stdout:0/983: readlink d1/db/d76/db9/de5/d115/l136 0 2024-09-18T12:51:21.675 INFO:tasks.workunit.client.1.smithi136.stdout:6/915: rename d8/d9/de/d1c/d50/da8/c101 to d8/d9/de/d60/d71/d7f/c125 0 2024-09-18T12:51:21.675 INFO:tasks.workunit.client.0.smithi081.stdout:9/474: dread dd/d15/d1a/d35/f53 [0,4194304] 0 2024-09-18T12:51:21.675 INFO:tasks.workunit.client.0.smithi081.stdout:9/475: chown dd/l25 250 1 2024-09-18T12:51:21.676 INFO:tasks.workunit.client.0.smithi081.stdout:4/453: dwrite d3/d20/d3d/d65/f21 [4194304,4194304] 0 2024-09-18T12:51:21.680 INFO:tasks.workunit.client.1.smithi136.stdout:6/916: rename d8/dc/f31 to d8/d9/f126 0 2024-09-18T12:51:21.681 INFO:tasks.workunit.client.1.smithi136.stdout:6/917: fsync d8/d9/d64/f69 0 2024-09-18T12:51:21.681 INFO:tasks.workunit.client.1.smithi136.stdout:6/918: symlink d8/d9/de/d60/d71/l127 0 2024-09-18T12:51:21.682 INFO:tasks.workunit.client.1.smithi136.stdout:6/919: fdatasync d8/d9d/db4/ff6 0 2024-09-18T12:51:21.683 INFO:tasks.workunit.client.1.smithi136.stdout:0/984: write d1/d60/f9c [2078,48863] 0 2024-09-18T12:51:21.683 INFO:tasks.workunit.client.1.smithi136.stdout:3/903: dwrite d3/d14/d17/d53/d73/f109 [0,4194304] 0 2024-09-18T12:51:21.684 INFO:tasks.workunit.client.1.smithi136.stdout:6/920: getdents d8/dcf/d113 0 2024-09-18T12:51:21.685 INFO:tasks.workunit.client.1.smithi136.stdout:6/921: fsync d8/dcf/d113/f11c 0 2024-09-18T12:51:21.685 INFO:tasks.workunit.client.1.smithi136.stdout:6/922: stat d8/d9/d56/f67 0 2024-09-18T12:51:21.685 INFO:tasks.workunit.client.1.smithi136.stdout:6/923: readlink d8/d9/d56/lc7 0 2024-09-18T12:51:21.690 INFO:tasks.workunit.client.1.smithi136.stdout:9/860: dwrite d6/db/d12/d62/f113 [0,4194304] 0 2024-09-18T12:51:21.690 INFO:tasks.workunit.client.1.smithi136.stdout:0/985: creat d1/d3/d1a/d98/d81/d35/d84/f152 x:0 0 0 2024-09-18T12:51:21.691 INFO:tasks.workunit.client.1.smithi136.stdout:0/986: write d1/f31 [304168,63770] 0 2024-09-18T12:51:21.691 INFO:tasks.workunit.client.1.smithi136.stdout:0/987: read d1/d60/d10c/f10f [282330,31189] 0 2024-09-18T12:51:21.691 INFO:tasks.workunit.client.0.smithi081.stdout:4/454: rename d3/db/d35/d79/d93 to d3/d20/d3d/d65/d9b 0 2024-09-18T12:51:21.693 INFO:tasks.workunit.client.1.smithi136.stdout:6/924: truncate d8/d9/de/d1c/f20 1754422 0 2024-09-18T12:51:21.693 INFO:tasks.workunit.client.0.smithi081.stdout:9/476: rmdir dd/de 39 2024-09-18T12:51:21.696 INFO:tasks.workunit.client.0.smithi081.stdout:8/474: sync 2024-09-18T12:51:21.696 INFO:tasks.workunit.client.0.smithi081.stdout:7/504: sync 2024-09-18T12:51:21.697 INFO:tasks.workunit.client.0.smithi081.stdout:2/579: sync 2024-09-18T12:51:21.697 INFO:tasks.workunit.client.0.smithi081.stdout:7/505: read d2/d18/f3b [560335,18725] 0 2024-09-18T12:51:21.697 INFO:tasks.workunit.client.0.smithi081.stdout:7/506: creat d2/d18/d60/d85/fb2 x:0 0 0 2024-09-18T12:51:21.700 INFO:tasks.workunit.client.0.smithi081.stdout:8/475: unlink d3/d1d/c45 0 2024-09-18T12:51:21.700 INFO:tasks.workunit.client.0.smithi081.stdout:8/476: readlink d3/d1d/d4a/l9b 0 2024-09-18T12:51:21.700 INFO:tasks.workunit.client.0.smithi081.stdout:8/477: write d3/d1e/f9c [101569,89209] 0 2024-09-18T12:51:21.700 INFO:tasks.workunit.client.0.smithi081.stdout:8/478: write d3/d2f/f94 [231746,114107] 0 2024-09-18T12:51:21.702 INFO:tasks.workunit.client.0.smithi081.stdout:2/580: mkdir d15/d16/d33/d53/d7a/d2f/d61/dd4 0 2024-09-18T12:51:21.702 INFO:tasks.workunit.client.0.smithi081.stdout:2/581: write d15/d16/d33/d53/d7a/d2f/d61/d97/fcf [355751,42723] 0 2024-09-18T12:51:21.704 INFO:tasks.workunit.client.1.smithi136.stdout:9/861: symlink d6/da/d3d/d41/l11e 0 2024-09-18T12:51:21.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/582: creat d15/d16/d33/d53/d7a/d32/d6d/fd5 x:0 0 0 2024-09-18T12:51:21.710 INFO:tasks.workunit.client.0.smithi081.stdout:7/507: truncate d2/d18/f1f 2994904 0 2024-09-18T12:51:21.710 INFO:tasks.workunit.client.0.smithi081.stdout:7/508: dread - d2/d18/fab zero size 2024-09-18T12:51:21.710 INFO:tasks.workunit.client.0.smithi081.stdout:2/583: mknod d15/d16/d33/d53/d7a/d32/d6d/da0/cd6 0 2024-09-18T12:51:21.711 INFO:tasks.workunit.client.1.smithi136.stdout:6/925: creat d8/d9/d3c/d4a/f128 x:0 0 0 2024-09-18T12:51:21.713 INFO:tasks.workunit.client.0.smithi081.stdout:7/509: link d2/c8f d2/d1d/cb3 0 2024-09-18T12:51:21.713 INFO:tasks.workunit.client.0.smithi081.stdout:7/510: write d2/d42/f82 [279508,16051] 0 2024-09-18T12:51:21.713 INFO:tasks.workunit.client.1.smithi136.stdout:9/862: creat d6/db/d12/d62/daa/f11f x:0 0 0 2024-09-18T12:51:21.715 INFO:tasks.workunit.client.0.smithi081.stdout:7/511: link d2/d18/d3c/c91 d2/d56/d73/da4/cb4 0 2024-09-18T12:51:21.715 INFO:tasks.workunit.client.1.smithi136.stdout:9/863: symlink d6/d96/l120 0 2024-09-18T12:51:21.716 INFO:tasks.workunit.client.0.smithi081.stdout:7/512: truncate d2/d18/d22/f32 4185734 0 2024-09-18T12:51:21.717 INFO:tasks.workunit.client.0.smithi081.stdout:7/513: dread - d2/d14/d21/f72 zero size 2024-09-18T12:51:21.718 INFO:tasks.workunit.client.0.smithi081.stdout:7/514: symlink d2/d56/d73/da4/lb5 0 2024-09-18T12:51:21.718 INFO:tasks.workunit.client.1.smithi136.stdout:9/864: getdents d6/d13 0 2024-09-18T12:51:21.719 INFO:tasks.workunit.client.1.smithi136.stdout:9/865: mknod d6/da/d3d/d41/c121 0 2024-09-18T12:51:21.719 INFO:tasks.workunit.client.0.smithi081.stdout:7/515: symlink d2/d56/d73/d90/lb6 0 2024-09-18T12:51:21.720 INFO:tasks.workunit.client.0.smithi081.stdout:7/516: unlink d2/d14/d21/f78 0 2024-09-18T12:51:21.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/517: read d2/d14/d21/d62/da7/f3d [671309,127425] 0 2024-09-18T12:51:21.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/518: getdents d2/d18/d60/daa 0 2024-09-18T12:51:21.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/519: creat d2/d14/d21/d49/fb7 x:0 0 0 2024-09-18T12:51:21.727 INFO:tasks.workunit.client.0.smithi081.stdout:7/520: symlink d2/d18/d60/daa/lb8 0 2024-09-18T12:51:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.736+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f470810ce10 con 0x7f46f4073a90 2024-09-18T12:51:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.737+0000 7f47067fc700 1 -- 172.21.15.81:0/3708932958 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f470810ce10 con 0x7f46f4073a90 2024-09-18T12:51:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 msgr2=0x7f46f4075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 0x7f46f4075f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009fd0 tx=0x7f46f000b540 comp rx=0 tx=0).stop 2024-09-18T12:51:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 msgr2=0x7f470819d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f470819d0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f470000bb00 tx=0x7f470000be10 comp rx=0 tx=0).stop 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 shutdown_connections 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f46f4073a90 0x7f46f4075f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47081072c0 0x7f470819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 --2- 172.21.15.81:0/3708932958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47081084c0 0x7f470819d0e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 >> 172.21.15.81:0/3708932958 conn(0x7f47080763d0 msgr2=0x7f470810b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 shutdown_connections 2024-09-18T12:51:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.739+0000 7f470f63d700 1 -- 172.21.15.81:0/3708932958 wait complete. 2024-09-18T12:51:21.795 INFO:tasks.workunit.client.0.smithi081.stdout:4/455: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:21.795 INFO:tasks.workunit.client.1.smithi136.stdout:8/968: sync 2024-09-18T12:51:21.795 INFO:tasks.workunit.client.1.smithi136.stdout:4/823: sync 2024-09-18T12:51:21.796 INFO:tasks.workunit.client.1.smithi136.stdout:1/888: sync 2024-09-18T12:51:21.797 INFO:tasks.workunit.client.1.smithi136.stdout:4/824: creat d0/d2/d85/f105 x:0 0 0 2024-09-18T12:51:21.798 INFO:tasks.workunit.client.0.smithi081.stdout:4/456: link d3/db/c48 d3/db/d2d/c9c 0 2024-09-18T12:51:21.798 INFO:tasks.workunit.client.0.smithi081.stdout:4/457: chown d3/db/d58 407 1 2024-09-18T12:51:21.800 INFO:tasks.workunit.client.1.smithi136.stdout:0/988: dwrite d1/d3/d1a/d98/d81/d51/fd7 [4194304,4194304] 0 2024-09-18T12:51:21.803 INFO:tasks.workunit.client.0.smithi081.stdout:4/458: read d3/db/f25 [2543375,19816] 0 2024-09-18T12:51:21.803 INFO:tasks.workunit.client.0.smithi081.stdout:4/459: chown d3/db/d35/f76 14070 1 2024-09-18T12:51:21.805 INFO:tasks.workunit.client.0.smithi081.stdout:4/460: rmdir d3/db/d2d/d4e/d6d 0 2024-09-18T12:51:21.807 INFO:tasks.workunit.client.1.smithi136.stdout:9/866: read d6/db/d72/fd4 [755005,93397] 0 2024-09-18T12:51:21.807 INFO:tasks.workunit.client.1.smithi136.stdout:9/867: getdents d6/da/d3d/d4d/d91/d25/df3 0 2024-09-18T12:51:21.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/868: rmdir d6/df/d23/d10f 39 2024-09-18T12:51:21.809 INFO:tasks.workunit.client.1.smithi136.stdout:9/869: dread - d6/df/d75/fec zero size 2024-09-18T12:51:21.812 INFO:tasks.workunit.client.1.smithi136.stdout:9/870: creat d6/df/dd3/f122 x:0 0 0 2024-09-18T12:51:21.815 INFO:tasks.workunit.client.1.smithi136.stdout:8/969: dread d9/d14/d1a/d2b/d42/fe4 [0,4194304] 0 2024-09-18T12:51:21.822 INFO:tasks.workunit.client.0.smithi081.stdout:8/479: dwrite d3/f86 [0,4194304] 0 2024-09-18T12:51:21.822 INFO:tasks.workunit.client.0.smithi081.stdout:8/480: chown d3/f2d 92930 1 2024-09-18T12:51:21.822 INFO:tasks.workunit.client.0.smithi081.stdout:8/481: chown d3/d1e/d4c/d53/f7d 60 1 2024-09-18T12:51:21.822 INFO:tasks.workunit.client.1.smithi136.stdout:0/989: write d1/d3/d1a/d98/d81/d35/f49 [803956,12909] 0 2024-09-18T12:51:21.822 INFO:tasks.workunit.client.1.smithi136.stdout:0/990: creat d1/d3/d1a/d98/d81/d35/d54/f153 x:0 0 0 2024-09-18T12:51:21.825 INFO:tasks.workunit.client.1.smithi136.stdout:0/991: truncate d1/d17/f37 3295899 0 2024-09-18T12:51:21.825 INFO:tasks.workunit.client.1.smithi136.stdout:4/825: dwrite d0/d45/d67/ddf/fdb [0,4194304] 0 2024-09-18T12:51:21.826 INFO:tasks.workunit.client.0.smithi081.stdout:8/482: link d3/d1e/d4c/fa1 d3/d1d/d4a/fa3 0 2024-09-18T12:51:21.826 INFO:tasks.workunit.client.0.smithi081.stdout:2/584: dwrite d15/d16/d33/f5b [4194304,4194304] 0 2024-09-18T12:51:21.826 INFO:tasks.workunit.client.0.smithi081.stdout:2/585: fsync d15/d16/d33/d53/d7a/d2f/dc2/fd2 0 2024-09-18T12:51:21.826 INFO:tasks.workunit.client.0.smithi081.stdout:9/477: dwrite fa [0,4194304] 0 2024-09-18T12:51:21.826 INFO:tasks.workunit.client.0.smithi081.stdout:9/478: truncate dd/de/d59/f5e 697472 0 2024-09-18T12:51:21.828 INFO:tasks.workunit.client.0.smithi081.stdout:9/479: symlink dd/d1d/d1e/d77/l9f 0 2024-09-18T12:51:21.828 INFO:tasks.workunit.client.0.smithi081.stdout:9/480: truncate dd/d1d/d1e/d39/f98 750172 0 2024-09-18T12:51:21.828 INFO:tasks.workunit.client.1.smithi136.stdout:6/926: dwrite d8/d9/de/d1c/d50/da8/df2/ffa [0,4194304] 0 2024-09-18T12:51:21.829 INFO:tasks.workunit.client.0.smithi081.stdout:2/586: getdents d15/d16/d20/d22/d5a 0 2024-09-18T12:51:21.830 INFO:tasks.workunit.client.0.smithi081.stdout:9/481: creat dd/d1b/fa0 x:0 0 0 2024-09-18T12:51:21.834 INFO:tasks.workunit.client.0.smithi081.stdout:2/587: dread d15/d16/d33/d53/d7a/d2f/dc2/f7d [0,4194304] 0 2024-09-18T12:51:21.834 INFO:tasks.workunit.client.0.smithi081.stdout:2/588: fdatasync d15/d16/f37 0 2024-09-18T12:51:21.834 INFO:tasks.workunit.client.0.smithi081.stdout:2/589: creat d15/d16/d33/d53/d7a/d2f/d61/d97/fd7 x:0 0 0 2024-09-18T12:51:21.836 INFO:tasks.workunit.client.0.smithi081.stdout:2/590: mkdir d15/d16/d33/d53/d7a/d2f/db3/dd8 0 2024-09-18T12:51:21.836 INFO:tasks.workunit.client.0.smithi081.stdout:8/483: dread d3/d1e/d4c/f64 [0,4194304] 0 2024-09-18T12:51:21.836 INFO:tasks.workunit.client.0.smithi081.stdout:8/484: write d3/f13 [9020233,83166] 0 2024-09-18T12:51:21.837 INFO:tasks.workunit.client.0.smithi081.stdout:2/591: mknod d15/d16/d33/d53/db0/cd9 0 2024-09-18T12:51:21.837 INFO:tasks.workunit.client.0.smithi081.stdout:2/592: chown d15/d16/d20/d22/d5a/c82 3 1 2024-09-18T12:51:21.838 INFO:tasks.workunit.client.0.smithi081.stdout:8/485: creat d3/d1e/fa4 x:0 0 0 2024-09-18T12:51:21.838 INFO:tasks.workunit.client.0.smithi081.stdout:2/593: creat d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fda x:0 0 0 2024-09-18T12:51:21.839 INFO:tasks.workunit.client.0.smithi081.stdout:8/486: mknod d3/d73/ca5 0 2024-09-18T12:51:21.839 INFO:tasks.workunit.client.0.smithi081.stdout:8/487: creat d3/d73/fa6 x:0 0 0 2024-09-18T12:51:21.840 INFO:tasks.workunit.client.0.smithi081.stdout:8/488: creat d3/d1d/d4a/fa7 x:0 0 0 2024-09-18T12:51:21.840 INFO:tasks.workunit.client.0.smithi081.stdout:8/489: fdatasync d3/d1e/f2b 0 2024-09-18T12:51:21.840 INFO:tasks.workunit.client.0.smithi081.stdout:9/482: dread dd/d1d/d1e/d24/f82 [0,4194304] 0 2024-09-18T12:51:21.840 INFO:tasks.workunit.client.1.smithi136.stdout:6/927: dread d8/dc/f15 [4194304,4194304] 0 2024-09-18T12:51:21.840 INFO:tasks.workunit.client.0.smithi081.stdout:2/594: symlink d15/d16/d33/d53/d7a/d32/d6d/da0/ldb 0 2024-09-18T12:51:21.841 INFO:tasks.workunit.client.0.smithi081.stdout:2/595: chown d15/d16/d33/d53/d7a/d2f/d61/f80 14 1 2024-09-18T12:51:21.841 INFO:tasks.workunit.client.1.smithi136.stdout:6/928: symlink d8/d9/d56/l129 0 2024-09-18T12:51:21.842 INFO:tasks.workunit.client.1.smithi136.stdout:6/929: rmdir d8/d9/de/d60/d71 39 2024-09-18T12:51:21.842 INFO:tasks.workunit.client.1.smithi136.stdout:6/930: chown d8/d9d/d9f/d122/la0 1 1 2024-09-18T12:51:21.842 INFO:tasks.workunit.client.1.smithi136.stdout:9/871: dwrite d6/d13/ff7 [0,4194304] 0 2024-09-18T12:51:21.843 INFO:tasks.workunit.client.1.smithi136.stdout:6/931: mkdir d8/d9/d56/d96/d9c/ded/d12a 0 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/596: rmdir d15/d26 39 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/597: truncate d15/d16/d33/d53/d7a/d32/f99 831084 0 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/598: truncate d15/d16/d33/d53/d7a/f63 903458 0 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.1.smithi136.stdout:1/889: dwrite d2/d5/d2b/d9b/d2e/d4c/f59 [0,4194304] 0 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.1.smithi136.stdout:1/890: read d2/d5/d2b/da9/fea [518217,88602] 0 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.1.smithi136.stdout:1/891: chown d2/d5/d2b/le4 16261 1 2024-09-18T12:51:21.844 INFO:tasks.workunit.client.1.smithi136.stdout:1/892: truncate d2/d5/d2b/d9b/d2e/df0/f112 737663 0 2024-09-18T12:51:21.845 INFO:tasks.workunit.client.0.smithi081.stdout:2/599: getdents d15/d16 0 2024-09-18T12:51:21.846 INFO:tasks.workunit.client.1.smithi136.stdout:9/872: mkdir d6/df/d23/d2b/d79/d119/d123 0 2024-09-18T12:51:21.846 INFO:tasks.workunit.client.1.smithi136.stdout:9/873: chown d6/da/cb0 12 1 2024-09-18T12:51:21.846 INFO:tasks.workunit.client.1.smithi136.stdout:8/970: dwrite d9/d14/d1a/d2b/d42/da4/de5/f137 [0,4194304] 0 2024-09-18T12:51:21.847 INFO:tasks.workunit.client.0.smithi081.stdout:2/600: rename d15/d16/d20/d22/f70 to d15/d16/d54/fdc 0 2024-09-18T12:51:21.847 INFO:tasks.workunit.client.0.smithi081.stdout:2/601: stat d15/d16/d33/f5b 0 2024-09-18T12:51:21.847 INFO:tasks.workunit.client.0.smithi081.stdout:2/602: write d15/d16/d33/d53/d7a/fb5 [529651,112663] 0 2024-09-18T12:51:21.847 INFO:tasks.workunit.client.1.smithi136.stdout:6/932: creat d8/d9/d3c/d4a/f12b x:0 0 0 2024-09-18T12:51:21.850 INFO:tasks.workunit.client.1.smithi136.stdout:1/893: creat d2/d5/d2b/d34/d103/f12e x:0 0 0 2024-09-18T12:51:21.850 INFO:tasks.workunit.client.1.smithi136.stdout:0/992: dwrite d1/db/d76/db9/ffd [0,4194304] 0 2024-09-18T12:51:21.851 INFO:tasks.workunit.client.0.smithi081.stdout:2/603: mkdir d15/d16/d33/d53/d7a/d2f/d61/d97/ddd 0 2024-09-18T12:51:21.851 INFO:tasks.workunit.client.1.smithi136.stdout:9/874: getdents d6/da/d3d/d4d/d91 0 2024-09-18T12:51:21.856 INFO:tasks.workunit.client.1.smithi136.stdout:1/894: getdents d2/d5/d9/dcb/d10e 0 2024-09-18T12:51:21.856 INFO:tasks.workunit.client.1.smithi136.stdout:1/895: stat d2/c87 0 2024-09-18T12:51:21.856 INFO:tasks.workunit.client.1.smithi136.stdout:1/896: chown d2/d5/d2b/d9b/fbd 533329084 1 2024-09-18T12:51:21.856 INFO:tasks.workunit.client.1.smithi136.stdout:8/971: write d9/fd8 [1655610,27636] 0 2024-09-18T12:51:21.856 INFO:tasks.workunit.client.0.smithi081.stdout:8/490: dread d3/f86 [0,4194304] 0 2024-09-18T12:51:21.862 INFO:tasks.workunit.client.1.smithi136.stdout:0/993: rename d1/d17/c1d to d1/d3/c154 0 2024-09-18T12:51:21.862 INFO:tasks.workunit.client.1.smithi136.stdout:0/994: stat d1/d60/fa7 0 2024-09-18T12:51:21.864 INFO:tasks.workunit.client.1.smithi136.stdout:8/972: link d9/f6a d9/d18/d34/d3d/d47/dbe/d106/f157 0 2024-09-18T12:51:21.865 INFO:tasks.workunit.client.1.smithi136.stdout:8/973: link d9/d14/d1a/d2b/d42/d6e/d75/db4/f135 d9/d18/d34/d3d/d47/d65/d93/f158 0 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 -- 172.21.15.81:0/1823250551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c100520 msgr2=0x7efe3c100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 --2- 172.21.15.81:0/1823250551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c100520 0x7efe3c100980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efe3000aa20 tx=0x7efe3000ad30 comp rx=0 tx=0).stop 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 -- 172.21.15.81:0/1823250551 shutdown_connections 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 --2- 172.21.15.81:0/1823250551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c100520 0x7efe3c100980 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 --2- 172.21.15.81:0/1823250551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c0ff320 0x7efe3c0ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.874+0000 7efe4099e700 1 -- 172.21.15.81:0/1823250551 >> 172.21.15.81:0/1823250551 conn(0x7efe3c0fa8c0 msgr2=0x7efe3c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.875+0000 7efe4099e700 1 -- 172.21.15.81:0/1823250551 shutdown_connections 2024-09-18T12:51:21.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.875+0000 7efe4099e700 1 -- 172.21.15.81:0/1823250551 wait complete. 2024-09-18T12:51:21.878 INFO:tasks.workunit.client.1.smithi136.stdout:1/897: dread d2/f60 [0,4194304] 0 2024-09-18T12:51:21.878 INFO:tasks.workunit.client.1.smithi136.stdout:6/933: dwrite d8/d9/de/d60/d94/fa1 [0,4194304] 0 2024-09-18T12:51:21.878 INFO:tasks.workunit.client.1.smithi136.stdout:1/898: write d2/d5/d2b/d9b/d2e/f6b [4270331,89165] 0 2024-09-18T12:51:21.878 INFO:tasks.workunit.client.1.smithi136.stdout:1/899: chown d2/d5/d2b/d9b/d2e/c123 1 1 2024-09-18T12:51:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 Processor -- start 2024-09-18T12:51:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 -- start start 2024-09-18T12:51:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c100520 0x7efe3c196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c197140 con 0x7efe3c0ff320 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe4099e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c197280 con 0x7efe3c100520 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47068/0 (socket says 172.21.15.81:47068) 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe3a59c700 1 -- 172.21.15.81:0/1019139134 learned_addr learned my addr 172.21.15.81:0/1019139134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.876+0000 7efe39d9b700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c100520 0x7efe3c196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.877+0000 7efe3a59c700 1 -- 172.21.15.81:0/1019139134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c100520 msgr2=0x7efe3c196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.877+0000 7efe3a59c700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c100520 0x7efe3c196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.877+0000 7efe3a59c700 1 -- 172.21.15.81:0/1019139134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3000a700 con 0x7efe3c0ff320 2024-09-18T12:51:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.877+0000 7efe3a59c700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b480 tx=0x7efe2c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:21.881 INFO:tasks.workunit.client.0.smithi081.stdout:2/604: dwrite d15/d16/d33/d53/d7a/d32/fab [0,4194304] 0 2024-09-18T12:51:21.881 INFO:tasks.workunit.client.1.smithi136.stdout:1/900: mknod d2/d5/d2b/d9b/dbe/dd3/c12f 0 2024-09-18T12:51:21.882 INFO:tasks.workunit.client.1.smithi136.stdout:1/901: fdatasync d2/d5/d2b/d9b/d2e/fb5 0 2024-09-18T12:51:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.880+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c011800 con 0x7efe3c0ff320 2024-09-18T12:51:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.880+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe2c011e10 con 0x7efe3c0ff320 2024-09-18T12:51:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.880+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c010ea0 con 0x7efe3c0ff320 2024-09-18T12:51:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.880+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c194000 con 0x7efe3c0ff320 2024-09-18T12:51:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.880+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c194500 con 0x7efe3c0ff320 2024-09-18T12:51:21.883 INFO:tasks.workunit.client.0.smithi081.stdout:2/605: dread d15/d16/d20/f4f [0,4194304] 0 2024-09-18T12:51:21.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.881+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c107690 con 0x7efe3c0ff320 2024-09-18T12:51:21.883 INFO:tasks.workunit.client.0.smithi081.stdout:2/606: truncate d15/d16/d33/d53/d7a/f52 4146710 0 2024-09-18T12:51:21.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.882+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7efe2c010380 con 0x7efe3c0ff320 2024-09-18T12:51:21.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.883+0000 7efe2b7fe700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 0x7efe2407a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:21.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.883+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7efe2c094320 con 0x7efe3c0ff320 2024-09-18T12:51:21.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.883+0000 7efe39d9b700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 0x7efe2407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:21.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.884+0000 7efe39d9b700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 0x7efe2407a310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe30005e20 tx=0x7efe300058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:21.887+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efe2c062660 con 0x7efe3c0ff320 2024-09-18T12:51:21.892 INFO:tasks.workunit.client.0.smithi081.stdout:2/607: dread d15/d16/f18 [0,4194304] 0 2024-09-18T12:51:21.893 INFO:tasks.workunit.client.0.smithi081.stdout:2/608: truncate d15/d16/d33/d53/d7a/d32/fab 3958219 0 2024-09-18T12:51:21.902 INFO:tasks.workunit.client.0.smithi081.stdout:2/609: write d15/d16/d20/d22/f34 [1209204,96293] 0 2024-09-18T12:51:21.902 INFO:tasks.workunit.client.0.smithi081.stdout:2/610: chown d15/d16/d20/d59/c60 1017 1 2024-09-18T12:51:21.903 INFO:tasks.workunit.client.0.smithi081.stdout:2/611: link d15/d16/d33/d53/d7a/d2f/dc2/f7d d15/d16/d33/d53/d7a/d2f/db3/dd8/fde 0 2024-09-18T12:51:21.904 INFO:tasks.workunit.client.0.smithi081.stdout:2/612: symlink d15/d26/ldf 0 2024-09-18T12:51:21.905 INFO:tasks.workunit.client.0.smithi081.stdout:2/613: link d15/d16/d54/fdc d15/fe0 0 2024-09-18T12:51:21.920 INFO:tasks.workunit.client.0.smithi081.stdout:2/614: dwrite d15/d16/f19 [0,4194304] 0 2024-09-18T12:51:21.921 INFO:tasks.workunit.client.0.smithi081.stdout:2/615: truncate d15/d16/d20/fbd 195611 0 2024-09-18T12:51:21.922 INFO:tasks.workunit.client.0.smithi081.stdout:2/616: getdents d15/d16/d33/d53/d7a/d2f/db3/dd8 0 2024-09-18T12:51:21.923 INFO:tasks.workunit.client.0.smithi081.stdout:2/617: symlink d15/d16/d20/d22/le1 0 2024-09-18T12:51:21.923 INFO:tasks.workunit.client.0.smithi081.stdout:2/618: creat d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 x:0 0 0 2024-09-18T12:51:21.926 INFO:tasks.workunit.client.0.smithi081.stdout:2/619: rename d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fda to d15/d16/d20/d22/d5a/fe3 0 2024-09-18T12:51:21.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/620: dread fe [0,4194304] 0 2024-09-18T12:51:21.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/621: fdatasync d15/d16/f18 0 2024-09-18T12:51:21.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/622: readlink d15/l69 0 2024-09-18T12:51:21.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/623: read f9 [8276305,27608] 0 2024-09-18T12:51:21.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/624: creat d15/d16/d33/d53/d7a/d2f/dc2/fe4 x:0 0 0 2024-09-18T12:51:21.931 INFO:tasks.workunit.client.0.smithi081.stdout:2/625: mknod d15/ce5 0 2024-09-18T12:51:21.944 INFO:tasks.workunit.client.1.smithi136.stdout:6/934: link d8/d9/d3c/d4a/l4b d8/d9d/dfd/l12c 0 2024-09-18T12:51:21.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/902: symlink d2/d5/d2b/d9b/dbe/dd3/d65/l130 0 2024-09-18T12:51:21.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/903: readlink d2/d5/d2b/d34/d86/l62 0 2024-09-18T12:51:21.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/904: readlink d2/d5/d2b/d9b/d2e/d4c/l53 0 2024-09-18T12:51:21.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/905: readlink d2/d5/l8 0 2024-09-18T12:51:21.945 INFO:tasks.workunit.client.1.smithi136.stdout:1/906: stat d2/d5/d2b/d9b/d2e/df0 0 2024-09-18T12:51:21.946 INFO:tasks.workunit.client.0.smithi081.stdout:2/626: dwrite d15/d16/f48 [0,4194304] 0 2024-09-18T12:51:21.946 INFO:tasks.workunit.client.0.smithi081.stdout:2/627: creat d15/d16/d20/d22/fe6 x:0 0 0 2024-09-18T12:51:21.950 INFO:tasks.workunit.client.0.smithi081.stdout:2/628: unlink d15/d16/d33/fcb 0 2024-09-18T12:51:21.951 INFO:tasks.workunit.client.1.smithi136.stdout:6/935: mkdir d8/d9d/d9f/d122/d12d 0 2024-09-18T12:51:21.953 INFO:tasks.workunit.client.1.smithi136.stdout:6/936: symlink d8/d9d/d9f/d122/dff/l12e 0 2024-09-18T12:51:21.954 INFO:tasks.workunit.client.1.smithi136.stdout:6/937: write d8/dc/f14 [889512,107971] 0 2024-09-18T12:51:21.956 INFO:tasks.workunit.client.1.smithi136.stdout:8/974: getdents d9/d18/d34/d3d/d47/d65/d93 0 2024-09-18T12:51:21.957 INFO:tasks.workunit.client.1.smithi136.stdout:8/975: chown d9/d14/d1a/d2b/d42/da4/dd9 155081687 1 2024-09-18T12:51:21.957 INFO:tasks.workunit.client.0.smithi081.stdout:2/629: truncate d15/d16/f48 2718210 0 2024-09-18T12:51:21.958 INFO:tasks.workunit.client.1.smithi136.stdout:6/938: creat d8/d9d/d9f/f12f x:0 0 0 2024-09-18T12:51:21.958 INFO:tasks.workunit.client.0.smithi081.stdout:2/630: link d15/d16/d33/d53/d7a/d32/d6d/ca3 d15/d16/d20/d31/ce7 0 2024-09-18T12:51:21.960 INFO:tasks.workunit.client.0.smithi081.stdout:2/631: mknod d15/d16/d33/ce8 0 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/976: creat d9/d18/d34/f159 x:0 0 0 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/977: chown d9/d14/d1a/d2b/f4d 470 1 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/978: readlink d9/d14/d1a/d2b/d42/d6e/l72 0 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/979: fsync f5 0 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/980: write d9/d14/f71 [2678339,78339] 0 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:8/981: chown d9/lc 11171132 1 2024-09-18T12:51:21.961 INFO:tasks.workunit.client.1.smithi136.stdout:6/939: rmdir d8/d9/de/d1c/db9/d10c 39 2024-09-18T12:51:21.962 INFO:tasks.workunit.client.1.smithi136.stdout:1/907: dwrite d2/d5/d2b/d34/feb [0,4194304] 0 2024-09-18T12:51:21.963 INFO:tasks.workunit.client.1.smithi136.stdout:8/982: rename d9/d14/d1a/c116 to d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e/d101/c15a 0 2024-09-18T12:51:21.963 INFO:tasks.workunit.client.1.smithi136.stdout:8/983: creat d9/d18/d34/f15b x:0 0 0 2024-09-18T12:51:21.965 INFO:tasks.workunit.client.1.smithi136.stdout:6/940: creat d8/d9/de/d60/f130 x:0 0 0 2024-09-18T12:51:21.965 INFO:tasks.workunit.client.1.smithi136.stdout:6/941: readlink d8/d9/de/d60/d71/l127 0 2024-09-18T12:51:21.967 INFO:tasks.workunit.client.1.smithi136.stdout:1/908: creat d2/d5/d2b/d9b/dbe/f131 x:0 0 0 2024-09-18T12:51:21.971 INFO:tasks.workunit.client.0.smithi081.stdout:2/632: write d15/d16/f37 [2537802,29261] 0 2024-09-18T12:51:21.972 INFO:tasks.workunit.client.0.smithi081.stdout:2/633: link d15/d16/d20/fa5 d15/d16/d33/d53/d7a/d2f/d61/d97/fe9 0 2024-09-18T12:51:21.972 INFO:tasks.workunit.client.0.smithi081.stdout:2/634: truncate d15/d16/d33/d53/d7a/d2f/d61/d97/fe9 978095 0 2024-09-18T12:51:21.976 INFO:tasks.workunit.client.1.smithi136.stdout:8/984: dread d9/d18/d34/d3d/d47/d65/fab [4194304,4194304] 0 2024-09-18T12:51:21.976 INFO:tasks.workunit.client.1.smithi136.stdout:8/985: stat d9/f133 0 2024-09-18T12:51:21.982 INFO:tasks.workunit.client.0.smithi081.stdout:2/635: dread d15/d16/f48 [0,4194304] 0 2024-09-18T12:51:21.983 INFO:tasks.workunit.client.0.smithi081.stdout:2/636: write d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 [823326,108452] 0 2024-09-18T12:51:21.983 INFO:tasks.workunit.client.0.smithi081.stdout:2/637: chown d15/d16/d54 22 1 2024-09-18T12:51:21.983 INFO:tasks.workunit.client.1.smithi136.stdout:6/942: dwrite d8/dc/f43 [0,4194304] 0 2024-09-18T12:51:21.985 INFO:tasks.workunit.client.1.smithi136.stdout:6/943: unlink d8/d9/d56/d96/d9c/fd9 0 2024-09-18T12:51:21.988 INFO:tasks.workunit.client.1.smithi136.stdout:1/909: dwrite d2/d5/d9/dcb/dfb/d107/d114/fc1 [0,4194304] 0 2024-09-18T12:51:21.991 INFO:tasks.workunit.client.1.smithi136.stdout:1/910: symlink d2/d5/d2b/d9b/d115/l132 0 2024-09-18T12:51:21.992 INFO:tasks.workunit.client.1.smithi136.stdout:8/986: dread d9/d14/d1a/d7f/fa0 [0,4194304] 0 2024-09-18T12:51:21.992 INFO:tasks.workunit.client.1.smithi136.stdout:1/911: mknod d2/c133 0 2024-09-18T12:51:21.993 INFO:tasks.workunit.client.1.smithi136.stdout:3/904: sync 2024-09-18T12:51:21.993 INFO:tasks.workunit.client.1.smithi136.stdout:8/987: rmdir d9/d18/d34/d3d/d47/d65/d93 39 2024-09-18T12:51:21.995 INFO:tasks.workunit.client.1.smithi136.stdout:1/912: creat d2/d5/d2b/d9b/dbe/dd3/f134 x:0 0 0 2024-09-18T12:51:21.996 INFO:tasks.workunit.client.1.smithi136.stdout:8/988: rmdir d9/d14/d1a/d2b/deb/d110/d145 0 2024-09-18T12:51:21.998 INFO:tasks.workunit.client.1.smithi136.stdout:3/905: symlink d3/d14/d17/d53/d73/l123 0 2024-09-18T12:51:21.998 INFO:tasks.workunit.client.1.smithi136.stdout:3/906: chown d3/d14/d17/d75 1740403095 1 2024-09-18T12:51:21.999 INFO:tasks.workunit.client.1.smithi136.stdout:1/913: mkdir d2/d5/d2b/d34/d86/d135 0 2024-09-18T12:51:22.001 INFO:tasks.workunit.client.1.smithi136.stdout:8/989: symlink d9/d18/d34/d3d/d8b/df0/l15c 0 2024-09-18T12:51:22.001 INFO:tasks.workunit.client.1.smithi136.stdout:4/826: sync 2024-09-18T12:51:22.001 INFO:tasks.workunit.client.1.smithi136.stdout:4/827: write d0/d25/db7/fce [2832783,117157] 0 2024-09-18T12:51:22.002 INFO:tasks.workunit.client.1.smithi136.stdout:4/828: creat d0/d25/f106 x:0 0 0 2024-09-18T12:51:22.002 INFO:tasks.workunit.client.0.smithi081.stdout:5/566: sync 2024-09-18T12:51:22.003 INFO:tasks.workunit.client.1.smithi136.stdout:8/990: creat d9/d14/d1a/d2b/d42/d6e/d75/db4/f15d x:0 0 0 2024-09-18T12:51:22.003 INFO:tasks.workunit.client.1.smithi136.stdout:8/991: dread - d9/d14/d1a/d2b/d42/da4/da7/fa9 zero size 2024-09-18T12:51:22.003 INFO:tasks.workunit.client.1.smithi136.stdout:8/992: chown d9/d18/d34/d3d/d47/d65/d93/d96/d9b/d103/d13e/d10d/fef 6621 1 2024-09-18T12:51:22.003 INFO:tasks.workunit.client.1.smithi136.stdout:8/993: readlink d9/d14/d1a/d2b/l5e 0 2024-09-18T12:51:22.003 INFO:tasks.workunit.client.0.smithi081.stdout:5/567: creat d2/d14/fb4 x:0 0 0 2024-09-18T12:51:22.006 INFO:tasks.workunit.client.1.smithi136.stdout:4/829: link d0/d5f/f75 d0/d45/d67/f107 0 2024-09-18T12:51:22.006 INFO:tasks.workunit.client.1.smithi136.stdout:0/995: sync 2024-09-18T12:51:22.006 INFO:tasks.workunit.client.1.smithi136.stdout:9/875: sync 2024-09-18T12:51:22.006 INFO:tasks.workunit.client.1.smithi136.stdout:0/996: stat d1/db/f71 0 2024-09-18T12:51:22.006 INFO:tasks.workunit.client.1.smithi136.stdout:0/997: creat d1/d3/d1a/d98/d81/d51/f155 x:0 0 0 2024-09-18T12:51:22.007 INFO:tasks.workunit.client.1.smithi136.stdout:8/994: truncate d9/d18/d34/d3d/d47/fb7 1334653 0 2024-09-18T12:51:22.008 INFO:tasks.workunit.client.1.smithi136.stdout:1/914: dread d2/d5/d2b/d9b/d2e/fb5 [4194304,4194304] 0 2024-09-18T12:51:22.009 INFO:tasks.workunit.client.1.smithi136.stdout:1/915: read d2/d5/d2b/d9b/d2e/fb0 [3035741,82382] 0 2024-09-18T12:51:22.009 INFO:tasks.workunit.client.1.smithi136.stdout:1/916: readlink d2/d5/d2b/d34/d86/ld4 0 2024-09-18T12:51:22.009 INFO:tasks.workunit.client.1.smithi136.stdout:4/830: mkdir d0/d45/d67/d7b/d108 0 2024-09-18T12:51:22.010 INFO:tasks.workunit.client.1.smithi136.stdout:0/998: dread d1/d3/d1a/d98/d81/d35/d84/fbe [0,4194304] 0 2024-09-18T12:51:22.010 INFO:tasks.workunit.client.1.smithi136.stdout:0/999: truncate d1/d3/d1a/d62/fa4 1877560 0 2024-09-18T12:51:22.011 INFO:tasks.workunit.client.1.smithi136.stdout:8/995: link d9/d18/d34/d3d/d47/d65/d93/d96/f11a d9/d18/d34/f15e 0 2024-09-18T12:51:22.011 INFO:tasks.workunit.client.1.smithi136.stdout:8/996: write d9/d18/d34/d3d/d47/d65/d92/f10f [891680,42040] 0 2024-09-18T12:51:22.012 INFO:tasks.workunit.client.1.smithi136.stdout:1/917: creat d2/d5/d2b/da9/f136 x:0 0 0 2024-09-18T12:51:22.016 INFO:tasks.workunit.client.1.smithi136.stdout:4/831: read d0/d45/d67/f99 [482325,122619] 0 2024-09-18T12:51:22.016 INFO:tasks.workunit.client.1.smithi136.stdout:1/918: link d2/d5/d2b/d9b/dbe/dd3/d65/f6e d2/d5/d2b/d63/dda/d120/d124/f137 0 2024-09-18T12:51:22.018 INFO:tasks.workunit.client.1.smithi136.stdout:4/832: symlink d0/d3/d90/l109 0 2024-09-18T12:51:22.019 INFO:tasks.workunit.client.0.smithi081.stdout:5/568: write d2/d14/d1d/d1a/f2b [1206668,29676] 0 2024-09-18T12:51:22.019 INFO:tasks.workunit.client.0.smithi081.stdout:5/569: creat d2/d14/d33/d37/d3b/d5f/fb5 x:0 0 0 2024-09-18T12:51:22.019 INFO:tasks.workunit.client.0.smithi081.stdout:5/570: fsync d2/d14/d33/d37/f95 0 2024-09-18T12:51:22.021 INFO:tasks.workunit.client.0.smithi081.stdout:2/638: dwrite d15/d16/f18 [4194304,4194304] 0 2024-09-18T12:51:22.022 INFO:tasks.workunit.client.1.smithi136.stdout:1/919: symlink d2/d5/d2b/d9b/dbe/l138 0 2024-09-18T12:51:22.022 INFO:tasks.workunit.client.1.smithi136.stdout:1/920: chown d2/d5/d2b/d9b/d2e/c9c 68 1 2024-09-18T12:51:22.022 INFO:tasks.workunit.client.1.smithi136.stdout:8/997: write d9/d18/d34/f3e [1307699,104499] 0 2024-09-18T12:51:22.022 INFO:tasks.workunit.client.1.smithi136.stdout:8/998: chown d9/d14/d1a/d2b/deb/d110/f10e 0 1 2024-09-18T12:51:22.023 INFO:tasks.workunit.client.1.smithi136.stdout:4/833: mknod d0/d8d/c10a 0 2024-09-18T12:51:22.023 INFO:tasks.workunit.client.1.smithi136.stdout:4/834: read d0/d3/d90/fe3 [104631,25026] 0 2024-09-18T12:51:22.024 INFO:tasks.workunit.client.0.smithi081.stdout:2/639: rename d15/d16/f18 to d15/d16/d20/d22/d5a/fea 0 2024-09-18T12:51:22.024 INFO:tasks.workunit.client.1.smithi136.stdout:9/876: dwrite d6/d96/dbb/fdf [0,4194304] 0 2024-09-18T12:51:22.025 INFO:tasks.workunit.client.1.smithi136.stdout:9/877: write d6/df/d23/d2b/d79/d53/d5c/fc8 [1413486,130543] 0 2024-09-18T12:51:22.025 INFO:tasks.workunit.client.1.smithi136.stdout:8/999: rename d9/d14/d1a/d2b/l3f to d9/d18/d34/d3d/d47/d65/l15f 0 2024-09-18T12:51:22.025 INFO:tasks.workunit.client.1.smithi136.stdout:4/835: symlink d0/d45/d67/ddf/l10b 0 2024-09-18T12:51:22.026 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:21 smithi136 ceph-mon[35363]: pgmap v283: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 307 MiB/s rd, 369 MiB/s wr, 508 op/s 2024-09-18T12:51:22.026 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:21 smithi136 ceph-mon[35363]: mgrmap e20: smithi081.pfnvgp(active, since 8m), standbys: smithi136.vdkrdt 2024-09-18T12:51:22.027 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:22.027 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:21 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:22.028 INFO:tasks.workunit.client.1.smithi136.stdout:1/921: mknod d2/d5/d9/c139 0 2024-09-18T12:51:22.033 INFO:tasks.workunit.client.1.smithi136.stdout:9/878: link d6/da/d3d/d4d/d91/faf d6/df/d23/f124 0 2024-09-18T12:51:22.034 INFO:tasks.workunit.client.1.smithi136.stdout:4/836: symlink d0/d45/d67/ddf/l10c 0 2024-09-18T12:51:22.037 INFO:tasks.workunit.client.0.smithi081.stdout:2/640: dwrite fd [4194304,4194304] 0 2024-09-18T12:51:22.038 INFO:tasks.workunit.client.1.smithi136.stdout:9/879: mkdir d6/df/d23/dae/d125 0 2024-09-18T12:51:22.038 INFO:tasks.workunit.client.1.smithi136.stdout:4/837: write d0/d3/d90/feb [559737,53968] 0 2024-09-18T12:51:22.041 INFO:tasks.workunit.client.1.smithi136.stdout:9/880: dread d6/df/d23/d2b/de5/feb [0,4194304] 0 2024-09-18T12:51:22.041 INFO:tasks.workunit.client.1.smithi136.stdout:9/881: chown d6/df/d23/d2b/d79/d8b/ldc 3894 1 2024-09-18T12:51:22.042 INFO:tasks.workunit.client.1.smithi136.stdout:9/882: chown d6/d13/l1b 403 1 2024-09-18T12:51:22.045 INFO:tasks.workunit.client.0.smithi081.stdout:2/641: dread d15/d26/f92 [0,4194304] 0 2024-09-18T12:51:22.055 INFO:tasks.workunit.client.1.smithi136.stdout:1/922: dwrite d2/f60 [0,4194304] 0 2024-09-18T12:51:22.055 INFO:tasks.workunit.client.1.smithi136.stdout:1/923: write d2/d5/d2b/da9/def/ff3 [2086444,94026] 0 2024-09-18T12:51:22.067 INFO:tasks.workunit.client.1.smithi136.stdout:9/883: dwrite d6/da/d3d/fff [0,4194304] 0 2024-09-18T12:51:22.067 INFO:tasks.workunit.client.1.smithi136.stdout:4/838: dwrite d0/d3/f3b [0,4194304] 0 2024-09-18T12:51:22.067 INFO:tasks.workunit.client.1.smithi136.stdout:4/839: write d0/d5f/faf [421914,3181] 0 2024-09-18T12:51:22.067 INFO:tasks.workunit.client.0.smithi081.stdout:2/642: dwrite d15/d16/d20/d22/d5a/f71 [0,4194304] 0 2024-09-18T12:51:22.069 INFO:tasks.workunit.client.1.smithi136.stdout:9/884: rename d6/db/d12/d62/f113 to d6/da/d3d/d4d/d91/d25/d55/f126 0 2024-09-18T12:51:22.071 INFO:tasks.workunit.client.1.smithi136.stdout:4/840: mknod d0/d3/d90/df8/c10d 0 2024-09-18T12:51:22.072 INFO:tasks.workunit.client.0.smithi081.stdout:2/643: dread d15/d16/d33/d53/d7a/fb5 [0,4194304] 0 2024-09-18T12:51:22.073 INFO:tasks.workunit.client.1.smithi136.stdout:1/924: dread d2/d5/d9/dcb/dfb/d107/d114/fc1 [0,4194304] 0 2024-09-18T12:51:22.081 INFO:tasks.workunit.client.1.smithi136.stdout:4/841: write d0/d3/f48 [1322627,83011] 0 2024-09-18T12:51:22.082 INFO:tasks.workunit.client.1.smithi136.stdout:4/842: write d0/d3/d54/d88/db1/fc6 [397806,123127] 0 2024-09-18T12:51:22.082 INFO:tasks.workunit.client.1.smithi136.stdout:4/843: fsync d0/d2/f28 0 2024-09-18T12:51:22.083 INFO:tasks.workunit.client.1.smithi136.stdout:4/844: link d0/l2b d0/d25/db7/l10e 0 2024-09-18T12:51:22.083 INFO:tasks.workunit.client.1.smithi136.stdout:4/845: getdents d0/d3/dfa 0 2024-09-18T12:51:22.084 INFO:tasks.workunit.client.1.smithi136.stdout:4/846: link d0/d3/l40 d0/d3/d54/l10f 0 2024-09-18T12:51:22.089 INFO:tasks.workunit.client.1.smithi136.stdout:1/925: dread d2/d5/d2b/d34/d5c/fe8 [0,4194304] 0 2024-09-18T12:51:22.089 INFO:tasks.workunit.client.1.smithi136.stdout:1/926: fdatasync d2/d5/d2b/d9b/f19 0 2024-09-18T12:51:22.089 INFO:tasks.workunit.client.1.smithi136.stdout:1/927: chown d2/dc4/ff2 0 1 2024-09-18T12:51:22.089 INFO:tasks.workunit.client.1.smithi136.stdout:4/847: rename d0/d3/dae/lf6 to d0/d25/l110 0 2024-09-18T12:51:22.089 INFO:tasks.workunit.client.1.smithi136.stdout:9/885: dwrite d6/df/d75/fec [0,4194304] 0 2024-09-18T12:51:22.091 INFO:tasks.workunit.client.1.smithi136.stdout:1/928: dread d2/d5/d2b/d34/d5c/ff7 [0,4194304] 0 2024-09-18T12:51:22.094 INFO:tasks.workunit.client.1.smithi136.stdout:1/929: symlink d2/d5/d2b/d34/d86/l13a 0 2024-09-18T12:51:22.105 INFO:tasks.workunit.client.1.smithi136.stdout:1/930: write d2/d5/d2b/d34/d86/fb8 [1874892,96964] 0 2024-09-18T12:51:22.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/886: dwrite d6/d59/f61 [0,4194304] 0 2024-09-18T12:51:22.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/887: stat d6/df/d75/dde 0 2024-09-18T12:51:22.106 INFO:tasks.workunit.client.1.smithi136.stdout:9/888: readlink d6/df/d23/d2b/l6e 0 2024-09-18T12:51:22.107 INFO:tasks.workunit.client.1.smithi136.stdout:1/931: mkdir d2/d5/d13b 0 2024-09-18T12:51:22.107 INFO:tasks.workunit.client.1.smithi136.stdout:1/932: chown d2/d5/d9/dcb/d10e 86 1 2024-09-18T12:51:22.107 INFO:tasks.workunit.client.1.smithi136.stdout:1/933: creat d2/d5/d2b/d9b/d2e/f13c x:0 0 0 2024-09-18T12:51:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:21 smithi081 ceph-mon[27646]: pgmap v283: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 307 MiB/s rd, 369 MiB/s wr, 508 op/s 2024-09-18T12:51:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:21 smithi081 ceph-mon[27646]: mgrmap e20: smithi081.pfnvgp(active, since 8m), standbys: smithi136.vdkrdt 2024-09-18T12:51:22.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:22.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:21 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:22.109 INFO:tasks.workunit.client.1.smithi136.stdout:4/848: dwrite d0/d3/f89 [4194304,4194304] 0 2024-09-18T12:51:22.126 INFO:tasks.workunit.client.1.smithi136.stdout:4/849: write d0/d3/d54/d88/f8f [2192512,115142] 0 2024-09-18T12:51:22.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/644: rename d15/d16/d20/d22/d5a/c9e to d15/d16/d33/d53/d7a/d2f/db3/ceb 0 2024-09-18T12:51:22.134 INFO:tasks.workunit.client.1.smithi136.stdout:9/889: dwrite d6/df/d23/fa1 [0,4194304] 0 2024-09-18T12:51:22.134 INFO:tasks.workunit.client.1.smithi136.stdout:1/934: dwrite d2/d5/d2b/d9b/d2e/d4c/f89 [0,4194304] 0 2024-09-18T12:51:22.135 INFO:tasks.workunit.client.0.smithi081.stdout:2/645: rename d15/d16/d33/d53/d7a/d2f/db3/f83 to d15/d16/d33/d53/db0/fec 0 2024-09-18T12:51:22.136 INFO:tasks.workunit.client.0.smithi081.stdout:2/646: mkdir d15/d16/ded 0 2024-09-18T12:51:22.136 INFO:tasks.workunit.client.0.smithi081.stdout:2/647: write d15/d16/d33/d53/d7a/d2f/dc2/fd2 [580325,23633] 0 2024-09-18T12:51:22.137 INFO:tasks.workunit.client.1.smithi136.stdout:9/890: rename d6/d59/f68 to d6/da/d3d/d4d/d91/d38/f127 0 2024-09-18T12:51:22.137 INFO:tasks.workunit.client.1.smithi136.stdout:9/891: truncate d6/df/d23/d2b/fa6 1278728 0 2024-09-18T12:51:22.145 INFO:tasks.workunit.client.1.smithi136.stdout:9/892: write d6/df/d75/fec [2214333,13579] 0 2024-09-18T12:51:22.145 INFO:tasks.workunit.client.1.smithi136.stdout:9/893: chown d6/d59/cf1 366182 1 2024-09-18T12:51:22.145 INFO:tasks.workunit.client.1.smithi136.stdout:9/894: truncate d6/df/dd3/f122 794236 0 2024-09-18T12:51:22.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/648: rename d15/d16/d33/d53/d7a/d32 to d15/d16/d33/d53/d7a/dee 0 2024-09-18T12:51:22.149 INFO:tasks.workunit.client.1.smithi136.stdout:4/850: dwrite d0/d13/fcc [0,4194304] 0 2024-09-18T12:51:22.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/649: rename d15/d16/d33/d53/d7a/d2f/db3 to d15/d16/def 0 2024-09-18T12:51:22.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/650: stat d15/d16/d33/d53/d7a/f63 0 2024-09-18T12:51:22.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/651: creat d15/d16/d20/d22/ff0 x:0 0 0 2024-09-18T12:51:22.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/652: dread - d15/fe0 zero size 2024-09-18T12:51:22.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/653: write d15/d16/d33/d53/d7a/d2f/dc2/fd2 [430788,122090] 0 2024-09-18T12:51:22.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/654: chown d15/d16/d20/d22/d5a/f74 51192986 1 2024-09-18T12:51:22.158 INFO:tasks.workunit.client.1.smithi136.stdout:1/935: dwrite d2/d5/d2b/d9b/f19 [0,4194304] 0 2024-09-18T12:51:22.163 INFO:tasks.workunit.client.1.smithi136.stdout:4/851: dwrite d0/f82 [0,4194304] 0 2024-09-18T12:51:22.176 INFO:tasks.workunit.client.1.smithi136.stdout:1/936: dwrite d2/fe5 [0,4194304] 0 2024-09-18T12:51:22.177 INFO:tasks.workunit.client.1.smithi136.stdout:4/852: dwrite d0/d3/d54/d5c/f101 [0,4194304] 0 2024-09-18T12:51:22.177 INFO:tasks.workunit.client.1.smithi136.stdout:4/853: write d0/d2/f28 [4968507,122883] 0 2024-09-18T12:51:22.177 INFO:tasks.workunit.client.1.smithi136.stdout:4/854: chown d0/c2f 41231 1 2024-09-18T12:51:22.178 INFO:tasks.workunit.client.1.smithi136.stdout:1/937: mkdir d2/d5/d9/dcb/d13d 0 2024-09-18T12:51:22.180 INFO:tasks.workunit.client.1.smithi136.stdout:4/855: mkdir d0/d3/d54/d88/d111 0 2024-09-18T12:51:22.180 INFO:tasks.workunit.client.1.smithi136.stdout:4/856: creat d0/d2/d85/f112 x:0 0 0 2024-09-18T12:51:22.180 INFO:tasks.workunit.client.1.smithi136.stdout:1/938: mknod d2/d5/d2b/d34/d5c/c13e 0 2024-09-18T12:51:22.182 INFO:tasks.workunit.client.1.smithi136.stdout:1/939: dread d2/fb3 [0,4194304] 0 2024-09-18T12:51:22.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.184+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3c104e70 con 0x7efe24077e50 2024-09-18T12:51:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.194+0000 7efe2b7fe700 1 -- 172.21.15.81:0/1019139134 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7efe3c104e70 con 0x7efe24077e50 2024-09-18T12:51:22.195 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:51:22.195 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (6m) 2m ago 8m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:51:22.195 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (9m) 2m ago 9m 7532k - 18.2.1 5be31c24972a 2dd4371065e4 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (8m) 2s ago 8m 7474k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (9m) 2m ago 9m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (8m) 2s ago 8m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 2m ago 8m 83.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (2m) 2m ago 2m 18.3M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (2m) 2m ago 2m 16.6M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (2m) 2s ago 2m 16.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (2m) 2s ago 2m 12.7M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (10m) 2m ago 10m 488M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (12s) 2s ago 7m 90.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1a0b20067729 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (10m) 2m ago 10m 47.0M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (7m) 2s ago 7m 38.8M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:51:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 2m ago 8m 16.3M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (7m) 2s ago 7m 15.0M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 2m ago 6m 49.6M 3946M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 2m ago 5m 48.5M 3946M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 2m ago 5m 48.8M 3946M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (5m) 2s ago 5m 244M 4970M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (4m) 2s ago 4m 192M 4970M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (4m) 2s ago 4m 243M 4970M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:51:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 2m ago 8m 59.0M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 msgr2=0x7efe2407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 0x7efe2407a310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe30005e20 tx=0x7efe300058e0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 msgr2=0x7efe3c1965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b480 tx=0x7efe2c00b790 comp rx=0 tx=0).stop 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 shutdown_connections 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7efe24077e50 0x7efe2407a310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c0ff320 0x7efe3c1965e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 --2- 172.21.15.81:0/1019139134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe3c100520 0x7efe3c196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 >> 172.21.15.81:0/1019139134 conn(0x7efe3c0fa8c0 msgr2=0x7efe3c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:22.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 shutdown_connections 2024-09-18T12:51:22.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.196+0000 7efe4099e700 1 -- 172.21.15.81:0/1019139134 wait complete. 2024-09-18T12:51:22.223 INFO:tasks.workunit.client.0.smithi081.stdout:3/531: sync 2024-09-18T12:51:22.224 INFO:tasks.workunit.client.0.smithi081.stdout:3/532: mkdir d3/db/df/d3b/dc0 0 2024-09-18T12:51:22.224 INFO:tasks.workunit.client.0.smithi081.stdout:3/533: stat d3/db/df/d29/d13/d9d 0 2024-09-18T12:51:22.225 INFO:tasks.workunit.client.0.smithi081.stdout:3/534: mknod d3/db/df/d60/cc1 0 2024-09-18T12:51:22.225 INFO:tasks.workunit.client.0.smithi081.stdout:3/535: write d3/db/df/d29/d13/f1e [4180350,49851] 0 2024-09-18T12:51:22.238 INFO:tasks.workunit.client.0.smithi081.stdout:3/536: dwrite d3/db/df/d29/d13/f4c [0,4194304] 0 2024-09-18T12:51:22.238 INFO:tasks.workunit.client.0.smithi081.stdout:3/537: write d3/db/df/da8/fa9 [216440,52001] 0 2024-09-18T12:51:22.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/538: mkdir d3/db/da4/dc2 0 2024-09-18T12:51:22.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/539: write d3/db/df/d29/d12/d44/d6f/f7c [7777272,80446] 0 2024-09-18T12:51:22.256 INFO:tasks.workunit.client.0.smithi081.stdout:3/540: dwrite d3/db/df/d29/d13/d9d/fb6 [0,4194304] 0 2024-09-18T12:51:22.281 INFO:tasks.workunit.client.0.smithi081.stdout:3/541: dwrite d3/f46 [0,4194304] 0 2024-09-18T12:51:22.281 INFO:tasks.workunit.client.0.smithi081.stdout:3/542: truncate d3/db/df/d29/d12/f92 890928 0 2024-09-18T12:51:22.282 INFO:tasks.workunit.client.0.smithi081.stdout:3/543: mkdir d3/db/dc/dc3 0 2024-09-18T12:51:22.282 INFO:tasks.workunit.client.0.smithi081.stdout:3/544: creat d3/db/df/d29/d12/d44/d76/fc4 x:0 0 0 2024-09-18T12:51:22.291 INFO:tasks.workunit.client.0.smithi081.stdout:3/545: write d3/d23/f79 [139635,18970] 0 2024-09-18T12:51:22.292 INFO:tasks.workunit.client.1.smithi136.stdout:3/907: sync 2024-09-18T12:51:22.292 INFO:tasks.workunit.client.1.smithi136.stdout:6/944: sync 2024-09-18T12:51:22.292 INFO:tasks.workunit.client.1.smithi136.stdout:3/908: chown d3/d2b/fba 53803501 1 2024-09-18T12:51:22.292 INFO:tasks.workunit.client.1.smithi136.stdout:3/909: chown d3/d14/dc5/fad 0 1 2024-09-18T12:51:22.296 INFO:tasks.workunit.client.0.smithi081.stdout:3/546: unlink d3/db/df/d29/d12/d44/d51/ca0 0 2024-09-18T12:51:22.296 INFO:tasks.workunit.client.0.smithi081.stdout:3/547: chown d3/db/df/da8/fba 766 1 2024-09-18T12:51:22.296 INFO:tasks.workunit.client.0.smithi081.stdout:3/548: write d3/db/d1b/f94 [474873,125526] 0 2024-09-18T12:51:22.297 INFO:tasks.workunit.client.1.smithi136.stdout:6/945: rename d8/d9/de/d1c/d50/cd0 to d8/d9d/d9f/c131 0 2024-09-18T12:51:22.297 INFO:tasks.workunit.client.1.smithi136.stdout:3/910: dread d3/d5/f35 [0,4194304] 0 2024-09-18T12:51:22.297 INFO:tasks.workunit.client.1.smithi136.stdout:6/946: symlink d8/daa/l132 0 2024-09-18T12:51:22.298 INFO:tasks.workunit.client.1.smithi136.stdout:6/947: mkdir d8/d9d/dfd/d133 0 2024-09-18T12:51:22.298 INFO:tasks.workunit.client.1.smithi136.stdout:6/948: truncate d8/d9/d3c/fa2 1553403 0 2024-09-18T12:51:22.298 INFO:tasks.workunit.client.1.smithi136.stdout:6/949: getdents d8/d9d/d9f/d105 0 2024-09-18T12:51:22.298 INFO:tasks.workunit.client.0.smithi081.stdout:3/549: mkdir d3/db/da4/dc2/dc5 0 2024-09-18T12:51:22.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/950: dread d8/d9/de/d1c/f5f [0,4194304] 0 2024-09-18T12:51:22.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/951: dread - d8/d9/d64/f82 zero size 2024-09-18T12:51:22.300 INFO:tasks.workunit.client.1.smithi136.stdout:6/952: fdatasync f5 0 2024-09-18T12:51:22.301 INFO:tasks.workunit.client.1.smithi136.stdout:6/953: dread - d8/d9d/db4/ff6 zero size 2024-09-18T12:51:22.302 INFO:tasks.workunit.client.1.smithi136.stdout:6/954: mknod d8/d9d/d9f/d122/dff/d103/c134 0 2024-09-18T12:51:22.304 INFO:tasks.workunit.client.1.smithi136.stdout:6/955: mknod d8/d9/d56/d96/d9c/ded/c135 0 2024-09-18T12:51:22.310 INFO:tasks.workunit.client.0.smithi081.stdout:3/550: write d3/db/df/d29/d12/d44/f62 [1376323,13632] 0 2024-09-18T12:51:22.310 INFO:tasks.workunit.client.0.smithi081.stdout:3/551: write d3/db/df/d29/d12/d44/d76/fc4 [665888,107042] 0 2024-09-18T12:51:22.311 INFO:tasks.workunit.client.0.smithi081.stdout:3/552: link d3/db/df/d29/d13/d9d/fb6 d3/db/df/fc6 0 2024-09-18T12:51:22.312 INFO:tasks.workunit.client.1.smithi136.stdout:6/956: write d8/d9/de/d1c/db9/fc3 [3053352,86027] 0 2024-09-18T12:51:22.312 INFO:tasks.workunit.client.1.smithi136.stdout:3/911: dwrite d3/d14/d17/d53/fb3 [0,4194304] 0 2024-09-18T12:51:22.312 INFO:tasks.workunit.client.1.smithi136.stdout:3/912: truncate d3/d14/d17/d53/d73/fcc 721827 0 2024-09-18T12:51:22.313 INFO:tasks.workunit.client.0.smithi081.stdout:3/553: creat d3/fc7 x:0 0 0 2024-09-18T12:51:22.313 INFO:tasks.workunit.client.0.smithi081.stdout:3/554: fdatasync d3/db/df/d29/d13/f2b 0 2024-09-18T12:51:22.315 INFO:tasks.workunit.client.1.smithi136.stdout:3/913: dread d3/d5/d102/fd1 [0,4194304] 0 2024-09-18T12:51:22.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/555: rename d3/db/df/d29/d12/l25 to d3/db/dc/d1a/lc8 0 2024-09-18T12:51:22.317 INFO:tasks.workunit.client.0.smithi081.stdout:3/556: rename d3/d23/f97 to d3/db/df/d29/d13/fc9 0 2024-09-18T12:51:22.317 INFO:tasks.workunit.client.0.smithi081.stdout:3/557: chown d3 2444225 1 2024-09-18T12:51:22.317 INFO:tasks.workunit.client.1.smithi136.stdout:3/914: dread d3/d14/d22/f37 [4194304,4194304] 0 2024-09-18T12:51:22.318 INFO:tasks.workunit.client.1.smithi136.stdout:3/915: symlink d3/d14/d18/l124 0 2024-09-18T12:51:22.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/558: creat d3/db/df/d29/d13/d93/fca x:0 0 0 2024-09-18T12:51:22.319 INFO:tasks.workunit.client.0.smithi081.stdout:3/559: write d3/db/df/d29/d13/f61 [300176,56892] 0 2024-09-18T12:51:22.320 INFO:tasks.workunit.client.0.smithi081.stdout:3/560: mkdir d3/db/d1b/dcb 0 2024-09-18T12:51:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 -- 172.21.15.81:0/3588751612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f88101180 msgr2=0x7f6f881015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/3588751612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f88101180 0x7f6f881015a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009910 tx=0x7f6f7c009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 -- 172.21.15.81:0/3588751612 shutdown_connections 2024-09-18T12:51:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/3588751612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f880ffe30 0x7f6f88100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/3588751612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f88101180 0x7f6f881015a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 -- 172.21.15.81:0/3588751612 >> 172.21.15.81:0/3588751612 conn(0x7f6f880fa8c0 msgr2=0x7f6f880fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 -- 172.21.15.81:0/3588751612 shutdown_connections 2024-09-18T12:51:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.320+0000 7f6f8eb38700 1 -- 172.21.15.81:0/3588751612 wait complete. 2024-09-18T12:51:22.323 INFO:tasks.workunit.client.0.smithi081.stdout:3/561: rmdir d3/db/dc/dc3 0 2024-09-18T12:51:22.323 INFO:tasks.workunit.client.0.smithi081.stdout:3/562: stat d3/db/c4f 0 2024-09-18T12:51:22.323 INFO:tasks.workunit.client.0.smithi081.stdout:3/563: write d3/db/dc/f28 [3459426,120604] 0 2024-09-18T12:51:22.324 INFO:tasks.workunit.client.0.smithi081.stdout:3/564: read - d3/db/df/da8/fba zero size 2024-09-18T12:51:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 Processor -- start 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 -- start start 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 0x7f6f88198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88199280 con 0x7f6f880ffe30 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8eb38700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f881993c0 con 0x7f6f88101180 2024-09-18T12:51:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8c8d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8c8d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47094/0 (socket says 172.21.15.81:47094) 2024-09-18T12:51:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f8c8d4700 1 -- 172.21.15.81:0/87582084 learned_addr learned my addr 172.21.15.81:0/87582084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.321+0000 7f6f87fff700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 0x7f6f88198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.327 INFO:tasks.workunit.client.0.smithi081.stdout:3/565: mkdir d3/db/df/d29/d12/dcc 0 2024-09-18T12:51:22.328 INFO:tasks.workunit.client.1.smithi136.stdout:6/957: dwrite d8/dcf/fd1 [0,4194304] 0 2024-09-18T12:51:22.329 INFO:tasks.workunit.client.1.smithi136.stdout:6/958: write d8/d9/d64/f82 [952844,42198] 0 2024-09-18T12:51:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f87fff700 1 -- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 msgr2=0x7f6f88198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f87fff700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f87fff700 1 -- 172.21.15.81:0/87582084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0095f0 con 0x7f6f88101180 2024-09-18T12:51:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f8c8d4700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:51:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f87fff700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 0x7f6f88198c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e970 tx=0x7f6f7400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7400c9d0 con 0x7f6f88101180 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f74004030 con 0x7f6f88101180 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f74005020 con 0x7f6f88101180 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.322+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8819de70 con 0x7f6f88101180 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.323+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8819e390 con 0x7f6f88101180 2024-09-18T12:51:22.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.323+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f88107610 con 0x7f6f88101180 2024-09-18T12:51:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.325+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f6f7400cb30 con 0x7f6f88101180 2024-09-18T12:51:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.325+0000 7f6f85ffb700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 0x7f6f78075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.325+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6f74014070 con 0x7f6f88101180 2024-09-18T12:51:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.326+0000 7f6f8c8d4700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 0x7f6f78075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.326+0000 7f6f8c8d4700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 0x7f6f78075f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00b6f0 tx=0x7f6f7c005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.333+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6f74062e50 con 0x7f6f88101180 2024-09-18T12:51:22.352 INFO:tasks.workunit.client.0.smithi081.stdout:3/566: dwrite d3/db/dc/f73 [0,4194304] 0 2024-09-18T12:51:22.352 INFO:tasks.workunit.client.1.smithi136.stdout:6/959: dwrite d8/d9/d3c/f7a [0,4194304] 0 2024-09-18T12:51:22.353 INFO:tasks.workunit.client.1.smithi136.stdout:6/960: chown d8/d9/de/d1c/d50/da8/df2/ffa 676400649 1 2024-09-18T12:51:22.355 INFO:tasks.workunit.client.1.smithi136.stdout:6/961: truncate d8/d9/d56/f7e 2181157 0 2024-09-18T12:51:22.358 INFO:tasks.workunit.client.1.smithi136.stdout:6/962: mkdir d8/d9/de/d60/d71/d76/d97/d136 0 2024-09-18T12:51:22.359 INFO:tasks.workunit.client.1.smithi136.stdout:1/940: sync 2024-09-18T12:51:22.359 INFO:tasks.workunit.client.1.smithi136.stdout:4/857: sync 2024-09-18T12:51:22.359 INFO:tasks.workunit.client.1.smithi136.stdout:9/895: sync 2024-09-18T12:51:22.361 INFO:tasks.workunit.client.1.smithi136.stdout:4/858: mkdir d0/d25/db7/d113 0 2024-09-18T12:51:22.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/859: write d0/d5f/faf [1175177,129697] 0 2024-09-18T12:51:22.362 INFO:tasks.workunit.client.1.smithi136.stdout:4/860: write d0/ff5 [497911,14182] 0 2024-09-18T12:51:22.363 INFO:tasks.workunit.client.1.smithi136.stdout:1/941: mkdir d2/d5/d2b/d9b/d2e/d13f 0 2024-09-18T12:51:22.363 INFO:tasks.workunit.client.1.smithi136.stdout:9/896: creat d6/df/d23/d2b/d79/d119/d123/f128 x:0 0 0 2024-09-18T12:51:22.364 INFO:tasks.workunit.client.1.smithi136.stdout:4/861: symlink d0/dd7/l114 0 2024-09-18T12:51:22.364 INFO:tasks.workunit.client.1.smithi136.stdout:1/942: mkdir d2/d5/d2b/d34/d86/d135/d140 0 2024-09-18T12:51:22.365 INFO:tasks.workunit.client.1.smithi136.stdout:4/862: mkdir d0/d45/d115 0 2024-09-18T12:51:22.367 INFO:tasks.workunit.client.1.smithi136.stdout:4/863: link d0/d25/l30 d0/dd7/l116 0 2024-09-18T12:51:22.368 INFO:tasks.workunit.client.1.smithi136.stdout:4/864: truncate d0/d3/d54/d5c/fe4 1023914 0 2024-09-18T12:51:22.369 INFO:tasks.workunit.client.1.smithi136.stdout:4/865: dread d0/d13/f86 [0,4194304] 0 2024-09-18T12:51:22.370 INFO:tasks.workunit.client.1.smithi136.stdout:4/866: getdents d0/d25/db7/d113 0 2024-09-18T12:51:22.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/567: dwrite d3/db/f56 [0,4194304] 0 2024-09-18T12:51:22.376 INFO:tasks.workunit.client.1.smithi136.stdout:1/943: dread d2/d5/d2b/d9b/d1b/f77 [0,4194304] 0 2024-09-18T12:51:22.377 INFO:tasks.workunit.client.0.smithi081.stdout:3/568: mknod d3/db/d1b/ccd 0 2024-09-18T12:51:22.381 INFO:tasks.workunit.client.1.smithi136.stdout:4/867: write d0/d3/f89 [299404,82727] 0 2024-09-18T12:51:22.381 INFO:tasks.workunit.client.1.smithi136.stdout:4/868: readlink d0/d25/lec 0 2024-09-18T12:51:22.382 INFO:tasks.workunit.client.0.smithi081.stdout:0/543: sync 2024-09-18T12:51:22.383 INFO:tasks.workunit.client.0.smithi081.stdout:0/544: symlink d7/d9/d4b/d33/db1/lb3 0 2024-09-18T12:51:22.384 INFO:tasks.workunit.client.0.smithi081.stdout:0/545: mknod d7/d9/cb4 0 2024-09-18T12:51:22.386 INFO:tasks.workunit.client.0.smithi081.stdout:0/546: symlink d7/d9/d4b/d3d/lb5 0 2024-09-18T12:51:22.386 INFO:tasks.workunit.client.1.smithi136.stdout:6/963: dwrite d8/d9/de/d1c/db9/fc3 [0,4194304] 0 2024-09-18T12:51:22.386 INFO:tasks.workunit.client.1.smithi136.stdout:9/897: dwrite d6/df/d23/f106 [0,4194304] 0 2024-09-18T12:51:22.387 INFO:tasks.workunit.client.0.smithi081.stdout:0/547: mknod d7/d9/d4b/d33/cb6 0 2024-09-18T12:51:22.388 INFO:tasks.workunit.client.0.smithi081.stdout:3/569: dread d3/db/df/d29/d12/d44/d51/fa7 [0,4194304] 0 2024-09-18T12:51:22.389 INFO:tasks.workunit.client.0.smithi081.stdout:3/570: rename d3/db/d1b/d57/f49 to d3/db/d1b/d57/fce 0 2024-09-18T12:51:22.391 INFO:tasks.workunit.client.0.smithi081.stdout:3/571: creat d3/db/da4/dc2/fcf x:0 0 0 2024-09-18T12:51:22.391 INFO:tasks.workunit.client.0.smithi081.stdout:3/572: fsync d3/f80 0 2024-09-18T12:51:22.397 INFO:tasks.workunit.client.1.smithi136.stdout:9/898: truncate d6/da/d3d/d4d/d91/d38/f127 4347675 0 2024-09-18T12:51:22.399 INFO:tasks.workunit.client.1.smithi136.stdout:9/899: mknod d6/df/d23/d2b/d79/d53/d5c/c129 0 2024-09-18T12:51:22.399 INFO:tasks.workunit.client.1.smithi136.stdout:9/900: write d6/da/ff2 [1190911,80470] 0 2024-09-18T12:51:22.399 INFO:tasks.workunit.client.1.smithi136.stdout:4/869: dwrite d0/d45/d67/d7b/fe9 [0,4194304] 0 2024-09-18T12:51:22.399 INFO:tasks.workunit.client.1.smithi136.stdout:4/870: creat d0/d3/d54/f117 x:0 0 0 2024-09-18T12:51:22.401 INFO:tasks.workunit.client.1.smithi136.stdout:9/901: unlink d6/d59/f2a 0 2024-09-18T12:51:22.403 INFO:tasks.workunit.client.1.smithi136.stdout:4/871: symlink d0/d45/d115/l118 0 2024-09-18T12:51:22.408 INFO:tasks.workunit.client.1.smithi136.stdout:6/964: dwrite d8/d9/de/f40 [0,4194304] 0 2024-09-18T12:51:22.409 INFO:tasks.workunit.client.1.smithi136.stdout:6/965: mkdir d8/d9/de/d60/d71/d7f/d137 0 2024-09-18T12:51:22.409 INFO:tasks.workunit.client.1.smithi136.stdout:6/966: write d8/d9/de/d1c/fdc [509561,90945] 0 2024-09-18T12:51:22.411 INFO:tasks.workunit.client.1.smithi136.stdout:6/967: mknod d8/d9d/d9f/c138 0 2024-09-18T12:51:22.411 INFO:tasks.workunit.client.1.smithi136.stdout:9/902: write d6/d59/f35 [2950598,57302] 0 2024-09-18T12:51:22.411 INFO:tasks.workunit.client.0.smithi081.stdout:3/573: dwrite d3/d84/fab [0,4194304] 0 2024-09-18T12:51:22.412 INFO:tasks.workunit.client.0.smithi081.stdout:3/574: chown d3/db/df/d29/l4d 3900 1 2024-09-18T12:51:22.412 INFO:tasks.workunit.client.0.smithi081.stdout:3/575: write d3/db/df/d29/f19 [3312798,49306] 0 2024-09-18T12:51:22.416 INFO:tasks.workunit.client.0.smithi081.stdout:3/576: rename d3/l21 to d3/db/df/d29/ld0 0 2024-09-18T12:51:22.417 INFO:tasks.workunit.client.1.smithi136.stdout:4/872: dread d0/d5f/f75 [0,4194304] 0 2024-09-18T12:51:22.426 INFO:tasks.workunit.client.1.smithi136.stdout:9/903: dwrite d6/da/fba [0,4194304] 0 2024-09-18T12:51:22.427 INFO:tasks.workunit.client.0.smithi081.stdout:3/577: dread d3/f4e [0,4194304] 0 2024-09-18T12:51:22.430 INFO:tasks.workunit.client.1.smithi136.stdout:4/873: dread d0/d45/f63 [0,4194304] 0 2024-09-18T12:51:22.434 INFO:tasks.workunit.client.1.smithi136.stdout:9/904: dread d6/da/d3d/d4d/d91/d25/d55/f8d [0,4194304] 0 2024-09-18T12:51:22.435 INFO:tasks.workunit.client.1.smithi136.stdout:9/905: symlink d6/da/dd1/l12a 0 2024-09-18T12:51:22.447 INFO:tasks.workunit.client.0.smithi081.stdout:3/578: dwrite d3/db/df/d29/d12/d44/d6f/f7c [8388608,4194304] 0 2024-09-18T12:51:22.447 INFO:tasks.workunit.client.0.smithi081.stdout:3/579: write d3/db/df/d29/f19 [4518916,32955] 0 2024-09-18T12:51:22.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/580: rmdir d3/db/df/d60 39 2024-09-18T12:51:22.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/581: creat d3/db/d1b/fd1 x:0 0 0 2024-09-18T12:51:22.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/582: truncate d3/db/d1b/f43 152236 0 2024-09-18T12:51:22.448 INFO:tasks.workunit.client.0.smithi081.stdout:3/583: chown d3/db/df/d29/d12/l9b 1841 1 2024-09-18T12:51:22.451 INFO:tasks.workunit.client.1.smithi136.stdout:4/874: dwrite d0/d3/f89 [0,4194304] 0 2024-09-18T12:51:22.455 INFO:tasks.workunit.client.1.smithi136.stdout:4/875: link d0/cb d0/d5f/c119 0 2024-09-18T12:51:22.455 INFO:tasks.workunit.client.1.smithi136.stdout:4/876: write d0/d3/d54/fe8 [217055,83929] 0 2024-09-18T12:51:22.455 INFO:tasks.workunit.client.1.smithi136.stdout:4/877: chown d0/d3/d54/dba/le2 3430 1 2024-09-18T12:51:22.455 INFO:tasks.workunit.client.1.smithi136.stdout:4/878: chown d0/d25/d79/l94 7 1 2024-09-18T12:51:22.455 INFO:tasks.workunit.client.1.smithi136.stdout:4/879: creat d0/d3/d54/d8a/f11a x:0 0 0 2024-09-18T12:51:22.457 INFO:tasks.workunit.client.1.smithi136.stdout:4/880: getdents d0/d3 0 2024-09-18T12:51:22.458 INFO:tasks.workunit.client.1.smithi136.stdout:4/881: creat d0/d3/d90/df8/f11b x:0 0 0 2024-09-18T12:51:22.461 INFO:tasks.workunit.client.1.smithi136.stdout:3/916: sync 2024-09-18T12:51:22.461 INFO:tasks.workunit.client.1.smithi136.stdout:3/917: dread - d3/d14/dc5/fad zero size 2024-09-18T12:51:22.462 INFO:tasks.workunit.client.1.smithi136.stdout:3/918: creat d3/d14/d17/d75/d86/f125 x:0 0 0 2024-09-18T12:51:22.467 INFO:tasks.workunit.client.1.smithi136.stdout:4/882: write d0/d3/f89 [4291590,13183] 0 2024-09-18T12:51:22.471 INFO:tasks.workunit.client.1.smithi136.stdout:9/906: dwrite d6/df/d23/d2b/fcc [0,4194304] 0 2024-09-18T12:51:22.472 INFO:tasks.workunit.client.0.smithi081.stdout:3/584: dwrite d3/db/df/da8/fa9 [0,4194304] 0 2024-09-18T12:51:22.475 INFO:tasks.workunit.client.1.smithi136.stdout:9/907: rmdir d6/d13/d4c/d10e 0 2024-09-18T12:51:22.478 INFO:tasks.workunit.client.0.smithi081.stdout:3/585: rename d3/db/f8a to d3/db/df/d60/fd2 0 2024-09-18T12:51:22.478 INFO:tasks.workunit.client.0.smithi081.stdout:3/586: truncate d3/db/d1b/fd1 208837 0 2024-09-18T12:51:22.485 INFO:tasks.workunit.client.1.smithi136.stdout:9/908: write d6/df/d23/d10f/f117 [3601800,58019] 0 2024-09-18T12:51:22.495 INFO:tasks.workunit.client.1.smithi136.stdout:4/883: dwrite d0/d25/fd6 [0,4194304] 0 2024-09-18T12:51:22.496 INFO:tasks.workunit.client.0.smithi081.stdout:3/587: dwrite d3/db/df/d29/d12/d44/d51/fa2 [4194304,4194304] 0 2024-09-18T12:51:22.497 INFO:tasks.workunit.client.1.smithi136.stdout:4/884: rename d0/d3/d90/df8/c10d to d0/d3/d54/dba/c11c 0 2024-09-18T12:51:22.502 INFO:tasks.workunit.client.1.smithi136.stdout:4/885: rmdir d0/d3 39 2024-09-18T12:51:22.502 INFO:tasks.workunit.client.1.smithi136.stdout:4/886: fsync d0/f4a 0 2024-09-18T12:51:22.502 INFO:tasks.workunit.client.1.smithi136.stdout:4/887: readlink d0/d3/d54/d5c/l5d 0 2024-09-18T12:51:22.502 INFO:tasks.workunit.client.1.smithi136.stdout:4/888: unlink d0/d3/d54/l61 0 2024-09-18T12:51:22.503 INFO:tasks.workunit.client.1.smithi136.stdout:4/889: read d0/d2/f77 [588279,5203] 0 2024-09-18T12:51:22.505 INFO:tasks.workunit.client.1.smithi136.stdout:4/890: unlink d0/d3/dae/fe1 0 2024-09-18T12:51:22.505 INFO:tasks.workunit.client.1.smithi136.stdout:4/891: write d0/d25/f39 [2634773,76212] 0 2024-09-18T12:51:22.505 INFO:tasks.workunit.client.1.smithi136.stdout:4/892: mkdir d0/d25/d79/d11d 0 2024-09-18T12:51:22.505 INFO:tasks.workunit.client.1.smithi136.stdout:4/893: symlink d0/d5f/dd3/l11e 0 2024-09-18T12:51:22.506 INFO:tasks.workunit.client.0.smithi081.stdout:3/588: rmdir d3/d23 39 2024-09-18T12:51:22.506 INFO:tasks.workunit.client.0.smithi081.stdout:3/589: symlink d3/db/da4/dc2/dc5/ld3 0 2024-09-18T12:51:22.506 INFO:tasks.workunit.client.0.smithi081.stdout:3/590: truncate d3/db/df/d60/fd2 1264447 0 2024-09-18T12:51:22.506 INFO:tasks.workunit.client.0.smithi081.stdout:3/591: mkdir d3/db/df/d29/d13/d9d/dd4 0 2024-09-18T12:51:22.507 INFO:tasks.workunit.client.0.smithi081.stdout:3/592: write d3/db/df/d29/d12/d44/d76/f8c [156089,85780] 0 2024-09-18T12:51:22.507 INFO:tasks.workunit.client.0.smithi081.stdout:3/593: chown d3/db/d1b/d57/c1c 42 1 2024-09-18T12:51:22.507 INFO:tasks.workunit.client.0.smithi081.stdout:7/521: sync 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.0.smithi081.stdout:1/602: sync 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.0.smithi081.stdout:6/484: sync 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.1.smithi136.stdout:4/894: rmdir d0/d45/d115 39 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.1.smithi136.stdout:4/895: rmdir d0/d3/d54/d5c 39 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.1.smithi136.stdout:4/896: read d0/d3/d54/d88/f8f [144420,27898] 0 2024-09-18T12:51:22.508 INFO:tasks.workunit.client.1.smithi136.stdout:4/897: creat d0/d2/f11f x:0 0 0 2024-09-18T12:51:22.509 INFO:tasks.workunit.client.1.smithi136.stdout:4/898: mkdir d0/d120 0 2024-09-18T12:51:22.510 INFO:tasks.workunit.client.0.smithi081.stdout:1/603: mkdir d0/d6/d33/d42/dcf 0 2024-09-18T12:51:22.511 INFO:tasks.workunit.client.0.smithi081.stdout:6/485: mkdir d4/d12/d1c/d8f/da0 0 2024-09-18T12:51:22.511 INFO:tasks.workunit.client.0.smithi081.stdout:6/486: stat d4/d12/d28/f4e 0 2024-09-18T12:51:22.512 INFO:tasks.workunit.client.1.smithi136.stdout:4/899: symlink d0/l121 0 2024-09-18T12:51:22.512 INFO:tasks.workunit.client.1.smithi136.stdout:9/909: dwrite d6/da/d3d/d4d/d91/d25/f71 [0,4194304] 0 2024-09-18T12:51:22.513 INFO:tasks.workunit.client.0.smithi081.stdout:7/522: mkdir d2/d18/d22/d48/db9 0 2024-09-18T12:51:22.513 INFO:tasks.workunit.client.1.smithi136.stdout:9/910: symlink d6/d13/d4c/l12b 0 2024-09-18T12:51:22.514 INFO:tasks.workunit.client.0.smithi081.stdout:1/604: truncate d0/d6/d7/d2e/fc2 467360 0 2024-09-18T12:51:22.516 INFO:tasks.workunit.client.0.smithi081.stdout:3/594: dwrite d3/db/dc/d1a/fb5 [0,4194304] 0 2024-09-18T12:51:22.517 INFO:tasks.workunit.client.0.smithi081.stdout:6/487: rename d4/fe to d4/d12/d28/d2a/d74/d8b/fa1 0 2024-09-18T12:51:22.517 INFO:tasks.workunit.client.0.smithi081.stdout:6/488: readlink d4/d6/l33 0 2024-09-18T12:51:22.517 INFO:tasks.workunit.client.0.smithi081.stdout:6/489: fsync d4/d6/f85 0 2024-09-18T12:51:22.517 INFO:tasks.workunit.client.0.smithi081.stdout:6/490: chown d4/d12/d1c/l4c 127863 1 2024-09-18T12:51:22.517 INFO:tasks.workunit.client.0.smithi081.stdout:6/491: write d4/fa [1828659,93357] 0 2024-09-18T12:51:22.518 INFO:tasks.workunit.client.0.smithi081.stdout:7/523: creat d2/d56/d73/da4/fba x:0 0 0 2024-09-18T12:51:22.523 INFO:tasks.workunit.client.0.smithi081.stdout:3/595: rmdir d3/db/d1b/dcb 0 2024-09-18T12:51:22.524 INFO:tasks.workunit.client.0.smithi081.stdout:3/596: dread - d3/db/df/d29/d13/f8f zero size 2024-09-18T12:51:22.524 INFO:tasks.workunit.client.1.smithi136.stdout:4/900: dwrite d0/d5f/f75 [4194304,4194304] 0 2024-09-18T12:51:22.525 INFO:tasks.workunit.client.1.smithi136.stdout:4/901: dread - d0/d3/d54/d5c/fb6 zero size 2024-09-18T12:51:22.526 INFO:tasks.workunit.client.0.smithi081.stdout:7/524: truncate d2/f11 31279 0 2024-09-18T12:51:22.530 INFO:tasks.workunit.client.1.smithi136.stdout:4/902: creat d0/d45/f122 x:0 0 0 2024-09-18T12:51:22.530 INFO:tasks.workunit.client.1.smithi136.stdout:4/903: dread - d0/d2/fa8 zero size 2024-09-18T12:51:22.531 INFO:tasks.workunit.client.1.smithi136.stdout:4/904: mknod d0/d45/d67/ddf/c123 0 2024-09-18T12:51:22.531 INFO:tasks.workunit.client.1.smithi136.stdout:4/905: readlink d0/d3/l42 0 2024-09-18T12:51:22.531 INFO:tasks.workunit.client.0.smithi081.stdout:1/605: getdents d0/d6/d7/d8 0 2024-09-18T12:51:22.534 INFO:tasks.workunit.client.0.smithi081.stdout:6/492: dread d4/d12/d28/d2a/d74/d8b/f78 [0,4194304] 0 2024-09-18T12:51:22.535 INFO:tasks.workunit.client.0.smithi081.stdout:6/493: write d4/d12/d28/f62 [1010404,16349] 0 2024-09-18T12:51:22.535 INFO:tasks.workunit.client.1.smithi136.stdout:4/906: link d0/d45/d67/f107 d0/d45/d67/d7b/f124 0 2024-09-18T12:51:22.536 INFO:tasks.workunit.client.1.smithi136.stdout:4/907: mknod d0/d3/d54/c125 0 2024-09-18T12:51:22.536 INFO:tasks.workunit.client.1.smithi136.stdout:4/908: chown d0/d3/d54/d8a 394011220 1 2024-09-18T12:51:22.536 INFO:tasks.workunit.client.1.smithi136.stdout:4/909: write d0/ff5 [663014,65636] 0 2024-09-18T12:51:22.536 INFO:tasks.workunit.client.1.smithi136.stdout:4/910: chown d0/d3/d54/f74 866 1 2024-09-18T12:51:22.541 INFO:tasks.workunit.client.0.smithi081.stdout:7/525: creat d2/d14/d21/fbb x:0 0 0 2024-09-18T12:51:22.542 INFO:tasks.workunit.client.0.smithi081.stdout:6/494: mkdir d4/d12/d56/d7d/d9f/da2 0 2024-09-18T12:51:22.542 INFO:tasks.workunit.client.0.smithi081.stdout:6/495: chown d4/d12/d1c/d8f/da0 29935989 1 2024-09-18T12:51:22.544 INFO:tasks.workunit.client.0.smithi081.stdout:3/597: dwrite d3/db/d1b/d57/fce [0,4194304] 0 2024-09-18T12:51:22.549 INFO:tasks.workunit.client.1.smithi136.stdout:4/911: dread d0/f15 [0,4194304] 0 2024-09-18T12:51:22.550 INFO:tasks.workunit.client.1.smithi136.stdout:4/912: write d0/d2/f28 [5795904,74807] 0 2024-09-18T12:51:22.551 INFO:tasks.workunit.client.1.smithi136.stdout:4/913: mknod d0/d45/c126 0 2024-09-18T12:51:22.552 INFO:tasks.workunit.client.1.smithi136.stdout:4/914: rename d0/dd7/cfc to d0/d5f/dd3/c127 0 2024-09-18T12:51:22.552 INFO:tasks.workunit.client.1.smithi136.stdout:4/915: truncate d0/d45/d67/d7b/f9d 308091 0 2024-09-18T12:51:22.554 INFO:tasks.workunit.client.0.smithi081.stdout:7/526: dread d2/d18/d22/d48/f8d [0,4194304] 0 2024-09-18T12:51:22.556 INFO:tasks.workunit.client.0.smithi081.stdout:7/527: symlink d2/d18/d60/daa/lbc 0 2024-09-18T12:51:22.558 INFO:tasks.workunit.client.0.smithi081.stdout:3/598: write d3/db/f56 [4031770,17191] 0 2024-09-18T12:51:22.567 INFO:tasks.workunit.client.1.smithi136.stdout:4/916: dwrite d0/d3/dae/fe7 [0,4194304] 0 2024-09-18T12:51:22.567 INFO:tasks.workunit.client.1.smithi136.stdout:4/917: fsync d0/d3/dae/fb5 0 2024-09-18T12:51:22.568 INFO:tasks.workunit.client.0.smithi081.stdout:7/528: dread d2/fe [0,4194304] 0 2024-09-18T12:51:22.569 INFO:tasks.workunit.client.0.smithi081.stdout:7/529: mknod d2/d18/d22/cbd 0 2024-09-18T12:51:22.569 INFO:tasks.workunit.client.0.smithi081.stdout:7/530: fdatasync d2/d56/d73/da4/fba 0 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:7/531: write d2/d42/f41 [91181,56372] 0 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:5/571: sync 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:9/483: sync 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:8/491: sync 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:5/572: stat d2/d14/d33/d37/d3b/d6a/d20/f97 0 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:8/492: chown d3 13935977 1 2024-09-18T12:51:22.571 INFO:tasks.workunit.client.0.smithi081.stdout:8/493: dread - d3/d1e/d4c/fa1 zero size 2024-09-18T12:51:22.572 INFO:tasks.workunit.client.0.smithi081.stdout:4/461: sync 2024-09-18T12:51:22.572 INFO:tasks.workunit.client.0.smithi081.stdout:2/655: sync 2024-09-18T12:51:22.572 INFO:tasks.workunit.client.0.smithi081.stdout:7/532: symlink d2/d14/d21/d62/da7/lbe 0 2024-09-18T12:51:22.572 INFO:tasks.workunit.client.0.smithi081.stdout:7/533: readlink d2/d14/d21/d62/da7/lbe 0 2024-09-18T12:51:22.573 INFO:tasks.workunit.client.0.smithi081.stdout:9/484: link dd/de/d59/f5e dd/de/d4f/d8c/fa1 0 2024-09-18T12:51:22.575 INFO:tasks.workunit.client.0.smithi081.stdout:8/494: truncate d3/d1d/d4a/f97 5107204 0 2024-09-18T12:51:22.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/534: symlink d2/d14/lbf 0 2024-09-18T12:51:22.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/535: write d2/d14/f2f [579096,7566] 0 2024-09-18T12:51:22.578 INFO:tasks.workunit.client.0.smithi081.stdout:8/495: rename d3/d2f/f72 to d3/d1d/d4a/d7f/fa8 0 2024-09-18T12:51:22.579 INFO:tasks.workunit.client.1.smithi136.stdout:4/918: write d0/d2/f28 [581983,123762] 0 2024-09-18T12:51:22.579 INFO:tasks.workunit.client.0.smithi081.stdout:4/462: mknod d3/d20/d3d/d65/c9d 0 2024-09-18T12:51:22.580 INFO:tasks.workunit.client.0.smithi081.stdout:4/463: readlink d3/d20/d3d/d65/d45/d6c/l77 0 2024-09-18T12:51:22.580 INFO:tasks.workunit.client.0.smithi081.stdout:4/464: chown d3/db/d2d/l2e 41668 1 2024-09-18T12:51:22.580 INFO:tasks.workunit.client.1.smithi136.stdout:9/911: dwrite d6/ff6 [0,4194304] 0 2024-09-18T12:51:22.582 INFO:tasks.workunit.client.0.smithi081.stdout:8/496: mkdir d3/d1d/d4a/da9 0 2024-09-18T12:51:22.582 INFO:tasks.workunit.client.0.smithi081.stdout:8/497: write d3/f3f [4410935,60586] 0 2024-09-18T12:51:22.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/465: truncate d3/db/d35/f76 10542 0 2024-09-18T12:51:22.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/573: dread d2/f66 [0,4194304] 0 2024-09-18T12:51:22.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/574: creat d2/d14/d33/d37/d3b/d6a/fb6 x:0 0 0 2024-09-18T12:51:22.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/575: chown d2/d14/d33/d37/d3b/d2a 1296 1 2024-09-18T12:51:22.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/576: chown d2/d14/d33/d37/d3b/d16/f69 262766 1 2024-09-18T12:51:22.584 INFO:tasks.workunit.client.0.smithi081.stdout:1/606: dwrite d0/d6/d33/d42/f5b [0,4194304] 0 2024-09-18T12:51:22.585 INFO:tasks.workunit.client.1.smithi136.stdout:4/919: creat d0/dd7/f128 x:0 0 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.1.smithi136.stdout:4/920: getdents d0/d45/dff 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.1.smithi136.stdout:4/921: write d0/d2/f16 [2114880,7661] 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.0.smithi081.stdout:6/496: dwrite d4/d6/f27 [0,4194304] 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.0.smithi081.stdout:6/497: fdatasync d4/f5c 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.0.smithi081.stdout:3/599: dwrite d3/db/df/fc6 [4194304,4194304] 0 2024-09-18T12:51:22.586 INFO:tasks.workunit.client.0.smithi081.stdout:3/600: fdatasync d3/db/f87 0 2024-09-18T12:51:22.589 INFO:tasks.workunit.client.0.smithi081.stdout:8/498: mkdir d3/d1e/d4c/d68/daa 0 2024-09-18T12:51:22.593 INFO:tasks.workunit.client.0.smithi081.stdout:4/466: creat d3/db/f9e x:0 0 0 2024-09-18T12:51:22.597 INFO:tasks.workunit.client.0.smithi081.stdout:5/577: truncate d2/dd/f75 1264009 0 2024-09-18T12:51:22.597 INFO:tasks.workunit.client.0.smithi081.stdout:5/578: read - d2/d47/f9f zero size 2024-09-18T12:51:22.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/912: mknod d6/df/d23/d2b/d79/d119/d123/c12c 0 2024-09-18T12:51:22.598 INFO:tasks.workunit.client.1.smithi136.stdout:9/913: dread d6/df/dd3/f122 [0,4194304] 0 2024-09-18T12:51:22.601 INFO:tasks.workunit.client.1.smithi136.stdout:9/914: symlink d6/d13/l12d 0 2024-09-18T12:51:22.603 INFO:tasks.workunit.client.1.smithi136.stdout:9/915: mkdir d6/da/d3d/d41/d12e 0 2024-09-18T12:51:22.603 INFO:tasks.workunit.client.1.smithi136.stdout:9/916: stat d6/d96/c78 0 2024-09-18T12:51:22.607 INFO:tasks.workunit.client.0.smithi081.stdout:3/601: unlink d3/db/df/d29/d13/d9d/fb6 0 2024-09-18T12:51:22.607 INFO:tasks.workunit.client.0.smithi081.stdout:8/499: rmdir d3/d1e/d4c/d68 39 2024-09-18T12:51:22.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/656: dwrite d15/d16/d33/d53/d7a/dee/f68 [4194304,4194304] 0 2024-09-18T12:51:22.610 INFO:tasks.workunit.client.0.smithi081.stdout:3/602: rename d3/d23/la5 to d3/db/df/d29/d13/ld5 0 2024-09-18T12:51:22.610 INFO:tasks.workunit.client.0.smithi081.stdout:3/603: chown d3/db/df/d60/d58/l74 10724246 1 2024-09-18T12:51:22.610 INFO:tasks.workunit.client.0.smithi081.stdout:3/604: chown d3/db/df/da8/lbd 1120730 1 2024-09-18T12:51:22.610 INFO:tasks.workunit.client.0.smithi081.stdout:3/605: chown d3/db/dc/d1a/cb2 7316226 1 2024-09-18T12:51:22.612 INFO:tasks.workunit.client.0.smithi081.stdout:8/500: creat d3/d1e/d4c/d53/fab x:0 0 0 2024-09-18T12:51:22.612 INFO:tasks.workunit.client.0.smithi081.stdout:8/501: creat d3/d1e/d4c/d53/fac x:0 0 0 2024-09-18T12:51:22.614 INFO:tasks.workunit.client.0.smithi081.stdout:3/606: rmdir d3/db/df/d60/d58 39 2024-09-18T12:51:22.614 INFO:tasks.workunit.client.0.smithi081.stdout:6/498: dwrite d4/d12/d28/f38 [0,4194304] 0 2024-09-18T12:51:22.616 INFO:tasks.workunit.client.0.smithi081.stdout:8/502: link d3/d1e/d4c/d53/f7d d3/d1d/d9f/fad 0 2024-09-18T12:51:22.617 INFO:tasks.workunit.client.1.smithi136.stdout:4/922: dwrite d0/d25/f106 [0,4194304] 0 2024-09-18T12:51:22.618 INFO:tasks.workunit.client.0.smithi081.stdout:5/579: dread d2/fe [0,4194304] 0 2024-09-18T12:51:22.618 INFO:tasks.workunit.client.0.smithi081.stdout:5/580: stat d2/d14/d33/d37/d3b/d6a/d20/c87 0 2024-09-18T12:51:22.620 INFO:tasks.workunit.client.0.smithi081.stdout:8/503: mkdir d3/d1e/d4c/dae 0 2024-09-18T12:51:22.623 INFO:tasks.workunit.client.0.smithi081.stdout:5/581: rename d2/d14/d33/d37/d3b/d6a/f35 to d2/d47/d7f/fb7 0 2024-09-18T12:51:22.623 INFO:tasks.workunit.client.0.smithi081.stdout:5/582: readlink d2/d47/l4d 0 2024-09-18T12:51:22.623 INFO:tasks.workunit.client.0.smithi081.stdout:4/467: dwrite d3/d20/d3d/d65/d2f/f33 [0,4194304] 0 2024-09-18T12:51:22.624 INFO:tasks.workunit.client.0.smithi081.stdout:6/499: getdents d4/d12/d28/d2a 0 2024-09-18T12:51:22.624 INFO:tasks.workunit.client.0.smithi081.stdout:6/500: chown d4/d12/d28/d2a/d74/d8b/c7c 66523 1 2024-09-18T12:51:22.624 INFO:tasks.workunit.client.0.smithi081.stdout:6/501: write d4/d12/d28/d2a/d2d/d31/f51 [497242,94478] 0 2024-09-18T12:51:22.625 INFO:tasks.workunit.client.0.smithi081.stdout:8/504: creat d3/d1e/d4c/dae/faf x:0 0 0 2024-09-18T12:51:22.627 INFO:tasks.workunit.client.0.smithi081.stdout:4/468: dread d3/d20/d3d/d65/d45/f4a [0,4194304] 0 2024-09-18T12:51:22.627 INFO:tasks.workunit.client.0.smithi081.stdout:5/583: unlink d2/d14/d33/d37/d3b/l11 0 2024-09-18T12:51:22.627 INFO:tasks.workunit.client.0.smithi081.stdout:5/584: readlink d2/d14/d1d/l62 0 2024-09-18T12:51:22.627 INFO:tasks.workunit.client.0.smithi081.stdout:5/585: creat d2/d14/d33/d37/d3b/d16/fb8 x:0 0 0 2024-09-18T12:51:22.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/607: dwrite d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:22.631 INFO:tasks.workunit.client.0.smithi081.stdout:6/502: symlink d4/d12/d1c/d8f/da0/la3 0 2024-09-18T12:51:22.631 INFO:tasks.workunit.client.0.smithi081.stdout:6/503: write d4/d12/d28/d2a/d2d/f82 [321162,98238] 0 2024-09-18T12:51:22.632 INFO:tasks.workunit.client.0.smithi081.stdout:8/505: mknod d3/d1d/d4a/cb0 0 2024-09-18T12:51:22.632 INFO:tasks.workunit.client.0.smithi081.stdout:8/506: write d3/d1d/d4a/f97 [1095128,11363] 0 2024-09-18T12:51:22.635 INFO:tasks.workunit.client.0.smithi081.stdout:2/657: dwrite d15/d16/d20/d59/fbc [0,4194304] 0 2024-09-18T12:51:22.635 INFO:tasks.workunit.client.0.smithi081.stdout:5/586: rename d2/d14/d33/d37/d3b/d2a/db0/l86 to d2/d14/d33/lb9 0 2024-09-18T12:51:22.638 INFO:tasks.workunit.client.0.smithi081.stdout:3/607: truncate d3/db/d1b/d57/fce 2139195 0 2024-09-18T12:51:22.639 INFO:tasks.workunit.client.0.smithi081.stdout:6/504: creat d4/d12/d56/d7d/d9f/da2/fa4 x:0 0 0 2024-09-18T12:51:22.641 INFO:tasks.workunit.client.0.smithi081.stdout:0/548: sync 2024-09-18T12:51:22.641 INFO:tasks.workunit.client.0.smithi081.stdout:0/549: chown d7/d9/d4b/d33/l7a 100748892 1 2024-09-18T12:51:22.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/507: mknod d3/d1d/d4a/da9/cb1 0 2024-09-18T12:51:22.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/508: write d3/d1d/f8b [473097,74608] 0 2024-09-18T12:51:22.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/509: creat d3/d2f/fb2 x:0 0 0 2024-09-18T12:51:22.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/510: dread - d3/d1e/fa4 zero size 2024-09-18T12:51:22.645 INFO:tasks.workunit.client.1.smithi136.stdout:4/923: dwrite d0/ff5 [0,4194304] 0 2024-09-18T12:51:22.645 INFO:tasks.workunit.client.0.smithi081.stdout:4/469: dwrite d3/d20/d3d/d65/d45/f53 [0,4194304] 0 2024-09-18T12:51:22.646 INFO:tasks.workunit.client.0.smithi081.stdout:8/511: fsync d3/d1e/d4c/f69 0 2024-09-18T12:51:22.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/658: symlink d15/d6e/lf1 0 2024-09-18T12:51:22.649 INFO:tasks.workunit.client.0.smithi081.stdout:6/505: link d4/d12/d1c/f48 d4/d12/d56/d7d/fa5 0 2024-09-18T12:51:22.651 INFO:tasks.workunit.client.0.smithi081.stdout:0/550: mknod d7/d9/d4b/d4a/d68/cb7 0 2024-09-18T12:51:22.652 INFO:tasks.workunit.client.0.smithi081.stdout:1/608: dwrite d0/db/d12/d28/f7f [0,4194304] 0 2024-09-18T12:51:22.658 INFO:tasks.workunit.client.0.smithi081.stdout:8/512: dread d3/d1d/d4a/d7f/f84 [0,4194304] 0 2024-09-18T12:51:22.659 INFO:tasks.workunit.client.0.smithi081.stdout:4/470: rename d3/d20/d3d/d90 to d3/db/d58/d9f 0 2024-09-18T12:51:22.659 INFO:tasks.workunit.client.0.smithi081.stdout:4/471: chown d3/d20/d3d/d65/d14/d27/f7c 41 1 2024-09-18T12:51:22.659 INFO:tasks.workunit.client.0.smithi081.stdout:4/472: dread - d3/d20/d3d/d65/d2f/f8b zero size 2024-09-18T12:51:22.659 INFO:tasks.workunit.client.0.smithi081.stdout:4/473: fsync d3/db/f9e 0 2024-09-18T12:51:22.660 INFO:tasks.workunit.client.1.smithi136.stdout:4/924: dwrite d0/d3/d54/d5c/fa1 [0,4194304] 0 2024-09-18T12:51:22.663 INFO:tasks.workunit.client.0.smithi081.stdout:5/587: rmdir d2/d14/d1d/d1a 39 2024-09-18T12:51:22.663 INFO:tasks.workunit.client.0.smithi081.stdout:5/588: stat d2/d14/d33/d37/d3b/d6a/f9b 0 2024-09-18T12:51:22.663 INFO:tasks.workunit.client.0.smithi081.stdout:5/589: write d2/d14/d33/d37/d3b/d6a/fb6 [353904,65207] 0 2024-09-18T12:51:22.663 INFO:tasks.workunit.client.0.smithi081.stdout:2/659: read d15/d16/d33/d53/db0/fec [3878103,654] 0 2024-09-18T12:51:22.664 INFO:tasks.workunit.client.0.smithi081.stdout:2/660: read d15/d16/d20/d31/f5e [933884,124876] 0 2024-09-18T12:51:22.664 INFO:tasks.workunit.client.0.smithi081.stdout:2/661: dread - d15/d16/d54/fc6 zero size 2024-09-18T12:51:22.664 INFO:tasks.workunit.client.0.smithi081.stdout:6/506: unlink d4/d12/d1c/d39/d60/d90/l92 0 2024-09-18T12:51:22.664 INFO:tasks.workunit.client.0.smithi081.stdout:6/507: readlink d4/d6/lf 0 2024-09-18T12:51:22.664 INFO:tasks.workunit.client.0.smithi081.stdout:6/508: stat d4/f58 0 2024-09-18T12:51:22.669 INFO:tasks.workunit.client.0.smithi081.stdout:8/513: rename d3/d1e/d4c/d68/l7b to d3/lb3 0 2024-09-18T12:51:22.673 INFO:tasks.workunit.client.0.smithi081.stdout:1/609: dwrite d0/d6/d33/d37/f94 [0,4194304] 0 2024-09-18T12:51:22.673 INFO:tasks.workunit.client.1.smithi136.stdout:4/925: dread d0/d8d/fb0 [0,4194304] 0 2024-09-18T12:51:22.673 INFO:tasks.workunit.client.1.smithi136.stdout:4/926: write d0/d3/d54/d8a/fbb [145099,99484] 0 2024-09-18T12:51:22.674 INFO:tasks.workunit.client.0.smithi081.stdout:5/590: dread d2/d14/d33/f6b [0,4194304] 0 2024-09-18T12:51:22.675 INFO:tasks.workunit.client.1.smithi136.stdout:4/927: symlink d0/d3/dae/l129 0 2024-09-18T12:51:22.679 INFO:tasks.workunit.client.0.smithi081.stdout:2/662: creat d15/d26/ff2 x:0 0 0 2024-09-18T12:51:22.682 INFO:tasks.workunit.client.0.smithi081.stdout:4/474: getdents d3/db/d35 0 2024-09-18T12:51:22.682 INFO:tasks.workunit.client.0.smithi081.stdout:4/475: chown d3/d20/d5b 17866011 1 2024-09-18T12:51:22.682 INFO:tasks.workunit.client.0.smithi081.stdout:4/476: chown d3/d20/d3d/d65/d2f/f8b 0 1 2024-09-18T12:51:22.682 INFO:tasks.workunit.client.0.smithi081.stdout:4/477: dread - d3/db/d35/d79/f92 zero size 2024-09-18T12:51:22.683 INFO:tasks.workunit.client.0.smithi081.stdout:8/514: dread d3/d2f/f31 [0,4194304] 0 2024-09-18T12:51:22.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/663: mkdir d15/d16/d20/d22/df3 0 2024-09-18T12:51:22.687 INFO:tasks.workunit.client.0.smithi081.stdout:1/610: write d0/d6/d33/d42/f5b [3255182,96083] 0 2024-09-18T12:51:22.689 INFO:tasks.workunit.client.0.smithi081.stdout:2/664: creat d15/d8e/ff4 x:0 0 0 2024-09-18T12:51:22.689 INFO:tasks.workunit.client.0.smithi081.stdout:2/665: dread - d15/d16/d20/d22/fe6 zero size 2024-09-18T12:51:22.692 INFO:tasks.workunit.client.1.smithi136.stdout:1/944: sync 2024-09-18T12:51:22.693 INFO:tasks.workunit.client.1.smithi136.stdout:1/945: stat d2/d5/d2b/d9b/d2e/c123 0 2024-09-18T12:51:22.694 INFO:tasks.workunit.client.0.smithi081.stdout:1/611: getdents d0/d6/d7/d2e 0 2024-09-18T12:51:22.694 INFO:tasks.workunit.client.0.smithi081.stdout:4/478: write d3/d20/d3d/d65/d14/d27/f7c [2426277,48714] 0 2024-09-18T12:51:22.694 INFO:tasks.workunit.client.0.smithi081.stdout:6/509: dwrite d4/d12/d28/d2a/d2d/f52 [0,4194304] 0 2024-09-18T12:51:22.694 INFO:tasks.workunit.client.0.smithi081.stdout:5/591: dread d2/dd/d5e/f3c [0,4194304] 0 2024-09-18T12:51:22.696 INFO:tasks.workunit.client.0.smithi081.stdout:1/612: symlink d0/d6/d33/d42/d70/ld0 0 2024-09-18T12:51:22.697 INFO:tasks.workunit.client.0.smithi081.stdout:1/613: write d0/d6/fe [3938036,32045] 0 2024-09-18T12:51:22.698 INFO:tasks.workunit.client.0.smithi081.stdout:8/515: dread d3/d1d/f21 [0,4194304] 0 2024-09-18T12:51:22.698 INFO:tasks.workunit.client.0.smithi081.stdout:8/516: creat d3/d73/fb4 x:0 0 0 2024-09-18T12:51:22.705 INFO:tasks.workunit.client.0.smithi081.stdout:6/510: creat d4/d12/d56/d7d/d96/fa6 x:0 0 0 2024-09-18T12:51:22.706 INFO:tasks.workunit.client.0.smithi081.stdout:5/592: creat d2/d14/d1d/fba x:0 0 0 2024-09-18T12:51:22.710 INFO:tasks.workunit.client.0.smithi081.stdout:6/511: mknod d4/d12/d28/d2a/d97/ca7 0 2024-09-18T12:51:22.712 INFO:tasks.workunit.client.0.smithi081.stdout:5/593: mkdir d2/d14/d33/d37/d3b/d16/dbb 0 2024-09-18T12:51:22.712 INFO:tasks.workunit.client.0.smithi081.stdout:5/594: stat d2/dd/f75 0 2024-09-18T12:51:22.714 INFO:tasks.workunit.client.0.smithi081.stdout:8/517: rmdir d3/d1d/d4a 39 2024-09-18T12:51:22.715 INFO:tasks.workunit.client.0.smithi081.stdout:8/518: write d3/d1d/f8b [744,101962] 0 2024-09-18T12:51:22.716 INFO:tasks.workunit.client.0.smithi081.stdout:6/512: mkdir d4/d12/d56/da8 0 2024-09-18T12:51:22.718 INFO:tasks.workunit.client.0.smithi081.stdout:5/595: rename d2/d14/d1d/c19 to d2/d14/d33/d37/d3b/d6a/d20/cbc 0 2024-09-18T12:51:22.718 INFO:tasks.workunit.client.0.smithi081.stdout:5/596: chown d2/d14/d33/d37/d3b/d2a/d8e/f99 6868 1 2024-09-18T12:51:22.718 INFO:tasks.workunit.client.0.smithi081.stdout:8/519: getdents d3/d1d/d4a/da9 0 2024-09-18T12:51:22.720 INFO:tasks.workunit.client.1.smithi136.stdout:4/928: dwrite d0/d2/f3e [0,4194304] 0 2024-09-18T12:51:22.720 INFO:tasks.workunit.client.1.smithi136.stdout:4/929: fsync d0/d3/d54/f117 0 2024-09-18T12:51:22.720 INFO:tasks.workunit.client.0.smithi081.stdout:5/597: mknod d2/cbd 0 2024-09-18T12:51:22.721 INFO:tasks.workunit.client.1.smithi136.stdout:4/930: mkdir d0/d25/d83/d12a 0 2024-09-18T12:51:22.722 INFO:tasks.workunit.client.1.smithi136.stdout:4/931: fsync d0/d3/d54/d8a/f11a 0 2024-09-18T12:51:22.722 INFO:tasks.workunit.client.1.smithi136.stdout:4/932: readlink d0/la7 0 2024-09-18T12:51:22.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/598: rmdir d2/d14/d33/d37/d3b/d2a/d8e 39 2024-09-18T12:51:22.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/599: chown d2/d14/d33/d37/d3b/d2a/db0 24 1 2024-09-18T12:51:22.725 INFO:tasks.workunit.client.0.smithi081.stdout:5/600: unlink d2/d14/d33/d37/d3b/d2a/db0/c84 0 2024-09-18T12:51:22.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/520: dread d3/f32 [0,4194304] 0 2024-09-18T12:51:22.726 INFO:tasks.workunit.client.1.smithi136.stdout:9/917: sync 2024-09-18T12:51:22.727 INFO:tasks.workunit.client.1.smithi136.stdout:3/919: sync 2024-09-18T12:51:22.727 INFO:tasks.workunit.client.1.smithi136.stdout:3/920: read d3/d10/d4a/d51/fa0 [1936308,119719] 0 2024-09-18T12:51:22.728 INFO:tasks.workunit.client.1.smithi136.stdout:9/918: read d6/db/f2c [4492443,374] 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:5/601: rename d2/d14/d33/d37/d3b/ca to d2/d14/d33/d37/d3b/d16/cbe 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:5/602: readlink d2/d14/d33/d37/d3b/d6a/l93 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:6/513: dread d4/d12/d1c/f6b [0,4194304] 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:8/521: mkdir d3/d1d/d89/db5 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:8/522: creat d3/d1e/d4c/fb6 x:0 0 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:6/514: rename d4/d12/d28/d2a/l3f to d4/d12/d28/la9 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:5/603: write d2/d14/d33/d37/f54 [397669,5643] 0 2024-09-18T12:51:22.730 INFO:tasks.workunit.client.0.smithi081.stdout:5/604: dread - d2/d14/d33/d37/d3b/d16/fb8 zero size 2024-09-18T12:51:22.731 INFO:tasks.workunit.client.0.smithi081.stdout:5/605: write d2/d14/d33/d37/f50 [5321827,117284] 0 2024-09-18T12:51:22.731 INFO:tasks.workunit.client.0.smithi081.stdout:5/606: truncate d2/d14/d33/d37/d3b/d2a/f8b 733609 0 2024-09-18T12:51:22.733 INFO:tasks.workunit.client.1.smithi136.stdout:4/933: read d0/d3/f43 [2675376,24942] 0 2024-09-18T12:51:22.733 INFO:tasks.workunit.client.1.smithi136.stdout:9/919: dread d6/da/ff2 [0,4194304] 0 2024-09-18T12:51:22.734 INFO:tasks.workunit.client.0.smithi081.stdout:6/515: creat d4/d12/d56/d7d/d91/faa x:0 0 0 2024-09-18T12:51:22.734 INFO:tasks.workunit.client.0.smithi081.stdout:1/614: dwrite d0/d6/d7/d2e/d51/d2c/f45 [0,4194304] 0 2024-09-18T12:51:22.734 INFO:tasks.workunit.client.0.smithi081.stdout:1/615: chown d0/d6/d7/d2e/d4e/lbe 206 1 2024-09-18T12:51:22.735 INFO:tasks.workunit.client.0.smithi081.stdout:1/616: chown d0/db/d12/l1e 941 1 2024-09-18T12:51:22.737 INFO:tasks.workunit.client.1.smithi136.stdout:1/946: dwrite d2/d5/fe1 [0,4194304] 0 2024-09-18T12:51:22.737 INFO:tasks.workunit.client.1.smithi136.stdout:1/947: read - d2/d5/d2b/d9b/dbe/f131 zero size 2024-09-18T12:51:22.737 INFO:tasks.workunit.client.0.smithi081.stdout:5/607: mknod d2/dd/d5e/cbf 0 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:5/608: chown d2/d14/d33/d37/d3b/d16 1663288 1 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:4/479: dwrite d3/db/f23 [0,4194304] 0 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/666: dwrite d15/d16/d33/d53/d7a/d2f/dc2/fe4 [0,4194304] 0 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/667: truncate d15/d16/d20/d22/d5a/fe3 443632 0 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/668: write d15/d16/d20/d22/f34 [1248065,57854] 0 2024-09-18T12:51:22.738 INFO:tasks.workunit.client.0.smithi081.stdout:6/516: symlink d4/d12/d1c/d39/lab 0 2024-09-18T12:51:22.739 INFO:tasks.workunit.client.0.smithi081.stdout:6/517: chown d4/d12/d1c/l4c 5581 1 2024-09-18T12:51:22.739 INFO:tasks.workunit.client.0.smithi081.stdout:5/609: creat d2/dd/d5e/fc0 x:0 0 0 2024-09-18T12:51:22.739 INFO:tasks.workunit.client.1.smithi136.stdout:6/968: sync 2024-09-18T12:51:22.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/921: write d3/d14/d18/f7d [692589,29297] 0 2024-09-18T12:51:22.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/922: chown d3/d14/d17/d53/d73/f109 1446 1 2024-09-18T12:51:22.741 INFO:tasks.workunit.client.1.smithi136.stdout:3/923: write d3/d10/d4a/d51/fa0 [2676742,86093] 0 2024-09-18T12:51:22.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/669: rename d15/d16/d33/d53/d7a/d2f/d61/d97/fac to d15/d16/d20/d22/df3/ff5 0 2024-09-18T12:51:22.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/670: chown d15/d16/d20/d22/d5a/c82 124 1 2024-09-18T12:51:22.748 INFO:tasks.workunit.client.1.smithi136.stdout:6/969: creat d8/d9/de/d1c/d50/f139 x:0 0 0 2024-09-18T12:51:22.748 INFO:tasks.workunit.client.1.smithi136.stdout:6/970: write d8/d9d/db4/fca [760881,109640] 0 2024-09-18T12:51:22.748 INFO:tasks.workunit.client.0.smithi081.stdout:5/610: mknod d2/dd/cc1 0 2024-09-18T12:51:22.751 INFO:tasks.workunit.client.0.smithi081.stdout:5/611: mkdir d2/d14/d33/d37/d3b/d2a/d8e/dc2 0 2024-09-18T12:51:22.751 INFO:tasks.workunit.client.0.smithi081.stdout:5/612: dread - d2/d14/d33/d37/d3b/d5f/fb5 zero size 2024-09-18T12:51:22.751 INFO:tasks.workunit.client.1.smithi136.stdout:3/924: truncate d3/d14/d22/d2c/dd5/fe4 1341411 0 2024-09-18T12:51:22.751 INFO:tasks.workunit.client.1.smithi136.stdout:3/925: write d3/d14/d22/d2c/dd5/fea [658521,58485] 0 2024-09-18T12:51:22.751 INFO:tasks.workunit.client.1.smithi136.stdout:3/926: readlink d3/d14/d22/l120 0 2024-09-18T12:51:22.755 INFO:tasks.workunit.client.0.smithi081.stdout:1/617: dread d0/f15 [0,4194304] 0 2024-09-18T12:51:22.756 INFO:tasks.workunit.client.1.smithi136.stdout:3/927: link d3/d14/d17/d11a/l11c d3/l126 0 2024-09-18T12:51:22.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/613: dread d2/dd/d5e/f40 [0,4194304] 0 2024-09-18T12:51:22.758 INFO:tasks.workunit.client.0.smithi081.stdout:4/480: dwrite d3/d20/d3d/d65/d14/f9a [0,4194304] 0 2024-09-18T12:51:22.758 INFO:tasks.workunit.client.0.smithi081.stdout:4/481: fdatasync d3/db/d35/f76 0 2024-09-18T12:51:22.759 INFO:tasks.workunit.client.0.smithi081.stdout:4/482: creat d3/d20/d3d/d65/d2f/fa0 x:0 0 0 2024-09-18T12:51:22.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/518: dread d4/d6/fb [0,4194304] 0 2024-09-18T12:51:22.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/519: getdents d4/d12/d28/d2a/d98 0 2024-09-18T12:51:22.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/520: chown d4/d6/fb 3098782 1 2024-09-18T12:51:22.765 INFO:tasks.workunit.client.1.smithi136.stdout:3/928: dread d3/d14/d17/d8c/d96/fa4 [0,4194304] 0 2024-09-18T12:51:22.767 INFO:tasks.workunit.client.1.smithi136.stdout:3/929: creat d3/d14/d17/d8c/f127 x:0 0 0 2024-09-18T12:51:22.771 INFO:tasks.workunit.client.0.smithi081.stdout:1/618: rename d0/db/d4f/f6e to d0/d18/db7/fd1 0 2024-09-18T12:51:22.771 INFO:tasks.workunit.client.0.smithi081.stdout:1/619: truncate d0/d6/d7/d8/f52 276058 0 2024-09-18T12:51:22.773 INFO:tasks.workunit.client.0.smithi081.stdout:1/620: mkdir d0/db/d4f/dd2 0 2024-09-18T12:51:22.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/483: dread d3/db/f36 [4194304,4194304] 0 2024-09-18T12:51:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.793+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f88107800 con 0x7f6f88101180 2024-09-18T12:51:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.793+0000 7f6f85ffb700 1 -- 172.21.15.81:0/87582084 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f6f740629e0 con 0x7f6f88101180 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:51:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:51:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:51:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 msgr2=0x7f6f78075f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 0x7f6f78075f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00b6f0 tx=0x7f6f7c005a90 comp rx=0 tx=0).stop 2024-09-18T12:51:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 msgr2=0x7f6f88198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 0x7f6f88198c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e970 tx=0x7f6f7400ec80 comp rx=0 tx=0).stop 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 shutdown_connections 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f6f78073a40 0x7f6f78075f00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f880ffe30 0x7f6f88198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 --2- 172.21.15.81:0/87582084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f88101180 0x7f6f88198c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 >> 172.21.15.81:0/87582084 conn(0x7f6f880fa8c0 msgr2=0x7f6f880fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 shutdown_connections 2024-09-18T12:51:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.796+0000 7f6f8eb38700 1 -- 172.21.15.81:0/87582084 wait complete. 2024-09-18T12:51:22.799 INFO:tasks.workunit.client.1.smithi136.stdout:4/934: dwrite d0/f82 [0,4194304] 0 2024-09-18T12:51:22.799 INFO:tasks.workunit.client.1.smithi136.stdout:4/935: creat d0/d120/f12b x:0 0 0 2024-09-18T12:51:22.805 INFO:tasks.workunit.client.1.smithi136.stdout:4/936: write d0/d3/f97 [316841,115563] 0 2024-09-18T12:51:22.805 INFO:tasks.workunit.client.1.smithi136.stdout:9/920: dwrite d6/df/d75/dde/fe6 [0,4194304] 0 2024-09-18T12:51:22.805 INFO:tasks.workunit.client.1.smithi136.stdout:9/921: chown d6/d13/l47 239 1 2024-09-18T12:51:22.807 INFO:tasks.workunit.client.1.smithi136.stdout:9/922: mknod d6/df/d23/d2b/c12f 0 2024-09-18T12:51:22.808 INFO:tasks.workunit.client.1.smithi136.stdout:9/923: creat d6/df/d23/d2b/de5/f130 x:0 0 0 2024-09-18T12:51:22.810 INFO:tasks.workunit.client.1.smithi136.stdout:9/924: read d6/da/ff2 [360575,33836] 0 2024-09-18T12:51:22.810 INFO:tasks.workunit.client.1.smithi136.stdout:9/925: chown d6/df/d23/d2b/d79/d53/d5c/fc8 0 1 2024-09-18T12:51:22.813 INFO:tasks.workunit.client.1.smithi136.stdout:1/948: dwrite d2/f5b [0,4194304] 0 2024-09-18T12:51:22.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/937: write d0/d5f/f81 [4007658,92138] 0 2024-09-18T12:51:22.815 INFO:tasks.workunit.client.1.smithi136.stdout:4/938: write d0/d2/f17 [1330743,87877] 0 2024-09-18T12:51:22.816 INFO:tasks.workunit.client.1.smithi136.stdout:1/949: mkdir d2/d5/d9/db4/dd0/d141 0 2024-09-18T12:51:22.816 INFO:tasks.workunit.client.1.smithi136.stdout:1/950: creat d2/d5/d2b/da9/f142 x:0 0 0 2024-09-18T12:51:22.816 INFO:tasks.workunit.client.1.smithi136.stdout:4/939: write d0/d3/d54/fe8 [182598,7953] 0 2024-09-18T12:51:22.821 INFO:tasks.workunit.client.1.smithi136.stdout:4/940: link d0/d2/f17 d0/d45/dff/f12c 0 2024-09-18T12:51:22.821 INFO:tasks.workunit.client.1.smithi136.stdout:6/971: dwrite d8/d9/de/d1c/f5e [4194304,4194304] 0 2024-09-18T12:51:22.823 INFO:tasks.workunit.client.1.smithi136.stdout:1/951: dread d2/d5/d2b/d9b/dbe/dd3/f75 [0,4194304] 0 2024-09-18T12:51:22.823 INFO:tasks.workunit.client.1.smithi136.stdout:1/952: creat d2/d5/d2b/d9b/f143 x:0 0 0 2024-09-18T12:51:22.825 INFO:tasks.workunit.client.1.smithi136.stdout:6/972: truncate d8/d9/de/f3d 2628671 0 2024-09-18T12:51:22.827 INFO:tasks.workunit.client.1.smithi136.stdout:1/953: link d2/d5/d2b/d9b/d115/l132 d2/d5/d9/db4/dd0/l144 0 2024-09-18T12:51:22.828 INFO:tasks.workunit.client.1.smithi136.stdout:6/973: creat d8/dcf/d113/f13a x:0 0 0 2024-09-18T12:51:22.829 INFO:tasks.workunit.client.1.smithi136.stdout:1/954: stat d2/d5/d9/dcb/dfb/d107/d114/cc0 0 2024-09-18T12:51:22.830 INFO:tasks.workunit.client.0.smithi081.stdout:8/523: dwrite d3/d2f/f8a [0,4194304] 0 2024-09-18T12:51:22.831 INFO:tasks.workunit.client.0.smithi081.stdout:6/521: dwrite d4/d12/d1c/f6b [0,4194304] 0 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/614: dwrite d2/d47/d7f/f96 [0,4194304] 0 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:2/671: dwrite d15/d8e/ff4 [0,4194304] 0 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/615: truncate d2/dd/fb2 392863 0 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/616: stat d2/d14/d33/d37/d3b/d6a 0 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/617: chown d2/d14/d33/d37/d3b 60444258 1 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/618: chown d2/fe 0 1 2024-09-18T12:51:22.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/619: stat d2/d14/d33/d37/d3b/d2a 0 2024-09-18T12:51:22.833 INFO:tasks.workunit.client.0.smithi081.stdout:8/524: mkdir d3/db7 0 2024-09-18T12:51:22.833 INFO:tasks.workunit.client.1.smithi136.stdout:3/930: dwrite d3/d5/d31/f90 [0,4194304] 0 2024-09-18T12:51:22.834 INFO:tasks.workunit.client.1.smithi136.stdout:3/931: write d3/d14/d17/d53/de8/f11e [703297,75041] 0 2024-09-18T12:51:22.834 INFO:tasks.workunit.client.1.smithi136.stdout:9/926: dwrite d6/df/d75/fec [0,4194304] 0 2024-09-18T12:51:22.837 INFO:tasks.workunit.client.1.smithi136.stdout:4/941: write d0/d5f/f93 [2212388,110504] 0 2024-09-18T12:51:22.837 INFO:tasks.workunit.client.1.smithi136.stdout:4/942: fdatasync d0/d3/d54/d88/f8f 0 2024-09-18T12:51:22.839 INFO:tasks.workunit.client.0.smithi081.stdout:4/484: dwrite d3/d20/d3d/d65/d45/f81 [0,4194304] 0 2024-09-18T12:51:22.840 INFO:tasks.workunit.client.1.smithi136.stdout:3/932: mknod d3/d14/d18/c128 0 2024-09-18T12:51:22.841 INFO:tasks.workunit.client.0.smithi081.stdout:2/672: creat d15/d16/d33/d53/d7a/dee/d6d/da0/ff6 x:0 0 0 2024-09-18T12:51:22.842 INFO:tasks.workunit.client.0.smithi081.stdout:2/673: write d15/d16/d54/fdc [371750,39637] 0 2024-09-18T12:51:22.843 INFO:tasks.workunit.client.1.smithi136.stdout:9/927: mknod d6/db/de8/c131 0 2024-09-18T12:51:22.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/620: symlink d2/d14/d33/d37/d3b/d2a/d8e/dc2/lc3 0 2024-09-18T12:51:22.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/621: chown d2/d14/c3d 0 1 2024-09-18T12:51:22.845 INFO:tasks.workunit.client.1.smithi136.stdout:4/943: unlink d0/d3/dae/fe6 0 2024-09-18T12:51:22.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/525: mkdir d3/d1d/d89/db5/db8 0 2024-09-18T12:51:22.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/526: chown d3/d1e/l47 16 1 2024-09-18T12:51:22.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/527: write d3/d1e/fa4 [1047902,7497] 0 2024-09-18T12:51:22.846 INFO:tasks.workunit.client.1.smithi136.stdout:3/933: mknod d3/d14/d17/d8c/c129 0 2024-09-18T12:51:22.847 INFO:tasks.workunit.client.1.smithi136.stdout:3/934: fsync d3/d14/d17/db8/f107 0 2024-09-18T12:51:22.847 INFO:tasks.workunit.client.1.smithi136.stdout:9/928: dread d6/da/ff2 [0,4194304] 0 2024-09-18T12:51:22.847 INFO:tasks.workunit.client.0.smithi081.stdout:2/674: symlink d15/d16/d33/d53/d7a/d2f/d61/dd4/lf7 0 2024-09-18T12:51:22.850 INFO:tasks.workunit.client.1.smithi136.stdout:9/929: getdents d6/da/d3d/d4d/d91/d25 0 2024-09-18T12:51:22.850 INFO:tasks.workunit.client.1.smithi136.stdout:9/930: chown d6/db/d12/c17 3 1 2024-09-18T12:51:22.850 INFO:tasks.workunit.client.1.smithi136.stdout:9/931: write d6/df/d23/d2b/d79/d8b/f115 [339487,56985] 0 2024-09-18T12:51:22.850 INFO:tasks.workunit.client.1.smithi136.stdout:4/944: dread d0/d3/ff9 [0,4194304] 0 2024-09-18T12:51:22.850 INFO:tasks.workunit.client.1.smithi136.stdout:4/945: readlink d0/d25/d79/l94 0 2024-09-18T12:51:22.852 INFO:tasks.workunit.client.0.smithi081.stdout:5/622: unlink d2/d47/l4d 0 2024-09-18T12:51:22.854 INFO:tasks.workunit.client.0.smithi081.stdout:6/522: dwrite d4/d12/d28/d2a/d2d/d31/f7a [0,4194304] 0 2024-09-18T12:51:22.854 INFO:tasks.workunit.client.0.smithi081.stdout:6/523: write d4/d12/d1c/d39/f4a [42526,70523] 0 2024-09-18T12:51:22.856 INFO:tasks.workunit.client.1.smithi136.stdout:6/974: write d8/d9/de/f3d [3174731,523] 0 2024-09-18T12:51:22.857 INFO:tasks.workunit.client.1.smithi136.stdout:9/932: creat d6/df/d75/f132 x:0 0 0 2024-09-18T12:51:22.857 INFO:tasks.workunit.client.1.smithi136.stdout:4/946: mknod d0/d3/d90/df8/c12d 0 2024-09-18T12:51:22.858 INFO:tasks.workunit.client.1.smithi136.stdout:9/933: getdents d6/df/d23/d2b/d79/d53/d5c/df9 0 2024-09-18T12:51:22.858 INFO:tasks.workunit.client.1.smithi136.stdout:6/975: symlink d8/d9/de/d60/d71/d76/l13b 0 2024-09-18T12:51:22.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/955: dwrite d2/d5/d2b/d9b/d2e/fb5 [0,4194304] 0 2024-09-18T12:51:22.859 INFO:tasks.workunit.client.1.smithi136.stdout:1/956: truncate d2/fe6 4855731 0 2024-09-18T12:51:22.860 INFO:tasks.workunit.client.0.smithi081.stdout:6/524: getdents d4/d12/d28/d2a/d74 0 2024-09-18T12:51:22.860 INFO:tasks.workunit.client.0.smithi081.stdout:6/525: chown d4/d12/d56/d7d/d84 122 1 2024-09-18T12:51:22.860 INFO:tasks.workunit.client.0.smithi081.stdout:6/526: dread - d4/d12/d28/f4e zero size 2024-09-18T12:51:22.860 INFO:tasks.workunit.client.1.smithi136.stdout:4/947: mknod d0/d3/d54/d88/d111/c12e 0 2024-09-18T12:51:22.862 INFO:tasks.workunit.client.1.smithi136.stdout:9/934: mkdir d6/d59/d133 0 2024-09-18T12:51:22.867 INFO:tasks.workunit.client.1.smithi136.stdout:9/935: mknod d6/da/dd1/c134 0 2024-09-18T12:51:22.867 INFO:tasks.workunit.client.1.smithi136.stdout:9/936: chown d6/da/d3d/d41/f6d 7 1 2024-09-18T12:51:22.871 INFO:tasks.workunit.client.0.smithi081.stdout:8/528: rmdir d3/d1d/d89 39 2024-09-18T12:51:22.875 INFO:tasks.workunit.client.0.smithi081.stdout:4/485: dwrite d3/db/d35/f76 [0,4194304] 0 2024-09-18T12:51:22.882 INFO:tasks.workunit.client.0.smithi081.stdout:2/675: dwrite d15/d16/d33/d53/d7a/f27 [0,4194304] 0 2024-09-18T12:51:22.883 INFO:tasks.workunit.client.0.smithi081.stdout:2/676: truncate d15/d16/d33/f8b 1193374 0 2024-09-18T12:51:22.885 INFO:tasks.workunit.client.0.smithi081.stdout:4/486: mknod d3/d20/d3d/d65/d14/d27/ca1 0 2024-09-18T12:51:22.885 INFO:tasks.workunit.client.0.smithi081.stdout:4/487: fdatasync d3/d20/d3d/d65/d14/f1e 0 2024-09-18T12:51:22.885 INFO:tasks.workunit.client.0.smithi081.stdout:4/488: dread - d3/d20/d3d/d65/d14/d27/f94 zero size 2024-09-18T12:51:22.885 INFO:tasks.workunit.client.0.smithi081.stdout:4/489: dread - d3/d20/d3d/d65/d14/d4b/f74 zero size 2024-09-18T12:51:22.886 INFO:tasks.workunit.client.0.smithi081.stdout:2/677: dread d15/d16/def/dd8/fde [0,4194304] 0 2024-09-18T12:51:22.886 INFO:tasks.workunit.client.0.smithi081.stdout:8/529: getdents d3/d1e/d4c/dae 0 2024-09-18T12:51:22.886 INFO:tasks.workunit.client.0.smithi081.stdout:8/530: write d3/d1d/d4a/f97 [3730664,129989] 0 2024-09-18T12:51:22.886 INFO:tasks.workunit.client.0.smithi081.stdout:8/531: write d3/d1d/d4a/f4f [960984,20538] 0 2024-09-18T12:51:22.886 INFO:tasks.workunit.client.0.smithi081.stdout:2/678: mkdir d15/d16/d33/d53/d7a/d2f/dc2/df8 0 2024-09-18T12:51:22.892 INFO:tasks.workunit.client.0.smithi081.stdout:5/623: dwrite d2/d14/d1d/d1a/f81 [0,4194304] 0 2024-09-18T12:51:22.897 INFO:tasks.workunit.client.0.smithi081.stdout:6/527: dwrite d4/d12/f32 [0,4194304] 0 2024-09-18T12:51:22.898 INFO:tasks.workunit.client.1.smithi136.stdout:4/948: dwrite d0/d45/f55 [0,4194304] 0 2024-09-18T12:51:22.900 INFO:tasks.workunit.client.1.smithi136.stdout:4/949: read d0/d25/d83/fa3 [4244142,6231] 0 2024-09-18T12:51:22.900 INFO:tasks.workunit.client.1.smithi136.stdout:4/950: chown d0/d3/d54/d88/lbe 100248 1 2024-09-18T12:51:22.901 INFO:tasks.workunit.client.1.smithi136.stdout:4/951: symlink d0/d25/d83/d12a/l12f 0 2024-09-18T12:51:22.903 INFO:tasks.workunit.client.1.smithi136.stdout:6/976: rmdir d8/d9/de/d60 39 2024-09-18T12:51:22.903 INFO:tasks.workunit.client.1.smithi136.stdout:6/977: readlink d8/lad 0 2024-09-18T12:51:22.903 INFO:tasks.workunit.client.1.smithi136.stdout:9/937: dwrite d6/ff6 [0,4194304] 0 2024-09-18T12:51:22.904 INFO:tasks.workunit.client.1.smithi136.stdout:4/952: symlink d0/l130 0 2024-09-18T12:51:22.906 INFO:tasks.workunit.client.1.smithi136.stdout:6/978: rename d8/d9/de/d60/d71/d76/d97/f100 to d8/d9/de/d1c/d50/da8/df2/f13c 0 2024-09-18T12:51:22.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/528: dread d4/f7 [0,4194304] 0 2024-09-18T12:51:22.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/529: read d4/d12/d28/d2a/d2d/d31/f3d [25286,5180] 0 2024-09-18T12:51:22.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/530: fdatasync d4/d6/fb 0 2024-09-18T12:51:22.909 INFO:tasks.workunit.client.1.smithi136.stdout:4/953: rename d0/d45/f84 to d0/d13/f131 0 2024-09-18T12:51:22.910 INFO:tasks.workunit.client.0.smithi081.stdout:6/531: mknod d4/d12/d1c/d39/d73/cac 0 2024-09-18T12:51:22.910 INFO:tasks.workunit.client.1.smithi136.stdout:4/954: unlink d0/d25/db7/fc7 0 2024-09-18T12:51:22.910 INFO:tasks.workunit.client.1.smithi136.stdout:4/955: fdatasync d0/d3/d54/d8a/faa 0 2024-09-18T12:51:22.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/532: write d4/d12/d28/f3c [1640407,32596] 0 2024-09-18T12:51:22.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/533: readlink d4/d12/l8e 0 2024-09-18T12:51:22.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/534: write d4/d12/d1c/f57 [167984,80060] 0 2024-09-18T12:51:22.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/535: read f0 [2310340,28641] 0 2024-09-18T12:51:22.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/536: stat d4/d12/d28/f38 0 2024-09-18T12:51:22.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/537: stat d4/d12/d28/d2a/d2d/c66 0 2024-09-18T12:51:22.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/538: stat d4/d12/c1f 0 2024-09-18T12:51:22.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/539: truncate d4/d6/f70 804163 0 2024-09-18T12:51:22.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/540: stat d4/d12/d1c/c29 0 2024-09-18T12:51:22.913 INFO:tasks.workunit.client.1.smithi136.stdout:9/938: dread d6/d13/fc1 [0,4194304] 0 2024-09-18T12:51:22.914 INFO:tasks.workunit.client.0.smithi081.stdout:4/490: dwrite d3/d20/d3d/d65/d45/d4f/f5a [0,4194304] 0 2024-09-18T12:51:22.914 INFO:tasks.workunit.client.0.smithi081.stdout:6/541: unlink d4/d12/d56/f63 0 2024-09-18T12:51:22.914 INFO:tasks.workunit.client.0.smithi081.stdout:6/542: chown d4/d12/d28/d2a/f4b 10416280 1 2024-09-18T12:51:22.914 INFO:tasks.workunit.client.1.smithi136.stdout:6/979: read d8/dcf/d113/f11c [1984398,79460] 0 2024-09-18T12:51:22.915 INFO:tasks.workunit.client.0.smithi081.stdout:8/532: dwrite d3/d1e/f2b [0,4194304] 0 2024-09-18T12:51:22.915 INFO:tasks.workunit.client.1.smithi136.stdout:9/939: symlink d6/df/d23/d2b/d79/l135 0 2024-09-18T12:51:22.915 INFO:tasks.workunit.client.1.smithi136.stdout:9/940: read d6/df/d23/dae/fd5 [15446,67779] 0 2024-09-18T12:51:22.917 INFO:tasks.workunit.client.0.smithi081.stdout:4/491: creat d3/db/d2d/d4e/d8d/fa2 x:0 0 0 2024-09-18T12:51:22.917 INFO:tasks.workunit.client.0.smithi081.stdout:4/492: write d3/db/d35/f83 [509786,67969] 0 2024-09-18T12:51:22.919 INFO:tasks.workunit.client.0.smithi081.stdout:6/543: rename d4/d12/d28/f3c to d4/d12/d56/d7d/d84/fad 0 2024-09-18T12:51:22.923 INFO:tasks.workunit.client.0.smithi081.stdout:4/493: truncate d3/db/f25 2272802 0 2024-09-18T12:51:22.925 INFO:tasks.workunit.client.0.smithi081.stdout:2/679: write d15/d16/d33/d53/d7a/f63 [1670729,47031] 0 2024-09-18T12:51:22.927 INFO:tasks.workunit.client.0.smithi081.stdout:8/533: rename d3/f2d to d3/d1e/d4c/fb9 0 2024-09-18T12:51:22.927 INFO:tasks.workunit.client.0.smithi081.stdout:8/534: fdatasync d3/d1e/d4c/d53/f5f 0 2024-09-18T12:51:22.928 INFO:tasks.workunit.client.0.smithi081.stdout:8/535: read d3/d2f/f94 [197578,11278] 0 2024-09-18T12:51:22.928 INFO:tasks.workunit.client.0.smithi081.stdout:4/494: mkdir d3/d20/da3 0 2024-09-18T12:51:22.928 INFO:tasks.workunit.client.0.smithi081.stdout:4/495: fsync d3/db/d2d/f7f 0 2024-09-18T12:51:22.928 INFO:tasks.workunit.client.0.smithi081.stdout:4/496: write d3/d20/f96 [214652,80930] 0 2024-09-18T12:51:22.931 INFO:tasks.workunit.client.0.smithi081.stdout:2/680: rename d15/d16/d20/d22/df3 to d15/df9 0 2024-09-18T12:51:22.931 INFO:tasks.workunit.client.0.smithi081.stdout:2/681: chown d15/d16/d20/d22/d5a/f74 21 1 2024-09-18T12:51:22.932 INFO:tasks.workunit.client.0.smithi081.stdout:6/544: dwrite d4/f4d [0,4194304] 0 2024-09-18T12:51:22.932 INFO:tasks.workunit.client.0.smithi081.stdout:6/545: truncate d4/d12/d28/d2a/d2d/f82 611006 0 2024-09-18T12:51:22.932 INFO:tasks.workunit.client.0.smithi081.stdout:8/536: creat d3/d1d/d4a/d8d/fba x:0 0 0 2024-09-18T12:51:22.932 INFO:tasks.workunit.client.0.smithi081.stdout:6/546: read d4/fa [1412239,13842] 0 2024-09-18T12:51:22.933 INFO:tasks.workunit.client.0.smithi081.stdout:8/537: dread d3/d1e/f36 [0,4194304] 0 2024-09-18T12:51:22.933 INFO:tasks.workunit.client.0.smithi081.stdout:4/497: mkdir d3/d20/d3d/d65/d45/da4 0 2024-09-18T12:51:22.933 INFO:tasks.workunit.client.0.smithi081.stdout:4/498: write d3/d20/d3d/d65/d2f/fa0 [292553,89497] 0 2024-09-18T12:51:22.936 INFO:tasks.workunit.client.0.smithi081.stdout:2/682: link d15/d16/d33/d53/d7a/d2f/dc2/f7d d15/d16/d33/d53/d7a/d2f/d61/d97/ffa 0 2024-09-18T12:51:22.942 INFO:tasks.workunit.client.0.smithi081.stdout:8/538: symlink d3/d1e/d4c/d53/lbb 0 2024-09-18T12:51:22.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/499: creat d3/d20/d3d/d65/fa5 x:0 0 0 2024-09-18T12:51:22.952 INFO:tasks.workunit.client.0.smithi081.stdout:8/539: truncate d3/d2f/f8a 1888785 0 2024-09-18T12:51:22.952 INFO:tasks.workunit.client.0.smithi081.stdout:8/540: chown d3/d1e/d4c/d53 12711640 1 2024-09-18T12:51:22.952 INFO:tasks.workunit.client.0.smithi081.stdout:8/541: dread - d3/d1e/d4c/fb6 zero size 2024-09-18T12:51:22.952 INFO:tasks.workunit.client.0.smithi081.stdout:6/547: dwrite d4/d12/d1c/f48 [0,4194304] 0 2024-09-18T12:51:22.955 INFO:tasks.workunit.client.0.smithi081.stdout:8/542: mknod d3/cbc 0 2024-09-18T12:51:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.959+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/1685979253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 msgr2=0x7f3a480fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.959+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/1685979253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480fffe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009910 tx=0x7f3a3c009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/1685979253 shutdown_connections 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/1685979253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 0x7f3a48101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/1685979253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480fffe0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/1685979253 >> 172.21.15.81:0/1685979253 conn(0x7f3a480fb160 msgr2=0x7f3a480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/1685979253 shutdown_connections 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.960+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/1685979253 wait complete. 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 Processor -- start 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 -- start start 2024-09-18T12:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/500: rmdir d3/d20/d3d/d65 39 2024-09-18T12:51:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 0x7f3a4819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4819bbb0 con 0x7f3a480ffbc0 2024-09-18T12:51:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.961+0000 7f3a4ea7a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4819bcf0 con 0x7f3a48100dc0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.962+0000 7f3a4c816700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.962+0000 7f3a4c816700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47108/0 (socket says 172.21.15.81:47108) 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.962+0000 7f3a4c816700 1 -- 172.21.15.81:0/881306846 learned_addr learned my addr 172.21.15.81:0/881306846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.962+0000 7f3a47fff700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 0x7f3a4819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.963+0000 7f3a4c816700 1 -- 172.21.15.81:0/881306846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 msgr2=0x7f3a4819b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.963+0000 7f3a4c816700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 0x7f3a4819b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.963+0000 7f3a4c816700 1 -- 172.21.15.81:0/881306846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c0095f0 con 0x7f3a480ffbc0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.963+0000 7f3a4c816700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006010 tx=0x7f3a3c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.964+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c01d070 con 0x7f3a480ffbc0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.964+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a3c022470 con 0x7f3a480ffbc0 2024-09-18T12:51:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.964+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c00f690 con 0x7f3a480ffbc0 2024-09-18T12:51:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.965+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a48195360 con 0x7f3a480ffbc0 2024-09-18T12:51:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.965+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a48195850 con 0x7f3a480ffbc0 2024-09-18T12:51:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.967+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4818f5d0 con 0x7f3a480ffbc0 2024-09-18T12:51:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.967+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f3a3c0225e0 con 0x7f3a480ffbc0 2024-09-18T12:51:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.968+0000 7f3a45ffb700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 0x7f3a38075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.968+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3a3c0960d0 con 0x7f3a480ffbc0 2024-09-18T12:51:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.968+0000 7f3a47fff700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 0x7f3a38075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.969+0000 7f3a47fff700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 0x7f3a38075f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a34006fd0 tx=0x7f3a34009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:22.976 INFO:tasks.workunit.client.0.smithi081.stdout:8/543: dwrite d3/d1e/f78 [0,4194304] 0 2024-09-18T12:51:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:22.975+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3a3c064410 con 0x7f3a480ffbc0 2024-09-18T12:51:22.977 INFO:tasks.workunit.client.0.smithi081.stdout:8/544: write d3/d1e/d4c/d53/f66 [1610002,69570] 0 2024-09-18T12:51:22.977 INFO:tasks.workunit.client.0.smithi081.stdout:6/548: dwrite d4/d12/d1c/f5b [0,4194304] 0 2024-09-18T12:51:22.977 INFO:tasks.workunit.client.0.smithi081.stdout:6/549: readlink d4/d6/lf 0 2024-09-18T12:51:22.981 INFO:tasks.workunit.client.0.smithi081.stdout:4/501: dwrite d3/d20/d3d/d65/d14/f1e [4194304,4194304] 0 2024-09-18T12:51:22.984 INFO:tasks.workunit.client.0.smithi081.stdout:4/502: truncate d3/d20/d3d/d65/d45/f81 2942644 0 2024-09-18T12:51:22.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/545: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:22.996 INFO:tasks.workunit.client.0.smithi081.stdout:6/550: dread d4/f13 [0,4194304] 0 2024-09-18T12:51:22.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/546: write d3/f25 [1621328,23070] 0 2024-09-18T12:51:22.996 INFO:tasks.workunit.client.0.smithi081.stdout:6/551: write d4/d6/f26 [5187737,35737] 0 2024-09-18T12:51:22.997 INFO:tasks.workunit.client.0.smithi081.stdout:8/547: chown d3/d1e/d4c/d53/fac 58534958 1 2024-09-18T12:51:22.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/552: symlink d4/d12/d1c/d39/d73/lae 0 2024-09-18T12:51:22.999 INFO:tasks.workunit.client.0.smithi081.stdout:6/553: creat d4/d12/d56/d7d/faf x:0 0 0 2024-09-18T12:51:23.000 INFO:tasks.workunit.client.0.smithi081.stdout:6/554: rename d4/d12/d1c/l2f to d4/d12/d28/d2a/lb0 0 2024-09-18T12:51:23.000 INFO:tasks.workunit.client.0.smithi081.stdout:6/555: creat d4/d12/d56/d7d/d9f/da2/fb1 x:0 0 0 2024-09-18T12:51:23.001 INFO:tasks.workunit.client.0.smithi081.stdout:6/556: truncate d4/d12/d28/d2a/d2d/d31/f3b 186412 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:8/548: write d3/d1e/f78 [2401169,97143] 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:8/549: chown d3/f85 81 1 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/503: dwrite d3/d20/d3d/d65/d45/f86 [0,4194304] 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/504: fdatasync d3/d20/d5b/f66 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:8/550: write d3/f13 [8177498,57543] 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/505: truncate d3/d20/d5b/f66 5123807 0 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:8/551: chown d3/l1b 0 1 2024-09-18T12:51:23.011 INFO:tasks.workunit.client.0.smithi081.stdout:8/552: readlink d3/l10 0 2024-09-18T12:51:23.013 INFO:tasks.workunit.client.0.smithi081.stdout:8/553: link d3/d2f/f87 d3/d1d/d4a/d8d/fbd 0 2024-09-18T12:51:23.013 INFO:tasks.workunit.client.0.smithi081.stdout:8/554: dread - d3/d73/fa6 zero size 2024-09-18T12:51:23.014 INFO:tasks.workunit.client.0.smithi081.stdout:4/506: symlink d3/db/la6 0 2024-09-18T12:51:23.015 INFO:tasks.workunit.client.0.smithi081.stdout:4/507: readlink d3/d20/d3d/d65/d14/d27/l40 0 2024-09-18T12:51:23.015 INFO:tasks.workunit.client.0.smithi081.stdout:8/555: mkdir d3/d73/dbe 0 2024-09-18T12:51:23.016 INFO:tasks.workunit.client.0.smithi081.stdout:8/556: unlink d3/d2f/f94 0 2024-09-18T12:51:23.022 INFO:tasks.workunit.client.0.smithi081.stdout:6/557: dwrite d4/d12/d28/d2a/d2d/d31/f3d [0,4194304] 0 2024-09-18T12:51:23.022 INFO:tasks.workunit.client.0.smithi081.stdout:8/557: dread d3/d2f/f8a [0,4194304] 0 2024-09-18T12:51:23.022 INFO:tasks.workunit.client.0.smithi081.stdout:8/558: write d3/d1d/d4a/f4f [2010120,12872] 0 2024-09-18T12:51:23.024 INFO:tasks.workunit.client.0.smithi081.stdout:6/558: mknod d4/d12/d56/d7d/d84/cb2 0 2024-09-18T12:51:23.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/508: read d3/db/f23 [3241578,17680] 0 2024-09-18T12:51:23.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/509: dread - d3/db/d2d/d4e/d8d/fa2 zero size 2024-09-18T12:51:23.025 INFO:tasks.workunit.client.0.smithi081.stdout:4/510: chown d3/db/f23 93 1 2024-09-18T12:51:23.026 INFO:tasks.workunit.client.0.smithi081.stdout:8/559: creat d3/d1d/d4a/fbf x:0 0 0 2024-09-18T12:51:23.027 INFO:tasks.workunit.client.0.smithi081.stdout:6/559: dread d4/d12/d1c/f57 [0,4194304] 0 2024-09-18T12:51:23.028 INFO:tasks.workunit.client.0.smithi081.stdout:4/511: rename d3/f7 to d3/db/d35/d79/fa7 0 2024-09-18T12:51:23.029 INFO:tasks.workunit.client.0.smithi081.stdout:8/560: rename d3/d1d/f41 to d3/d1d/d89/fc0 0 2024-09-18T12:51:23.029 INFO:tasks.workunit.client.0.smithi081.stdout:4/512: symlink d3/d20/d3d/d65/d45/d4f/la8 0 2024-09-18T12:51:23.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/561: rename d3/f98 to d3/d73/dbe/fc1 0 2024-09-18T12:51:23.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/562: chown d3/d1e 90 1 2024-09-18T12:51:23.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/563: write d3/d1d/f8b [1183877,21246] 0 2024-09-18T12:51:23.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/564: fsync d3/d1d/f55 0 2024-09-18T12:51:23.032 INFO:tasks.workunit.client.0.smithi081.stdout:4/513: symlink d3/db/d2d/d4e/d8d/la9 0 2024-09-18T12:51:23.034 INFO:tasks.workunit.client.0.smithi081.stdout:4/514: creat d3/d20/d3d/d65/d14/d4b/faa x:0 0 0 2024-09-18T12:51:23.034 INFO:tasks.workunit.client.0.smithi081.stdout:4/515: read d3/d20/d5b/f66 [1568722,39000] 0 2024-09-18T12:51:23.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/560: dread d4/d12/d56/d7d/fa5 [0,4194304] 0 2024-09-18T12:51:23.038 INFO:tasks.workunit.client.0.smithi081.stdout:6/561: getdents d4/d88 0 2024-09-18T12:51:23.039 INFO:tasks.workunit.client.0.smithi081.stdout:6/562: write d4/d12/d1c/f57 [576705,115440] 0 2024-09-18T12:51:23.039 INFO:tasks.workunit.client.0.smithi081.stdout:6/563: fsync d4/d12/d28/d2a/d2d/f4f 0 2024-09-18T12:51:23.041 INFO:tasks.workunit.client.0.smithi081.stdout:4/516: unlink d3/db/c3f 0 2024-09-18T12:51:23.041 INFO:tasks.workunit.client.0.smithi081.stdout:8/565: write d3/d2f/f87 [1598198,118734] 0 2024-09-18T12:51:23.041 INFO:tasks.workunit.client.0.smithi081.stdout:8/566: fdatasync d3/d73/fa2 0 2024-09-18T12:51:23.053 INFO:tasks.workunit.client.0.smithi081.stdout:8/567: rename d3/d1e/d4c/dae/faf to d3/d1d/fc2 0 2024-09-18T12:51:23.053 INFO:tasks.workunit.client.0.smithi081.stdout:8/568: write d3/d73/fa2 [591955,26274] 0 2024-09-18T12:51:23.053 INFO:tasks.workunit.client.0.smithi081.stdout:8/569: readlink d3/l60 0 2024-09-18T12:51:23.054 INFO:tasks.workunit.client.0.smithi081.stdout:4/517: link d3/db/d35/d79/f92 d3/db/fab 0 2024-09-18T12:51:23.055 INFO:tasks.workunit.client.0.smithi081.stdout:4/518: stat d3/d20/d3d/d65/d45/f4a 0 2024-09-18T12:51:23.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/570: unlink d3/f86 0 2024-09-18T12:51:23.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/571: write d3/d1d/d89/fc0 [19994,112918] 0 2024-09-18T12:51:23.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/572: fdatasync d3/d1d/f55 0 2024-09-18T12:51:23.059 INFO:tasks.workunit.client.0.smithi081.stdout:6/564: dwrite f1 [0,4194304] 0 2024-09-18T12:51:23.062 INFO:tasks.workunit.client.0.smithi081.stdout:6/565: mknod d4/d12/d28/d2a/d2d/cb3 0 2024-09-18T12:51:23.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:22 smithi136 ceph-mon[35363]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:22 smithi136 ceph-mon[35363]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:22 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/87582084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:23.068 INFO:tasks.workunit.client.0.smithi081.stdout:4/519: rmdir d3/db/d2d/d4e 39 2024-09-18T12:51:23.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/566: dread d4/f58 [0,4194304] 0 2024-09-18T12:51:23.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/567: write d4/d12/d28/f38 [4385177,51894] 0 2024-09-18T12:51:23.073 INFO:tasks.workunit.client.0.smithi081.stdout:6/568: rmdir d4/d12/d56/d7d/d9f/da2 39 2024-09-18T12:51:23.075 INFO:tasks.workunit.client.0.smithi081.stdout:6/569: mkdir d4/d6/db4 0 2024-09-18T12:51:23.076 INFO:tasks.workunit.client.0.smithi081.stdout:4/520: dread d3/d20/d3d/d65/d45/d4f/f5a [0,4194304] 0 2024-09-18T12:51:23.077 INFO:tasks.workunit.client.0.smithi081.stdout:4/521: write d3/d20/d3d/d65/d14/d3e/f51 [411718,63367] 0 2024-09-18T12:51:23.077 INFO:tasks.workunit.client.0.smithi081.stdout:4/522: read - d3/d20/d3d/d65/d14/d27/f94 zero size 2024-09-18T12:51:23.077 INFO:tasks.workunit.client.0.smithi081.stdout:4/523: chown d3/d20/d3d/d65/f19 141 1 2024-09-18T12:51:23.077 INFO:tasks.workunit.client.0.smithi081.stdout:6/570: unlink d4/d12/l5a 0 2024-09-18T12:51:23.078 INFO:tasks.workunit.client.0.smithi081.stdout:6/571: dread - d4/d6/f85 zero size 2024-09-18T12:51:23.079 INFO:tasks.workunit.client.0.smithi081.stdout:6/572: mknod d4/d12/d1c/d8f/cb5 0 2024-09-18T12:51:23.079 INFO:tasks.workunit.client.0.smithi081.stdout:6/573: write d4/d12/d1c/d64/f81 [863279,55423] 0 2024-09-18T12:51:23.079 INFO:tasks.workunit.client.0.smithi081.stdout:6/574: rmdir d4/d12/d28/d2a/d74 39 2024-09-18T12:51:23.086 INFO:tasks.workunit.client.0.smithi081.stdout:4/524: dread d3/d20/d3d/d65/d45/f53 [0,4194304] 0 2024-09-18T12:51:23.088 INFO:tasks.workunit.client.1.smithi136.stdout:3/935: sync 2024-09-18T12:51:23.088 INFO:tasks.workunit.client.1.smithi136.stdout:1/957: sync 2024-09-18T12:51:23.089 INFO:tasks.workunit.client.0.smithi081.stdout:4/525: creat d3/d20/d3d/d65/d14/d54/fac x:0 0 0 2024-09-18T12:51:23.089 INFO:tasks.workunit.client.1.smithi136.stdout:3/936: symlink d3/l12a 0 2024-09-18T12:51:23.091 INFO:tasks.workunit.client.1.smithi136.stdout:1/958: rename d2/d5/d2b/d9b/dbe/dd3/fdc to d2/d5/d9/dcb/dfb/d107/d114/f145 0 2024-09-18T12:51:23.096 INFO:tasks.workunit.client.0.smithi081.stdout:6/575: dwrite d4/d12/d1c/d39/d60/f8c [0,4194304] 0 2024-09-18T12:51:23.098 INFO:tasks.workunit.client.0.smithi081.stdout:4/526: dread d3/d20/d3d/d65/d14/d27/f37 [0,4194304] 0 2024-09-18T12:51:23.099 INFO:tasks.workunit.client.0.smithi081.stdout:4/527: chown d3/d20/d3d/d65/d2f/d8c 868651 1 2024-09-18T12:51:23.099 INFO:tasks.workunit.client.0.smithi081.stdout:4/528: truncate d3/d20/d3d/d65/d14/d3e/f6a 716771 0 2024-09-18T12:51:23.101 INFO:tasks.workunit.client.0.smithi081.stdout:6/576: rename d4/d12/d1c/f5b to d4/d12/d28/d2a/d2d/d31/fb6 0 2024-09-18T12:51:23.103 INFO:tasks.workunit.client.0.smithi081.stdout:4/529: write d3/db/d2d/f7f [2852803,97968] 0 2024-09-18T12:51:23.104 INFO:tasks.workunit.client.1.smithi136.stdout:3/937: dread d3/d14/d17/d53/fb3 [0,4194304] 0 2024-09-18T12:51:23.105 INFO:tasks.workunit.client.0.smithi081.stdout:4/530: link d3/lf d3/d20/d3d/d65/d14/lad 0 2024-09-18T12:51:23.105 INFO:tasks.workunit.client.0.smithi081.stdout:4/531: dread - d3/d20/d3d/f8f zero size 2024-09-18T12:51:23.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:22 smithi081 ceph-mon[27646]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:23.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:22 smithi081 ceph-mon[27646]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:23.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:22 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/87582084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:23.108 INFO:tasks.workunit.client.0.smithi081.stdout:4/532: rename d3/db/f18 to d3/d20/d3d/d6b/fae 0 2024-09-18T12:51:23.110 INFO:tasks.workunit.client.0.smithi081.stdout:4/533: rename d3/d20/d3d/d65/d14/f31 to d3/db/d2d/faf 0 2024-09-18T12:51:23.111 INFO:tasks.workunit.client.0.smithi081.stdout:4/534: mknod d3/d20/d5b/cb0 0 2024-09-18T12:51:23.113 INFO:tasks.workunit.client.0.smithi081.stdout:4/535: unlink d3/d20/d3d/d65/d14/lad 0 2024-09-18T12:51:23.114 INFO:tasks.workunit.client.0.smithi081.stdout:4/536: creat d3/d20/d3d/d65/d45/d4f/fb1 x:0 0 0 2024-09-18T12:51:23.115 INFO:tasks.workunit.client.0.smithi081.stdout:4/537: rmdir d3/d20/d3d/d65/d9b 0 2024-09-18T12:51:23.118 INFO:tasks.workunit.client.1.smithi136.stdout:3/938: dwrite d3/d14/d17/d53/d73/dbf/fec [0,4194304] 0 2024-09-18T12:51:23.121 INFO:tasks.workunit.client.1.smithi136.stdout:3/939: dread d3/d5/d102/fc3 [0,4194304] 0 2024-09-18T12:51:23.134 INFO:tasks.workunit.client.0.smithi081.stdout:4/538: dwrite d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:23.134 INFO:tasks.workunit.client.0.smithi081.stdout:4/539: truncate d3/db/d2d/faf 3256867 0 2024-09-18T12:51:23.141 INFO:tasks.workunit.client.1.smithi136.stdout:3/940: dwrite d3/d14/d22/f1f [0,4194304] 0 2024-09-18T12:51:23.141 INFO:tasks.workunit.client.1.smithi136.stdout:3/941: chown d3/d14/d17/d11a/l11c 769957 1 2024-09-18T12:51:23.142 INFO:tasks.workunit.client.1.smithi136.stdout:3/942: mknod d3/d14/d22/d2c/c12b 0 2024-09-18T12:51:23.142 INFO:tasks.workunit.client.1.smithi136.stdout:3/943: readlink d3/d14/d17/l82 0 2024-09-18T12:51:23.143 INFO:tasks.workunit.client.1.smithi136.stdout:3/944: read d3/d5/d102/fd1 [644589,32141] 0 2024-09-18T12:51:23.144 INFO:tasks.workunit.client.1.smithi136.stdout:3/945: creat d3/d10/f12c x:0 0 0 2024-09-18T12:51:23.152 INFO:tasks.workunit.client.0.smithi081.stdout:4/540: dwrite d3/db/f23 [0,4194304] 0 2024-09-18T12:51:23.153 INFO:tasks.workunit.client.1.smithi136.stdout:3/946: dread d3/d14/fb9 [0,4194304] 0 2024-09-18T12:51:23.156 INFO:tasks.workunit.client.1.smithi136.stdout:3/947: rmdir d3/d14/dc5 39 2024-09-18T12:51:23.159 INFO:tasks.workunit.client.1.smithi136.stdout:3/948: rename d3/d10/d4a to d3/d2b/d6c/db4/dfe/df7/d12d 0 2024-09-18T12:51:23.161 INFO:tasks.workunit.client.1.smithi136.stdout:3/949: rename d3/d10/caa to d3/d2b/d6c/db4/dfe/df7/c12e 0 2024-09-18T12:51:23.162 INFO:tasks.workunit.client.1.smithi136.stdout:3/950: creat d3/d5/d102/f12f x:0 0 0 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/951: mknod d3/d14/d22/d2c/c130 0 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/952: stat d3/d2b/d6c/db4/dfe/df7/d12d/l111 0 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/953: stat d3/d14/d17/d75/d86/dd9/df2/f101 0 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/954: write d3/d14/d18/f7d [1776151,102765] 0 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/955: read - d3/d14/d17/d75/d86/ffa zero size 2024-09-18T12:51:23.164 INFO:tasks.workunit.client.1.smithi136.stdout:3/956: chown d3/d14/d22/f42 1116622285 1 2024-09-18T12:51:23.165 INFO:tasks.workunit.client.1.smithi136.stdout:3/957: creat d3/d10/d84/f131 x:0 0 0 2024-09-18T12:51:23.165 INFO:tasks.workunit.client.1.smithi136.stdout:3/958: getdents d3/d14/d17/d53/d73/dbf 0 2024-09-18T12:51:23.167 INFO:tasks.workunit.client.1.smithi136.stdout:3/959: rename d3/d5/d31/l104 to d3/d2b/d6c/db4/dfe/df7/l132 0 2024-09-18T12:51:23.168 INFO:tasks.workunit.client.0.smithi081.stdout:4/541: dwrite d3/d20/f96 [0,4194304] 0 2024-09-18T12:51:23.169 INFO:tasks.workunit.client.1.smithi136.stdout:3/960: link d3/d14/dc5/l66 d3/d14/d17/d75/d86/l133 0 2024-09-18T12:51:23.173 INFO:tasks.workunit.client.0.smithi081.stdout:4/542: write d3/d20/d3d/d65/d14/d3e/f6a [1760675,126639] 0 2024-09-18T12:51:23.173 INFO:tasks.workunit.client.0.smithi081.stdout:4/543: fsync d3/db/f9e 0 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:1/621: sync 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:0/551: sync 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/485: sync 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/536: sync 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:0/552: truncate d7/d9/d4b/d33/f82 344742 0 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/486: write dd/de/d4f/f66 [340746,24238] 0 2024-09-18T12:51:23.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/487: fdatasync dd/de/f13 0 2024-09-18T12:51:23.182 INFO:tasks.workunit.client.0.smithi081.stdout:1/622: fdatasync d0/d6/f1b 0 2024-09-18T12:51:23.182 INFO:tasks.workunit.client.0.smithi081.stdout:3/608: sync 2024-09-18T12:51:23.183 INFO:tasks.workunit.client.0.smithi081.stdout:0/553: creat d7/fb8 x:0 0 0 2024-09-18T12:51:23.184 INFO:tasks.workunit.client.0.smithi081.stdout:1/623: mkdir d0/d18/d1a/dd3 0 2024-09-18T12:51:23.185 INFO:tasks.workunit.client.0.smithi081.stdout:3/609: creat d3/db/dc/fd6 x:0 0 0 2024-09-18T12:51:23.186 INFO:tasks.workunit.client.0.smithi081.stdout:0/554: creat d7/d9/d4b/d33/db1/fb9 x:0 0 0 2024-09-18T12:51:23.187 INFO:tasks.workunit.client.0.smithi081.stdout:3/610: symlink d3/db/df/d29/d13/d65/ld7 0 2024-09-18T12:51:23.187 INFO:tasks.workunit.client.0.smithi081.stdout:3/611: fdatasync d3/db/f4b 0 2024-09-18T12:51:23.191 INFO:tasks.workunit.client.0.smithi081.stdout:0/555: rename d7/d4f to d7/d9/d12/dba 0 2024-09-18T12:51:23.194 INFO:tasks.workunit.client.0.smithi081.stdout:3/612: rename d3/c6e to d3/db/da4/dc2/cd8 0 2024-09-18T12:51:23.194 INFO:tasks.workunit.client.0.smithi081.stdout:1/624: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:23.196 INFO:tasks.workunit.client.0.smithi081.stdout:3/613: mkdir d3/db/df/d60/dd9 0 2024-09-18T12:51:23.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/537: write d2/d14/d21/d62/da7/f7d [2803013,43871] 0 2024-09-18T12:51:23.196 INFO:tasks.workunit.client.1.smithi136.stdout:3/961: dwrite d3/d14/d17/d8c/d96/fcf [0,4194304] 0 2024-09-18T12:51:23.197 INFO:tasks.workunit.client.1.smithi136.stdout:3/962: dread - d3/d2b/d6c/db4/dfe/df7/d12d/fd3 zero size 2024-09-18T12:51:23.197 INFO:tasks.workunit.client.0.smithi081.stdout:9/488: write dd/de/f97 [1537536,92880] 0 2024-09-18T12:51:23.198 INFO:tasks.workunit.client.0.smithi081.stdout:1/625: rename d0/d18/d6a/c6f to d0/d6/d33/d37/d98/d79/cd4 0 2024-09-18T12:51:23.198 INFO:tasks.workunit.client.0.smithi081.stdout:1/626: stat d0/d6/d33/f61 0 2024-09-18T12:51:23.198 INFO:tasks.workunit.client.0.smithi081.stdout:1/627: truncate d0/db/d12/d2d/faa 868626 0 2024-09-18T12:51:23.200 INFO:tasks.workunit.client.0.smithi081.stdout:9/489: rmdir dd/d15 39 2024-09-18T12:51:23.200 INFO:tasks.workunit.client.0.smithi081.stdout:9/490: write dd/d1d/d1e/d24/f64 [816303,129873] 0 2024-09-18T12:51:23.200 INFO:tasks.workunit.client.0.smithi081.stdout:9/491: dread - dd/de/d4f/f9c zero size 2024-09-18T12:51:23.201 INFO:tasks.workunit.client.1.smithi136.stdout:3/963: mknod d3/d2b/d6c/db4/dfe/df7/d12d/d51/c134 0 2024-09-18T12:51:23.201 INFO:tasks.workunit.client.0.smithi081.stdout:1/628: mkdir d0/db/d4f/dd2/dd5 0 2024-09-18T12:51:23.202 INFO:tasks.workunit.client.0.smithi081.stdout:9/492: link dd/d15/d1a/d35/l57 dd/de/d7a/la2 0 2024-09-18T12:51:23.206 INFO:tasks.workunit.client.0.smithi081.stdout:4/544: dwrite d3/d20/d3d/d65/d45/f53 [4194304,4194304] 0 2024-09-18T12:51:23.207 INFO:tasks.workunit.client.0.smithi081.stdout:4/545: readlink d3/d20/d3d/d65/d45/d6c/l8a 0 2024-09-18T12:51:23.209 INFO:tasks.workunit.client.0.smithi081.stdout:3/614: dread d3/db/dc/f73 [0,4194304] 0 2024-09-18T12:51:23.209 INFO:tasks.workunit.client.0.smithi081.stdout:3/615: chown d3/db/df/d29/d13/d93 1848344 1 2024-09-18T12:51:23.211 INFO:tasks.workunit.client.0.smithi081.stdout:4/546: unlink d3/db/d2d/c78 0 2024-09-18T12:51:23.215 INFO:tasks.workunit.client.1.smithi136.stdout:4/956: sync 2024-09-18T12:51:23.215 INFO:tasks.workunit.client.1.smithi136.stdout:6/980: sync 2024-09-18T12:51:23.216 INFO:tasks.workunit.client.1.smithi136.stdout:9/941: sync 2024-09-18T12:51:23.216 INFO:tasks.workunit.client.1.smithi136.stdout:1/959: sync 2024-09-18T12:51:23.216 INFO:tasks.workunit.client.0.smithi081.stdout:3/616: creat d3/d84/fda x:0 0 0 2024-09-18T12:51:23.216 INFO:tasks.workunit.client.0.smithi081.stdout:3/617: chown d3/d23 3 1 2024-09-18T12:51:23.216 INFO:tasks.workunit.client.0.smithi081.stdout:3/618: truncate d3/db/d1b/f94 1265344 0 2024-09-18T12:51:23.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/556: fsync d7/d9/d4b/d33/db1/fb9 0 2024-09-18T12:51:23.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/557: write d7/d9/d4b/d4a/d77/f7e [1044181,68857] 0 2024-09-18T12:51:23.218 INFO:tasks.workunit.client.1.smithi136.stdout:9/942: mknod d6/da/d3d/d4d/d91/d38/dbc/c136 0 2024-09-18T12:51:23.222 INFO:tasks.workunit.client.1.smithi136.stdout:9/943: dread d6/d13/fc1 [0,4194304] 0 2024-09-18T12:51:23.224 INFO:tasks.workunit.client.1.smithi136.stdout:9/944: mkdir d6/d96/dbb/d137 0 2024-09-18T12:51:23.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/619: write d3/db/d1b/d57/fce [635301,72806] 0 2024-09-18T12:51:23.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/620: write d3/db/df/d29/d12/d44/d6f/f99 [359131,31351] 0 2024-09-18T12:51:23.228 INFO:tasks.workunit.client.1.smithi136.stdout:9/945: mkdir d6/da/d3d/d4d/d91/d138 0 2024-09-18T12:51:23.228 INFO:tasks.workunit.client.1.smithi136.stdout:9/946: truncate d6/df/d23/d2b/d79/d119/d123/f128 155501 0 2024-09-18T12:51:23.228 INFO:tasks.workunit.client.1.smithi136.stdout:1/960: dread d2/d5/d2b/d9b/f19 [0,4194304] 0 2024-09-18T12:51:23.228 INFO:tasks.workunit.client.1.smithi136.stdout:1/961: getdents d2/d5/d2b/d9b/d2e/d13f 0 2024-09-18T12:51:23.229 INFO:tasks.workunit.client.1.smithi136.stdout:1/962: write d2/d5/fa1 [1445652,52488] 0 2024-09-18T12:51:23.229 INFO:tasks.workunit.client.0.smithi081.stdout:4/547: symlink d3/d20/d3d/d65/d45/d4f/lb2 0 2024-09-18T12:51:23.230 INFO:tasks.workunit.client.1.smithi136.stdout:1/963: truncate d2/d5/d2b/f4a 1381135 0 2024-09-18T12:51:23.230 INFO:tasks.workunit.client.1.smithi136.stdout:1/964: stat d2/d5/d2b/d34/d5c/f9e 0 2024-09-18T12:51:23.231 INFO:tasks.workunit.client.0.smithi081.stdout:0/558: rmdir d7/d9/d4b/d33 39 2024-09-18T12:51:23.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/559: truncate d7/d9/f90 1414591 0 2024-09-18T12:51:23.232 INFO:tasks.workunit.client.1.smithi136.stdout:1/965: mknod d2/d5/d9/dcb/d13d/c146 0 2024-09-18T12:51:23.232 INFO:tasks.workunit.client.1.smithi136.stdout:1/966: chown d2/d5/d2b/d34/d86/f2c 48779432 1 2024-09-18T12:51:23.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/629: dwrite d0/db/fba [0,4194304] 0 2024-09-18T12:51:23.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/630: chown d0/d6/d7/d8/f52 2820 1 2024-09-18T12:51:23.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/631: chown d0/d6/d7/f81 27 1 2024-09-18T12:51:23.234 INFO:tasks.workunit.client.1.smithi136.stdout:3/964: dwrite d3/d2b/d6c/db4/dfe/ff1 [0,4194304] 0 2024-09-18T12:51:23.234 INFO:tasks.workunit.client.1.smithi136.stdout:3/965: read - d3/d14/d17/d8c/f127 zero size 2024-09-18T12:51:23.235 INFO:tasks.workunit.client.0.smithi081.stdout:1/632: write d0/d6/d66/f6b [656071,77201] 0 2024-09-18T12:51:23.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/493: dwrite dd/d1d/d1e/d24/f67 [0,4194304] 0 2024-09-18T12:51:23.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/494: getdents dd/d1d/d1e/d39/d73 0 2024-09-18T12:51:23.236 INFO:tasks.workunit.client.0.smithi081.stdout:4/548: unlink d3/d20/d3d/d65/d14/c1f 0 2024-09-18T12:51:23.238 INFO:tasks.workunit.client.1.smithi136.stdout:3/966: creat d3/d14/d18/d7f/d100/f135 x:0 0 0 2024-09-18T12:51:23.239 INFO:tasks.workunit.client.0.smithi081.stdout:0/560: creat d7/d9/d4b/d33/fbb x:0 0 0 2024-09-18T12:51:23.240 INFO:tasks.workunit.client.1.smithi136.stdout:3/967: mknod d3/d2b/d6c/db4/dfe/c136 0 2024-09-18T12:51:23.241 INFO:tasks.workunit.client.1.smithi136.stdout:1/967: read d2/fe5 [1982801,20102] 0 2024-09-18T12:51:23.243 INFO:tasks.workunit.client.0.smithi081.stdout:1/633: link d0/ff d0/db/d12/d2d/fd6 0 2024-09-18T12:51:23.243 INFO:tasks.workunit.client.1.smithi136.stdout:1/968: creat d2/d5/d2b/d63/f147 x:0 0 0 2024-09-18T12:51:23.243 INFO:tasks.workunit.client.1.smithi136.stdout:1/969: readlink l0 0 2024-09-18T12:51:23.246 INFO:tasks.workunit.client.1.smithi136.stdout:6/981: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-18T12:51:23.246 INFO:tasks.workunit.client.1.smithi136.stdout:6/982: write d8/f5a [168678,67681] 0 2024-09-18T12:51:23.249 INFO:tasks.workunit.client.0.smithi081.stdout:3/621: dwrite d3/db/f56 [0,4194304] 0 2024-09-18T12:51:23.251 INFO:tasks.workunit.client.0.smithi081.stdout:9/495: write dd/d31/d4a/f62 [1679116,57907] 0 2024-09-18T12:51:23.253 INFO:tasks.workunit.client.0.smithi081.stdout:0/561: dread d7/d9/d4b/d53/f70 [0,4194304] 0 2024-09-18T12:51:23.253 INFO:tasks.workunit.client.0.smithi081.stdout:0/562: readlink d7/d9/d4b/d4a/l62 0 2024-09-18T12:51:23.256 INFO:tasks.workunit.client.0.smithi081.stdout:0/563: mknod d7/cbc 0 2024-09-18T12:51:23.257 INFO:tasks.workunit.client.0.smithi081.stdout:7/538: write d2/d18/f20 [2057838,85750] 0 2024-09-18T12:51:23.257 INFO:tasks.workunit.client.0.smithi081.stdout:7/539: chown d2/d56/d73/da4/cb4 5712 1 2024-09-18T12:51:23.257 INFO:tasks.workunit.client.0.smithi081.stdout:7/540: write d2/d14/d21/d62/da7/f50 [4205881,18442] 0 2024-09-18T12:51:23.259 INFO:tasks.workunit.client.0.smithi081.stdout:0/564: creat d7/d9/d4b/d33/d43/fbd x:0 0 0 2024-09-18T12:51:23.263 INFO:tasks.workunit.client.0.smithi081.stdout:9/496: dread dd/d1d/f2e [4194304,4194304] 0 2024-09-18T12:51:23.267 INFO:tasks.workunit.client.0.smithi081.stdout:7/541: symlink d2/d1d/lc0 0 2024-09-18T12:51:23.269 INFO:tasks.workunit.client.0.smithi081.stdout:0/565: mknod d7/d5d/d9f/cbe 0 2024-09-18T12:51:23.269 INFO:tasks.workunit.client.0.smithi081.stdout:0/566: truncate d7/d9/d4b/d53/fad 190524 0 2024-09-18T12:51:23.269 INFO:tasks.workunit.client.0.smithi081.stdout:9/497: symlink dd/de/la3 0 2024-09-18T12:51:23.270 INFO:tasks.workunit.client.0.smithi081.stdout:9/498: rmdir dd/de 39 2024-09-18T12:51:23.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/499: creat dd/d1d/d1e/d24/fa4 x:0 0 0 2024-09-18T12:51:23.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/500: fdatasync dd/d1d/d1e/d24/f67 0 2024-09-18T12:51:23.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/501: write dd/de/d4f/f95 [1044593,15228] 0 2024-09-18T12:51:23.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/502: chown dd/de/d7a/la2 7230446 1 2024-09-18T12:51:23.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/503: fdatasync dd/d15/d1a/d35/f53 0 2024-09-18T12:51:23.273 INFO:tasks.workunit.client.0.smithi081.stdout:9/504: read - dd/d1d/d1e/d24/d2a/f96 zero size 2024-09-18T12:51:23.273 INFO:tasks.workunit.client.1.smithi136.stdout:3/968: dwrite d3/d2b/d6c/db4/dfe/ff1 [0,4194304] 0 2024-09-18T12:51:23.274 INFO:tasks.workunit.client.1.smithi136.stdout:1/970: dwrite d2/d5/d2b/d34/f125 [0,4194304] 0 2024-09-18T12:51:23.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/505: rename dd/d1d/d1e/d39/d73/l8f to dd/d1b/la5 0 2024-09-18T12:51:23.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/506: creat dd/d1d/d1e/d39/fa6 x:0 0 0 2024-09-18T12:51:23.278 INFO:tasks.workunit.client.1.smithi136.stdout:1/971: mknod d2/d5/d2b/d34/d5c/d96/c148 0 2024-09-18T12:51:23.278 INFO:tasks.workunit.client.0.smithi081.stdout:9/507: rmdir dd/d15/d1a/d35 39 2024-09-18T12:51:23.279 INFO:tasks.workunit.client.0.smithi081.stdout:0/567: write d7/d9/d4b/d33/d7d/f8d [2139501,102652] 0 2024-09-18T12:51:23.280 INFO:tasks.workunit.client.0.smithi081.stdout:9/508: mkdir dd/d15/d1a/da7 0 2024-09-18T12:51:23.282 INFO:tasks.workunit.client.1.smithi136.stdout:1/972: getdents d2/d5/d2b/d34 0 2024-09-18T12:51:23.283 INFO:tasks.workunit.client.0.smithi081.stdout:0/568: mkdir d7/dbf 0 2024-09-18T12:51:23.283 INFO:tasks.workunit.client.0.smithi081.stdout:0/569: truncate d7/d9/d4b/d3d/f91 947393 0 2024-09-18T12:51:23.283 INFO:tasks.workunit.client.0.smithi081.stdout:0/570: chown d7/d9/d4b/f38 36782805 1 2024-09-18T12:51:23.306 INFO:tasks.workunit.client.1.smithi136.stdout:3/969: dwrite d3/d2b/fba [0,4194304] 0 2024-09-18T12:51:23.307 INFO:tasks.workunit.client.1.smithi136.stdout:1/973: dwrite d2/d5/fa1 [0,4194304] 0 2024-09-18T12:51:23.308 INFO:tasks.workunit.client.0.smithi081.stdout:0/571: dwrite d7/d9/d4b/d33/d43/fbd [0,4194304] 0 2024-09-18T12:51:23.309 INFO:tasks.workunit.client.1.smithi136.stdout:3/970: creat d3/d14/dc5/f137 x:0 0 0 2024-09-18T12:51:23.309 INFO:tasks.workunit.client.1.smithi136.stdout:3/971: stat d3/d5/d31/le2 0 2024-09-18T12:51:23.310 INFO:tasks.workunit.client.0.smithi081.stdout:7/542: truncate d2/d18/f20 1573567 0 2024-09-18T12:51:23.310 INFO:tasks.workunit.client.0.smithi081.stdout:7/543: stat d2/d18/d60/d85/fb2 0 2024-09-18T12:51:23.312 INFO:tasks.workunit.client.1.smithi136.stdout:3/972: link d3/d14/d18/d7f/d100/f135 d3/d2b/d6c/db4/dfe/df7/d12d/f138 0 2024-09-18T12:51:23.313 INFO:tasks.workunit.client.1.smithi136.stdout:3/973: mkdir d3/d2b/d6c/db4/dfe/df7/d12d/d139 0 2024-09-18T12:51:23.317 INFO:tasks.workunit.client.0.smithi081.stdout:0/572: mknod d7/d9/cc0 0 2024-09-18T12:51:23.317 INFO:tasks.workunit.client.0.smithi081.stdout:0/573: fsync d7/d9/d4b/d4a/f1a 0 2024-09-18T12:51:23.317 INFO:tasks.workunit.client.0.smithi081.stdout:7/544: rename d2/d14/d21/d62/f70 to d2/d56/d73/fc1 0 2024-09-18T12:51:23.318 INFO:tasks.workunit.client.1.smithi136.stdout:3/974: mkdir d3/d14/d22/d2c/dd5/d13a 0 2024-09-18T12:51:23.318 INFO:tasks.workunit.client.1.smithi136.stdout:3/975: rmdir d3/d14/d22/d2c 39 2024-09-18T12:51:23.318 INFO:tasks.workunit.client.1.smithi136.stdout:3/976: chown d3/d14/d17/d75/d86/ld2 27429073 1 2024-09-18T12:51:23.319 INFO:tasks.workunit.client.0.smithi081.stdout:0/574: symlink d7/d9/d4b/d4a/lc1 0 2024-09-18T12:51:23.319 INFO:tasks.workunit.client.0.smithi081.stdout:0/575: readlink d7/d9/l2f 0 2024-09-18T12:51:23.319 INFO:tasks.workunit.client.0.smithi081.stdout:0/576: fdatasync d7/d9/d4b/d4a/d92/f9b 0 2024-09-18T12:51:23.321 INFO:tasks.workunit.client.0.smithi081.stdout:0/577: unlink d7/d9/d4b/d33/l7a 0 2024-09-18T12:51:23.322 INFO:tasks.workunit.client.1.smithi136.stdout:1/974: write d2/fd2 [1480958,15465] 0 2024-09-18T12:51:23.322 INFO:tasks.workunit.client.0.smithi081.stdout:0/578: dread d7/d9/d4b/d4a/f1e [0,4194304] 0 2024-09-18T12:51:23.322 INFO:tasks.workunit.client.0.smithi081.stdout:0/579: read d7/d9/d4b/d4a/d92/f9b [6552160,74328] 0 2024-09-18T12:51:23.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/580: symlink d7/d9/d4b/lc2 0 2024-09-18T12:51:23.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/581: chown d7/d9/d4b/d4a/c17 84 1 2024-09-18T12:51:23.323 INFO:tasks.workunit.client.1.smithi136.stdout:1/975: mknod d2/d5/d2b/d63/dda/d120/d122/c149 0 2024-09-18T12:51:23.323 INFO:tasks.workunit.client.1.smithi136.stdout:1/976: chown d2 28704952 1 2024-09-18T12:51:23.324 INFO:tasks.workunit.client.0.smithi081.stdout:0/582: creat d7/d9/d4b/d33/d7d/fc3 x:0 0 0 2024-09-18T12:51:23.325 INFO:tasks.workunit.client.0.smithi081.stdout:0/583: readlink d7/d9/d12/l37 0 2024-09-18T12:51:23.327 INFO:tasks.workunit.client.1.smithi136.stdout:3/977: write d3/d14/d17/d53/fb3 [1204903,17367] 0 2024-09-18T12:51:23.328 INFO:tasks.workunit.client.0.smithi081.stdout:0/584: creat d7/d9/d4b/d33/d43/d9a/fc4 x:0 0 0 2024-09-18T12:51:23.328 INFO:tasks.workunit.client.0.smithi081.stdout:0/585: dread - d7/d9/d4b/d33/db1/fb9 zero size 2024-09-18T12:51:23.328 INFO:tasks.workunit.client.0.smithi081.stdout:0/586: chown d7/d9/f3e 17522276 1 2024-09-18T12:51:23.328 INFO:tasks.workunit.client.0.smithi081.stdout:0/587: chown d7/d7c 0 1 2024-09-18T12:51:23.330 INFO:tasks.workunit.client.1.smithi136.stdout:3/978: mknod d3/d14/c13b 0 2024-09-18T12:51:23.334 INFO:tasks.workunit.client.1.smithi136.stdout:3/979: mkdir d3/d14/d18/d13c 0 2024-09-18T12:51:23.337 INFO:tasks.workunit.client.1.smithi136.stdout:3/980: creat d3/d2b/d6c/db4/dfe/df7/d12d/d51/f13d x:0 0 0 2024-09-18T12:51:23.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/683: sync 2024-09-18T12:51:23.338 INFO:tasks.workunit.client.0.smithi081.stdout:5/624: sync 2024-09-18T12:51:23.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/684: write d15/d16/d33/d53/d7a/d2f/f5c [613021,7641] 0 2024-09-18T12:51:23.339 INFO:tasks.workunit.client.1.smithi136.stdout:1/977: dread d2/f41 [0,4194304] 0 2024-09-18T12:51:23.339 INFO:tasks.workunit.client.1.smithi136.stdout:3/981: symlink d3/d14/d108/l13e 0 2024-09-18T12:51:23.340 INFO:tasks.workunit.client.0.smithi081.stdout:2/685: write d15/d16/def/f9d [917533,30131] 0 2024-09-18T12:51:23.340 INFO:tasks.workunit.client.0.smithi081.stdout:5/625: truncate d2/fe 448083 0 2024-09-18T12:51:23.340 INFO:tasks.workunit.client.0.smithi081.stdout:2/686: getdents d15/d16/d33/d53/d7a/d2f/d61 0 2024-09-18T12:51:23.340 INFO:tasks.workunit.client.0.smithi081.stdout:5/626: mknod d2/d14/d1d/d1a/cc4 0 2024-09-18T12:51:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.340+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a48068af0 con 0x7f3a480ffbc0 2024-09-18T12:51:23.342 INFO:tasks.workunit.client.1.smithi136.stdout:3/982: rename d3/d14/d17/d53/d73/fcc to d3/d2b/d6c/db4/dfe/df7/d12d/d139/f13f 0 2024-09-18T12:51:23.342 INFO:tasks.workunit.client.1.smithi136.stdout:3/983: creat d3/d14/d18/d7f/d100/f140 x:0 0 0 2024-09-18T12:51:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.341+0000 7f3a45ffb700 1 -- 172.21.15.81:0/881306846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f3a3c027750 con 0x7f3a480ffbc0 2024-09-18T12:51:23.342 INFO:tasks.workunit.client.0.smithi081.stdout:2/687: rename d15/d16/d33/d53/d7a/dee/f99 to d15/d6e/d7f/ffb 0 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:e19 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:51:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 19 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:50:34.867341+0000 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:51:23.344 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:51:23.345 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:23.347 INFO:tasks.workunit.client.1.smithi136.stdout:1/978: write d2/f16 [3495776,64617] 0 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:5/627: mkdir d2/d14/d33/d37/dc5 0 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:5/628: chown d2/d14/d1d 488 1 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:5/629: fdatasync d2/d14/d33/d37/d3b/d6a/d20/f30 0 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:7/545: dwrite d2/f6 [0,4194304] 0 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:7/546: chown d2/d56/d73/da4/c87 0 1 2024-09-18T12:51:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:7/547: read - d2/d1d/d4e/d84/fb1 zero size 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.344+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 msgr2=0x7f3a38075f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.344+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 0x7f3a38075f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a34006fd0 tx=0x7f3a34009190 comp rx=0 tx=0).stop 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.344+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 msgr2=0x7f3a480699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.344+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006010 tx=0x7f3a3c00bd70 comp rx=0 tx=0).stop 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 shutdown_connections 2024-09-18T12:51:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f3a38073a40 0x7f3a38075f00 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a34006fd0 tx=0x7f3a34009190 comp rx=0 tx=0).stop 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a480ffbc0 0x7f3a480699d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 --2- 172.21.15.81:0/881306846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a48100dc0 0x7f3a4819b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 >> 172.21.15.81:0/881306846 conn(0x7f3a480fb160 msgr2=0x7f3a48104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 shutdown_connections 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.345+0000 7f3a4ea7a700 1 -- 172.21.15.81:0/881306846 wait complete. 2024-09-18T12:51:23.350 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2024-09-18T12:51:23.350 INFO:tasks.workunit.client.0.smithi081.stdout:5/630: getdents d2/d14/d1d 0 2024-09-18T12:51:23.351 INFO:tasks.workunit.client.0.smithi081.stdout:0/588: dwrite d7/f93 [0,4194304] 0 2024-09-18T12:51:23.353 INFO:tasks.workunit.client.0.smithi081.stdout:0/589: link d7/d9/d4b/d33/f82 d7/d9/d4b/d4a/d92/fc5 0 2024-09-18T12:51:23.353 INFO:tasks.workunit.client.0.smithi081.stdout:0/590: write d7/d9/d4b/d33/d7d/f8d [3691014,64435] 0 2024-09-18T12:51:23.355 INFO:tasks.workunit.client.0.smithi081.stdout:0/591: truncate d7/d9/d4b/d4a/d92/fc5 146068 0 2024-09-18T12:51:23.355 INFO:tasks.workunit.client.0.smithi081.stdout:0/592: fsync d7/d9/d12/dba/f85 0 2024-09-18T12:51:23.355 INFO:tasks.workunit.client.1.smithi136.stdout:1/979: write d2/f41 [2867870,20264] 0 2024-09-18T12:51:23.359 INFO:tasks.workunit.client.0.smithi081.stdout:2/688: dwrite d15/d16/f44 [0,4194304] 0 2024-09-18T12:51:23.362 INFO:tasks.workunit.client.0.smithi081.stdout:2/689: mkdir d15/d16/ded/dfc 0 2024-09-18T12:51:23.363 INFO:tasks.workunit.client.0.smithi081.stdout:2/690: mkdir d15/d16/d33/d53/d7a/d2f/dfd 0 2024-09-18T12:51:23.363 INFO:tasks.workunit.client.0.smithi081.stdout:2/691: fdatasync d15/d16/d20/d22/fe6 0 2024-09-18T12:51:23.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/692: rename d15/d16/d33/d53/d7a/dee/d6d/ca3 to d15/df9/cfe 0 2024-09-18T12:51:23.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/693: link d15/d16/d20/l21 d15/d16/d20/d22/lff 0 2024-09-18T12:51:23.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/694: write d15/d16/d33/d53/fd3 [366734,34936] 0 2024-09-18T12:51:23.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/695: chown d15/d8e/ff4 135649490 1 2024-09-18T12:51:23.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/696: mknod d15/d16/ded/dfc/c100 0 2024-09-18T12:51:23.369 INFO:tasks.workunit.client.0.smithi081.stdout:2/697: read d15/d16/d20/f76 [294434,20626] 0 2024-09-18T12:51:23.377 INFO:tasks.workunit.client.0.smithi081.stdout:7/548: dwrite d2/d14/d21/d62/da7/f2e [0,4194304] 0 2024-09-18T12:51:23.377 INFO:tasks.workunit.client.0.smithi081.stdout:5/631: dwrite d2/d14/d33/d37/d3b/d2a/db0/f88 [0,4194304] 0 2024-09-18T12:51:23.379 INFO:tasks.workunit.client.0.smithi081.stdout:0/593: dwrite d7/d9/d4b/d53/fad [0,4194304] 0 2024-09-18T12:51:23.392 INFO:tasks.workunit.client.0.smithi081.stdout:2/698: dwrite d15/d16/d33/d53/d7a/d2f/fa6 [0,4194304] 0 2024-09-18T12:51:23.396 INFO:tasks.workunit.client.0.smithi081.stdout:0/594: dwrite d7/d9/d4b/d4a/f1b [4194304,4194304] 0 2024-09-18T12:51:23.396 INFO:tasks.workunit.client.0.smithi081.stdout:0/595: creat d7/d9/d4b/d4a/fc6 x:0 0 0 2024-09-18T12:51:23.407 INFO:tasks.workunit.client.0.smithi081.stdout:2/699: dwrite d15/d16/f37 [0,4194304] 0 2024-09-18T12:51:23.407 INFO:tasks.workunit.client.0.smithi081.stdout:2/700: chown d15/d16/d33/d53/d7a/dee/d6d/fd5 20638 1 2024-09-18T12:51:23.407 INFO:tasks.workunit.client.0.smithi081.stdout:2/701: readlink d15/d16/d33/d53/d7a/d2f/l91 0 2024-09-18T12:51:23.408 INFO:tasks.workunit.client.0.smithi081.stdout:2/702: truncate d15/f17 2117905 0 2024-09-18T12:51:23.415 INFO:tasks.workunit.client.0.smithi081.stdout:0/596: dwrite d7/d9/d4b/d33/db1/fb9 [0,4194304] 0 2024-09-18T12:51:23.418 INFO:tasks.workunit.client.0.smithi081.stdout:0/597: mkdir d7/d9/d4b/d33/dc7 0 2024-09-18T12:51:23.421 INFO:tasks.workunit.client.0.smithi081.stdout:2/703: dread d15/d16/f19 [0,4194304] 0 2024-09-18T12:51:23.421 INFO:tasks.workunit.client.0.smithi081.stdout:0/598: rename d7/d9/f23 to d7/d9/d4b/d4a/d92/fc8 0 2024-09-18T12:51:23.421 INFO:tasks.workunit.client.0.smithi081.stdout:0/599: creat d7/fc9 x:0 0 0 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.0.smithi081.stdout:0/600: truncate d7/d9/f90 1923912 0 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.0.smithi081.stdout:0/601: dread - d7/d9/d4b/d4a/d77/fb0 zero size 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.0.smithi081.stdout:0/602: chown d7/d9/d4b/d33/c95 122 1 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.1.smithi136.stdout:4/957: sync 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.1.smithi136.stdout:9/947: sync 2024-09-18T12:51:23.422 INFO:tasks.workunit.client.1.smithi136.stdout:6/983: sync 2024-09-18T12:51:23.423 INFO:tasks.workunit.client.1.smithi136.stdout:6/984: truncate d8/d9d/db4/ff6 587975 0 2024-09-18T12:51:23.423 INFO:tasks.workunit.client.0.smithi081.stdout:0/603: symlink d7/d9/d4b/d33/d43/lca 0 2024-09-18T12:51:23.423 INFO:tasks.workunit.client.0.smithi081.stdout:0/604: readlink d7/d9/d4b/d4a/d92/lab 0 2024-09-18T12:51:23.423 INFO:tasks.workunit.client.0.smithi081.stdout:0/605: chown d7/d9/d4b/d33/l66 9139 1 2024-09-18T12:51:23.424 INFO:tasks.workunit.client.1.smithi136.stdout:9/948: symlink d6/da/d3d/l139 0 2024-09-18T12:51:23.424 INFO:tasks.workunit.client.1.smithi136.stdout:9/949: fsync d6/da/fdb 0 2024-09-18T12:51:23.425 INFO:tasks.workunit.client.0.smithi081.stdout:2/704: dread d15/d16/d33/d53/d7a/dee/f3c [0,4194304] 0 2024-09-18T12:51:23.425 INFO:tasks.workunit.client.0.smithi081.stdout:2/705: chown d15/d16/d33/d53/d7a/dee/d6d/da0/fce 239 1 2024-09-18T12:51:23.425 INFO:tasks.workunit.client.0.smithi081.stdout:2/706: read - d15/d16/d20/d22/fe6 zero size 2024-09-18T12:51:23.425 INFO:tasks.workunit.client.0.smithi081.stdout:0/606: mknod d7/d9/d4b/d33/d43/d9a/ccb 0 2024-09-18T12:51:23.425 INFO:tasks.workunit.client.0.smithi081.stdout:0/607: truncate d7/d9/d4b/fa3 195039 0 2024-09-18T12:51:23.426 INFO:tasks.workunit.client.1.smithi136.stdout:4/958: mkdir d0/d132 0 2024-09-18T12:51:23.426 INFO:tasks.workunit.client.0.smithi081.stdout:2/707: creat d15/d16/d33/d53/d7a/d2f/dc2/df8/f101 x:0 0 0 2024-09-18T12:51:23.427 INFO:tasks.workunit.client.0.smithi081.stdout:0/608: unlink d7/d9/d4b/d33/f86 0 2024-09-18T12:51:23.428 INFO:tasks.workunit.client.0.smithi081.stdout:2/708: symlink d15/d16/d33/d53/d7a/dee/d6d/l102 0 2024-09-18T12:51:23.432 INFO:tasks.workunit.client.1.smithi136.stdout:9/950: dread d6/f2d [0,4194304] 0 2024-09-18T12:51:23.432 INFO:tasks.workunit.client.1.smithi136.stdout:9/951: write d6/da/d3d/f7b [2324549,38630] 0 2024-09-18T12:51:23.433 INFO:tasks.workunit.client.0.smithi081.stdout:0/609: mknod d7/d9/d4b/d33/dc7/ccc 0 2024-09-18T12:51:23.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/709: mkdir d15/d16/d33/d53/d7a/d2f/d61/dd4/d103 0 2024-09-18T12:51:23.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/710: truncate d15/d16/d20/fa5 1173264 0 2024-09-18T12:51:23.435 INFO:tasks.workunit.client.1.smithi136.stdout:9/952: mknod d6/da/d3d/d41/c13a 0 2024-09-18T12:51:23.435 INFO:tasks.workunit.client.0.smithi081.stdout:0/610: mknod d7/dbf/ccd 0 2024-09-18T12:51:23.435 INFO:tasks.workunit.client.0.smithi081.stdout:0/611: creat d7/d9/d4b/d4a/fce x:0 0 0 2024-09-18T12:51:23.435 INFO:tasks.workunit.client.0.smithi081.stdout:0/612: chown d7/d9/d4b/d33/d43/d9a/faa 24925 1 2024-09-18T12:51:23.436 INFO:tasks.workunit.client.1.smithi136.stdout:4/959: dwrite d0/d5f/dd3/f104 [0,4194304] 0 2024-09-18T12:51:23.436 INFO:tasks.workunit.client.1.smithi136.stdout:4/960: truncate d0/d3/d54/fe8 816163 0 2024-09-18T12:51:23.436 INFO:tasks.workunit.client.0.smithi081.stdout:2/711: creat d15/d16/ded/f104 x:0 0 0 2024-09-18T12:51:23.437 INFO:tasks.workunit.client.0.smithi081.stdout:2/712: dread - d15/d16/d33/d53/d7a/d2f/dc2/df8/f101 zero size 2024-09-18T12:51:23.437 INFO:tasks.workunit.client.0.smithi081.stdout:2/713: chown d15/d16/d33/d53/db0 1 1 2024-09-18T12:51:23.437 INFO:tasks.workunit.client.1.smithi136.stdout:9/953: link d6/db/d12/l46 d6/df/d23/l13b 0 2024-09-18T12:51:23.439 INFO:tasks.workunit.client.1.smithi136.stdout:4/961: truncate d0/f15 2463981 0 2024-09-18T12:51:23.440 INFO:tasks.workunit.client.1.smithi136.stdout:4/962: write d0/d2/d85/f105 [158238,76107] 0 2024-09-18T12:51:23.440 INFO:tasks.workunit.client.1.smithi136.stdout:4/963: fsync d0/d2/f17 0 2024-09-18T12:51:23.440 INFO:tasks.workunit.client.0.smithi081.stdout:0/613: dread d7/f6f [0,4194304] 0 2024-09-18T12:51:23.441 INFO:tasks.workunit.client.0.smithi081.stdout:0/614: dread - d7/d9/d4b/d4a/fc6 zero size 2024-09-18T12:51:23.459 INFO:tasks.workunit.client.0.smithi081.stdout:2/714: dwrite d15/d16/d33/d53/d7a/d2f/d61/d97/ffa [0,4194304] 0 2024-09-18T12:51:23.459 INFO:tasks.workunit.client.0.smithi081.stdout:2/715: chown d15/d16/d33/d53/f79 23221 1 2024-09-18T12:51:23.460 INFO:tasks.workunit.client.0.smithi081.stdout:0/615: dwrite d7/d5d/f7f [0,4194304] 0 2024-09-18T12:51:23.460 INFO:tasks.workunit.client.0.smithi081.stdout:0/616: creat d7/d9/d4b/d4a/d77/fcf x:0 0 0 2024-09-18T12:51:23.463 INFO:tasks.workunit.client.0.smithi081.stdout:2/716: dread d15/d16/d20/f76 [0,4194304] 0 2024-09-18T12:51:23.468 INFO:tasks.workunit.client.0.smithi081.stdout:0/617: write d7/d9/d4b/d53/f70 [2029432,104723] 0 2024-09-18T12:51:23.470 INFO:tasks.workunit.client.0.smithi081.stdout:2/717: dread d15/d16/f58 [4194304,4194304] 0 2024-09-18T12:51:23.477 INFO:tasks.workunit.client.0.smithi081.stdout:0/618: dread d7/d9/d4b/d33/d7d/faf [0,4194304] 0 2024-09-18T12:51:23.478 INFO:tasks.workunit.client.0.smithi081.stdout:0/619: creat d7/d9/d12/dba/fd0 x:0 0 0 2024-09-18T12:51:23.486 INFO:tasks.workunit.client.0.smithi081.stdout:2/718: dwrite d15/d16/d33/d53/d7a/d2f/d61/fb4 [0,4194304] 0 2024-09-18T12:51:23.487 INFO:tasks.workunit.client.0.smithi081.stdout:2/719: creat d15/d16/ded/f105 x:0 0 0 2024-09-18T12:51:23.487 INFO:tasks.workunit.client.0.smithi081.stdout:2/720: chown d15/d16/ded/f105 57825 1 2024-09-18T12:51:23.489 INFO:tasks.workunit.client.0.smithi081.stdout:2/721: rmdir d15/d26 39 2024-09-18T12:51:23.489 INFO:tasks.workunit.client.0.smithi081.stdout:2/722: chown d15/d16/d20/d22/fe6 219 1 2024-09-18T12:51:23.490 INFO:tasks.workunit.client.0.smithi081.stdout:2/723: symlink d15/d16/d20/d31/l106 0 2024-09-18T12:51:23.491 INFO:tasks.workunit.client.0.smithi081.stdout:2/724: mkdir d15/d16/d20/d107 0 2024-09-18T12:51:23.491 INFO:tasks.workunit.client.0.smithi081.stdout:2/725: write d15/d16/d33/d53/db0/fec [3562628,103706] 0 2024-09-18T12:51:23.492 INFO:tasks.workunit.client.1.smithi136.stdout:1/980: sync 2024-09-18T12:51:23.492 INFO:tasks.workunit.client.1.smithi136.stdout:3/984: sync 2024-09-18T12:51:23.492 INFO:tasks.workunit.client.1.smithi136.stdout:3/985: write d3/d14/d18/ffc [605583,99287] 0 2024-09-18T12:51:23.492 INFO:tasks.workunit.client.1.smithi136.stdout:3/986: truncate d3/d5/fb7 1594004 0 2024-09-18T12:51:23.493 INFO:tasks.workunit.client.1.smithi136.stdout:3/987: creat d3/d14/d22/d2c/f141 x:0 0 0 2024-09-18T12:51:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 -- 172.21.15.81:0/2447270168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 msgr2=0x7f1fb40fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 --2- 172.21.15.81:0/2447270168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb40fffe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009910 tx=0x7f1fa4009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 -- 172.21.15.81:0/2447270168 shutdown_connections 2024-09-18T12:51:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 --2- 172.21.15.81:0/2447270168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fb4100dc0 0x7f1fb4101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 --2- 172.21.15.81:0/2447270168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb40fffe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 -- 172.21.15.81:0/2447270168 >> 172.21.15.81:0/2447270168 conn(0x7f1fb40fb160 msgr2=0x7f1fb40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 -- 172.21.15.81:0/2447270168 shutdown_connections 2024-09-18T12:51:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.496+0000 7f1fb989a700 1 -- 172.21.15.81:0/2447270168 wait complete. 2024-09-18T12:51:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 Processor -- start 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 -- start start 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fb4100dc0 0x7f1fb4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41973c0 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb989a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4197500 con 0x7f1fb4100dc0 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47130/0 (socket says 172.21.15.81:47130) 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.497+0000 7f1fb2ffd700 1 -- 172.21.15.81:0/3222719781 learned_addr learned my addr 172.21.15.81:0/3222719781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb2ffd700 1 -- 172.21.15.81:0/3222719781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fb4100dc0 msgr2=0x7f1fb4196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb2ffd700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fb4100dc0 0x7f1fb4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb2ffd700 1 -- 172.21.15.81:0/3222719781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40095f0 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb2ffd700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bda0 tx=0x7f1fa400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa401d070 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb419bf50 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb419c3f0 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1fa4004c50 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.498+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa400f690 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.500+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa0005320 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.500+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f1fa4022470 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.501+0000 7f1fb8898700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 0x7f1f9c075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.501+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1fa4096090 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.501+0000 7f1fb27fc700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 0x7f1f9c075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:23.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.501+0000 7f1fb27fc700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 0x7f1f9c075f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097b0 tx=0x7f1fa8006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:23.505 INFO:tasks.workunit.client.0.smithi081.stdout:0/620: dwrite d7/d9/d4b/d33/d43/d9a/f9e [0,4194304] 0 2024-09-18T12:51:23.505 INFO:tasks.workunit.client.0.smithi081.stdout:0/621: truncate d7/d9/d4b/f84 490522 0 2024-09-18T12:51:23.507 INFO:tasks.workunit.client.0.smithi081.stdout:0/622: read d7/d9/d4b/d4a/d77/f7e [784768,128246] 0 2024-09-18T12:51:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.509+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1fa4064400 con 0x7f1fb40ffbc0 2024-09-18T12:51:23.518 INFO:tasks.workunit.client.1.smithi136.stdout:1/981: dwrite d2/d5/d9/f3b [0,4194304] 0 2024-09-18T12:51:23.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/988: dwrite d3/d2b/d6c/db4/dfe/df7/d12d/d51/fc7 [0,4194304] 0 2024-09-18T12:51:23.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/989: readlink d3/d14/d17/d11a/l11c 0 2024-09-18T12:51:23.520 INFO:tasks.workunit.client.1.smithi136.stdout:3/990: getdents d3/d14/d18/d13c 0 2024-09-18T12:51:23.527 INFO:tasks.workunit.client.1.smithi136.stdout:3/991: write d3/d2b/d6c/db4/dfe/fde [2730509,38609] 0 2024-09-18T12:51:23.527 INFO:tasks.workunit.client.0.smithi081.stdout:2/726: dwrite d15/d16/d54/fc6 [0,4194304] 0 2024-09-18T12:51:23.527 INFO:tasks.workunit.client.0.smithi081.stdout:2/727: readlink d15/d16/d20/d31/l106 0 2024-09-18T12:51:23.527 INFO:tasks.workunit.client.1.smithi136.stdout:3/992: write d3/d14/d18/ffc [397164,25191] 0 2024-09-18T12:51:23.530 INFO:tasks.workunit.client.0.smithi081.stdout:2/728: symlink d15/d16/ded/dfc/l108 0 2024-09-18T12:51:23.530 INFO:tasks.workunit.client.0.smithi081.stdout:2/729: truncate d15/d16/ded/f105 631726 0 2024-09-18T12:51:23.531 INFO:tasks.workunit.client.1.smithi136.stdout:3/993: symlink d3/d14/l142 0 2024-09-18T12:51:23.532 INFO:tasks.workunit.client.1.smithi136.stdout:1/982: write d2/d5/d2b/d34/feb [244708,111553] 0 2024-09-18T12:51:23.532 INFO:tasks.workunit.client.1.smithi136.stdout:3/994: readlink d3/d2b/l74 0 2024-09-18T12:51:23.532 INFO:tasks.workunit.client.0.smithi081.stdout:8/573: sync 2024-09-18T12:51:23.532 INFO:tasks.workunit.client.0.smithi081.stdout:6/577: sync 2024-09-18T12:51:23.533 INFO:tasks.workunit.client.1.smithi136.stdout:3/995: creat d3/d14/d18/d13c/f143 x:0 0 0 2024-09-18T12:51:23.534 INFO:tasks.workunit.client.0.smithi081.stdout:8/574: rename d3/d1d/d4a/l6a to d3/d1d/d4a/d8d/lc3 0 2024-09-18T12:51:23.534 INFO:tasks.workunit.client.0.smithi081.stdout:8/575: read d3/f3f [829844,114746] 0 2024-09-18T12:51:23.535 INFO:tasks.workunit.client.1.smithi136.stdout:1/983: mknod d2/d5/d2b/d34/d86/d135/d140/c14a 0 2024-09-18T12:51:23.535 INFO:tasks.workunit.client.1.smithi136.stdout:1/984: write d2/d5/d2b/d9b/dbe/dd3/d65/f6e [676325,69795] 0 2024-09-18T12:51:23.535 INFO:tasks.workunit.client.1.smithi136.stdout:1/985: dread - d2/d5/d2b/d9b/dbe/dd3/f134 zero size 2024-09-18T12:51:23.536 INFO:tasks.workunit.client.0.smithi081.stdout:6/578: mkdir d4/d12/d56/d7d/d96/db7 0 2024-09-18T12:51:23.536 INFO:tasks.workunit.client.0.smithi081.stdout:6/579: fdatasync d4/d6/f42 0 2024-09-18T12:51:23.536 INFO:tasks.workunit.client.0.smithi081.stdout:6/580: readlink d4/d6/l33 0 2024-09-18T12:51:23.536 INFO:tasks.workunit.client.0.smithi081.stdout:8/576: symlink d3/d1e/d4c/lc4 0 2024-09-18T12:51:23.538 INFO:tasks.workunit.client.1.smithi136.stdout:1/986: symlink d2/d5/d2b/d9b/l14b 0 2024-09-18T12:51:23.538 INFO:tasks.workunit.client.0.smithi081.stdout:6/581: mkdir d4/d12/d1c/d39/d60/db8 0 2024-09-18T12:51:23.539 INFO:tasks.workunit.client.0.smithi081.stdout:2/730: write d15/d16/d33/d53/d7a/dee/fab [348899,107734] 0 2024-09-18T12:51:23.539 INFO:tasks.workunit.client.0.smithi081.stdout:6/582: creat d4/d88/fb9 x:0 0 0 2024-09-18T12:51:23.541 INFO:tasks.workunit.client.0.smithi081.stdout:6/583: truncate d4/d12/d1c/d39/f9a 3309590 0 2024-09-18T12:51:23.541 INFO:tasks.workunit.client.0.smithi081.stdout:6/584: read d4/d12/d28/d2a/d2d/d31/f51 [346209,123171] 0 2024-09-18T12:51:23.543 INFO:tasks.workunit.client.0.smithi081.stdout:6/585: mknod d4/d12/d28/d2a/d74/d8b/d54/cba 0 2024-09-18T12:51:23.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/586: dread d4/d12/d1c/f23 [0,4194304] 0 2024-09-18T12:51:23.546 INFO:tasks.workunit.client.0.smithi081.stdout:6/587: creat d4/d12/d1c/d39/d60/db8/fbb x:0 0 0 2024-09-18T12:51:23.551 INFO:tasks.workunit.client.1.smithi136.stdout:1/987: dwrite d2/d5/d2b/d9b/d2e/d4c/f45 [0,4194304] 0 2024-09-18T12:51:23.556 INFO:tasks.workunit.client.1.smithi136.stdout:3/996: dwrite d3/d14/fb9 [4194304,4194304] 0 2024-09-18T12:51:23.558 INFO:tasks.workunit.client.1.smithi136.stdout:3/997: read d3/d14/d17/d75/d86/f9a [317708,37003] 0 2024-09-18T12:51:23.558 INFO:tasks.workunit.client.1.smithi136.stdout:3/998: chown d3/d14/dc5/cf6 22 1 2024-09-18T12:51:23.558 INFO:tasks.workunit.client.1.smithi136.stdout:3/999: truncate d3/d14/d17/fc2 110531 0 2024-09-18T12:51:23.560 INFO:tasks.workunit.client.1.smithi136.stdout:1/988: rename d2/d5/d2b/d34/d86/d135 to d2/d5/d2b/d34/d103/d14c 0 2024-09-18T12:51:23.561 INFO:tasks.workunit.client.1.smithi136.stdout:1/989: chown d2/d5/d2b/d9b/l7a 3898 1 2024-09-18T12:51:23.561 INFO:tasks.workunit.client.0.smithi081.stdout:6/588: dwrite d4/d12/d28/d2a/f4b [4194304,4194304] 0 2024-09-18T12:51:23.562 INFO:tasks.workunit.client.0.smithi081.stdout:6/589: creat d4/d12/d28/d2a/d74/fbc x:0 0 0 2024-09-18T12:51:23.563 INFO:tasks.workunit.client.0.smithi081.stdout:6/590: creat d4/d12/d28/d2a/fbd x:0 0 0 2024-09-18T12:51:23.563 INFO:tasks.workunit.client.0.smithi081.stdout:6/591: creat d4/d12/d28/d2a/fbe x:0 0 0 2024-09-18T12:51:23.584 INFO:tasks.workunit.client.0.smithi081.stdout:6/592: dwrite d4/d12/d1c/d39/f9a [4194304,4194304] 0 2024-09-18T12:51:23.584 INFO:tasks.workunit.client.0.smithi081.stdout:6/593: stat d4/d12/d28/d2a/d98 0 2024-09-18T12:51:23.584 INFO:tasks.workunit.client.1.smithi136.stdout:1/990: dwrite d2/d5/d9/ffd [0,4194304] 0 2024-09-18T12:51:23.586 INFO:tasks.workunit.client.0.smithi081.stdout:6/594: mkdir d4/d12/d1c/d64/dbf 0 2024-09-18T12:51:23.586 INFO:tasks.workunit.client.0.smithi081.stdout:6/595: write d4/d12/d56/d7d/faf [437857,45240] 0 2024-09-18T12:51:23.587 INFO:tasks.workunit.client.0.smithi081.stdout:6/596: creat d4/d12/d28/d2a/d98/fc0 x:0 0 0 2024-09-18T12:51:23.587 INFO:tasks.workunit.client.0.smithi081.stdout:6/597: chown d4/d12/l35 3 1 2024-09-18T12:51:23.589 INFO:tasks.workunit.client.0.smithi081.stdout:6/598: symlink d4/d12/d56/d7d/d96/db7/lc1 0 2024-09-18T12:51:23.594 INFO:tasks.workunit.client.1.smithi136.stdout:1/991: rmdir d2/d5/d2b/d9b/d2e 39 2024-09-18T12:51:23.594 INFO:tasks.workunit.client.1.smithi136.stdout:1/992: truncate d2/d5/d2b/d9b/d2e/d4c/f2f 4504838 0 2024-09-18T12:51:23.594 INFO:tasks.workunit.client.1.smithi136.stdout:1/993: chown d2/d5/d2b/d34/d86/l13a 1869860265 1 2024-09-18T12:51:23.594 INFO:tasks.workunit.client.1.smithi136.stdout:1/994: readlink l0 0 2024-09-18T12:51:23.594 INFO:tasks.workunit.client.1.smithi136.stdout:1/995: dread - d2/d5/d2b/d9b/dbe/dd3/d65/f12a zero size 2024-09-18T12:51:23.595 INFO:tasks.workunit.client.1.smithi136.stdout:1/996: symlink d2/d5/d9/dcb/l14d 0 2024-09-18T12:51:23.597 INFO:tasks.workunit.client.1.smithi136.stdout:1/997: creat d2/d5/d9/dcb/dfb/d107/d114/f14e x:0 0 0 2024-09-18T12:51:23.597 INFO:tasks.workunit.client.1.smithi136.stdout:6/985: sync 2024-09-18T12:51:23.597 INFO:tasks.workunit.client.1.smithi136.stdout:4/964: sync 2024-09-18T12:51:23.597 INFO:tasks.workunit.client.1.smithi136.stdout:9/954: sync 2024-09-18T12:51:23.600 INFO:tasks.workunit.client.1.smithi136.stdout:1/998: rename d2/d5/d2b/d63/dda/d120/d124 to d2/d5/d9/dcb/dfb/d107/d114/d14f 0 2024-09-18T12:51:23.601 INFO:tasks.workunit.client.1.smithi136.stdout:6/986: creat d8/d9/d64/dbb/f13d x:0 0 0 2024-09-18T12:51:23.602 INFO:tasks.workunit.client.1.smithi136.stdout:4/965: creat d0/d5f/f133 x:0 0 0 2024-09-18T12:51:23.605 INFO:tasks.workunit.client.1.smithi136.stdout:1/999: rename d2/d5/d9/c102 to d2/d5/d9/dcb/dfb/c150 0 2024-09-18T12:51:23.608 INFO:tasks.workunit.client.1.smithi136.stdout:6/987: creat d8/d9/de/d1c/db9/d10b/f13e x:0 0 0 2024-09-18T12:51:23.609 INFO:tasks.workunit.client.1.smithi136.stdout:4/966: mknod d0/d45/d67/d7b/c134 0 2024-09-18T12:51:23.609 INFO:tasks.workunit.client.1.smithi136.stdout:4/967: creat d0/d3/d90/df8/f135 x:0 0 0 2024-09-18T12:51:23.609 INFO:tasks.workunit.client.1.smithi136.stdout:6/988: write d8/d9/d64/fac [702314,83714] 0 2024-09-18T12:51:23.611 INFO:tasks.workunit.client.1.smithi136.stdout:6/989: link d8/daa/c119 d8/daa/c13f 0 2024-09-18T12:51:23.611 INFO:tasks.workunit.client.1.smithi136.stdout:6/990: readlink d8/d9/de/d60/d71/d76/l13b 0 2024-09-18T12:51:23.611 INFO:tasks.workunit.client.1.smithi136.stdout:4/968: dread d0/d2/f28 [0,4194304] 0 2024-09-18T12:51:23.612 INFO:tasks.workunit.client.0.smithi081.stdout:6/599: dwrite d4/d12/d28/d2a/d2d/f52 [0,4194304] 0 2024-09-18T12:51:23.612 INFO:tasks.workunit.client.1.smithi136.stdout:6/991: mknod d8/d9/d3c/c140 0 2024-09-18T12:51:23.613 INFO:tasks.workunit.client.1.smithi136.stdout:4/969: symlink d0/d3/d90/df8/l136 0 2024-09-18T12:51:23.614 INFO:tasks.workunit.client.1.smithi136.stdout:6/992: mknod d8/d9/de/d1c/d50/da8/df2/c141 0 2024-09-18T12:51:23.615 INFO:tasks.workunit.client.1.smithi136.stdout:6/993: chown d8/d9/d3c/c140 268 1 2024-09-18T12:51:23.615 INFO:tasks.workunit.client.1.smithi136.stdout:6/994: write d8/d9/de/d1c/f38 [1911745,63215] 0 2024-09-18T12:51:23.615 INFO:tasks.workunit.client.1.smithi136.stdout:6/995: write d8/d9/de/d1c/f5e [605337,126286] 0 2024-09-18T12:51:23.617 INFO:tasks.workunit.client.0.smithi081.stdout:6/600: unlink d4/d12/d1c/l4c 0 2024-09-18T12:51:23.617 INFO:tasks.workunit.client.0.smithi081.stdout:6/601: fsync d4/d12/d28/d2a/d2d/d31/f51 0 2024-09-18T12:51:23.621 INFO:tasks.workunit.client.0.smithi081.stdout:6/602: link d4/d12/d1c/d64/f81 d4/d12/d1c/fc2 0 2024-09-18T12:51:23.621 INFO:tasks.workunit.client.1.smithi136.stdout:4/970: read d0/d8d/f8e [2029332,56514] 0 2024-09-18T12:51:23.622 INFO:tasks.workunit.client.1.smithi136.stdout:4/971: creat d0/d45/d67/d7b/f137 x:0 0 0 2024-09-18T12:51:23.623 INFO:tasks.workunit.client.0.smithi081.stdout:6/603: mknod d4/d12/d1c/d39/cc3 0 2024-09-18T12:51:23.624 INFO:tasks.workunit.client.0.smithi081.stdout:6/604: creat d4/fc4 x:0 0 0 2024-09-18T12:51:23.626 INFO:tasks.workunit.client.1.smithi136.stdout:4/972: unlink d0/d3/d90/df8/l136 0 2024-09-18T12:51:23.626 INFO:tasks.workunit.client.1.smithi136.stdout:4/973: fdatasync d0/d3/d90/fe3 0 2024-09-18T12:51:23.626 INFO:tasks.workunit.client.0.smithi081.stdout:6/605: symlink d4/d12/d1c/d39/d60/d90/lc5 0 2024-09-18T12:51:23.626 INFO:tasks.workunit.client.0.smithi081.stdout:6/606: fdatasync d4/d12/f44 0 2024-09-18T12:51:23.627 INFO:tasks.workunit.client.1.smithi136.stdout:6/996: dwrite d8/d9/d3c/f68 [0,4194304] 0 2024-09-18T12:51:23.627 INFO:tasks.workunit.client.0.smithi081.stdout:6/607: mknod d4/d6/db4/cc6 0 2024-09-18T12:51:23.628 INFO:tasks.workunit.client.0.smithi081.stdout:4/549: sync 2024-09-18T12:51:23.628 INFO:tasks.workunit.client.0.smithi081.stdout:4/550: fsync d3/d20/d3d/d65/d14/f88 0 2024-09-18T12:51:23.629 INFO:tasks.workunit.client.0.smithi081.stdout:4/551: getdents d3/d20/d3d/d65/d2f 0 2024-09-18T12:51:23.630 INFO:tasks.workunit.client.1.smithi136.stdout:6/997: creat d8/d9/de/d60/d71/d76/d97/d136/f142 x:0 0 0 2024-09-18T12:51:23.630 INFO:tasks.workunit.client.1.smithi136.stdout:6/998: fdatasync d8/d9/d64/f82 0 2024-09-18T12:51:23.632 INFO:tasks.workunit.client.1.smithi136.stdout:6/999: rmdir d8/daa 39 2024-09-18T12:51:23.635 INFO:tasks.workunit.client.1.smithi136.stdout:4/974: dread d0/d3/d54/d5c/f101 [0,4194304] 0 2024-09-18T12:51:23.635 INFO:tasks.workunit.client.0.smithi081.stdout:4/552: write d3/d20/d3d/d65/d14/d27/f37 [3327478,48968] 0 2024-09-18T12:51:23.636 INFO:tasks.workunit.client.1.smithi136.stdout:4/975: truncate d0/f82 1789244 0 2024-09-18T12:51:23.638 INFO:tasks.workunit.client.1.smithi136.stdout:4/976: mknod d0/d3/d54/d88/c138 0 2024-09-18T12:51:23.639 INFO:tasks.workunit.client.1.smithi136.stdout:4/977: unlink d0/d2/d85/f105 0 2024-09-18T12:51:23.644 INFO:tasks.workunit.client.0.smithi081.stdout:6/608: dwrite d4/d12/d28/d2a/f45 [0,4194304] 0 2024-09-18T12:51:23.647 INFO:tasks.workunit.client.0.smithi081.stdout:6/609: symlink d4/d12/d56/d7d/d96/lc7 0 2024-09-18T12:51:23.647 INFO:tasks.workunit.client.0.smithi081.stdout:6/610: truncate d4/d12/d1c/f23 534686 0 2024-09-18T12:51:23.661 INFO:tasks.workunit.client.0.smithi081.stdout:4/553: dwrite d3/d20/d3d/d65/d45/d6c/f7b [0,4194304] 0 2024-09-18T12:51:23.664 INFO:tasks.workunit.client.1.smithi136.stdout:4/978: dwrite d0/d45/d67/d7b/f124 [0,4194304] 0 2024-09-18T12:51:23.664 INFO:tasks.workunit.client.0.smithi081.stdout:4/554: creat d3/d20/d3d/d65/d45/d6c/fb3 x:0 0 0 2024-09-18T12:51:23.664 INFO:tasks.workunit.client.0.smithi081.stdout:4/555: fsync d3/d20/d3d/d65/d14/d3e/f51 0 2024-09-18T12:51:23.665 INFO:tasks.workunit.client.0.smithi081.stdout:4/556: stat d3/db/d35/d79 0 2024-09-18T12:51:23.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/557: rmdir d3/db/d35/d79 39 2024-09-18T12:51:23.668 INFO:tasks.workunit.client.0.smithi081.stdout:6/611: getdents d4/d12/d1c/d39 0 2024-09-18T12:51:23.669 INFO:tasks.workunit.client.0.smithi081.stdout:6/612: creat d4/d12/d1c/d8f/fc8 x:0 0 0 2024-09-18T12:51:23.671 INFO:tasks.workunit.client.1.smithi136.stdout:4/979: write d0/d5f/dd3/fe5 [2116987,16273] 0 2024-09-18T12:51:23.671 INFO:tasks.workunit.client.1.smithi136.stdout:4/980: dread - d0/d3/d90/df8/f135 zero size 2024-09-18T12:51:23.693 INFO:tasks.workunit.client.1.smithi136.stdout:4/981: dwrite d0/d5f/fa6 [0,4194304] 0 2024-09-18T12:51:23.696 INFO:tasks.workunit.client.0.smithi081.stdout:6/613: dwrite d4/f13 [0,4194304] 0 2024-09-18T12:51:23.696 INFO:tasks.workunit.client.0.smithi081.stdout:4/558: dwrite d3/db/f36 [4194304,4194304] 0 2024-09-18T12:51:23.696 INFO:tasks.workunit.client.1.smithi136.stdout:4/982: symlink d0/d3/d54/d88/d111/l139 0 2024-09-18T12:51:23.697 INFO:tasks.workunit.client.0.smithi081.stdout:6/614: mkdir d4/d12/d56/d7d/d84/dc9 0 2024-09-18T12:51:23.698 INFO:tasks.workunit.client.0.smithi081.stdout:4/559: creat d3/d20/d3d/d65/d14/d27/fb4 x:0 0 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/615: mknod d4/d12/d1c/d39/d60/d90/cca 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/616: truncate d4/d12/d28/d2a/fbe 141182 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/617: fsync d4/d12/d56/d7d/d96/fa6 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/618: creat d4/d88/fcb x:0 0 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/619: write d4/d12/d28/d2a/d74/fbc [546781,63759] 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/620: truncate d4/d12/d28/d2a/d2d/f82 1419252 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/621: creat d4/d12/d1c/d39/d60/db8/fcc x:0 0 0 2024-09-18T12:51:23.700 INFO:tasks.workunit.client.0.smithi081.stdout:6/622: write f0 [5775436,81892] 0 2024-09-18T12:51:23.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/560: link d3/db/d2d/c9c d3/d20/d3d/d65/d2f/d8c/cb5 0 2024-09-18T12:51:23.707 INFO:tasks.workunit.client.0.smithi081.stdout:6/623: unlink d4/d6/f42 0 2024-09-18T12:51:23.709 INFO:tasks.workunit.client.0.smithi081.stdout:4/561: mknod d3/db/d58/cb6 0 2024-09-18T12:51:23.717 INFO:tasks.workunit.client.1.smithi136.stdout:4/983: dwrite d0/d3/f89 [4194304,4194304] 0 2024-09-18T12:51:23.717 INFO:tasks.workunit.client.1.smithi136.stdout:4/984: readlink d0/d25/d79/lcd 0 2024-09-18T12:51:23.717 INFO:tasks.workunit.client.1.smithi136.stdout:4/985: fsync d0/d45/d67/d7b/fe9 0 2024-09-18T12:51:23.722 INFO:tasks.workunit.client.0.smithi081.stdout:4/562: write d3/f22 [2760886,103359] 0 2024-09-18T12:51:23.722 INFO:tasks.workunit.client.0.smithi081.stdout:6/624: dwrite d4/d12/d56/d7d/d9f/da2/fa4 [0,4194304] 0 2024-09-18T12:51:23.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/625: unlink d4/d12/d28/d2a/d2d/d31/f67 0 2024-09-18T12:51:23.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/626: stat d4/d12/d1c/d8f/da0 0 2024-09-18T12:51:23.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/627: readlink d4/d6/l55 0 2024-09-18T12:51:23.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/628: read d4/fa [636148,45232] 0 2024-09-18T12:51:23.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/629: readlink d4/d12/l8e 0 2024-09-18T12:51:23.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/630: stat d4/d12/d56/l94 0 2024-09-18T12:51:23.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/631: fsync d4/d12/d28/d2a/d74/d8b/fa1 0 2024-09-18T12:51:23.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/632: fdatasync d4/d12/d1c/d39/d73/f87 0 2024-09-18T12:51:23.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/633: creat d4/d12/d28/d2a/d97/fcd x:0 0 0 2024-09-18T12:51:23.728 INFO:tasks.workunit.client.0.smithi081.stdout:6/634: stat d4/d6/c68 0 2024-09-18T12:51:23.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/635: unlink d4/d12/d28/d2a/d2d/d31/l5e 0 2024-09-18T12:51:23.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/636: rmdir d4/d12/d56/d7d/d96/db7 39 2024-09-18T12:51:23.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/563: dread d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:23.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/564: fdatasync d3/d20/d3d/d6b/fae 0 2024-09-18T12:51:23.734 INFO:tasks.workunit.client.0.smithi081.stdout:4/565: write d3/d20/d3d/d65/d14/d54/fac [388597,14277] 0 2024-09-18T12:51:23.739 INFO:tasks.workunit.client.0.smithi081.stdout:6/637: rmdir d4/d12/d1c/d64/dbf 0 2024-09-18T12:51:23.740 INFO:tasks.workunit.client.0.smithi081.stdout:4/566: creat d3/d20/d3d/d6b/fb7 x:0 0 0 2024-09-18T12:51:23.781 INFO:tasks.workunit.client.1.smithi136.stdout:9/955: sync 2024-09-18T12:51:23.788 INFO:tasks.workunit.client.0.smithi081.stdout:4/567: dwrite d3/d20/d3d/d65/d45/d6c/fb3 [0,4194304] 0 2024-09-18T12:51:23.788 INFO:tasks.workunit.client.0.smithi081.stdout:6/638: dwrite d4/f18 [0,4194304] 0 2024-09-18T12:51:23.788 INFO:tasks.workunit.client.0.smithi081.stdout:6/639: chown d4/d12/d28/d2a/d74/d8b/d54/cba 6174 1 2024-09-18T12:51:23.788 INFO:tasks.workunit.client.0.smithi081.stdout:6/640: chown d4/d12/d1c/d8f/da0 65 1 2024-09-18T12:51:23.789 INFO:tasks.workunit.client.1.smithi136.stdout:9/956: write d6/df/f3b [3034246,12399] 0 2024-09-18T12:51:23.790 INFO:tasks.workunit.client.1.smithi136.stdout:9/957: creat d6/d59/f13c x:0 0 0 2024-09-18T12:51:23.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/568: mkdir d3/db/d2d/d4e/d8d/db8 0 2024-09-18T12:51:23.792 INFO:tasks.workunit.client.1.smithi136.stdout:9/958: link d6/d59/lb6 d6/df/d75/dde/l13d 0 2024-09-18T12:51:23.794 INFO:tasks.workunit.client.1.smithi136.stdout:9/959: unlink d6/d59/f13c 0 2024-09-18T12:51:23.794 INFO:tasks.workunit.client.0.smithi081.stdout:6/641: symlink d4/d12/d56/lce 0 2024-09-18T12:51:23.794 INFO:tasks.workunit.client.0.smithi081.stdout:6/642: chown d4/d12/d1c/d39/d73 6938 1 2024-09-18T12:51:23.795 INFO:tasks.workunit.client.1.smithi136.stdout:9/960: dread d6/df/d23/d2b/d79/ffa [0,4194304] 0 2024-09-18T12:51:23.795 INFO:tasks.workunit.client.1.smithi136.stdout:9/961: fdatasync d6/d13/d4c/fa7 0 2024-09-18T12:51:23.797 INFO:tasks.workunit.client.0.smithi081.stdout:4/569: unlink d3/db/d35/d79/fa7 0 2024-09-18T12:51:23.797 INFO:tasks.workunit.client.1.smithi136.stdout:9/962: creat d6/da/d3d/d4d/f13e x:0 0 0 2024-09-18T12:51:23.797 INFO:tasks.workunit.client.0.smithi081.stdout:6/643: mknod d4/d6/d95/ccf 0 2024-09-18T12:51:23.798 INFO:tasks.workunit.client.1.smithi136.stdout:9/963: creat d6/db/de8/d101/f13f x:0 0 0 2024-09-18T12:51:23.799 INFO:tasks.workunit.client.0.smithi081.stdout:4/570: link d3/d20/d3d/d65/d45/f81 d3/d20/d3d/d65/d45/d6c/fb9 0 2024-09-18T12:51:23.799 INFO:tasks.workunit.client.0.smithi081.stdout:4/571: fsync d3/f22 0 2024-09-18T12:51:23.800 INFO:tasks.workunit.client.1.smithi136.stdout:9/964: mkdir d6/da/d3d/d4d/d91/d25/dee/df8/d140 0 2024-09-18T12:51:23.800 INFO:tasks.workunit.client.0.smithi081.stdout:6/644: link d4/d12/d1c/d8f/da0/la3 d4/d12/d1c/ld0 0 2024-09-18T12:51:23.800 INFO:tasks.workunit.client.0.smithi081.stdout:6/645: chown d4/d12/d1c/d64 200605 1 2024-09-18T12:51:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.802+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 --> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fa0000bf0 con 0x7f1f9c073a40 2024-09-18T12:51:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.804+0000 7f1fb8898700 1 -- 172.21.15.81:0/3222719781 <== mgr.14213 v2:172.21.15.81:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f1fa0000bf0 con 0x7f1f9c073a40 2024-09-18T12:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "1/23 daemons upgraded", 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:51:23.806 INFO:tasks.workunit.client.0.smithi081.stdout:1/634: sync 2024-09-18T12:51:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 msgr2=0x7f1f9c075f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 0x7f1f9c075f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097b0 tx=0x7f1fa8006d20 comp rx=0 tx=0).stop 2024-09-18T12:51:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 msgr2=0x7f1fb4196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400bda0 tx=0x7f1fa400be80 comp rx=0 tx=0).stop 2024-09-18T12:51:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 shutdown_connections 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f1f9c073a40 0x7f1f9c075f00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb40ffbc0 0x7f1fb4196860 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 --2- 172.21.15.81:0/3222719781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fb4100dc0 0x7f1fb4196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.808+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 >> 172.21.15.81:0/3222719781 conn(0x7f1fb40fb160 msgr2=0x7f1fb4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.809+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 shutdown_connections 2024-09-18T12:51:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.809+0000 7f1fb989a700 1 -- 172.21.15.81:0/3222719781 wait complete. 2024-09-18T12:51:23.812 INFO:tasks.workunit.client.0.smithi081.stdout:1/635: rename d0/db/d12 to d0/dd7 0 2024-09-18T12:51:23.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/572: dread d3/d20/d3d/d65/d2f/f33 [0,4194304] 0 2024-09-18T12:51:23.815 INFO:tasks.workunit.client.0.smithi081.stdout:4/573: rename d3/d20/d3d/d65/d14/d3e/f6a to d3/d20/d3d/d65/d14/d27/fba 0 2024-09-18T12:51:23.815 INFO:tasks.workunit.client.0.smithi081.stdout:4/574: chown d3/db/c16 10340 1 2024-09-18T12:51:23.816 INFO:tasks.workunit.client.0.smithi081.stdout:4/575: mkdir d3/dbb 0 2024-09-18T12:51:23.817 INFO:tasks.workunit.client.0.smithi081.stdout:4/576: mknod d3/db/d35/d79/cbc 0 2024-09-18T12:51:23.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/577: mkdir d3/d20/d3d/dbd 0 2024-09-18T12:51:23.827 INFO:tasks.workunit.client.1.smithi136.stdout:9/965: dwrite d6/da/d3d/d4d/d91/f16 [0,4194304] 0 2024-09-18T12:51:23.827 INFO:tasks.workunit.client.1.smithi136.stdout:9/966: creat d6/df/d23/d2b/d79/d119/d123/f141 x:0 0 0 2024-09-18T12:51:23.828 INFO:tasks.workunit.client.0.smithi081.stdout:6/646: dwrite d4/d12/d1c/d39/d60/db8/fcc [0,4194304] 0 2024-09-18T12:51:23.828 INFO:tasks.workunit.client.0.smithi081.stdout:6/647: fsync d4/d12/f32 0 2024-09-18T12:51:23.833 INFO:tasks.workunit.client.0.smithi081.stdout:1/636: dwrite d0/d6/d7/f81 [0,4194304] 0 2024-09-18T12:51:23.836 INFO:tasks.workunit.client.0.smithi081.stdout:1/637: mknod d0/d6/d33/cd8 0 2024-09-18T12:51:23.836 INFO:tasks.workunit.client.0.smithi081.stdout:1/638: fdatasync d0/d6/d7/d2e/d51/f56 0 2024-09-18T12:51:23.836 INFO:tasks.workunit.client.0.smithi081.stdout:1/639: fsync d0/f4a 0 2024-09-18T12:51:23.837 INFO:tasks.workunit.client.1.smithi136.stdout:9/967: dread d6/da/d3d/f7b [0,4194304] 0 2024-09-18T12:51:23.840 INFO:tasks.workunit.client.1.smithi136.stdout:9/968: dread d6/da/d3d/f7b [0,4194304] 0 2024-09-18T12:51:23.841 INFO:tasks.workunit.client.1.smithi136.stdout:9/969: mknod d6/d96/dbb/c142 0 2024-09-18T12:51:23.841 INFO:tasks.workunit.client.0.smithi081.stdout:4/578: dwrite d3/d20/d3d/d65/d45/d6c/f7b [0,4194304] 0 2024-09-18T12:51:23.843 INFO:tasks.workunit.client.1.smithi136.stdout:9/970: creat d6/df/d23/d2b/d79/d119/f143 x:0 0 0 2024-09-18T12:51:23.856 INFO:tasks.workunit.client.0.smithi081.stdout:6/648: dwrite d4/d12/d1c/d39/d60/f9d [0,4194304] 0 2024-09-18T12:51:23.856 INFO:tasks.workunit.client.0.smithi081.stdout:1/640: dwrite d0/dd7/d2d/f2f [0,4194304] 0 2024-09-18T12:51:23.856 INFO:tasks.workunit.client.0.smithi081.stdout:1/641: getdents d0/dd7/d28/db0 0 2024-09-18T12:51:23.859 INFO:tasks.workunit.client.1.smithi136.stdout:9/971: dwrite d6/df/d23/dae/fd5 [0,4194304] 0 2024-09-18T12:51:23.860 INFO:tasks.workunit.client.0.smithi081.stdout:6/649: unlink d4/d12/d28/d2a/d2d/c66 0 2024-09-18T12:51:23.861 INFO:tasks.workunit.client.0.smithi081.stdout:6/650: chown d4/d12/d28/c7e 31347118 1 2024-09-18T12:51:23.861 INFO:tasks.workunit.client.0.smithi081.stdout:1/642: mkdir d0/d6/d33/d42/d70/dd9 0 2024-09-18T12:51:23.862 INFO:tasks.workunit.client.1.smithi136.stdout:9/972: creat d6/df/d23/dae/f144 x:0 0 0 2024-09-18T12:51:23.863 INFO:tasks.workunit.client.0.smithi081.stdout:1/643: symlink d0/dd7/d28/db0/lda 0 2024-09-18T12:51:23.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/973: mkdir d6/df/d23/d2b/d79/d145 0 2024-09-18T12:51:23.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/974: write d6/df/d23/d2b/d79/d119/d123/f128 [536496,114344] 0 2024-09-18T12:51:23.864 INFO:tasks.workunit.client.1.smithi136.stdout:9/975: creat d6/db/d12/d62/f146 x:0 0 0 2024-09-18T12:51:23.869 INFO:tasks.workunit.client.1.smithi136.stdout:9/976: mkdir d6/df/d23/d2b/d79/d53/d147 0 2024-09-18T12:51:23.869 INFO:tasks.workunit.client.1.smithi136.stdout:9/977: creat d6/d96/f148 x:0 0 0 2024-09-18T12:51:23.872 INFO:tasks.workunit.client.0.smithi081.stdout:1/644: dread d0/dd7/d2d/fd6 [0,4194304] 0 2024-09-18T12:51:23.880 INFO:tasks.workunit.client.0.smithi081.stdout:6/651: dwrite d4/d12/d28/d2a/d2d/d31/f7a [0,4194304] 0 2024-09-18T12:51:23.883 INFO:tasks.workunit.client.0.smithi081.stdout:6/652: mkdir d4/d12/d28/d2a/d74/d8b/d54/dd1 0 2024-09-18T12:51:23.883 INFO:tasks.workunit.client.0.smithi081.stdout:6/653: creat d4/d12/d28/d2a/d2d/fd2 x:0 0 0 2024-09-18T12:51:23.883 INFO:tasks.workunit.client.0.smithi081.stdout:6/654: stat d4/d12/d28/d2a 0 2024-09-18T12:51:23.883 INFO:tasks.workunit.client.1.smithi136.stdout:9/978: write d6/ff6 [1785155,129363] 0 2024-09-18T12:51:23.885 INFO:tasks.workunit.client.0.smithi081.stdout:6/655: mkdir d4/d12/d1c/d39/dd3 0 2024-09-18T12:51:23.885 INFO:tasks.workunit.client.0.smithi081.stdout:6/656: chown d4/d12/d56/d7d/d84 33686 1 2024-09-18T12:51:23.887 INFO:tasks.workunit.client.1.smithi136.stdout:9/979: symlink d6/l149 0 2024-09-18T12:51:23.887 INFO:tasks.workunit.client.1.smithi136.stdout:9/980: chown d6/db/d72/fb3 223118 1 2024-09-18T12:51:23.887 INFO:tasks.workunit.client.0.smithi081.stdout:6/657: getdents d4/d12/d56/d7d/d91 0 2024-09-18T12:51:23.890 INFO:tasks.workunit.client.1.smithi136.stdout:9/981: rename d6/db/de8/d101/l116 to d6/df/d23/d10f/l14a 0 2024-09-18T12:51:23.890 INFO:tasks.workunit.client.1.smithi136.stdout:9/982: truncate d6/da/d3d/d4d/fa2 4659206 0 2024-09-18T12:51:23.891 INFO:tasks.workunit.client.1.smithi136.stdout:9/983: mknod d6/da/d3d/d41/c14b 0 2024-09-18T12:51:23.891 INFO:tasks.workunit.client.1.smithi136.stdout:4/986: sync 2024-09-18T12:51:23.892 INFO:tasks.workunit.client.0.smithi081.stdout:6/658: getdents d4/d12/d1c/d39/d60/d90 0 2024-09-18T12:51:23.892 INFO:tasks.workunit.client.1.smithi136.stdout:9/984: mknod d6/df/d23/d2b/d79/d53/c14c 0 2024-09-18T12:51:23.893 INFO:tasks.workunit.client.1.smithi136.stdout:9/985: stat d6/db/l3e 0 2024-09-18T12:51:23.894 INFO:tasks.workunit.client.1.smithi136.stdout:4/987: rename d0/d3/d90/fe3 to d0/d3/d90/df8/f13a 0 2024-09-18T12:51:23.895 INFO:tasks.workunit.client.0.smithi081.stdout:6/659: symlink d4/d12/d28/d2a/d74/d8b/d6f/ld4 0 2024-09-18T12:51:23.895 INFO:tasks.workunit.client.0.smithi081.stdout:6/660: truncate d4/d12/d1c/d64/f81 1766890 0 2024-09-18T12:51:23.896 INFO:tasks.workunit.client.1.smithi136.stdout:9/986: truncate d6/da/d3d/f69 3420427 0 2024-09-18T12:51:23.896 INFO:tasks.workunit.client.0.smithi081.stdout:1/645: dwrite d0/db/d4f/dab/fbf [0,4194304] 0 2024-09-18T12:51:23.897 INFO:tasks.workunit.client.1.smithi136.stdout:4/988: mknod d0/d3/d54/dba/c13b 0 2024-09-18T12:51:23.897 INFO:tasks.workunit.client.1.smithi136.stdout:9/987: mknod d6/df/dd3/c14d 0 2024-09-18T12:51:23.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/661: creat d4/d12/d28/fd5 x:0 0 0 2024-09-18T12:51:23.906 INFO:tasks.workunit.client.1.smithi136.stdout:4/989: dread d0/d3/d54/d8a/faa [0,4194304] 0 2024-09-18T12:51:23.906 INFO:tasks.workunit.client.1.smithi136.stdout:4/990: write d0/d25/f39 [1410669,87044] 0 2024-09-18T12:51:23.906 INFO:tasks.workunit.client.1.smithi136.stdout:4/991: write d0/d2/f16 [4767681,71203] 0 2024-09-18T12:51:23.907 INFO:tasks.workunit.client.1.smithi136.stdout:4/992: mknod d0/d13/c13c 0 2024-09-18T12:51:23.909 INFO:tasks.workunit.client.1.smithi136.stdout:4/993: truncate d0/d13/fcc 1415186 0 2024-09-18T12:51:23.914 INFO:tasks.workunit.client.0.smithi081.stdout:6/662: write d4/d12/f44 [3524611,116410] 0 2024-09-18T12:51:23.917 INFO:tasks.workunit.client.0.smithi081.stdout:6/663: link d4/d12/l61 d4/d12/d28/d2a/d74/d8b/d54/ld6 0 2024-09-18T12:51:23.917 INFO:tasks.workunit.client.0.smithi081.stdout:6/664: read - d4/d12/d28/fd5 zero size 2024-09-18T12:51:23.917 INFO:tasks.workunit.client.1.smithi136.stdout:4/994: dread d0/d25/fd6 [0,4194304] 0 2024-09-18T12:51:23.918 INFO:tasks.workunit.client.1.smithi136.stdout:4/995: creat d0/d3/d54/f13d x:0 0 0 2024-09-18T12:51:23.919 INFO:tasks.workunit.client.1.smithi136.stdout:4/996: truncate d0/d13/f7f 867462 0 2024-09-18T12:51:23.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/646: dwrite d0/db/d4f/dab/fbf [0,4194304] 0 2024-09-18T12:51:23.932 INFO:tasks.workunit.client.0.smithi081.stdout:1/647: dread d0/dd7/d2d/f2f [0,4194304] 0 2024-09-18T12:51:23.951 INFO:tasks.workunit.client.0.smithi081.stdout:1/648: dwrite d0/dd7/f60 [0,4194304] 0 2024-09-18T12:51:23.951 INFO:tasks.workunit.client.1.smithi136.stdout:4/997: dwrite d0/d25/d79/ff4 [0,4194304] 0 2024-09-18T12:51:23.952 INFO:tasks.workunit.client.0.smithi081.stdout:1/649: mknod d0/dd7/cdb 0 2024-09-18T12:51:23.953 INFO:tasks.workunit.client.0.smithi081.stdout:1/650: readlink d0/d6/d7/d2e/d51/d2c/l5d 0 2024-09-18T12:51:23.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/651: truncate d0/d6/fd 4362232 0 2024-09-18T12:51:23.958 INFO:tasks.workunit.client.0.smithi081.stdout:1/652: unlink d0/d6/d7/d2e/d51/d2c/f5c 0 2024-09-18T12:51:23.958 INFO:tasks.workunit.client.0.smithi081.stdout:1/653: chown d0/d6/d7/d2e/d51/d2c 3 1 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:3/622: sync 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:9/509: sync 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:9/510: readlink dd/d15/d1a/d35/l60 0 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:3/623: truncate d3/db/df/d29/d13/d65/fb3 1030348 0 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:9/511: truncate dd/de/d59/f84 1102414 0 2024-09-18T12:51:23.962 INFO:tasks.workunit.client.0.smithi081.stdout:9/512: creat dd/d15/d1a/fa8 x:0 0 0 2024-09-18T12:51:23.964 INFO:tasks.workunit.client.1.smithi136.stdout:4/998: dwrite d0/d5f/dd3/fe5 [0,4194304] 0 2024-09-18T12:51:23.964 INFO:tasks.workunit.client.1.smithi136.stdout:4/999: chown d0/d3/d90/feb 3100908 1 2024-09-18T12:51:23.965 INFO:tasks.workunit.client.0.smithi081.stdout:3/624: symlink d3/db/df/d29/d13/d68/dac/ldb 0 2024-09-18T12:51:23.967 INFO:tasks.workunit.client.0.smithi081.stdout:9/513: rename dd/d1d/d1e/f43 to dd/de/fa9 0 2024-09-18T12:51:23.968 INFO:tasks.workunit.client.0.smithi081.stdout:3/625: symlink d3/d23/ldc 0 2024-09-18T12:51:23.971 INFO:tasks.workunit.client.0.smithi081.stdout:9/514: dread dd/de/d4f/f95 [0,4194304] 0 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 -- 172.21.15.81:0/1047823788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44100ca0 msgr2=0x7f9d441010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/1047823788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44100ca0 0x7f9d441010c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009910 tx=0x7f9d34009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 -- 172.21.15.81:0/1047823788 shutdown_connections 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/1047823788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d44101ea0 0x7f9d44102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/1047823788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44100ca0 0x7f9d441010c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 -- 172.21.15.81:0/1047823788 >> 172.21.15.81:0/1047823788 conn(0x7f9d440fc260 msgr2=0x7f9d440fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 -- 172.21.15.81:0/1047823788 shutdown_connections 2024-09-18T12:51:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.972+0000 7f9d48c4c700 1 -- 172.21.15.81:0/1047823788 wait complete. 2024-09-18T12:51:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 Processor -- start 2024-09-18T12:51:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 -- start start 2024-09-18T12:51:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d44100ca0 0x7f9d44198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441992a0 con 0x7f9d44101ea0 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.973+0000 7f9d48c4c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441993e0 con 0x7f9d44100ca0 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47138/0 (socket says 172.21.15.81:47138) 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 -- 172.21.15.81:0/2939417950 learned_addr learned my addr 172.21.15.81:0/2939417950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 -- 172.21.15.81:0/2939417950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d44100ca0 msgr2=0x7f9d44198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d44100ca0 0x7f9d44198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 -- 172.21.15.81:0/2939417950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340095f0 con 0x7f9d44101ea0 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d41d9b700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800b4b0 tx=0x7f9d3800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d38011800 con 0x7f9d44101ea0 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d38011e10 con 0x7f9d44101ea0 2024-09-18T12:51:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3800f2e0 con 0x7f9d44101ea0 2024-09-18T12:51:23.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.974+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4419de90 con 0x7f9d44101ea0 2024-09-18T12:51:23.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.975+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4419e3b0 con 0x7f9d44101ea0 2024-09-18T12:51:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.976+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44105f80 con 0x7f9d44101ea0 2024-09-18T12:51:23.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.977+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) v1 ==== 96746+0+0 (secure 0 0 0) 0x7f9d38010380 con 0x7f9d44101ea0 2024-09-18T12:51:23.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.977+0000 7f9d337fe700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 0x7f9d2c075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:23.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.977+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9d38094370 con 0x7f9d44101ea0 2024-09-18T12:51:23.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.977+0000 7f9d4259c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 0x7f9d2c075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:23.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.978+0000 7f9d4259c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 0x7f9d2c075f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b5c0 tx=0x7f9d34005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:23.982 INFO:tasks.workunit.client.0.smithi081.stdout:1/654: dwrite d0/d6/d33/d37/d71/f72 [0,4194304] 0 2024-09-18T12:51:23.983 INFO:tasks.workunit.client.0.smithi081.stdout:1/655: symlink d0/d96/ldc 0 2024-09-18T12:51:23.985 INFO:tasks.workunit.client.0.smithi081.stdout:3/626: dwrite d3/db/df/d29/d12/d44/d6f/f9a [0,4194304] 0 2024-09-18T12:51:23.985 INFO:tasks.workunit.client.0.smithi081.stdout:3/627: write d3/db/df/d29/d13/fc9 [1815508,10966] 0 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/628: fsync d3/db/df/d29/d13/d93/fca 0 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/629: chown d3/db/df/da8/fa9 123050856 1 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/630: chown d3/db/df/d29/d13/d9d/dd4 7246 1 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/631: write d3/db/dc/fd6 [504107,104367] 0 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/632: write d3/db/df/da8/fba [515815,105967] 0 2024-09-18T12:51:23.986 INFO:tasks.workunit.client.0.smithi081.stdout:1/656: link d0/d6/d33/c77 d0/d6/d33/d37/d71/cdd 0 2024-09-18T12:51:23.987 INFO:tasks.workunit.client.0.smithi081.stdout:9/515: read dd/d1d/d1e/d24/f67 [3235571,59102] 0 2024-09-18T12:51:23.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:23.985+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9d380626b0 con 0x7f9d44101ea0 2024-09-18T12:51:23.991 INFO:tasks.workunit.client.0.smithi081.stdout:3/633: rmdir d3/db/df/d29/d12/d44/d6f 39 2024-09-18T12:51:23.994 INFO:tasks.workunit.client.0.smithi081.stdout:1/657: link d0/d6/c64 d0/d18/d1a/cde 0 2024-09-18T12:51:23.996 INFO:tasks.workunit.client.0.smithi081.stdout:3/634: unlink d3/db/df/d29/d13/fc9 0 2024-09-18T12:51:23.997 INFO:tasks.workunit.client.0.smithi081.stdout:1/658: link d0/d6/d33/d37/dbc/cc3 d0/d18/cdf 0 2024-09-18T12:51:23.998 INFO:tasks.workunit.client.0.smithi081.stdout:9/516: dwrite dd/d1d/d1e/d24/d2a/f30 [4194304,4194304] 0 2024-09-18T12:51:23.999 INFO:tasks.workunit.client.0.smithi081.stdout:3/635: creat d3/db/dc/d1a/fdd x:0 0 0 2024-09-18T12:51:24.000 INFO:tasks.workunit.client.0.smithi081.stdout:3/636: dread d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:24.000 INFO:tasks.workunit.client.0.smithi081.stdout:1/659: symlink d0/d18/d6a/le0 0 2024-09-18T12:51:24.000 INFO:tasks.workunit.client.0.smithi081.stdout:1/660: chown d0/dd7/d2d/fcb 150729007 1 2024-09-18T12:51:24.003 INFO:tasks.workunit.client.0.smithi081.stdout:9/517: creat dd/d1d/d1e/d24/d2a/d55/d85/faa x:0 0 0 2024-09-18T12:51:24.006 INFO:tasks.workunit.client.0.smithi081.stdout:3/637: rename d3/db/da4/dc2/dc5 to d3/db/df/d29/d12/d44/d51/dde 0 2024-09-18T12:51:24.008 INFO:tasks.workunit.client.0.smithi081.stdout:3/638: symlink d3/db/da4/dc2/ldf 0 2024-09-18T12:51:24.012 INFO:tasks.workunit.client.0.smithi081.stdout:3/639: symlink d3/db/df/d29/d13/d93/le0 0 2024-09-18T12:51:24.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/661: dwrite d0/d6/d33/d42/f44 [0,4194304] 0 2024-09-18T12:51:24.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/662: creat d0/d6/d33/d37/fe1 x:0 0 0 2024-09-18T12:51:24.021 INFO:tasks.workunit.client.0.smithi081.stdout:1/663: creat d0/dd7/d2d/d75/fe2 x:0 0 0 2024-09-18T12:51:24.021 INFO:tasks.workunit.client.0.smithi081.stdout:1/664: chown d0/d6/f17 60194347 1 2024-09-18T12:51:24.023 INFO:tasks.workunit.client.0.smithi081.stdout:1/665: rename d0/d6/d7/d2e/d51/l86 to d0/dd7/d2d/le3 0 2024-09-18T12:51:24.026 INFO:tasks.workunit.client.0.smithi081.stdout:3/640: read d3/db/df/fc6 [5147307,8591] 0 2024-09-18T12:51:24.032 INFO:tasks.workunit.client.0.smithi081.stdout:3/641: rename d3/db/da4/dc2 to d3/db/df/d29/d12/d44/d51/dde/de1 0 2024-09-18T12:51:24.033 INFO:tasks.workunit.client.0.smithi081.stdout:1/666: dread d0/db/d4f/dab/fbf [0,4194304] 0 2024-09-18T12:51:24.034 INFO:tasks.workunit.client.0.smithi081.stdout:1/667: rmdir d0/db/d4f/dd2 39 2024-09-18T12:51:24.034 INFO:tasks.workunit.client.0.smithi081.stdout:1/668: read d0/db/f14 [232350,65969] 0 2024-09-18T12:51:24.049 INFO:tasks.workunit.client.0.smithi081.stdout:3/642: dwrite d3/db/d1b/fd1 [0,4194304] 0 2024-09-18T12:51:24.051 INFO:tasks.workunit.client.0.smithi081.stdout:3/643: truncate d3/db/df/d29/d13/f2b 832686 0 2024-09-18T12:51:24.058 INFO:tasks.workunit.client.0.smithi081.stdout:1/669: dwrite d0/d6/d7/f81 [0,4194304] 0 2024-09-18T12:51:24.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/670: truncate d0/d6/fe 3463186 0 2024-09-18T12:51:24.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/671: chown d0/dd7/d2d 3182511 1 2024-09-18T12:51:24.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/672: fdatasync d0/db/d32/f87 0 2024-09-18T12:51:24.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/644: dread d3/db/df/d29/f64 [0,4194304] 0 2024-09-18T12:51:24.066 INFO:tasks.workunit.client.0.smithi081.stdout:1/673: rename d0/d6/f17 to d0/db/d32/fe4 0 2024-09-18T12:51:24.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/645: creat d3/db/df/d29/d12/d44/d6f/fe2 x:0 0 0 2024-09-18T12:51:24.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/646: creat d3/db/df/d29/d13/d68/fe3 x:0 0 0 2024-09-18T12:51:24.070 INFO:tasks.workunit.client.0.smithi081.stdout:3/647: mknod d3/db/dc/ce4 0 2024-09-18T12:51:24.071 INFO:tasks.workunit.client.0.smithi081.stdout:3/648: rename d3 to d3/db/df/d29/d13/d65/de5 22 2024-09-18T12:51:24.071 INFO:tasks.workunit.client.0.smithi081.stdout:3/649: dread - d3/db/df/d29/d13/d93/fca zero size 2024-09-18T12:51:24.079 INFO:tasks.workunit.client.0.smithi081.stdout:1/674: fsync d0/ff 0 2024-09-18T12:51:24.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/675: stat d0/d6/d33 0 2024-09-18T12:51:24.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/676: readlink d0/d6/d7/d2e/la6 0 2024-09-18T12:51:24.083 INFO:tasks.workunit.client.0.smithi081.stdout:3/650: write d3/db/dc/f73 [514884,102278] 0 2024-09-18T12:51:24.085 INFO:tasks.workunit.client.0.smithi081.stdout:3/651: unlink d3/db/df/d29/d13/c82 0 2024-09-18T12:51:24.087 INFO:tasks.workunit.client.0.smithi081.stdout:3/652: link d3/db/df/d60/d58/l74 d3/db/le6 0 2024-09-18T12:51:24.087 INFO:tasks.workunit.client.0.smithi081.stdout:3/653: fdatasync d3/db/df/d29/d13/f95 0 2024-09-18T12:51:24.089 INFO:tasks.workunit.client.0.smithi081.stdout:3/654: symlink d3/db/df/d60/le7 0 2024-09-18T12:51:24.089 INFO:tasks.workunit.client.0.smithi081.stdout:3/655: write d3/db/df/d29/d13/d93/fca [994308,97606] 0 2024-09-18T12:51:24.089 INFO:tasks.workunit.client.0.smithi081.stdout:3/656: write d3/d84/fda [251236,76642] 0 2024-09-18T12:51:24.089 INFO:tasks.workunit.client.0.smithi081.stdout:3/657: fdatasync d3/db/df/d29/d13/d68/fa3 0 2024-09-18T12:51:24.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/658: link d3/db/df/d29/d12/d44/d6f/f9a d3/d84/fe8 0 2024-09-18T12:51:24.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/659: write d3/db/df/d29/d12/d44/d6f/fe2 [448940,95090] 0 2024-09-18T12:51:24.094 INFO:tasks.workunit.client.0.smithi081.stdout:3/660: mknod d3/d23/ce9 0 2024-09-18T12:51:24.094 INFO:tasks.workunit.client.0.smithi081.stdout:3/661: chown d3/db/d1b/f7d 1 1 2024-09-18T12:51:24.095 INFO:tasks.workunit.client.0.smithi081.stdout:3/662: creat d3/db/df/d29/d13/d9d/fea x:0 0 0 2024-09-18T12:51:24.095 INFO:tasks.workunit.client.0.smithi081.stdout:3/663: chown d3/db/df/d29/d12/l39 5 1 2024-09-18T12:51:24.096 INFO:tasks.workunit.client.0.smithi081.stdout:3/664: truncate d3/fc7 673598 0 2024-09-18T12:51:24.096 INFO:tasks.workunit.client.0.smithi081.stdout:3/665: mknod d3/db/df/d29/d12/d44/ceb 0 2024-09-18T12:51:24.097 INFO:tasks.workunit.client.0.smithi081.stdout:1/677: dwrite d0/db/f39 [8388608,4194304] 0 2024-09-18T12:51:24.098 INFO:tasks.workunit.client.0.smithi081.stdout:3/666: link d3/db/f56 d3/db/df/d60/d58/fec 0 2024-09-18T12:51:24.100 INFO:tasks.workunit.client.0.smithi081.stdout:1/678: creat d0/d18/fe5 x:0 0 0 2024-09-18T12:51:24.101 INFO:tasks.workunit.client.0.smithi081.stdout:3/667: mknod d3/db/dc/d1a/ced 0 2024-09-18T12:51:24.101 INFO:tasks.workunit.client.0.smithi081.stdout:3/668: stat d3/db/d1b/f7d 0 2024-09-18T12:51:24.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:23 smithi081 ceph-mon[27646]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:24.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:23 smithi081 ceph-mon[27646]: pgmap v284: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 302 MiB/s rd, 372 MiB/s wr, 479 op/s 2024-09-18T12:51:24.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:23 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/881306846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:51:24.133 INFO:tasks.workunit.client.1.smithi136.stdout:9/988: sync 2024-09-18T12:51:24.133 INFO:tasks.workunit.client.1.smithi136.stdout:9/989: symlink d6/df/d23/d2b/l14e 0 2024-09-18T12:51:24.134 INFO:tasks.workunit.client.1.smithi136.stdout:9/990: mkdir d6/df/d23/d2b/d14f 0 2024-09-18T12:51:24.135 INFO:tasks.workunit.client.1.smithi136.stdout:9/991: mkdir d6/d13/d4c/d150 0 2024-09-18T12:51:24.146 INFO:tasks.workunit.client.0.smithi081.stdout:7/549: sync 2024-09-18T12:51:24.146 INFO:tasks.workunit.client.0.smithi081.stdout:5/632: sync 2024-09-18T12:51:24.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/577: sync 2024-09-18T12:51:24.147 INFO:tasks.workunit.client.0.smithi081.stdout:2/731: sync 2024-09-18T12:51:24.147 INFO:tasks.workunit.client.0.smithi081.stdout:0/623: sync 2024-09-18T12:51:24.147 INFO:tasks.workunit.client.0.smithi081.stdout:0/624: write d7/d9/d4b/d4a/d77/f7e [1428322,99473] 0 2024-09-18T12:51:24.149 INFO:tasks.workunit.client.0.smithi081.stdout:8/578: creat d3/d1d/fc5 x:0 0 0 2024-09-18T12:51:24.151 INFO:tasks.workunit.client.0.smithi081.stdout:2/732: mkdir d15/d16/d20/d31/d109 0 2024-09-18T12:51:24.151 INFO:tasks.workunit.client.1.smithi136.stdout:9/992: dwrite d6/da/d3d/d4d/d91/d25/f31 [4194304,4194304] 0 2024-09-18T12:51:24.152 INFO:tasks.workunit.client.1.smithi136.stdout:9/993: write d6/df/d23/d2b/fa6 [925344,56516] 0 2024-09-18T12:51:24.152 INFO:tasks.workunit.client.1.smithi136.stdout:9/994: dread - d6/db/d12/d62/f146 zero size 2024-09-18T12:51:24.152 INFO:tasks.workunit.client.0.smithi081.stdout:0/625: truncate d7/d9/d4b/d3d/f5e 474816 0 2024-09-18T12:51:24.153 INFO:tasks.workunit.client.0.smithi081.stdout:0/626: creat d7/d9/d4b/d33/d7d/fd1 x:0 0 0 2024-09-18T12:51:24.153 INFO:tasks.workunit.client.0.smithi081.stdout:7/550: dread d2/d14/d21/d62/da7/f7d [0,4194304] 0 2024-09-18T12:51:24.155 INFO:tasks.workunit.client.1.smithi136.stdout:9/995: dread d6/d13/ff4 [0,4194304] 0 2024-09-18T12:51:24.156 INFO:tasks.workunit.client.0.smithi081.stdout:0/627: creat d7/dbf/fd2 x:0 0 0 2024-09-18T12:51:24.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/579: rename d3/d1e/f27 to d3/d1e/fc6 0 2024-09-18T12:51:24.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/580: chown d3/d73/dbe 2574 1 2024-09-18T12:51:24.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/581: truncate d3/d1d/d4a/f92 4651029 0 2024-09-18T12:51:24.161 INFO:tasks.workunit.client.0.smithi081.stdout:8/582: read - d3/d1e/d4c/fb6 zero size 2024-09-18T12:51:24.162 INFO:tasks.workunit.client.0.smithi081.stdout:7/551: truncate d2/d14/d21/d62/da7/f2e 823160 0 2024-09-18T12:51:24.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/628: symlink d7/d9/d4b/d3d/ld3 0 2024-09-18T12:51:24.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/629: read - d7/d9/d4b/d33/d43/d9a/fc4 zero size 2024-09-18T12:51:24.165 INFO:tasks.workunit.client.0.smithi081.stdout:7/552: getdents d2/d1d/d4e/d84 0 2024-09-18T12:51:24.166 INFO:tasks.workunit.client.0.smithi081.stdout:2/733: dwrite d15/d26/ff2 [0,4194304] 0 2024-09-18T12:51:24.171 INFO:tasks.workunit.client.0.smithi081.stdout:8/583: dread d3/d1e/fc6 [0,4194304] 0 2024-09-18T12:51:24.171 INFO:tasks.workunit.client.0.smithi081.stdout:8/584: creat d3/d73/fc7 x:0 0 0 2024-09-18T12:51:24.173 INFO:tasks.workunit.client.0.smithi081.stdout:0/630: link d7/cbc d7/d9/d12/cd4 0 2024-09-18T12:51:24.174 INFO:tasks.workunit.client.0.smithi081.stdout:7/553: mknod d2/d18/d22/d48/cc2 0 2024-09-18T12:51:24.176 INFO:tasks.workunit.client.0.smithi081.stdout:2/734: rmdir d15/d16/ded 39 2024-09-18T12:51:24.178 INFO:tasks.workunit.client.0.smithi081.stdout:8/585: symlink d3/d1e/d4c/dae/lc8 0 2024-09-18T12:51:24.179 INFO:tasks.workunit.client.0.smithi081.stdout:0/631: symlink d7/d9/d4b/d33/dc7/ld5 0 2024-09-18T12:51:24.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/554: creat d2/d18/d22/d48/db9/fc3 x:0 0 0 2024-09-18T12:51:24.182 INFO:tasks.workunit.client.0.smithi081.stdout:2/735: mkdir d15/d16/def/dd8/d10a 0 2024-09-18T12:51:24.183 INFO:tasks.workunit.client.0.smithi081.stdout:7/555: rmdir d2/d1d/d4e 39 2024-09-18T12:51:24.184 INFO:tasks.workunit.client.0.smithi081.stdout:7/556: chown d2/d14/d21 140080821 1 2024-09-18T12:51:24.184 INFO:tasks.workunit.client.0.smithi081.stdout:7/557: creat d2/d14/d21/fc4 x:0 0 0 2024-09-18T12:51:24.186 INFO:tasks.workunit.client.0.smithi081.stdout:2/736: link d15/d16/d33/d53/d7a/dee/fab d15/d16/d20/d22/f10b 0 2024-09-18T12:51:24.186 INFO:tasks.workunit.client.0.smithi081.stdout:2/737: creat d15/d16/d20/f10c x:0 0 0 2024-09-18T12:51:24.189 INFO:tasks.workunit.client.0.smithi081.stdout:7/558: getdents d2/d1d 0 2024-09-18T12:51:24.192 INFO:tasks.workunit.client.0.smithi081.stdout:2/738: mkdir d15/df9/d10d 0 2024-09-18T12:51:24.194 INFO:tasks.workunit.client.0.smithi081.stdout:7/559: unlink d2/d14/l40 0 2024-09-18T12:51:24.197 INFO:tasks.workunit.client.0.smithi081.stdout:2/739: dread f7 [0,4194304] 0 2024-09-18T12:51:24.197 INFO:tasks.workunit.client.0.smithi081.stdout:2/740: truncate d15/d16/d33/d53/d7a/d2f/dc2/f94 4721146 0 2024-09-18T12:51:24.197 INFO:tasks.workunit.client.0.smithi081.stdout:0/632: dwrite d7/d9/d12/dba/fd0 [0,4194304] 0 2024-09-18T12:51:24.198 INFO:tasks.workunit.client.0.smithi081.stdout:8/586: dwrite d3/d1e/f78 [4194304,4194304] 0 2024-09-18T12:51:24.202 INFO:tasks.workunit.client.0.smithi081.stdout:8/587: mkdir d3/dc9 0 2024-09-18T12:51:24.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/588: getdents d3/d1e/d4c 0 2024-09-18T12:51:24.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/589: getdents d3/d1d/d89/db5/db8 0 2024-09-18T12:51:24.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/590: readlink d3/l3b 0 2024-09-18T12:51:24.207 INFO:tasks.workunit.client.0.smithi081.stdout:8/591: creat d3/dc9/fca x:0 0 0 2024-09-18T12:51:24.216 INFO:tasks.workunit.client.0.smithi081.stdout:8/592: dread d3/d1e/f9c [0,4194304] 0 2024-09-18T12:51:24.216 INFO:tasks.workunit.client.0.smithi081.stdout:8/593: read d3/d73/dbe/fc1 [1014151,55329] 0 2024-09-18T12:51:24.221 INFO:tasks.workunit.client.0.smithi081.stdout:7/560: dwrite d2/d14/d21/d49/fb7 [0,4194304] 0 2024-09-18T12:51:24.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/741: dwrite d15/d16/d33/d53/d7a/dee/f68 [4194304,4194304] 0 2024-09-18T12:51:24.221 INFO:tasks.workunit.client.0.smithi081.stdout:7/561: write d2/d14/d21/d62/da7/f3d [1636701,108267] 0 2024-09-18T12:51:24.224 INFO:tasks.workunit.client.0.smithi081.stdout:2/742: creat d15/d16/d20/d31/f10e x:0 0 0 2024-09-18T12:51:24.225 INFO:tasks.workunit.client.0.smithi081.stdout:7/562: truncate d2/d56/d73/d7c/f63 2415306 0 2024-09-18T12:51:24.226 INFO:tasks.workunit.client.0.smithi081.stdout:7/563: truncate d2/d18/d3c/f7a 2999005 0 2024-09-18T12:51:24.230 INFO:tasks.workunit.client.0.smithi081.stdout:7/564: unlink d2/d18/d22/d48/f9f 0 2024-09-18T12:51:24.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/565: fsync d2/d42/f82 0 2024-09-18T12:51:24.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/566: symlink d2/d14/lc5 0 2024-09-18T12:51:24.234 INFO:tasks.workunit.client.0.smithi081.stdout:7/567: mknod d2/d18/d22/cc6 0 2024-09-18T12:51:24.235 INFO:tasks.workunit.client.0.smithi081.stdout:7/568: mkdir d2/d1d/d4e/dc7 0 2024-09-18T12:51:24.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/569: truncate d2/d14/d21/d49/fb7 2124298 0 2024-09-18T12:51:24.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/570: fsync d2/f4a 0 2024-09-18T12:51:24.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/571: chown d2/d14/d21/d62/da7/f2e 1039185691 1 2024-09-18T12:51:24.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/572: fdatasync d2/f4a 0 2024-09-18T12:51:24.237 INFO:tasks.workunit.client.0.smithi081.stdout:7/573: truncate d2/f3a 510741 0 2024-09-18T12:51:24.239 INFO:tasks.workunit.client.0.smithi081.stdout:8/594: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-18T12:51:24.240 INFO:tasks.workunit.client.0.smithi081.stdout:8/595: chown d3/d2f/f31 176 1 2024-09-18T12:51:24.240 INFO:tasks.workunit.client.0.smithi081.stdout:8/596: readlink d3/l3b 0 2024-09-18T12:51:24.241 INFO:tasks.workunit.client.0.smithi081.stdout:8/597: mkdir d3/d1e/d4c/d68/daa/dcb 0 2024-09-18T12:51:24.242 INFO:tasks.workunit.client.0.smithi081.stdout:8/598: creat d3/d1e/d4c/fcc x:0 0 0 2024-09-18T12:51:24.243 INFO:tasks.workunit.client.0.smithi081.stdout:2/743: dwrite d15/d16/d33/d53/d7a/d2f/dc2/f7d [0,4194304] 0 2024-09-18T12:51:24.254 INFO:tasks.workunit.client.1.smithi136.stdout:9/996: sync 2024-09-18T12:51:24.254 INFO:tasks.workunit.client.1.smithi136.stdout:9/997: stat d6/da/d3d/d4d/d91/c2f 0 2024-09-18T12:51:24.256 INFO:tasks.workunit.client.0.smithi081.stdout:2/744: dread d15/d16/f44 [0,4194304] 0 2024-09-18T12:51:24.256 INFO:tasks.workunit.client.0.smithi081.stdout:2/745: readlink d15/d16/d33/d53/d7a/d2f/laa 0 2024-09-18T12:51:24.256 INFO:tasks.workunit.client.0.smithi081.stdout:2/746: truncate d15/d16/ded/f104 372186 0 2024-09-18T12:51:24.256 INFO:tasks.workunit.client.0.smithi081.stdout:7/574: dwrite d2/d56/d73/d7c/f63 [0,4194304] 0 2024-09-18T12:51:24.257 INFO:tasks.workunit.client.1.smithi136.stdout:9/998: rename d6/db/l3e to d6/d13/d4c/l151 0 2024-09-18T12:51:24.257 INFO:tasks.workunit.client.1.smithi136.stdout:9/999: fsync d6/da/d3d/d4d/d91/f104 0 2024-09-18T12:51:24.257 INFO:tasks.workunit.client.0.smithi081.stdout:2/747: creat d15/df9/d10d/f10f x:0 0 0 2024-09-18T12:51:24.257 INFO:tasks.workunit.client.0.smithi081.stdout:2/748: chown l10 88 1 2024-09-18T12:51:24.259 INFO:tasks.workunit.client.0.smithi081.stdout:2/749: mkdir d15/d16/d33/d53/d7a/d2f/d110 0 2024-09-18T12:51:24.259 INFO:tasks.workunit.client.1.smithi136.stderr:+ rm -rf -- ./tmp.s9CV0n89Fr 2024-09-18T12:51:24.265 INFO:tasks.workunit.client.0.smithi081.stdout:8/599: dwrite d3/d1d/d4a/f7e [0,4194304] 0 2024-09-18T12:51:24.265 INFO:tasks.workunit.client.0.smithi081.stdout:7/575: read d2/f10 [5613130,118028] 0 2024-09-18T12:51:24.266 INFO:tasks.workunit.client.0.smithi081.stdout:8/600: chown d3/d1e/f34 57 1 2024-09-18T12:51:24.275 INFO:tasks.workunit.client.0.smithi081.stdout:2/750: dwrite d15/d16/d33/d53/d7a/d2f/dc2/f7c [0,4194304] 0 2024-09-18T12:51:24.280 INFO:tasks.workunit.client.0.smithi081.stdout:2/751: getdents d15/d16/def 0 2024-09-18T12:51:24.282 INFO:tasks.workunit.client.0.smithi081.stdout:7/576: unlink d2/d18/d22/d48/l4c 0 2024-09-18T12:51:24.285 INFO:tasks.workunit.client.0.smithi081.stdout:2/752: unlink d15/d16/d20/d22/d5a/c82 0 2024-09-18T12:51:24.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/753: dread d15/d16/ded/f104 [0,4194304] 0 2024-09-18T12:51:24.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/577: mkdir d2/d56/dc8 0 2024-09-18T12:51:24.290 INFO:tasks.workunit.client.0.smithi081.stdout:8/601: dwrite d3/d1d/d4a/d7f/fa8 [0,4194304] 0 2024-09-18T12:51:24.298 INFO:tasks.workunit.client.0.smithi081.stdout:7/578: dread d2/f12 [0,4194304] 0 2024-09-18T12:51:24.300 INFO:tasks.workunit.client.0.smithi081.stdout:7/579: mknod d2/d1d/cc9 0 2024-09-18T12:51:24.301 INFO:tasks.workunit.client.0.smithi081.stdout:7/580: write d2/d7f/f83 [457333,100205] 0 2024-09-18T12:51:24.302 INFO:tasks.workunit.client.0.smithi081.stdout:7/581: creat d2/d56/dc8/fca x:0 0 0 2024-09-18T12:51:24.303 INFO:tasks.workunit.client.0.smithi081.stdout:2/754: dwrite d15/d16/d33/d53/d7a/f52 [0,4194304] 0 2024-09-18T12:51:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:23 smithi136 ceph-mon[35363]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:23 smithi136 ceph-mon[35363]: pgmap v284: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 302 MiB/s rd, 372 MiB/s wr, 479 op/s 2024-09-18T12:51:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:23 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/881306846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:51:24.315 INFO:tasks.workunit.client.0.smithi081.stdout:4/579: sync 2024-09-18T12:51:24.316 INFO:tasks.workunit.client.0.smithi081.stdout:7/582: dread d2/d14/d21/f7e [0,4194304] 0 2024-09-18T12:51:24.316 INFO:tasks.workunit.client.0.smithi081.stdout:8/602: dwrite d3/d1e/d4c/d53/f66 [0,4194304] 0 2024-09-18T12:51:24.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/580: creat d3/d20/d3d/d65/d2f/d8c/fbe x:0 0 0 2024-09-18T12:51:24.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/581: stat d3/d20/d3d/d65/d2f/f8b 0 2024-09-18T12:51:24.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/582: fsync d3/db/d35/d79/f92 0 2024-09-18T12:51:24.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/583: mknod d2/d18/d60/d85/ccb 0 2024-09-18T12:51:24.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/603: creat d3/d1d/d89/db5/fcd x:0 0 0 2024-09-18T12:51:24.321 INFO:tasks.workunit.client.0.smithi081.stdout:4/583: mknod d3/d20/d3d/d65/d45/d6c/cbf 0 2024-09-18T12:51:24.323 INFO:tasks.workunit.client.0.smithi081.stdout:7/584: mkdir d2/d14/d21/d49/dcc 0 2024-09-18T12:51:24.323 INFO:tasks.workunit.client.0.smithi081.stdout:2/755: dwrite d15/d16/d33/f86 [0,4194304] 0 2024-09-18T12:51:24.326 INFO:tasks.workunit.client.0.smithi081.stdout:8/604: unlink d3/d1e/d4c/d53/f66 0 2024-09-18T12:51:24.327 INFO:tasks.workunit.client.0.smithi081.stdout:4/584: symlink d3/d20/d3d/d6b/lc0 0 2024-09-18T12:51:24.327 INFO:tasks.workunit.client.0.smithi081.stdout:4/585: fsync d3/d20/d3d/d65/d14/d27/f7c 0 2024-09-18T12:51:24.333 INFO:tasks.workunit.client.0.smithi081.stdout:2/756: creat d15/d16/d33/d53/d7a/dee/f111 x:0 0 0 2024-09-18T12:51:24.336 INFO:tasks.workunit.client.0.smithi081.stdout:2/757: truncate d15/d16/f37 1882708 0 2024-09-18T12:51:24.336 INFO:tasks.workunit.client.0.smithi081.stdout:2/758: fdatasync d15/d16/def/dd8/fde 0 2024-09-18T12:51:24.342 INFO:tasks.workunit.client.0.smithi081.stdout:7/585: dwrite d2/d18/d22/f32 [0,4194304] 0 2024-09-18T12:51:24.345 INFO:tasks.workunit.client.0.smithi081.stdout:7/586: mkdir d2/d1d/d4e/d84/dcd 0 2024-09-18T12:51:24.352 INFO:tasks.workunit.client.0.smithi081.stdout:4/586: dwrite d3/db/d35/d79/f92 [0,4194304] 0 2024-09-18T12:51:24.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/605: dwrite d3/d73/dbe/fc1 [0,4194304] 0 2024-09-18T12:51:24.355 INFO:tasks.workunit.client.0.smithi081.stdout:2/759: dwrite d15/d16/f19 [4194304,4194304] 0 2024-09-18T12:51:24.356 INFO:tasks.workunit.client.0.smithi081.stdout:2/760: creat d15/d16/d20/f112 x:0 0 0 2024-09-18T12:51:24.356 INFO:tasks.workunit.client.0.smithi081.stdout:2/761: readlink d15/d16/d20/d31/l106 0 2024-09-18T12:51:24.356 INFO:tasks.workunit.client.0.smithi081.stdout:2/762: fdatasync d15/d6e/fcd 0 2024-09-18T12:51:24.356 INFO:tasks.workunit.client.0.smithi081.stdout:4/587: mkdir d3/db/d2d/d4e/dc1 0 2024-09-18T12:51:24.361 INFO:tasks.workunit.client.0.smithi081.stdout:8/606: mkdir d3/d1e/d4c/d53/dce 0 2024-09-18T12:51:24.361 INFO:tasks.workunit.client.0.smithi081.stdout:7/587: dwrite d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:24.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/763: mknod d15/d16/d20/d22/d5a/c113 0 2024-09-18T12:51:24.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/764: fsync d15/d16/d33/f5b 0 2024-09-18T12:51:24.366 INFO:tasks.workunit.client.0.smithi081.stdout:8/607: dread d3/d1d/f51 [0,4194304] 0 2024-09-18T12:51:24.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/588: rmdir d3/d20/d3d/d65/d2f/d8c 39 2024-09-18T12:51:24.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/589: stat d3/d20/d3d/d65/d45/d4f/f82 0 2024-09-18T12:51:24.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/590: truncate d3/db/d35/d79/f8e 108388 0 2024-09-18T12:51:24.380 INFO:tasks.workunit.client.0.smithi081.stdout:8/608: dwrite d3/d1e/d4c/d53/fac [0,4194304] 0 2024-09-18T12:51:24.380 INFO:tasks.workunit.client.0.smithi081.stdout:4/591: creat d3/d20/d5b/fc2 x:0 0 0 2024-09-18T12:51:24.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/609: mkdir d3/d1d/d9f/dcf 0 2024-09-18T12:51:24.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/610: write d3/d1d/d4a/f97 [2165830,125392] 0 2024-09-18T12:51:24.385 INFO:tasks.workunit.client.0.smithi081.stdout:4/592: unlink d3/d20/d3d/d65/d14/l75 0 2024-09-18T12:51:24.385 INFO:tasks.workunit.client.0.smithi081.stdout:4/593: write d3/db/d2d/d4e/d8d/fa2 [211746,122668] 0 2024-09-18T12:51:24.387 INFO:tasks.workunit.client.0.smithi081.stdout:2/765: write d15/d6e/d7f/ffb [967243,29371] 0 2024-09-18T12:51:24.387 INFO:tasks.workunit.client.0.smithi081.stdout:2/766: chown d15/d16/d33/d53/d7a/d2f/dc2/f94 0 1 2024-09-18T12:51:24.389 INFO:tasks.workunit.client.0.smithi081.stdout:2/767: creat d15/f114 x:0 0 0 2024-09-18T12:51:24.390 INFO:tasks.workunit.client.0.smithi081.stdout:8/611: getdents d3/d1e/d4c/d68/daa 0 2024-09-18T12:51:24.390 INFO:tasks.workunit.client.0.smithi081.stdout:8/612: truncate d3/f6c 176226 0 2024-09-18T12:51:24.392 INFO:tasks.workunit.client.0.smithi081.stdout:2/768: unlink d15/d16/d20/f55 0 2024-09-18T12:51:24.395 INFO:tasks.workunit.client.0.smithi081.stdout:8/613: mknod d3/d1e/d4c/d68/cd0 0 2024-09-18T12:51:24.396 INFO:tasks.workunit.client.0.smithi081.stdout:4/594: read d3/d20/d3d/d65/d14/d27/f3a [2587633,22630] 0 2024-09-18T12:51:24.399 INFO:tasks.workunit.client.0.smithi081.stdout:4/595: mknod d3/db/d35/d79/cc3 0 2024-09-18T12:51:24.399 INFO:tasks.workunit.client.0.smithi081.stdout:4/596: dread - d3/d20/d3d/d65/fa5 zero size 2024-09-18T12:51:24.401 INFO:tasks.workunit.client.0.smithi081.stdout:4/597: mkdir d3/d20/d3d/d65/d45/dc4 0 2024-09-18T12:51:24.401 INFO:tasks.workunit.client.0.smithi081.stdout:4/598: truncate d3/db/f23 4311954 0 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/599: mknod d3/db/d2d/d4e/d8d/db8/cc5 0 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/600: write d3/d20/d3d/d65/d14/d27/f3a [1631295,69588] 0 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/601: dread - d3/d20/d3d/d65/d14/d4b/f74 zero size 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/602: chown d3/d20/d3d/d6b 65513507 1 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/603: dread - d3/db/f9e zero size 2024-09-18T12:51:24.402 INFO:tasks.workunit.client.0.smithi081.stdout:4/604: chown d3/d20/d3d/d65/d14/f1e 0 1 2024-09-18T12:51:24.404 INFO:tasks.workunit.client.0.smithi081.stdout:4/605: unlink d3/d20/d3d/d65/d2f/f33 0 2024-09-18T12:51:24.404 INFO:tasks.workunit.client.0.smithi081.stdout:4/606: getdents d3/db/d35 0 2024-09-18T12:51:24.405 INFO:tasks.workunit.client.0.smithi081.stdout:4/607: mknod d3/d20/d3d/d65/d45/cc6 0 2024-09-18T12:51:24.408 INFO:tasks.workunit.client.0.smithi081.stdout:2/769: dwrite d15/d16/d33/f86 [0,4194304] 0 2024-09-18T12:51:24.410 INFO:tasks.workunit.client.0.smithi081.stdout:2/770: symlink d15/d16/d20/l115 0 2024-09-18T12:51:24.412 INFO:tasks.workunit.client.0.smithi081.stdout:2/771: unlink d15/d16/d33/d53/d7a/d2f/d61/d97/ffa 0 2024-09-18T12:51:24.413 INFO:tasks.workunit.client.0.smithi081.stdout:2/772: truncate d15/f114 892870 0 2024-09-18T12:51:24.417 INFO:tasks.workunit.client.0.smithi081.stdout:8/614: dwrite d3/d1e/d4c/d68/f82 [0,4194304] 0 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:2/773: dread d15/d16/d20/d22/f10b [0,4194304] 0 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:2/774: creat d15/d16/d20/d22/f116 x:0 0 0 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:2/775: chown d15/d16/d33/d53/d7a/d2f/dc2/f93 6032 1 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:8/615: mknod d3/d1d/d4a/d7f/cd1 0 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:8/616: chown d3/d1e/d4c 66386133 1 2024-09-18T12:51:24.420 INFO:tasks.workunit.client.0.smithi081.stdout:8/617: write d3/d1d/d4a/d8d/fbd [1300979,60822] 0 2024-09-18T12:51:24.422 INFO:tasks.workunit.client.0.smithi081.stdout:2/776: creat d15/d16/d33/d53/d7a/d2f/dfd/f117 x:0 0 0 2024-09-18T12:51:24.424 INFO:tasks.workunit.client.0.smithi081.stdout:4/608: dwrite d3/d20/d3d/f8f [0,4194304] 0 2024-09-18T12:51:24.424 INFO:tasks.workunit.client.0.smithi081.stdout:4/609: write d3/f22 [1812801,59797] 0 2024-09-18T12:51:24.424 INFO:tasks.workunit.client.0.smithi081.stdout:2/777: creat d15/d16/d33/d53/d7a/d2f/d61/d97/ddd/f118 x:0 0 0 2024-09-18T12:51:24.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/618: mkdir d3/d1e/d4c/d68/dd2 0 2024-09-18T12:51:24.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/619: fsync d3/d1e/f9c 0 2024-09-18T12:51:24.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/620: creat d3/d1d/d4a/d8d/fd3 x:0 0 0 2024-09-18T12:51:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.427+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9d4402cc70 con 0x7f9d44101ea0 2024-09-18T12:51:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.427+0000 7f9d337fe700 1 -- 172.21.15.81:0/2939417950 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9d38062240 con 0x7f9d44101ea0 2024-09-18T12:51:24.428 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:51:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.430+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 msgr2=0x7f9d2c075f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.430+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 0x7f9d2c075f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b5c0 tx=0x7f9d34005960 comp rx=0 tx=0).stop 2024-09-18T12:51:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.430+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 msgr2=0x7f9d44198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.430+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800b4b0 tx=0x7f9d3800b870 comp rx=0 tx=0).stop 2024-09-18T12:51:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 shutdown_connections 2024-09-18T12:51:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d44100ca0 0x7f9d44198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:6800/2,v1:172.21.15.81:6801/2] conn(0x7f9d2c073a40 0x7f9d2c075f00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 --2- 172.21.15.81:0/2939417950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d44101ea0 0x7f9d44198c80 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800b4b0 tx=0x7f9d3800b870 comp rx=0 tx=0).stop 2024-09-18T12:51:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 >> 172.21.15.81:0/2939417950 conn(0x7f9d440fc260 msgr2=0x7f9d441030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.431+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 shutdown_connections 2024-09-18T12:51:24.434 INFO:tasks.workunit.client.0.smithi081.stdout:4/610: truncate d3/d20/d3d/d65/d45/f81 770909 0 2024-09-18T12:51:24.434 INFO:tasks.workunit.client.0.smithi081.stdout:4/611: fdatasync d3/db/fab 0 2024-09-18T12:51:24.434 INFO:tasks.workunit.client.0.smithi081.stdout:4/612: stat d3/d20/d3d/dbd 0 2024-09-18T12:51:24.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/778: symlink d15/d16/d33/d53/d7a/d2f/d61/d97/ddd/l119 0 2024-09-18T12:51:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:24.433+0000 7f9d48c4c700 1 -- 172.21.15.81:0/2939417950 wait complete. 2024-09-18T12:51:24.437 INFO:tasks.workunit.client.0.smithi081.stdout:8/621: unlink d3/d2f/f31 0 2024-09-18T12:51:24.437 INFO:tasks.workunit.client.0.smithi081.stdout:8/622: fsync d3/d1d/d4a/d7f/f84 0 2024-09-18T12:51:24.437 INFO:tasks.workunit.client.0.smithi081.stdout:8/623: write d3/d1d/d4a/d8d/fd3 [35148,62739] 0 2024-09-18T12:51:24.438 INFO:tasks.workunit.client.0.smithi081.stdout:2/779: symlink d15/d26/da8/l11a 0 2024-09-18T12:51:24.439 INFO:tasks.workunit.client.0.smithi081.stdout:2/780: fdatasync d15/d16/d33/d53/d7a/d2f/d61/fb4 0 2024-09-18T12:51:24.440 INFO:tasks.workunit.client.0.smithi081.stdout:8/624: write d3/f6c [1179552,34543] 0 2024-09-18T12:51:24.442 INFO:tasks.workunit.client.0.smithi081.stdout:2/781: symlink d15/d16/d33/l11b 0 2024-09-18T12:51:24.444 INFO:tasks.workunit.client.0.smithi081.stdout:8/625: creat d3/db7/fd4 x:0 0 0 2024-09-18T12:51:24.448 INFO:tasks.workunit.client.0.smithi081.stdout:2/782: rename d15/d16/d33/d53/fb2 to d15/d16/d33/d53/db0/f11c 0 2024-09-18T12:51:24.450 INFO:tasks.workunit.client.0.smithi081.stdout:4/613: dwrite d3/d20/d3d/d65/d2f/f8b [0,4194304] 0 2024-09-18T12:51:24.451 INFO:tasks.workunit.client.0.smithi081.stdout:2/783: rename d15/d16/d33/d53/d7a/d2f/c30 to d15/d16/d20/d107/c11d 0 2024-09-18T12:51:24.459 INFO:tasks.workunit.client.0.smithi081.stdout:4/614: mkdir d3/d20/d3d/d65/d14/d4b/dc7 0 2024-09-18T12:51:24.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/626: dwrite d3/d1d/fc5 [0,4194304] 0 2024-09-18T12:51:24.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/627: read d3/d1d/d4a/d8d/fbd [3898844,99980] 0 2024-09-18T12:51:24.481 INFO:tasks.workunit.client.0.smithi081.stdout:4/615: dwrite d3/db/f36 [0,4194304] 0 2024-09-18T12:51:24.492 INFO:tasks.workunit.client.0.smithi081.stdout:4/616: dread d3/d20/d3d/d65/d2f/f8b [0,4194304] 0 2024-09-18T12:51:24.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/628: dwrite d3/d2f/f8a [0,4194304] 0 2024-09-18T12:51:24.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/629: dread - d3/dc9/fca zero size 2024-09-18T12:51:24.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/630: getdents d3/d1e/d4c/d68/dd2 0 2024-09-18T12:51:24.493 INFO:tasks.workunit.client.0.smithi081.stdout:4/617: symlink d3/d20/d3d/d65/d45/d4f/lc8 0 2024-09-18T12:51:24.493 INFO:tasks.workunit.client.0.smithi081.stdout:4/618: fdatasync d3/d20/d5b/fc2 0 2024-09-18T12:51:24.495 INFO:tasks.workunit.client.0.smithi081.stdout:8/631: link d3/d2f/c8c d3/d73/dbe/cd5 0 2024-09-18T12:51:24.498 INFO:tasks.workunit.client.0.smithi081.stdout:4/619: rename d3/d20/d3d/d65/d45/d4f/lc8 to d3/db/d58/d9f/lc9 0 2024-09-18T12:51:24.521 INFO:tasks.workunit.client.0.smithi081.stdout:8/632: dwrite d3/d1d/d89/f93 [0,4194304] 0 2024-09-18T12:51:24.521 INFO:tasks.workunit.client.0.smithi081.stdout:8/633: readlink d3/l22 0 2024-09-18T12:51:24.521 INFO:tasks.workunit.client.0.smithi081.stdout:4/620: dwrite d3/d20/d3d/d6b/fae [4194304,4194304] 0 2024-09-18T12:51:24.522 INFO:tasks.workunit.client.0.smithi081.stdout:8/634: rename d3/d73/dbe/cd5 to d3/d2f/cd6 0 2024-09-18T12:51:24.522 INFO:tasks.workunit.client.0.smithi081.stdout:8/635: fsync d3/d1d/d4a/d7f/f84 0 2024-09-18T12:51:24.523 INFO:tasks.workunit.client.0.smithi081.stdout:4/621: unlink d3/db/d35/c64 0 2024-09-18T12:51:24.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/636: mknod d3/d1d/d9f/dcf/cd7 0 2024-09-18T12:51:24.525 INFO:tasks.workunit.client.0.smithi081.stdout:4/622: creat d3/d20/d3d/d65/d45/d7e/fca x:0 0 0 2024-09-18T12:51:24.527 INFO:tasks.workunit.client.0.smithi081.stdout:4/623: link d3/d20/d3d/d65/d45/d7e/fca d3/d20/d3d/d65/d2f/fcb 0 2024-09-18T12:51:24.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/624: getdents d3/d20/d3d/d65/d14/d27 0 2024-09-18T12:51:24.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/625: dread - d3/d20/d3d/d65/d45/d7e/fca zero size 2024-09-18T12:51:24.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/626: fsync d3/d20/d3d/f8f 0 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/627: mknod d3/d20/d5b/ccc 0 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/628: write d3/d20/d3d/d6b/fb7 [93686,119803] 0 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/629: read d3/d20/d3d/d65/d2f/fa0 [320854,77680] 0 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/630: chown d3/d20/d3d/d65/d2f/fa0 249045 1 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/631: readlink d3/db/d58/d9f/lc9 0 2024-09-18T12:51:24.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/632: creat d3/d20/d3d/d65/d14/d54/fcd x:0 0 0 2024-09-18T12:51:24.540 INFO:tasks.workunit.client.0.smithi081.stdout:4/633: dread d3/d20/d3d/d65/d2f/f8b [0,4194304] 0 2024-09-18T12:51:24.540 INFO:tasks.workunit.client.0.smithi081.stdout:4/634: chown d3/d20/d3d/c68 1473975001 1 2024-09-18T12:51:24.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/637: dwrite d3/d1d/d89/fc0 [0,4194304] 0 2024-09-18T12:51:24.543 INFO:tasks.workunit.client.0.smithi081.stdout:4/635: creat d3/d20/d3d/d65/d14/d3e/fce x:0 0 0 2024-09-18T12:51:24.543 INFO:tasks.workunit.client.0.smithi081.stdout:4/636: creat d3/d20/d3d/fcf x:0 0 0 2024-09-18T12:51:24.544 INFO:tasks.workunit.client.0.smithi081.stdout:8/638: mknod d3/d1d/d4a/cd8 0 2024-09-18T12:51:24.546 INFO:tasks.workunit.client.0.smithi081.stdout:4/637: getdents d3/db/d2d/d4e 0 2024-09-18T12:51:24.546 INFO:tasks.workunit.client.0.smithi081.stdout:4/638: creat d3/d20/d3d/fd0 x:0 0 0 2024-09-18T12:51:24.547 INFO:tasks.workunit.client.0.smithi081.stdout:8/639: mknod d3/d1d/d4a/da9/cd9 0 2024-09-18T12:51:24.547 INFO:tasks.workunit.client.0.smithi081.stdout:8/640: write d3/db7/fd4 [747183,95792] 0 2024-09-18T12:51:24.547 INFO:tasks.workunit.client.0.smithi081.stdout:8/641: truncate d3/d1e/f34 8759596 0 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:4/639: link d3/c8 d3/db/d2d/d4e/dc1/cd1 0 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:8/642: mkdir d3/d1d/d9f/dcf/dda 0 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:8/643: fdatasync d3/d1d/d4a/fbf 0 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/518: sync 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:6/665: sync 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:6/666: write d4/d12/d56/d7d/d96/fa6 [757346,45170] 0 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:6/667: chown d4/d12/d56/d7d 337 1 2024-09-18T12:51:24.553 INFO:tasks.workunit.client.0.smithi081.stdout:8/644: rmdir d3/db7 39 2024-09-18T12:51:24.554 INFO:tasks.workunit.client.0.smithi081.stdout:9/519: unlink dd/d1d/d1e/d39/f5d 0 2024-09-18T12:51:24.555 INFO:tasks.workunit.client.0.smithi081.stdout:9/520: creat dd/d1d/d1e/d39/d73/fab x:0 0 0 2024-09-18T12:51:24.556 INFO:tasks.workunit.client.0.smithi081.stdout:9/521: write dd/d1d/d1e/d24/f67 [2468397,75987] 0 2024-09-18T12:51:24.557 INFO:tasks.workunit.client.0.smithi081.stdout:8/645: link d3/d1e/d4c/d53/c6d d3/d1e/d4c/d68/cdb 0 2024-09-18T12:51:24.562 INFO:tasks.workunit.client.0.smithi081.stdout:6/668: dread d4/f5c [0,4194304] 0 2024-09-18T12:51:24.562 INFO:tasks.workunit.client.0.smithi081.stdout:8/646: read d3/d1d/d4a/d8d/fd3 [20428,117377] 0 2024-09-18T12:51:24.567 INFO:tasks.workunit.client.0.smithi081.stdout:4/640: dwrite d3/d20/d3d/d65/d14/d4b/f74 [0,4194304] 0 2024-09-18T12:51:24.574 INFO:tasks.workunit.client.0.smithi081.stdout:4/641: dread d3/db/fab [0,4194304] 0 2024-09-18T12:51:24.574 INFO:tasks.workunit.client.0.smithi081.stdout:4/642: truncate d3/d20/d3d/d65/d2f/d8c/fbe 568484 0 2024-09-18T12:51:24.574 INFO:tasks.workunit.client.0.smithi081.stdout:4/643: chown d3/d20/d3d/d65/d2f/fa0 1 1 2024-09-18T12:51:24.576 INFO:tasks.workunit.client.0.smithi081.stdout:9/522: dwrite dd/d31/d4a/f93 [0,4194304] 0 2024-09-18T12:51:24.580 INFO:tasks.workunit.client.0.smithi081.stdout:8/647: dwrite d3/d1d/d4a/d7f/fa8 [0,4194304] 0 2024-09-18T12:51:24.580 INFO:tasks.workunit.client.0.smithi081.stdout:8/648: chown d3/d2f/l95 410 1 2024-09-18T12:51:24.580 INFO:tasks.workunit.client.0.smithi081.stdout:8/649: chown d3/d1d/d9f/fad 8 1 2024-09-18T12:51:24.580 INFO:tasks.workunit.client.0.smithi081.stdout:9/523: unlink dd/de/l18 0 2024-09-18T12:51:24.580 INFO:tasks.workunit.client.0.smithi081.stdout:9/524: chown dd/d1b/f34 12039 1 2024-09-18T12:51:24.581 INFO:tasks.workunit.client.0.smithi081.stdout:9/525: write dd/d1d/d1e/d24/f82 [108951,20135] 0 2024-09-18T12:51:24.581 INFO:tasks.workunit.client.0.smithi081.stdout:9/526: fdatasync dd/de/f97 0 2024-09-18T12:51:24.583 INFO:tasks.workunit.client.0.smithi081.stdout:8/650: unlink d3/f3f 0 2024-09-18T12:51:24.585 INFO:tasks.workunit.client.0.smithi081.stdout:9/527: creat dd/d1d/d1e/fac x:0 0 0 2024-09-18T12:51:24.587 INFO:tasks.workunit.client.0.smithi081.stdout:9/528: rmdir dd/d1d/d1e/d39/d73 39 2024-09-18T12:51:24.587 INFO:tasks.workunit.client.0.smithi081.stdout:9/529: readlink dd/l86 0 2024-09-18T12:51:24.588 INFO:tasks.workunit.client.0.smithi081.stdout:9/530: mknod dd/d1d/d1e/d24/d2a/d55/d85/cad 0 2024-09-18T12:51:24.589 INFO:tasks.workunit.client.0.smithi081.stdout:9/531: symlink dd/de/d7a/d9e/lae 0 2024-09-18T12:51:24.589 INFO:tasks.workunit.client.0.smithi081.stdout:9/532: mkdir dd/d15/d1a/d35/daf 0 2024-09-18T12:51:24.590 INFO:tasks.workunit.client.0.smithi081.stdout:9/533: creat dd/d15/d1a/d35/daf/fb0 x:0 0 0 2024-09-18T12:51:24.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/644: dwrite d3/f22 [0,4194304] 0 2024-09-18T12:51:24.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/645: chown d3/db/d2d/d4e/d8d/db8 11061486 1 2024-09-18T12:51:24.592 INFO:tasks.workunit.client.0.smithi081.stdout:9/534: unlink dd/de/d4f/f95 0 2024-09-18T12:51:24.592 INFO:tasks.workunit.client.0.smithi081.stdout:9/535: truncate dd/d1d/d1e/d39/fa6 210350 0 2024-09-18T12:51:24.592 INFO:tasks.workunit.client.0.smithi081.stdout:9/536: write dd/de/f97 [3626853,98792] 0 2024-09-18T12:51:24.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/646: creat d3/db/d2d/d4e/d8d/d97/fd2 x:0 0 0 2024-09-18T12:51:24.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/647: readlink d3/d20/d3d/d65/d14/d27/l72 0 2024-09-18T12:51:24.595 INFO:tasks.workunit.client.0.smithi081.stdout:9/537: mkdir dd/d15/db1 0 2024-09-18T12:51:24.602 INFO:tasks.workunit.client.0.smithi081.stdout:4/648: rename d3/db/d2d/d4e to d3/d20/d3d/d65/d14/d54/dd3 0 2024-09-18T12:51:24.603 INFO:tasks.workunit.client.0.smithi081.stdout:9/538: getdents dd/d15 0 2024-09-18T12:51:24.903 INFO:tasks.workunit.client.0.smithi081.stdout:1/679: sync 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:0/633: sync 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/669: sync 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:5/633: sync 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:5/634: write d2/d14/d1d/d1a/f4a [3335748,30756] 0 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:0/634: creat d7/d9/d12/dba/fd6 x:0 0 0 2024-09-18T12:51:24.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/670: creat d3/db/da4/fee x:0 0 0 2024-09-18T12:51:24.905 INFO:tasks.workunit.client.0.smithi081.stdout:1/680: mknod d0/d6/d33/d37/d71/d90/ce6 0 2024-09-18T12:51:24.907 INFO:tasks.workunit.client.0.smithi081.stdout:5/635: symlink d2/d14/d33/d37/d3b/lc6 0 2024-09-18T12:51:24.908 INFO:tasks.workunit.client.0.smithi081.stdout:0/635: mknod d7/d9/d4b/d4a/d68/cd7 0 2024-09-18T12:51:24.908 INFO:tasks.workunit.client.0.smithi081.stdout:0/636: read - d7/d9/d12/dba/f85 zero size 2024-09-18T12:51:24.910 INFO:tasks.workunit.client.0.smithi081.stdout:0/637: creat d7/d9/d4b/d4a/d68/fd8 x:0 0 0 2024-09-18T12:51:24.910 INFO:tasks.workunit.client.0.smithi081.stdout:0/638: write d7/d9/d4b/d33/f52 [1930722,56984] 0 2024-09-18T12:51:24.910 INFO:tasks.workunit.client.0.smithi081.stdout:0/639: write d7/d9/d4b/d4a/fce [791677,56564] 0 2024-09-18T12:51:24.912 INFO:tasks.workunit.client.0.smithi081.stdout:0/640: mkdir d7/d5d/dd9 0 2024-09-18T12:51:24.912 INFO:tasks.workunit.client.0.smithi081.stdout:0/641: fsync d7/d9/d4b/d53/fad 0 2024-09-18T12:51:24.919 INFO:tasks.workunit.client.0.smithi081.stdout:1/681: write d0/dd7/d55/fb3 [3557308,82669] 0 2024-09-18T12:51:24.920 INFO:tasks.workunit.client.0.smithi081.stdout:1/682: creat d0/db/fe7 x:0 0 0 2024-09-18T12:51:24.920 INFO:tasks.workunit.client.0.smithi081.stdout:1/683: chown d0/d6/d7/d8/lb4 503340 1 2024-09-18T12:51:24.926 INFO:tasks.workunit.client.0.smithi081.stdout:5/636: dwrite d2/d14/d33/d37/d3b/d16/fb8 [0,4194304] 0 2024-09-18T12:51:24.927 INFO:tasks.workunit.client.0.smithi081.stdout:5/637: rename d2/d14/d33/d37/d3b/d2a/db0/f65 to d2/d14/d33/d37/d3b/d16/dbb/fc7 0 2024-09-18T12:51:24.928 INFO:tasks.workunit.client.0.smithi081.stdout:5/638: chown d2/d47/f76 5203665 1 2024-09-18T12:51:24.928 INFO:tasks.workunit.client.0.smithi081.stdout:5/639: chown d2/d14/d33/d37/d3b/d6a/d20/f92 3642124 1 2024-09-18T12:51:24.928 INFO:tasks.workunit.client.0.smithi081.stdout:5/640: fsync d2/d14/f1e 0 2024-09-18T12:51:24.932 INFO:tasks.workunit.client.0.smithi081.stdout:3/671: dwrite d3/db/df/d29/d12/d44/d6f/f9a [0,4194304] 0 2024-09-18T12:51:24.937 INFO:tasks.workunit.client.0.smithi081.stdout:0/642: dwrite d7/d9/d4b/d33/fbb [0,4194304] 0 2024-09-18T12:51:24.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/684: dwrite d0/d6/d33/d42/f44 [4194304,4194304] 0 2024-09-18T12:51:24.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/685: fsync d0/d6/d33/d37/f6d 0 2024-09-18T12:51:24.986 INFO:tasks.workunit.client.0.smithi081.stdout:3/672: symlink d3/db/df/d3b/dc0/lef 0 2024-09-18T12:51:24.991 INFO:tasks.workunit.client.0.smithi081.stdout:0/643: creat d7/d5d/fda x:0 0 0 2024-09-18T12:51:24.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/673: unlink d3/d23/f79 0 2024-09-18T12:51:24.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/674: readlink d3/db/df/d29/d12/d44/d51/dde/ld3 0 2024-09-18T12:51:24.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/675: rename d3 to d3/db/df/d29/d12/df0 22 2024-09-18T12:51:24.996 INFO:tasks.workunit.client.0.smithi081.stdout:1/686: truncate d0/d6/f9 4864422 0 2024-09-18T12:51:24.996 INFO:tasks.workunit.client.0.smithi081.stdout:1/687: readlink d0/l5 0 2024-09-18T12:51:25.018 INFO:tasks.workunit.client.0.smithi081.stdout:3/676: dwrite d3/db/dc/d1a/fdd [0,4194304] 0 2024-09-18T12:51:25.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/688: dwrite d0/d6/d7/d2e/d51/d2c/f45 [0,4194304] 0 2024-09-18T12:51:25.020 INFO:tasks.workunit.client.0.smithi081.stdout:3/677: creat d3/db/df/d3b/dc0/ff1 x:0 0 0 2024-09-18T12:51:25.021 INFO:tasks.workunit.client.0.smithi081.stdout:1/689: read d0/d6/d7/d8/f52 [29092,54877] 0 2024-09-18T12:51:25.022 INFO:tasks.workunit.client.0.smithi081.stdout:1/690: stat d0/d6/d33/d42/dcf 0 2024-09-18T12:51:25.027 INFO:tasks.workunit.client.0.smithi081.stdout:1/691: dread d0/db/d4f/dab/fbf [0,4194304] 0 2024-09-18T12:51:25.027 INFO:tasks.workunit.client.0.smithi081.stdout:1/692: chown d0/d6/d7/d2e/l3c 2049828 1 2024-09-18T12:51:25.131 INFO:tasks.workunit.client.0.smithi081.stdout:3/678: rename d3/db/df/d29/d13/d68/dac to d3/db/df/d29/d12/d44/df2 0 2024-09-18T12:51:25.131 INFO:tasks.workunit.client.0.smithi081.stdout:3/679: fdatasync d3/db/df/d29/f19 0 2024-09-18T12:51:25.131 INFO:tasks.workunit.client.0.smithi081.stdout:3/680: creat d3/db/dc/ff3 x:0 0 0 2024-09-18T12:51:25.131 INFO:tasks.workunit.client.0.smithi081.stdout:3/681: chown d3/db/df/d29/d12/l9b 872 1 2024-09-18T12:51:25.143 INFO:tasks.workunit.client.0.smithi081.stdout:1/693: dread d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:25.143 INFO:tasks.workunit.client.0.smithi081.stdout:1/694: write d0/dd7/d55/fb3 [2506098,71623] 0 2024-09-18T12:51:25.144 INFO:tasks.workunit.client.0.smithi081.stdout:1/695: mknod d0/d6/d33/d37/d71/d90/ce8 0 2024-09-18T12:51:25.145 INFO:tasks.workunit.client.0.smithi081.stdout:3/682: dwrite d3/db/df/da8/fa9 [0,4194304] 0 2024-09-18T12:51:25.145 INFO:tasks.workunit.client.0.smithi081.stdout:3/683: write d3/db/df/d29/d13/f95 [4699418,60022] 0 2024-09-18T12:51:25.146 INFO:tasks.workunit.client.0.smithi081.stdout:3/684: creat d3/db/df/d29/ff4 x:0 0 0 2024-09-18T12:51:25.146 INFO:tasks.workunit.client.0.smithi081.stdout:1/696: rename d0/dd7/d28 to d0/dd7/de9 0 2024-09-18T12:51:25.146 INFO:tasks.workunit.client.0.smithi081.stdout:1/697: write d0/d18/db7/fd1 [469164,47736] 0 2024-09-18T12:51:25.146 INFO:tasks.workunit.client.0.smithi081.stdout:3/685: mkdir d3/db/df/d29/d13/d93/df5 0 2024-09-18T12:51:25.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/698: creat d0/db/d4f/fea x:0 0 0 2024-09-18T12:51:25.148 INFO:tasks.workunit.client.0.smithi081.stdout:1/699: readlink d0/d6/d7/d2e/d51/d2c/l5d 0 2024-09-18T12:51:25.148 INFO:tasks.workunit.client.0.smithi081.stdout:1/700: fdatasync d0/d6/d7/f81 0 2024-09-18T12:51:25.148 INFO:tasks.workunit.client.0.smithi081.stdout:1/701: write d0/d6/fd [4755460,108610] 0 2024-09-18T12:51:25.148 INFO:tasks.workunit.client.0.smithi081.stdout:1/702: write d0/d6/d7/d8/f82 [326723,82323] 0 2024-09-18T12:51:25.148 INFO:tasks.workunit.client.0.smithi081.stdout:1/703: write d0/d18/db7/fd1 [548212,99561] 0 2024-09-18T12:51:25.155 INFO:tasks.workunit.client.0.smithi081.stdout:3/686: dread d3/db/dc/f28 [0,4194304] 0 2024-09-18T12:51:25.156 INFO:tasks.workunit.client.0.smithi081.stdout:1/704: write d0/d6/d33/d37/d71/f72 [399338,80257] 0 2024-09-18T12:51:25.165 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:24 smithi136 ceph-mon[35363]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:25.165 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:24 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2939417950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:51:25.165 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:24 smithi136 ceph-mon[35363]: pgmap v285: 65 pgs: 65 active+clean; 3.4 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 365 MiB/s rd, 447 MiB/s wr, 616 op/s 2024-09-18T12:51:25.175 INFO:tasks.workunit.client.0.smithi081.stdout:1/705: dwrite d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:25.175 INFO:tasks.workunit.client.0.smithi081.stdout:3/687: dwrite d3/db/df/d29/f64 [0,4194304] 0 2024-09-18T12:51:25.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/688: dwrite d3/db/df/d29/d12/d44/d51/fa2 [0,4194304] 0 2024-09-18T12:51:25.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/689: chown d3/db/df/d29/f19 20384 1 2024-09-18T12:51:25.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/690: truncate d3/db/dc/fd6 1013019 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:3/691: write d3/db/dc/f73 [3413256,40929] 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:3/692: write d3/db/d1b/d57/fce [161911,109129] 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:1/706: dwrite d0/f4a [0,4194304] 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:1/707: creat d0/d6/d33/d42/d70/feb x:0 0 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:1/708: fsync d0/d6/f9 0 2024-09-18T12:51:25.196 INFO:tasks.workunit.client.0.smithi081.stdout:3/693: mkdir d3/db/df/d29/d12/d44/df2/df6 0 2024-09-18T12:51:25.197 INFO:tasks.workunit.client.0.smithi081.stdout:3/694: chown d3/db/dc/d1a/lc8 238496 1 2024-09-18T12:51:25.197 INFO:tasks.workunit.client.0.smithi081.stdout:3/695: creat d3/db/df/d3b/dc0/ff7 x:0 0 0 2024-09-18T12:51:25.221 INFO:tasks.workunit.client.0.smithi081.stdout:3/696: dwrite d3/db/df/d29/d12/d44/d51/dde/de1/fcf [0,4194304] 0 2024-09-18T12:51:25.221 INFO:tasks.workunit.client.0.smithi081.stdout:3/697: write d3/db/df/d29/d13/d93/fca [1254183,14047] 0 2024-09-18T12:51:25.221 INFO:tasks.workunit.client.0.smithi081.stdout:3/698: chown d3/db/d1b/l5a 386194377 1 2024-09-18T12:51:25.221 INFO:tasks.workunit.client.0.smithi081.stdout:1/709: dwrite d0/d6/d7/d2e/d4e/f89 [4194304,4194304] 0 2024-09-18T12:51:25.222 INFO:tasks.workunit.client.0.smithi081.stdout:3/699: mknod d3/db/df/d3b/d47/cf8 0 2024-09-18T12:51:25.222 INFO:tasks.workunit.client.0.smithi081.stdout:3/700: write d3/db/df/d29/d13/d93/fca [2175274,81922] 0 2024-09-18T12:51:25.224 INFO:tasks.workunit.client.0.smithi081.stdout:1/710: unlink d0/c3 0 2024-09-18T12:51:25.225 INFO:tasks.workunit.client.0.smithi081.stdout:1/711: write d0/f20 [4603753,93402] 0 2024-09-18T12:51:25.225 INFO:tasks.workunit.client.0.smithi081.stdout:1/712: readlink d0/d18/d6a/l9c 0 2024-09-18T12:51:25.225 INFO:tasks.workunit.client.0.smithi081.stdout:1/713: dread - d0/d18/fe5 zero size 2024-09-18T12:51:25.225 INFO:tasks.workunit.client.0.smithi081.stdout:3/701: unlink d3/f80 0 2024-09-18T12:51:25.227 INFO:tasks.workunit.client.0.smithi081.stdout:1/714: mkdir d0/d6/d33/d42/d70/dec 0 2024-09-18T12:51:25.229 INFO:tasks.workunit.client.0.smithi081.stdout:3/702: link d3/db/c50 d3/db/d1b/d57/cf9 0 2024-09-18T12:51:25.229 INFO:tasks.workunit.client.0.smithi081.stdout:3/703: chown d3/db/dc/d1a/fb5 142 1 2024-09-18T12:51:25.244 INFO:tasks.workunit.client.0.smithi081.stdout:1/715: dwrite d0/db/d4f/dab/fc7 [0,4194304] 0 2024-09-18T12:51:25.246 INFO:tasks.workunit.client.0.smithi081.stdout:1/716: mknod d0/dd7/ced 0 2024-09-18T12:51:25.247 INFO:tasks.workunit.client.0.smithi081.stdout:1/717: mknod d0/d6/d33/d42/d70/dd9/cee 0 2024-09-18T12:51:25.247 INFO:tasks.workunit.client.0.smithi081.stdout:1/718: fsync d0/db/f39 0 2024-09-18T12:51:25.247 INFO:tasks.workunit.client.0.smithi081.stdout:3/704: dwrite d3/db/da4/fee [0,4194304] 0 2024-09-18T12:51:25.247 INFO:tasks.workunit.client.0.smithi081.stdout:3/705: readlink d3/db/df/d29/d13/d93/le0 0 2024-09-18T12:51:25.247 INFO:tasks.workunit.client.0.smithi081.stdout:3/706: write d3/db/df/d29/d12/d44/d76/f8c [2773047,42262] 0 2024-09-18T12:51:25.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/719: dwrite d0/d6/d33/d42/d70/feb [0,4194304] 0 2024-09-18T12:51:25.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/720: fdatasync d0/d6/d7/d2e/d51/d2c/f45 0 2024-09-18T12:51:25.274 INFO:tasks.workunit.client.0.smithi081.stdout:3/707: dwrite d3/db/df/d29/d13/f95 [0,4194304] 0 2024-09-18T12:51:25.278 INFO:tasks.workunit.client.0.smithi081.stdout:1/721: dread d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:25.280 INFO:tasks.workunit.client.0.smithi081.stdout:1/722: creat d0/db/d4f/dd2/dd5/fef x:0 0 0 2024-09-18T12:51:25.280 INFO:tasks.workunit.client.0.smithi081.stdout:1/723: getdents d0/d18/db7 0 2024-09-18T12:51:25.282 INFO:tasks.workunit.client.0.smithi081.stdout:1/724: mknod d0/d6/d33/d37/d71/cf0 0 2024-09-18T12:51:25.282 INFO:tasks.workunit.client.0.smithi081.stdout:1/725: chown d0/d6/d33/d42/dcf 379 1 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:7/588: sync 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/784: sync 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:6/669: sync 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:0/644: sync 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:5/641: sync 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/785: write d15/d26/f92 [1412840,50715] 0 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:5/642: write d2/d14/f4e [822810,109049] 0 2024-09-18T12:51:25.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/786: chown d15/d16/d20/d22/c8a 3852 1 2024-09-18T12:51:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/539: sync 2024-09-18T12:51:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:4/649: sync 2024-09-18T12:51:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:8/651: sync 2024-09-18T12:51:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/540: readlink dd/d1d/d1e/d24/d2a/l38 0 2024-09-18T12:51:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/541: write dd/d1d/d1e/d39/f3f [2444936,107853] 0 2024-09-18T12:51:25.288 INFO:tasks.workunit.client.0.smithi081.stdout:6/670: unlink d4/d12/d28/d2a/l80 0 2024-09-18T12:51:25.289 INFO:tasks.workunit.client.0.smithi081.stdout:0/645: mknod d7/d9/d4b/d33/d43/cdb 0 2024-09-18T12:51:25.291 INFO:tasks.workunit.client.0.smithi081.stdout:5/643: mknod d2/d47/d7f/cc8 0 2024-09-18T12:51:25.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/708: dwrite d3/db/dc/f15 [0,4194304] 0 2024-09-18T12:51:25.293 INFO:tasks.workunit.client.0.smithi081.stdout:8/652: unlink d3/d1d/d4a/c4b 0 2024-09-18T12:51:25.293 INFO:tasks.workunit.client.0.smithi081.stdout:8/653: dread - d3/d1d/d4a/d8d/f8f zero size 2024-09-18T12:51:25.293 INFO:tasks.workunit.client.0.smithi081.stdout:9/542: mknod dd/d1d/d1e/d39/cb2 0 2024-09-18T12:51:25.293 INFO:tasks.workunit.client.0.smithi081.stdout:9/543: fdatasync dd/de/fa9 0 2024-09-18T12:51:25.295 INFO:tasks.workunit.client.0.smithi081.stdout:6/671: rmdir d4/d12/d28/d2a/d74/d8b/d54/dd1 0 2024-09-18T12:51:25.295 INFO:tasks.workunit.client.0.smithi081.stdout:6/672: creat d4/d12/d56/d7d/fd7 x:0 0 0 2024-09-18T12:51:25.295 INFO:tasks.workunit.client.0.smithi081.stdout:6/673: readlink d4/d12/d1c/d39/d73/l83 0 2024-09-18T12:51:25.296 INFO:tasks.workunit.client.0.smithi081.stdout:5/644: truncate d2/d14/d33/d37/d3b/d5f/f60 1800785 0 2024-09-18T12:51:25.299 INFO:tasks.workunit.client.0.smithi081.stdout:1/726: write d0/d6/d33/d37/f94 [3813710,122694] 0 2024-09-18T12:51:25.299 INFO:tasks.workunit.client.0.smithi081.stdout:3/709: mknod d3/db/df/d29/d13/d9d/cfa 0 2024-09-18T12:51:25.299 INFO:tasks.workunit.client.0.smithi081.stdout:3/710: truncate d3/db/df/d29/d12/f92 1258844 0 2024-09-18T12:51:25.300 INFO:tasks.workunit.client.0.smithi081.stdout:3/711: chown d3/db/df/d29/f64 232852 1 2024-09-18T12:51:25.302 INFO:tasks.workunit.client.0.smithi081.stdout:9/544: mkdir dd/de/db3 0 2024-09-18T12:51:25.302 INFO:tasks.workunit.client.0.smithi081.stdout:6/674: mkdir d4/d12/d28/d2a/d98/dd8 0 2024-09-18T12:51:25.304 INFO:tasks.workunit.client.0.smithi081.stdout:9/545: creat dd/d1d/d91/fb4 x:0 0 0 2024-09-18T12:51:25.304 INFO:tasks.workunit.client.0.smithi081.stdout:9/546: write dd/d15/d1a/fa8 [401938,6606] 0 2024-09-18T12:51:25.305 INFO:tasks.workunit.client.0.smithi081.stdout:8/654: dread d3/d1d/d89/f93 [0,4194304] 0 2024-09-18T12:51:25.306 INFO:tasks.workunit.client.0.smithi081.stdout:6/675: unlink d4/d6/d95/ccf 0 2024-09-18T12:51:25.311 INFO:tasks.workunit.client.0.smithi081.stdout:9/547: creat dd/d1d/d1e/d77/fb5 x:0 0 0 2024-09-18T12:51:25.312 INFO:tasks.workunit.client.0.smithi081.stdout:9/548: creat dd/d1d/d91/fb6 x:0 0 0 2024-09-18T12:51:25.312 INFO:tasks.workunit.client.0.smithi081.stdout:9/549: fsync dd/d31/f3b 0 2024-09-18T12:51:25.312 INFO:tasks.workunit.client.0.smithi081.stdout:3/712: dread d3/db/dc/d1a/f8e [0,4194304] 0 2024-09-18T12:51:25.312 INFO:tasks.workunit.client.0.smithi081.stdout:3/713: chown d3/db/df/d3b/d47/f2f 373 1 2024-09-18T12:51:25.314 INFO:tasks.workunit.client.0.smithi081.stdout:7/589: dwrite d2/d18/d22/f32 [0,4194304] 0 2024-09-18T12:51:25.315 INFO:tasks.workunit.client.0.smithi081.stdout:7/590: fdatasync d2/d18/d60/d85/f89 0 2024-09-18T12:51:25.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/714: truncate d3/db/df/d29/d12/d44/d76/f8c 2571339 0 2024-09-18T12:51:25.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/591: creat d2/d18/d60/daa/fce x:0 0 0 2024-09-18T12:51:25.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/592: truncate d2/d14/d21/f72 354535 0 2024-09-18T12:51:25.319 INFO:tasks.workunit.client.0.smithi081.stdout:5/645: dwrite d2/d14/d1d/d1a/fa0 [0,4194304] 0 2024-09-18T12:51:25.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/655: getdents d3/d1d/d4a 0 2024-09-18T12:51:25.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/656: chown d3/c44 0 1 2024-09-18T12:51:25.325 INFO:tasks.workunit.client.0.smithi081.stdout:5/646: symlink d2/d14/d33/d37/d3b/lc9 0 2024-09-18T12:51:25.328 INFO:tasks.workunit.client.0.smithi081.stdout:5/647: truncate d2/dd/fb2 113328 0 2024-09-18T12:51:25.330 INFO:tasks.workunit.client.0.smithi081.stdout:3/715: write d3/db/df/d29/d13/f4c [4167097,602] 0 2024-09-18T12:51:25.330 INFO:tasks.workunit.client.0.smithi081.stdout:5/648: getdents d2/d14/d33/d37/d3b/d2a/d8e/dc2 0 2024-09-18T12:51:25.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/649: chown d2/dd/d5e/fc0 9029 1 2024-09-18T12:51:25.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/650: dread - d2/dd/d5e/fc0 zero size 2024-09-18T12:51:25.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/651: write d2/d14/d33/d37/d3b/d6a/d20/f92 [497128,125563] 0 2024-09-18T12:51:25.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/652: dread d2/fe [0,4194304] 0 2024-09-18T12:51:25.334 INFO:tasks.workunit.client.0.smithi081.stdout:8/657: dread d3/f25 [0,4194304] 0 2024-09-18T12:51:25.335 INFO:tasks.workunit.client.0.smithi081.stdout:3/716: dread d3/db/dc/f28 [0,4194304] 0 2024-09-18T12:51:25.336 INFO:tasks.workunit.client.0.smithi081.stdout:1/727: dwrite d0/d18/f38 [0,4194304] 0 2024-09-18T12:51:25.336 INFO:tasks.workunit.client.0.smithi081.stdout:6/676: dwrite d4/d12/d1c/d39/f89 [0,4194304] 0 2024-09-18T12:51:25.336 INFO:tasks.workunit.client.0.smithi081.stdout:8/658: link d3/f25 d3/d1e/d4c/dae/fdc 0 2024-09-18T12:51:25.338 INFO:tasks.workunit.client.0.smithi081.stdout:1/728: mknod d0/db/d4f/dab/cf1 0 2024-09-18T12:51:25.341 INFO:tasks.workunit.client.0.smithi081.stdout:3/717: dread d3/db/df/d29/d12/d44/d6f/fe2 [0,4194304] 0 2024-09-18T12:51:25.341 INFO:tasks.workunit.client.0.smithi081.stdout:9/550: dwrite dd/d1d/d1e/d39/fa6 [0,4194304] 0 2024-09-18T12:51:25.341 INFO:tasks.workunit.client.0.smithi081.stdout:7/593: dwrite d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:25.342 INFO:tasks.workunit.client.0.smithi081.stdout:4/650: dwrite d3/d20/d3d/fcf [0,4194304] 0 2024-09-18T12:51:25.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/551: mknod dd/d1d/cb7 0 2024-09-18T12:51:25.344 INFO:tasks.workunit.client.0.smithi081.stdout:7/594: truncate d2/d18/d22/f25 1455716 0 2024-09-18T12:51:25.345 INFO:tasks.workunit.client.0.smithi081.stdout:3/718: symlink d3/lfb 0 2024-09-18T12:51:25.347 INFO:tasks.workunit.client.0.smithi081.stdout:4/651: symlink d3/d20/d3d/ld4 0 2024-09-18T12:51:25.349 INFO:tasks.workunit.client.0.smithi081.stdout:9/552: symlink dd/d15/d1a/d3d/lb8 0 2024-09-18T12:51:25.352 INFO:tasks.workunit.client.0.smithi081.stdout:3/719: rename d3/db/df/d29/d12/d44/d76/l78 to d3/db/df/d3b/dc0/lfc 0 2024-09-18T12:51:25.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/659: dread d3/d1d/fc5 [0,4194304] 0 2024-09-18T12:51:25.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/660: readlink d3/l60 0 2024-09-18T12:51:25.355 INFO:tasks.workunit.client.0.smithi081.stdout:4/652: link d3/db/fab d3/fd5 0 2024-09-18T12:51:25.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:24 smithi081 ceph-mon[27646]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:24 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2939417950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:51:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:24 smithi081 ceph-mon[27646]: pgmap v285: 65 pgs: 65 active+clean; 3.4 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 365 MiB/s rd, 447 MiB/s wr, 616 op/s 2024-09-18T12:51:25.359 INFO:tasks.workunit.client.0.smithi081.stdout:3/720: dread d3/db/df/da8/fba [0,4194304] 0 2024-09-18T12:51:25.363 INFO:tasks.workunit.client.0.smithi081.stdout:3/721: unlink d3/db/df/d29/d12/d44/d76/fc4 0 2024-09-18T12:51:25.363 INFO:tasks.workunit.client.0.smithi081.stdout:6/677: dwrite d4/d12/d28/d2a/d98/fc0 [0,4194304] 0 2024-09-18T12:51:25.364 INFO:tasks.workunit.client.0.smithi081.stdout:9/553: write dd/d15/d1a/f81 [520176,43634] 0 2024-09-18T12:51:25.365 INFO:tasks.workunit.client.0.smithi081.stdout:3/722: symlink d3/db/df/d29/d12/d44/df2/lfd 0 2024-09-18T12:51:25.369 INFO:tasks.workunit.client.0.smithi081.stdout:6/678: truncate d4/d12/d1c/f6b 3369886 0 2024-09-18T12:51:25.370 INFO:tasks.workunit.client.0.smithi081.stdout:4/653: write d3/d20/d3d/d65/d45/f53 [6625337,82800] 0 2024-09-18T12:51:25.370 INFO:tasks.workunit.client.0.smithi081.stdout:4/654: write d3/d20/d3d/d65/d2f/fa0 [813955,9827] 0 2024-09-18T12:51:25.373 INFO:tasks.workunit.client.0.smithi081.stdout:9/554: link dd/d1d/d1e/d24/d2a/d55/l61 dd/d1d/d1e/d24/lb9 0 2024-09-18T12:51:25.373 INFO:tasks.workunit.client.0.smithi081.stdout:9/555: readlink dd/d1d/d1e/d24/d2a/d55/d85/l6f 0 2024-09-18T12:51:25.375 INFO:tasks.workunit.client.0.smithi081.stdout:5/653: dread d2/dd/fb2 [0,4194304] 0 2024-09-18T12:51:25.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/723: rmdir d3/db/df 39 2024-09-18T12:51:25.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/724: readlink d3/db/df/d29/ld0 0 2024-09-18T12:51:25.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/725: chown d3/db/df/d29/d12/d44/d51/dde/de1/fcf 43931 1 2024-09-18T12:51:25.378 INFO:tasks.workunit.client.0.smithi081.stdout:1/729: dwrite d0/d6/d7/d2e/d51/d2c/f7b [4194304,4194304] 0 2024-09-18T12:51:25.378 INFO:tasks.workunit.client.0.smithi081.stdout:4/655: rename d3/d20/d3d/d65/d2f/fcb to d3/db/d35/fd6 0 2024-09-18T12:51:25.381 INFO:tasks.workunit.client.0.smithi081.stdout:5/654: link d2/d14/d33/d37/f95 d2/d14/d33/d37/d3b/d5f/fca 0 2024-09-18T12:51:25.383 INFO:tasks.workunit.client.0.smithi081.stdout:9/556: dread f6 [0,4194304] 0 2024-09-18T12:51:25.384 INFO:tasks.workunit.client.0.smithi081.stdout:8/661: dwrite d3/d1e/f77 [0,4194304] 0 2024-09-18T12:51:25.384 INFO:tasks.workunit.client.0.smithi081.stdout:7/595: dwrite d2/d18/d22/f2a [4194304,4194304] 0 2024-09-18T12:51:25.385 INFO:tasks.workunit.client.0.smithi081.stdout:9/557: write dd/de/fa9 [741585,110498] 0 2024-09-18T12:51:25.385 INFO:tasks.workunit.client.0.smithi081.stdout:9/558: fdatasync dd/de/f13 0 2024-09-18T12:51:25.385 INFO:tasks.workunit.client.0.smithi081.stdout:6/679: symlink d4/d12/d28/ld9 0 2024-09-18T12:51:25.389 INFO:tasks.workunit.client.0.smithi081.stdout:5/655: creat d2/d14/d33/d37/d3b/d2a/d8e/fcb x:0 0 0 2024-09-18T12:51:25.394 INFO:tasks.workunit.client.0.smithi081.stdout:8/662: dread d3/d1e/d4c/fb9 [0,4194304] 0 2024-09-18T12:51:25.395 INFO:tasks.workunit.client.0.smithi081.stdout:8/663: readlink d3/d1e/d4c/dae/lc8 0 2024-09-18T12:51:25.408 INFO:tasks.workunit.client.0.smithi081.stdout:4/656: dwrite d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:25.411 INFO:tasks.workunit.client.0.smithi081.stdout:9/559: unlink dd/c14 0 2024-09-18T12:51:25.411 INFO:tasks.workunit.client.0.smithi081.stdout:9/560: readlink dd/d15/l7d 0 2024-09-18T12:51:25.411 INFO:tasks.workunit.client.0.smithi081.stdout:5/656: dwrite d2/d47/f9f [0,4194304] 0 2024-09-18T12:51:25.415 INFO:tasks.workunit.client.0.smithi081.stdout:6/680: mknod d4/d12/d28/d2a/d2d/d31/cda 0 2024-09-18T12:51:25.416 INFO:tasks.workunit.client.0.smithi081.stdout:7/596: dwrite d2/f4a [4194304,4194304] 0 2024-09-18T12:51:25.417 INFO:tasks.workunit.client.0.smithi081.stdout:1/730: unlink d0/d6/l59 0 2024-09-18T12:51:25.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/664: creat d3/d1d/d4a/d7f/fdd x:0 0 0 2024-09-18T12:51:25.425 INFO:tasks.workunit.client.0.smithi081.stdout:9/561: unlink dd/d1d/d1e/d24/d2a/f96 0 2024-09-18T12:51:25.425 INFO:tasks.workunit.client.0.smithi081.stdout:9/562: fsync dd/d1d/d1e/d24/d2a/f2c 0 2024-09-18T12:51:25.425 INFO:tasks.workunit.client.0.smithi081.stdout:4/657: dwrite d3/db/fab [0,4194304] 0 2024-09-18T12:51:25.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/657: mknod d2/d14/d33/d37/d3b/d16/ccc 0 2024-09-18T12:51:25.432 INFO:tasks.workunit.client.0.smithi081.stdout:7/597: creat d2/d14/d21/d49/dcc/fcf x:0 0 0 2024-09-18T12:51:25.435 INFO:tasks.workunit.client.0.smithi081.stdout:9/563: mknod dd/d1d/d1e/d24/d48/cba 0 2024-09-18T12:51:25.435 INFO:tasks.workunit.client.0.smithi081.stdout:9/564: write dd/d1d/d1e/d24/f82 [552556,37023] 0 2024-09-18T12:51:25.435 INFO:tasks.workunit.client.0.smithi081.stdout:9/565: write dd/d15/d1a/d8d/f8e [65263,106872] 0 2024-09-18T12:51:25.436 INFO:tasks.workunit.client.0.smithi081.stdout:6/681: getdents d4/d12/d56/d7d 0 2024-09-18T12:51:25.436 INFO:tasks.workunit.client.0.smithi081.stdout:6/682: chown d4/d12/d56/d7d/d9f/da2/fa4 50264 1 2024-09-18T12:51:25.437 INFO:tasks.workunit.client.0.smithi081.stdout:4/658: write d3/d20/d3d/d65/d14/f29 [3783459,66780] 0 2024-09-18T12:51:25.438 INFO:tasks.workunit.client.0.smithi081.stdout:1/731: link d0/d6/d66/c9a d0/d6/cf2 0 2024-09-18T12:51:25.440 INFO:tasks.workunit.client.0.smithi081.stdout:8/665: mknod d3/d1e/d4c/d68/cde 0 2024-09-18T12:51:25.440 INFO:tasks.workunit.client.0.smithi081.stdout:8/666: dread - d3/d1d/d4a/fa7 zero size 2024-09-18T12:51:25.441 INFO:tasks.workunit.client.0.smithi081.stdout:3/726: dwrite d3/db/df/d29/d13/d65/fb3 [0,4194304] 0 2024-09-18T12:51:25.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/566: creat dd/d15/fbb x:0 0 0 2024-09-18T12:51:25.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/567: readlink dd/de/d7a/l90 0 2024-09-18T12:51:25.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/568: readlink dd/de/l4c 0 2024-09-18T12:51:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:6/683: read d4/d12/d28/d2a/d2d/f52 [1781619,105714] 0 2024-09-18T12:51:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:6/684: chown d4/f18 66039 1 2024-09-18T12:51:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:1/732: symlink d0/d6/d33/d42/dcf/lf3 0 2024-09-18T12:51:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:8/667: creat d3/d1e/d4c/d68/daa/fdf x:0 0 0 2024-09-18T12:51:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:3/727: mknod d3/db/df/d29/d13/d9d/dd4/cfe 0 2024-09-18T12:51:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:4/659: dwrite d3/d20/d3d/d65/d2f/fa0 [0,4194304] 0 2024-09-18T12:51:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:9/569: mkdir dd/d15/d1a/d8d/dbc 0 2024-09-18T12:51:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:6/685: write d4/d6/fb [4024083,54826] 0 2024-09-18T12:51:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:6/686: chown d4/d12/d56/d7d/d91 6604 1 2024-09-18T12:51:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:8/668: mknod d3/d1d/d4a/d8d/ce0 0 2024-09-18T12:51:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:6/687: write d4/d12/d1c/f23 [430300,40719] 0 2024-09-18T12:51:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:4/660: symlink d3/d20/d3d/dbd/ld7 0 2024-09-18T12:51:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:9/570: truncate dd/d1d/d1e/d39/fa6 2855543 0 2024-09-18T12:51:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:6/688: mknod d4/d12/d56/d7d/cdb 0 2024-09-18T12:51:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:1/733: dwrite d0/d6/d33/d37/fe1 [0,4194304] 0 2024-09-18T12:51:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:6/689: mkdir d4/d12/d28/d2a/d97/ddc 0 2024-09-18T12:51:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:6/690: fsync d4/f7 0 2024-09-18T12:51:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:8/669: dread d3/d1d/d4a/f97 [0,4194304] 0 2024-09-18T12:51:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:8/670: fdatasync d3/d1e/fc6 0 2024-09-18T12:51:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:8/671: write d3/d1e/d4c/fcc [427151,27586] 0 2024-09-18T12:51:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:1/734: truncate d0/d6/d7/d8/f82 799823 0 2024-09-18T12:51:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:4/661: rmdir d3/d20/d3d/d65/d14 39 2024-09-18T12:51:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:4/662: fsync d3/d20/d5b/fc2 0 2024-09-18T12:51:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:4/663: write d3/d20/d3d/d65/d14/f88 [1042315,122737] 0 2024-09-18T12:51:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:6/691: symlink d4/d6/d95/ldd 0 2024-09-18T12:51:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:3/728: dwrite d3/db/dc/d1a/f6a [0,4194304] 0 2024-09-18T12:51:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:9/571: write dd/d1d/d1e/d24/f33 [2048164,62776] 0 2024-09-18T12:51:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:9/572: dread f6 [0,4194304] 0 2024-09-18T12:51:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:3/729: creat d3/db/df/fff x:0 0 0 2024-09-18T12:51:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:3/730: creat d3/db/df/d29/f100 x:0 0 0 2024-09-18T12:51:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:8/672: mknod d3/d1e/ce1 0 2024-09-18T12:51:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:9/573: symlink dd/de/d7a/d9e/lbd 0 2024-09-18T12:51:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/673: truncate d3/d2f/f8a 184896 0 2024-09-18T12:51:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/674: write d3/d1e/d4c/fb9 [3174743,27643] 0 2024-09-18T12:51:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/675: chown d3/d1e/l47 1651 1 2024-09-18T12:51:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/676: creat d3/d1d/fe2 x:0 0 0 2024-09-18T12:51:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/677: creat d3/d2f/fe3 x:0 0 0 2024-09-18T12:51:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:1/735: dwrite d0/d6/d7/d2e/d4e/f89 [0,4194304] 0 2024-09-18T12:51:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:9/574: unlink dd/d1d/d1e/d24/d2a/d55/l87 0 2024-09-18T12:51:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:1/736: mkdir d0/d18/df4 0 2024-09-18T12:51:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/575: symlink dd/d15/d1a/lbe 0 2024-09-18T12:51:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/576: truncate dd/d1d/d1e/fac 17981 0 2024-09-18T12:51:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/577: creat dd/d1d/d91/fbf x:0 0 0 2024-09-18T12:51:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/578: write dd/d1d/d1e/d39/d73/fab [170802,4883] 0 2024-09-18T12:51:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/579: write dd/d1d/d1e/d24/d2a/f88 [753394,119094] 0 2024-09-18T12:51:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:6/692: dwrite f0 [8388608,4194304] 0 2024-09-18T12:51:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:1/737: creat d0/d6/d33/d37/d98/d79/ff5 x:0 0 0 2024-09-18T12:51:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:3/731: dwrite d3/db/df/da8/fa9 [0,4194304] 0 2024-09-18T12:51:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:6/693: link d4/d12/d28/d2a/d2d/f4f d4/d6/fde 0 2024-09-18T12:51:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:1/738: rmdir d0/d6/d33/d42/dcf 39 2024-09-18T12:51:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:3/732: mknod d3/db/df/d29/d12/d44/d76/c101 0 2024-09-18T12:51:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:8/678: dwrite d3/d1d/d4a/fbf [0,4194304] 0 2024-09-18T12:51:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:8/679: fdatasync d3/d1d/f4d 0 2024-09-18T12:51:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:6/694: creat d4/d12/d56/d7d/d84/fdf x:0 0 0 2024-09-18T12:51:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:9/580: write dd/d1d/d1e/d24/d2a/f68 [2238486,40895] 0 2024-09-18T12:51:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:9/581: write dd/d1d/d1e/d39/f98 [1126178,43618] 0 2024-09-18T12:51:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:3/733: symlink d3/db/df/d29/d13/d93/l102 0 2024-09-18T12:51:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/680: rename d3/d1e/fc6 to d3/d1d/d4a/d8d/fe4 0 2024-09-18T12:51:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:6/695: creat d4/d12/d28/d2a/d97/ddc/fe0 x:0 0 0 2024-09-18T12:51:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:6/696: stat d4/d12/d28/d2a/d74/d8b 0 2024-09-18T12:51:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:6/697: creat d4/d12/d56/d7d/d84/fe1 x:0 0 0 2024-09-18T12:51:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/698: read d4/d12/d28/d2a/d2d/d31/f51 [2939258,55606] 0 2024-09-18T12:51:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:9/582: unlink dd/d1d/d1e/d39/d73/fab 0 2024-09-18T12:51:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:8/681: mkdir d3/d1e/d4c/d53/de5 0 2024-09-18T12:51:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:6/699: getdents d4/d12/d28/d2a/d2d 0 2024-09-18T12:51:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:6/700: chown d4/d12/d56/d7d/d84/fe1 3063558 1 2024-09-18T12:51:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:6/701: creat d4/d12/d56/d7d/d96/db7/fe2 x:0 0 0 2024-09-18T12:51:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:1/739: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-18T12:51:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:1/740: write d0/dd7/d2d/d75/fe2 [1041214,82085] 0 2024-09-18T12:51:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:4/664: dwrite d3/d20/d3d/d65/f2c [0,4194304] 0 2024-09-18T12:51:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:4/665: read d3/d20/d3d/d65/d14/d27/f37 [3295883,111457] 0 2024-09-18T12:51:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:3/734: dwrite d3/db/dc/fd6 [0,4194304] 0 2024-09-18T12:51:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:9/583: dread dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:9/584: write dd/d1d/d1e/d24/f33 [1595403,69244] 0 2024-09-18T12:51:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:1/741: dread d0/db/d4f/dab/fbf [0,4194304] 0 2024-09-18T12:51:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:3/735: dread d3/db/df/d29/d13/d93/fca [0,4194304] 0 2024-09-18T12:51:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:3/736: symlink d3/db/df/d29/d13/d65/l103 0 2024-09-18T12:51:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:3/737: rename d3/db/f2c to d3/db/df/d29/d12/dcc/f104 0 2024-09-18T12:51:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:9/585: dread dd/de/f97 [0,4194304] 0 2024-09-18T12:51:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:9/586: fsync dd/d1d/d1e/d24/d2a/f30 0 2024-09-18T12:51:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:6/702: dwrite d4/d12/d28/d2a/d2d/d31/f3d [0,4194304] 0 2024-09-18T12:51:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:8/682: dread d3/d1e/d4c/fb9 [0,4194304] 0 2024-09-18T12:51:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:8/683: stat d3/l1b 0 2024-09-18T12:51:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:4/666: dwrite d3/d20/d3d/d65/d2f/d8c/fbe [0,4194304] 0 2024-09-18T12:51:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:3/738: unlink d3/db/df/d60/c4a 0 2024-09-18T12:51:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:9/587: rmdir dd/de/d7a/d9e 39 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/588: dread dd/d15/d1a/d8d/f8e [0,4194304] 0 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:6/703: rename d4/d12/d56/d7d/d84/fe1 to d4/d12/d56/da8/fe3 0 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:6/704: stat d4/d12/d1c/c29 0 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:6/705: chown d4/d12/l8e 704 1 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/589: dread dd/d1d/d1e/fac [0,4194304] 0 2024-09-18T12:51:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/590: chown dd/d1d/d91/fb4 4100 1 2024-09-18T12:51:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:8/684: write d3/d1d/d4a/f92 [1003976,129741] 0 2024-09-18T12:51:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:8/685: fsync d3/dc9/fca 0 2024-09-18T12:51:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:8/686: dread - d3/d1e/d4c/d68/daa/fdf zero size 2024-09-18T12:51:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:3/739: creat d3/db/df/d29/d12/d44/f105 x:0 0 0 2024-09-18T12:51:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:6/706: mknod d4/d12/d1c/ce4 0 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:8/687: rename d3/d1d/l2c to d3/d1e/d4c/d53/dce/le6 0 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:3/740: rename d3 to d3/db/df/d29/d12/d106 22 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:9/591: dwrite dd/d1d/d1e/fac [0,4194304] 0 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:3/741: chown d3/db/dc/d1a/l67 29458317 1 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:3/742: read d3/db/df/fc6 [5627458,75522] 0 2024-09-18T12:51:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:9/592: write dd/d1b/fa0 [821232,92592] 0 2024-09-18T12:51:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:4/667: rmdir d3/d20/da3 0 2024-09-18T12:51:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:8/688: rename d3/l10 to d3/d1d/d89/db5/le7 0 2024-09-18T12:51:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:9/593: creat dd/d31/fc0 x:0 0 0 2024-09-18T12:51:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:9/594: fsync dd/d1d/d1e/d2f/f83 0 2024-09-18T12:51:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:9/595: creat dd/d31/fc1 x:0 0 0 2024-09-18T12:51:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:4/668: mkdir d3/d20/d5b/dd8 0 2024-09-18T12:51:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:6/707: rmdir d4 39 2024-09-18T12:51:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:8/689: truncate d3/d1e/f77 1720705 0 2024-09-18T12:51:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:9/596: unlink dd/de/d4f/f8a 0 2024-09-18T12:51:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:6/708: mkdir d4/d12/d28/d2a/d98/dd8/de5 0 2024-09-18T12:51:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:9/597: mkdir dd/d1d/d1e/d24/d48/dc2 0 2024-09-18T12:51:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:9/598: dread - dd/d15/fbb zero size 2024-09-18T12:51:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:6/709: mknod d4/d12/d56/da8/ce6 0 2024-09-18T12:51:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:3/743: rename d3/db/dc to d3/db/df/d29/d13/d9d/d107 0 2024-09-18T12:51:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:9/599: mknod dd/d15/cc3 0 2024-09-18T12:51:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:9/600: read - dd/d31/fc1 zero size 2024-09-18T12:51:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/690: dwrite d3/d1d/d89/fa0 [0,4194304] 0 2024-09-18T12:51:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:3/744: dread d3/d84/fda [0,4194304] 0 2024-09-18T12:51:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:3/745: stat d3/db/d1b/f7d 0 2024-09-18T12:51:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:6/710: truncate d4/d12/d28/d2a/d2d/f4f 3040853 0 2024-09-18T12:51:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:9/601: mkdir dd/d1d/d1e/d2f/dc4 0 2024-09-18T12:51:25.626 INFO:tasks.workunit.client.0.smithi081.stdout:6/711: rename d4/d12/d56/d7d/d84/cb2 to d4/d6/db4/ce7 0 2024-09-18T12:51:25.627 INFO:tasks.workunit.client.0.smithi081.stdout:3/746: rmdir d3/db/df/d29/d12/d44/d76 39 2024-09-18T12:51:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:6/712: mkdir d4/d12/d56/d7d/d96/db7/de8 0 2024-09-18T12:51:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/747: dread d3/db/df/d29/d13/d93/fca [0,4194304] 0 2024-09-18T12:51:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:6/713: unlink d4/d12/l8e 0 2024-09-18T12:51:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:3/748: link d3/db/df/d29/fb8 d3/db/df/d29/d13/d93/f108 0 2024-09-18T12:51:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:6/714: rename d4/d12/d28/d2a/d2d/d31/c93 to d4/d12/d56/d7d/d96/db7/de8/ce9 0 2024-09-18T12:51:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:6/715: chown d4/d12/d1c/d39/d60/d90 14011628 1 2024-09-18T12:51:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:6/716: chown d4/d12/c25 226672 1 2024-09-18T12:51:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:3/749: mknod d3/db/d1b/c109 0 2024-09-18T12:51:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:6/717: mkdir d4/d12/d1c/d8f/dea 0 2024-09-18T12:51:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:6/718: write d4/f21 [4209082,39910] 0 2024-09-18T12:51:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/787: sync 2024-09-18T12:51:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/788: chown d15/d16/d33/d53/d7a/d2f/dc2/fd2 14 1 2024-09-18T12:51:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/789: chown d15/l69 251 1 2024-09-18T12:51:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:2/790: creat d15/d16/d33/d53/d7a/d2f/dfd/f11e x:0 0 0 2024-09-18T12:51:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:2/791: symlink d15/d16/d33/d53/d7a/d2f/d110/l11f 0 2024-09-18T12:51:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:2/792: write d15/d8e/ff4 [5024835,100604] 0 2024-09-18T12:51:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:9/602: dwrite dd/d1b/f34 [8388608,4194304] 0 2024-09-18T12:51:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:9/603: truncate dd/d1d/d1e/d24/d2a/f30 5247608 0 2024-09-18T12:51:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:9/604: chown dd/d15/d1a/fa8 131897961 1 2024-09-18T12:51:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:9/605: fdatasync dd/d1d/d1e/d24/d48/f6c 0 2024-09-18T12:51:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:6/719: dread d4/d12/d1c/d39/f89 [0,4194304] 0 2024-09-18T12:51:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:9/606: mknod dd/d15/d1a/da7/cc5 0 2024-09-18T12:51:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:6/720: mknod d4/d12/d56/ceb 0 2024-09-18T12:51:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:6/721: chown d4/d12/d1c/d39 1 1 2024-09-18T12:51:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:6/722: dread - d4/d12/d56/d7d/fd7 zero size 2024-09-18T12:51:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:6/723: mkdir d4/d12/d56/d7d/d84/dec 0 2024-09-18T12:51:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:8/691: dwrite d3/d73/dbe/fc1 [4194304,4194304] 0 2024-09-18T12:51:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:8/692: write d3/d1e/d4c/d53/f5f [762304,39291] 0 2024-09-18T12:51:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:6/724: mkdir d4/d12/d56/d7d/d96/ded 0 2024-09-18T12:51:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:8/693: symlink d3/d1d/d4a/le8 0 2024-09-18T12:51:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/725: rmdir d4/d6 39 2024-09-18T12:51:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/726: chown d4/d12/d28/d2a/d97 372202187 1 2024-09-18T12:51:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:8/694: creat d3/d1e/fe9 x:0 0 0 2024-09-18T12:51:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:6/727: mkdir d4/d12/d56/d7d/d84/dec/dee 0 2024-09-18T12:51:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:3/750: dwrite d3/db/df/d29/d13/d9d/fea [0,4194304] 0 2024-09-18T12:51:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:3/751: chown d3/db/df/d60/cbb 237449 1 2024-09-18T12:51:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:3/752: creat d3/db/df/f10a x:0 0 0 2024-09-18T12:51:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:6/728: creat d4/d12/d56/d7d/d96/fef x:0 0 0 2024-09-18T12:51:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:6/729: write d4/f7 [2856955,97574] 0 2024-09-18T12:51:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:6/730: write d4/d12/d1c/d39/f9a [756046,70009] 0 2024-09-18T12:51:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:6/731: stat d4/d12/d28/d2a/d74/d8b/d6f 0 2024-09-18T12:51:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/753: dread d3/db/df/d29/f64 [0,4194304] 0 2024-09-18T12:51:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/754: chown d3/db/df/d29/d12/d44/d76/fbe 390522815 1 2024-09-18T12:51:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/755: write d3/d23/f55 [508507,51411] 0 2024-09-18T12:51:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/756: chown d3/db/df/d29/d12/d44/df2/df6 62 1 2024-09-18T12:51:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:6/732: creat d4/d12/d56/d7d/ff0 x:0 0 0 2024-09-18T12:51:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:2/793: dwrite d15/d16/d33/d53/fd3 [0,4194304] 0 2024-09-18T12:51:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:9/607: dwrite dd/d31/f3b [0,4194304] 0 2024-09-18T12:51:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:9/608: fsync dd/d1d/d1e/d39/f98 0 2024-09-18T12:51:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:9/609: chown dd/f20 482098 1 2024-09-18T12:51:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:9/610: chown dd/d1d/d1e/d24/d2a/d55/c72 87816816 1 2024-09-18T12:51:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/794: mkdir d15/d16/d20/d22/d120 0 2024-09-18T12:51:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:2/795: readlink d15/d16/d33/d53/d7a/ld0 0 2024-09-18T12:51:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/695: dwrite d3/d1e/d4c/d53/f74 [0,4194304] 0 2024-09-18T12:51:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/696: write d3/d1d/d4a/d8d/fd3 [389881,100303] 0 2024-09-18T12:51:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/796: mkdir d15/d16/d20/d22/d120/d121 0 2024-09-18T12:51:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/797: dread - d15/d16/d20/f112 zero size 2024-09-18T12:51:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/798: dread - d15/d16/d20/d59/f9b zero size 2024-09-18T12:51:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/799: write d15/d16/d20/d22/f10b [4996218,46009] 0 2024-09-18T12:51:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:8/697: creat d3/d1e/d4c/d68/fea x:0 0 0 2024-09-18T12:51:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:8/698: symlink d3/d1e/d4c/dae/leb 0 2024-09-18T12:51:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:8/699: write d3/d1d/d89/fc0 [776533,68533] 0 2024-09-18T12:51:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:3/757: dwrite d3/d84/fda [0,4194304] 0 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:9/611: dwrite dd/d31/f8b [4194304,4194304] 0 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:9/612: write dd/d1d/d1e/d24/d2a/d55/d85/faa [711490,97204] 0 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/733: dwrite d4/f7 [0,4194304] 0 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/734: chown d4/d12/d1c/d39/d73/l83 46 1 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:8/700: dwrite d3/d1d/fc5 [4194304,4194304] 0 2024-09-18T12:51:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/800: dwrite d15/d16/fa7 [0,4194304] 0 2024-09-18T12:51:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:2/801: fsync d15/d16/d33/d53/d7a/d2f/d61/d97/ddd/f118 0 2024-09-18T12:51:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:2/802: fdatasync d15/d16/d20/d22/f116 0 2024-09-18T12:51:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:3/758: link d3/db/df/d29/d13/d9d/cfa d3/db/df/d29/d12/d44/d51/dde/c10b 0 2024-09-18T12:51:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:9/613: mkdir dd/d15/d1a/dc6 0 2024-09-18T12:51:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:6/735: symlink d4/d6/d95/lf1 0 2024-09-18T12:51:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:8/701: mknod d3/db7/cec 0 2024-09-18T12:51:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:8/702: fsync d3/d73/fa2 0 2024-09-18T12:51:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:8/703: write d3/d1e/d4c/d53/f7d [2984979,102710] 0 2024-09-18T12:51:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/803: mkdir d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/d122 0 2024-09-18T12:51:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:3/759: dread d3/db/df/d29/d13/d9d/d107/d1a/f6a [0,4194304] 0 2024-09-18T12:51:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/736: creat d4/d12/d1c/d64/ff2 x:0 0 0 2024-09-18T12:51:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/737: chown d4/d12/d56/d7d/d96/db7 109902 1 2024-09-18T12:51:25.737 INFO:tasks.workunit.client.0.smithi081.stdout:8/704: mknod d3/ced 0 2024-09-18T12:51:25.737 INFO:tasks.workunit.client.0.smithi081.stdout:8/705: chown d3/d1d/d4a/l9b 983909 1 2024-09-18T12:51:25.738 INFO:tasks.workunit.client.0.smithi081.stdout:9/614: getdents dd/de/d4f 0 2024-09-18T12:51:25.738 INFO:tasks.workunit.client.0.smithi081.stdout:9/615: fdatasync dd/de/d4f/d8c/d94/f9d 0 2024-09-18T12:51:25.739 INFO:tasks.workunit.client.0.smithi081.stdout:3/760: symlink d3/db/df/d29/d13/d68/l10c 0 2024-09-18T12:51:25.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/616: symlink dd/d15/d1a/dc6/lc7 0 2024-09-18T12:51:25.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/617: fdatasync dd/de/d4f/d8c/fa1 0 2024-09-18T12:51:25.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/618: chown dd/d1d/d1e/d2f/c6a 16334179 1 2024-09-18T12:51:25.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/619: stat f0 0 2024-09-18T12:51:25.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/620: fsync dd/d1d/d91/fb4 0 2024-09-18T12:51:25.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/621: write dd/d31/f8b [9062784,10600] 0 2024-09-18T12:51:25.750 INFO:tasks.workunit.client.0.smithi081.stdout:8/706: getdents d3/d1e/d4c/d68 0 2024-09-18T12:51:25.750 INFO:tasks.workunit.client.0.smithi081.stdout:2/804: dwrite d15/d16/d20/d22/d5a/fe3 [0,4194304] 0 2024-09-18T12:51:25.750 INFO:tasks.workunit.client.0.smithi081.stdout:2/805: fdatasync d15/d16/d33/d53/d7a/dee/f68 0 2024-09-18T12:51:25.754 INFO:tasks.workunit.client.0.smithi081.stdout:8/707: mkdir d3/d1d/d9f/dcf/dee 0 2024-09-18T12:51:25.754 INFO:tasks.workunit.client.0.smithi081.stdout:8/708: read d3/d1d/f55 [1228723,60392] 0 2024-09-18T12:51:25.754 INFO:tasks.workunit.client.0.smithi081.stdout:8/709: creat d3/dc9/fef x:0 0 0 2024-09-18T12:51:25.754 INFO:tasks.workunit.client.0.smithi081.stdout:8/710: chown d3/d1e/d4c/d53/f5f 479527631 1 2024-09-18T12:51:25.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/806: symlink d15/d6e/l123 0 2024-09-18T12:51:25.758 INFO:tasks.workunit.client.0.smithi081.stdout:9/622: dwrite dd/d1d/d91/fbf [0,4194304] 0 2024-09-18T12:51:25.758 INFO:tasks.workunit.client.0.smithi081.stdout:9/623: chown dd/d1d/d1e/d2f/dc4 789562095 1 2024-09-18T12:51:25.758 INFO:tasks.workunit.client.0.smithi081.stdout:9/624: write dd/d15/d1a/f22 [10609,60341] 0 2024-09-18T12:51:25.758 INFO:tasks.workunit.client.0.smithi081.stdout:9/625: dread - dd/d1d/d1e/d77/fb5 zero size 2024-09-18T12:51:25.759 INFO:tasks.workunit.client.0.smithi081.stdout:3/761: rename d3/d23 to d3/db/df/d60/d58/d10d 0 2024-09-18T12:51:25.762 INFO:tasks.workunit.client.0.smithi081.stdout:9/626: mknod dd/de/d7a/cc8 0 2024-09-18T12:51:25.762 INFO:tasks.workunit.client.0.smithi081.stdout:9/627: truncate dd/de/d4f/f75 62769 0 2024-09-18T12:51:25.764 INFO:tasks.workunit.client.0.smithi081.stdout:3/762: symlink d3/db/l10e 0 2024-09-18T12:51:25.765 INFO:tasks.workunit.client.0.smithi081.stdout:8/711: rename d3/d1d/d89/db5/le7 to d3/d1e/d4c/d53/de5/lf0 0 2024-09-18T12:51:25.766 INFO:tasks.workunit.client.0.smithi081.stdout:9/628: rmdir dd/d1d/d1e/d24/d48 39 2024-09-18T12:51:25.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/807: write d15/d16/d33/d53/d7a/d2f/dc2/f94 [3422925,1812] 0 2024-09-18T12:51:25.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/808: stat d15/d26/ca1 0 2024-09-18T12:51:25.770 INFO:tasks.workunit.client.0.smithi081.stdout:8/712: symlink d3/d1e/d4c/d68/lf1 0 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:3/763: rename d3/db/da4 to d3/db/df/d60/d58/d10f 0 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:3/764: write d3/db/df/d29/ff4 [212771,92596] 0 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:3/765: creat d3/db/df/d3b/dc0/f110 x:0 0 0 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:2/809: truncate d15/d16/def/dd8/fde 1223356 0 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:2/810: chown d15/d16/ded/dfc/l108 55 1 2024-09-18T12:51:25.777 INFO:tasks.workunit.client.0.smithi081.stdout:9/629: rename dd/d1d/d1e/d2f/c58 to dd/d1d/d1e/d24/d48/dc2/cc9 0 2024-09-18T12:51:25.780 INFO:tasks.workunit.client.0.smithi081.stdout:3/766: mknod d3/db/df/da8/c111 0 2024-09-18T12:51:25.784 INFO:tasks.workunit.client.0.smithi081.stdout:8/713: rename d3/l22 to d3/dc9/lf2 0 2024-09-18T12:51:25.788 INFO:tasks.workunit.client.0.smithi081.stdout:8/714: symlink d3/lf3 0 2024-09-18T12:51:25.789 INFO:tasks.workunit.client.0.smithi081.stdout:8/715: symlink d3/d1d/d4a/lf4 0 2024-09-18T12:51:25.789 INFO:tasks.workunit.client.0.smithi081.stdout:8/716: fsync d3/dc9/fef 0 2024-09-18T12:51:25.790 INFO:tasks.workunit.client.0.smithi081.stdout:3/767: write d3/db/df/d29/d13/d9d/d107/d1a/fb5 [3696261,32365] 0 2024-09-18T12:51:25.791 INFO:tasks.workunit.client.0.smithi081.stdout:8/717: rename d3/d1e/d4c/d68/daa/dcb to d3/d1d/d89/df5 0 2024-09-18T12:51:25.791 INFO:tasks.workunit.client.0.smithi081.stdout:2/811: dwrite d15/d16/d20/d31/f10e [0,4194304] 0 2024-09-18T12:51:25.791 INFO:tasks.workunit.client.0.smithi081.stdout:2/812: truncate d15/f114 1576798 0 2024-09-18T12:51:25.794 INFO:tasks.workunit.client.0.smithi081.stdout:3/768: mknod d3/db/df/d3b/c112 0 2024-09-18T12:51:25.805 INFO:tasks.workunit.client.0.smithi081.stdout:8/718: dread d3/d1d/d4a/d8d/fbd [0,4194304] 0 2024-09-18T12:51:25.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/769: rename d3/db/df/d29/d12 to d3/db/df/d113 0 2024-09-18T12:51:25.807 INFO:tasks.workunit.client.0.smithi081.stdout:8/719: unlink d3/d1e/f33 0 2024-09-18T12:51:25.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/770: link d3/db/d1b/ccd d3/db/df/d3b/d47/c114 0 2024-09-18T12:51:25.810 INFO:tasks.workunit.client.0.smithi081.stdout:2/813: dwrite d15/d26/f72 [0,4194304] 0 2024-09-18T12:51:25.812 INFO:tasks.workunit.client.0.smithi081.stdout:8/720: creat d3/d1d/d9f/dcf/ff6 x:0 0 0 2024-09-18T12:51:25.813 INFO:tasks.workunit.client.0.smithi081.stdout:3/771: truncate d3/db/df/d29/d13/d9d/d107/f15 3269114 0 2024-09-18T12:51:25.817 INFO:tasks.workunit.client.0.smithi081.stdout:8/721: mkdir d3/d1d/d4a/d7f/df7 0 2024-09-18T12:51:25.824 INFO:tasks.workunit.client.0.smithi081.stdout:3/772: dread f1 [0,4194304] 0 2024-09-18T12:51:25.824 INFO:tasks.workunit.client.0.smithi081.stdout:0/646: sync 2024-09-18T12:51:25.824 INFO:tasks.workunit.client.0.smithi081.stdout:3/773: readlink d3/db/df/d29/d13/d9d/d107/d1a/lc8 0 2024-09-18T12:51:25.827 INFO:tasks.workunit.client.0.smithi081.stdout:8/722: read d3/d1d/d89/fa0 [2886733,6367] 0 2024-09-18T12:51:25.828 INFO:tasks.workunit.client.0.smithi081.stdout:8/723: fsync d3/d1e/d4c/d53/f74 0 2024-09-18T12:51:25.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/814: dwrite d15/d16/d20/d31/f5e [0,4194304] 0 2024-09-18T12:51:25.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/815: dread - d15/d16/d20/d22/fe6 zero size 2024-09-18T12:51:25.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/724: symlink d3/d1d/d89/db5/db8/lf8 0 2024-09-18T12:51:25.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/725: stat d3/d2f/c52 0 2024-09-18T12:51:25.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/726: dread - d3/dc9/fca zero size 2024-09-18T12:51:25.830 INFO:tasks.workunit.client.0.smithi081.stdout:2/816: symlink d15/d16/d33/l124 0 2024-09-18T12:51:25.831 INFO:tasks.workunit.client.0.smithi081.stdout:8/727: truncate d3/f6c 851401 0 2024-09-18T12:51:25.831 INFO:tasks.workunit.client.0.smithi081.stdout:8/728: chown d3/d1e/d4c/d53/c6d 68996481 1 2024-09-18T12:51:25.832 INFO:tasks.workunit.client.0.smithi081.stdout:2/817: mknod d15/d16/d33/d53/d7a/d2f/d61/dd4/c125 0 2024-09-18T12:51:25.833 INFO:tasks.workunit.client.0.smithi081.stdout:3/774: write d3/db/df/d29/f30 [1814942,56595] 0 2024-09-18T12:51:25.834 INFO:tasks.workunit.client.0.smithi081.stdout:2/818: getdents d15/d8e 0 2024-09-18T12:51:25.836 INFO:tasks.workunit.client.0.smithi081.stdout:2/819: mkdir d15/d16/d20/d22/d120/d121/d126 0 2024-09-18T12:51:25.838 INFO:tasks.workunit.client.0.smithi081.stdout:3/775: mknod d3/db/df/d29/d13/d9d/d107/d1a/c115 0 2024-09-18T12:51:25.838 INFO:tasks.workunit.client.0.smithi081.stdout:3/776: chown d3/db/df/d113/d44/d51/f63 6 1 2024-09-18T12:51:25.842 INFO:tasks.workunit.client.0.smithi081.stdout:0/647: dwrite d7/d9/d4b/d33/db1/fb9 [0,4194304] 0 2024-09-18T12:51:25.842 INFO:tasks.workunit.client.0.smithi081.stdout:0/648: creat d7/d9/d4b/d4a/d77/fdc x:0 0 0 2024-09-18T12:51:25.842 INFO:tasks.workunit.client.0.smithi081.stdout:0/649: write d7/dbf/fd2 [230477,57333] 0 2024-09-18T12:51:25.842 INFO:tasks.workunit.client.0.smithi081.stdout:0/650: creat d7/d9/d4b/d33/fdd x:0 0 0 2024-09-18T12:51:25.852 INFO:tasks.workunit.client.0.smithi081.stdout:0/651: dread d7/dbf/fd2 [0,4194304] 0 2024-09-18T12:51:25.852 INFO:tasks.workunit.client.0.smithi081.stdout:0/652: creat d7/d9/fde x:0 0 0 2024-09-18T12:51:25.852 INFO:tasks.workunit.client.0.smithi081.stdout:0/653: chown d7/d9/d4b/d33/d43/la9 53701 1 2024-09-18T12:51:25.852 INFO:tasks.workunit.client.0.smithi081.stdout:0/654: readlink d7/d9/la1 0 2024-09-18T12:51:25.854 INFO:tasks.workunit.client.0.smithi081.stdout:0/655: symlink d7/d5d/dd9/ldf 0 2024-09-18T12:51:25.855 INFO:tasks.workunit.client.0.smithi081.stdout:0/656: truncate d7/d9/d4b/d4a/f16 5276998 0 2024-09-18T12:51:25.855 INFO:tasks.workunit.client.0.smithi081.stdout:0/657: truncate d7/fb8 257049 0 2024-09-18T12:51:25.855 INFO:tasks.workunit.client.0.smithi081.stdout:0/658: chown d7/d9/d4b/d4a/c6a 26714 1 2024-09-18T12:51:25.856 INFO:tasks.workunit.client.0.smithi081.stdout:0/659: creat d7/d7c/fe0 x:0 0 0 2024-09-18T12:51:25.856 INFO:tasks.workunit.client.0.smithi081.stdout:0/660: fdatasync d7/d9/f3e 0 2024-09-18T12:51:25.856 INFO:tasks.workunit.client.0.smithi081.stdout:0/661: mknod d7/dbf/ce1 0 2024-09-18T12:51:25.857 INFO:tasks.workunit.client.0.smithi081.stdout:2/820: dwrite d15/d26/ff2 [0,4194304] 0 2024-09-18T12:51:25.857 INFO:tasks.workunit.client.0.smithi081.stdout:2/821: truncate d15/df9/d10d/f10f 562088 0 2024-09-18T12:51:25.858 INFO:tasks.workunit.client.0.smithi081.stdout:2/822: creat d15/d16/d20/d22/d120/f127 x:0 0 0 2024-09-18T12:51:25.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/823: mkdir d15/d26/da8/d128 0 2024-09-18T12:51:25.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/824: chown d15/d16/d33/l124 3894 1 2024-09-18T12:51:25.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/825: readlink d15/d16/d20/d22/lc3 0 2024-09-18T12:51:25.860 INFO:tasks.workunit.client.0.smithi081.stdout:2/826: link d15/d16/d20/d22/fe6 d15/d26/da8/f129 0 2024-09-18T12:51:25.861 INFO:tasks.workunit.client.0.smithi081.stdout:3/777: dwrite d3/db/df/d113/d44/d6f/f9a [0,4194304] 0 2024-09-18T12:51:25.862 INFO:tasks.workunit.client.0.smithi081.stdout:3/778: write d3/db/df/d3b/dc0/ff1 [471642,80354] 0 2024-09-18T12:51:25.863 INFO:tasks.workunit.client.0.smithi081.stdout:3/779: creat d3/db/df/d113/d44/df2/f116 x:0 0 0 2024-09-18T12:51:25.865 INFO:tasks.workunit.client.0.smithi081.stdout:3/780: rename d3/db/df/d60/d58/d10d/ce9 to d3/db/df/d29/d13/d65/c117 0 2024-09-18T12:51:25.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/827: write d15/d16/d33/f5b [6756590,50094] 0 2024-09-18T12:51:25.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/828: fsync d15/df9/ff5 0 2024-09-18T12:51:25.885 INFO:tasks.workunit.client.0.smithi081.stdout:2/829: dread d15/d16/f19 [4194304,4194304] 0 2024-09-18T12:51:25.885 INFO:tasks.workunit.client.0.smithi081.stdout:2/830: write d15/d16/d20/fa4 [389469,68560] 0 2024-09-18T12:51:25.886 INFO:tasks.workunit.client.0.smithi081.stdout:2/831: rmdir d15/d16/d33/d53/d7a/d2f/dfd 39 2024-09-18T12:51:25.886 INFO:tasks.workunit.client.0.smithi081.stdout:2/832: stat d15/d26/ca1 0 2024-09-18T12:51:25.891 INFO:tasks.workunit.client.0.smithi081.stdout:3/781: dwrite d3/db/df/d113/d44/d51/fa7 [0,4194304] 0 2024-09-18T12:51:25.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/782: rename d3/db/df/d29/d13/d68 to d3/d84/d118 0 2024-09-18T12:51:25.897 INFO:tasks.workunit.client.0.smithi081.stdout:3/783: dread d3/db/df/d113/d44/d51/f63 [0,4194304] 0 2024-09-18T12:51:25.897 INFO:tasks.workunit.client.0.smithi081.stdout:3/784: chown d3/db/df/d3b/dc0/f110 518076536 1 2024-09-18T12:51:25.897 INFO:tasks.workunit.client.0.smithi081.stdout:3/785: write d3/db/df/da8/fa9 [5181898,8362] 0 2024-09-18T12:51:25.899 INFO:tasks.workunit.client.0.smithi081.stdout:0/662: dwrite d7/d9/d4b/d4a/f16 [0,4194304] 0 2024-09-18T12:51:25.899 INFO:tasks.workunit.client.0.smithi081.stdout:0/663: fsync d7/fb8 0 2024-09-18T12:51:25.899 INFO:tasks.workunit.client.0.smithi081.stdout:0/664: creat d7/d9/d4b/d33/d43/fe2 x:0 0 0 2024-09-18T12:51:25.899 INFO:tasks.workunit.client.0.smithi081.stdout:2/833: dread d15/d16/d20/d31/f5e [0,4194304] 0 2024-09-18T12:51:25.919 INFO:tasks.workunit.client.0.smithi081.stdout:3/786: dwrite d3/db/df/d3b/dc0/f110 [0,4194304] 0 2024-09-18T12:51:25.919 INFO:tasks.workunit.client.0.smithi081.stdout:2/834: dwrite d15/df9/ff5 [0,4194304] 0 2024-09-18T12:51:25.924 INFO:tasks.workunit.client.0.smithi081.stdout:2/835: symlink d15/d16/d20/d22/d120/d121/l12a 0 2024-09-18T12:51:25.932 INFO:tasks.workunit.client.0.smithi081.stdout:2/836: dread d15/d26/f92 [0,4194304] 0 2024-09-18T12:51:25.932 INFO:tasks.workunit.client.0.smithi081.stdout:2/837: stat d15/d16/d33/d53/d7a/f38 0 2024-09-18T12:51:25.940 INFO:tasks.workunit.client.0.smithi081.stdout:3/787: write d3/db/df/fb9 [2056725,1591] 0 2024-09-18T12:51:25.943 INFO:tasks.workunit.client.0.smithi081.stdout:2/838: dread d15/d16/d20/d22/f10b [0,4194304] 0 2024-09-18T12:51:25.945 INFO:tasks.workunit.client.0.smithi081.stdout:2/839: unlink d15/d16/d20/c28 0 2024-09-18T12:51:25.946 INFO:tasks.workunit.client.0.smithi081.stdout:2/840: fsync d15/d16/def/f9d 0 2024-09-18T12:51:25.946 INFO:tasks.workunit.client.0.smithi081.stdout:2/841: fdatasync d15/d16/d20/d22/d5a/f74 0 2024-09-18T12:51:25.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/788: dread d3/db/df/d29/d13/d9d/d107/f15 [0,4194304] 0 2024-09-18T12:51:25.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/789: dread - d3/db/df/d113/d44/df2/f116 zero size 2024-09-18T12:51:25.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/790: truncate d3/db/df/d29/f100 753536 0 2024-09-18T12:51:25.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/791: unlink d3/db/df/d60/cbb 0 2024-09-18T12:51:25.963 INFO:tasks.workunit.client.0.smithi081.stdout:2/842: dwrite d15/d16/d33/d53/d7a/d2f/d61/d97/fe9 [0,4194304] 0 2024-09-18T12:51:25.964 INFO:tasks.workunit.client.0.smithi081.stdout:2/843: creat d15/d16/d20/d22/d5a/f12b x:0 0 0 2024-09-18T12:51:25.971 INFO:tasks.workunit.client.0.smithi081.stdout:3/792: dwrite d3/db/df/d60/d58/d10d/f55 [0,4194304] 0 2024-09-18T12:51:25.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/793: rename d3/db/df/d29/d13/d9d/d107/d1a to d3/db/df/d60/d119 0 2024-09-18T12:51:25.975 INFO:tasks.workunit.client.0.smithi081.stdout:3/794: stat d3/db/df/d29/d13/f8f 0 2024-09-18T12:51:25.978 INFO:tasks.workunit.client.0.smithi081.stdout:2/844: dread d15/d16/d20/d22/f34 [0,4194304] 0 2024-09-18T12:51:25.978 INFO:tasks.workunit.client.0.smithi081.stdout:2/845: write d15/d26/f72 [4548630,41589] 0 2024-09-18T12:51:25.987 INFO:tasks.workunit.client.0.smithi081.stdout:2/846: write d15/d16/d20/fc1 [742250,82933] 0 2024-09-18T12:51:26.004 INFO:tasks.workunit.client.0.smithi081.stdout:2/847: dwrite d15/d16/d33/d53/d7a/d2f/dc2/fd2 [0,4194304] 0 2024-09-18T12:51:26.049 INFO:tasks.workunit.client.0.smithi081.stdout:3/795: rename d3/db/df/d3b/dc0/lef to d3/db/df/d113/d44/d51/dde/l11a 0 2024-09-18T12:51:26.049 INFO:tasks.workunit.client.0.smithi081.stdout:3/796: readlink d3/db/df/d29/d13/d65/ld7 0 2024-09-18T12:51:26.049 INFO:tasks.workunit.client.0.smithi081.stdout:3/797: write d3/db/df/d3b/dc0/ff7 [634748,47958] 0 2024-09-18T12:51:26.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/848: symlink d15/d16/d33/d53/l12c 0 2024-09-18T12:51:26.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/849: truncate d15/d16/f58 9099133 0 2024-09-18T12:51:26.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/798: symlink d3/db/df/d29/d13/d9d/l11b 0 2024-09-18T12:51:26.066 INFO:tasks.workunit.client.0.smithi081.stdout:2/850: mkdir d15/d16/d33/d53/d7a/d2f/d110/d12d 0 2024-09-18T12:51:26.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/799: symlink d3/db/df/d29/d13/d9d/l11c 0 2024-09-18T12:51:26.069 INFO:tasks.workunit.client.0.smithi081.stdout:2/851: creat d15/d16/def/f12e x:0 0 0 2024-09-18T12:51:26.070 INFO:tasks.workunit.client.0.smithi081.stdout:2/852: mknod d15/d16/d33/d53/d7a/d2f/d110/d12d/c12f 0 2024-09-18T12:51:26.078 INFO:tasks.workunit.client.0.smithi081.stdout:2/853: write d15/d16/d20/fa5 [4063318,20795] 0 2024-09-18T12:51:26.078 INFO:tasks.workunit.client.0.smithi081.stdout:2/854: write d15/d16/d33/d53/d7a/d2f/d61/d97/fe9 [2669398,7981] 0 2024-09-18T12:51:26.080 INFO:tasks.workunit.client.0.smithi081.stdout:2/855: getdents d15/d16/d33/d53/d7a/d2f/dc2/df8 0 2024-09-18T12:51:26.082 INFO:tasks.workunit.client.0.smithi081.stdout:2/856: link d15/d26/da8/l11a d15/d26/da8/l130 0 2024-09-18T12:51:26.082 INFO:tasks.workunit.client.0.smithi081.stdout:2/857: truncate d15/d26/f29 3284655 0 2024-09-18T12:51:26.100 INFO:tasks.workunit.client.0.smithi081.stdout:5/658: sync 2024-09-18T12:51:26.101 INFO:tasks.workunit.client.0.smithi081.stdout:2/858: dwrite d15/d16/d33/d53/d7a/d2f/dfd/f11e [0,4194304] 0 2024-09-18T12:51:26.107 INFO:tasks.workunit.client.0.smithi081.stdout:2/859: dread d15/d16/d33/d53/d7a/d2f/dc2/f93 [0,4194304] 0 2024-09-18T12:51:26.108 INFO:tasks.workunit.client.0.smithi081.stdout:2/860: mkdir d15/d16/d20/d22/d120/d131 0 2024-09-18T12:51:26.109 INFO:tasks.workunit.client.0.smithi081.stdout:2/861: read d15/d26/f7e [1175391,66297] 0 2024-09-18T12:51:26.109 INFO:tasks.workunit.client.0.smithi081.stdout:2/862: symlink d15/d16/d33/d53/d7a/d2f/d61/dd4/l132 0 2024-09-18T12:51:26.115 INFO:tasks.workunit.client.0.smithi081.stdout:5/659: dwrite d2/d14/d33/d37/d3b/d5f/fb5 [0,4194304] 0 2024-09-18T12:51:26.124 INFO:tasks.workunit.client.0.smithi081.stdout:5/660: write d2/d14/d1d/d1a/f85 [983013,8422] 0 2024-09-18T12:51:26.127 INFO:tasks.workunit.client.0.smithi081.stdout:5/661: mknod d2/d14/d33/d37/d3b/d6a/ccd 0 2024-09-18T12:51:26.137 INFO:tasks.workunit.client.0.smithi081.stdout:5/662: dread d2/d14/d33/d37/d3b/d2a/db0/f88 [0,4194304] 0 2024-09-18T12:51:26.137 INFO:tasks.workunit.client.0.smithi081.stdout:2/863: dwrite d15/d16/d33/d53/d7a/dee/d6d/da0/fcc [0,4194304] 0 2024-09-18T12:51:26.137 INFO:tasks.workunit.client.0.smithi081.stdout:5/663: fsync d2/d14/d33/d37/d3b/d16/f73 0 2024-09-18T12:51:26.137 INFO:tasks.workunit.client.0.smithi081.stdout:5/664: creat d2/dd/d5e/fce x:0 0 0 2024-09-18T12:51:26.143 INFO:tasks.workunit.client.0.smithi081.stdout:5/665: link d2/dd/d5e/f3a d2/d14/d33/d37/d3b/d2a/d8e/dc2/fcf 0 2024-09-18T12:51:26.148 INFO:tasks.workunit.client.0.smithi081.stdout:2/864: write d15/d16/d20/d31/f10e [3237881,52738] 0 2024-09-18T12:51:26.150 INFO:tasks.workunit.client.0.smithi081.stdout:2/865: symlink d15/df9/d10d/l133 0 2024-09-18T12:51:26.151 INFO:tasks.workunit.client.0.smithi081.stdout:2/866: rename d15/d16/d33/d53/d7a/lbe to d15/d16/d20/d59/l134 0 2024-09-18T12:51:26.154 INFO:tasks.workunit.client.0.smithi081.stdout:2/867: truncate d15/d16/f58 3462755 0 2024-09-18T12:51:26.157 INFO:tasks.workunit.client.0.smithi081.stdout:2/868: dread d15/d16/d33/d53/d7a/dee/f3c [0,4194304] 0 2024-09-18T12:51:26.158 INFO:tasks.workunit.client.0.smithi081.stdout:5/666: dread d2/d14/d33/d37/d3b/d16/f73 [0,4194304] 0 2024-09-18T12:51:26.159 INFO:tasks.workunit.client.0.smithi081.stdout:5/667: chown d2/d14 36 1 2024-09-18T12:51:26.159 INFO:tasks.workunit.client.0.smithi081.stdout:5/668: stat d2/d14/d1d/d1a/l41 0 2024-09-18T12:51:26.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/669: rename d2/d14/d1d/c39 to d2/d14/d33/d37/d3b/cd0 0 2024-09-18T12:51:26.168 INFO:tasks.workunit.client.0.smithi081.stdout:5/670: rmdir d2/dd/d5e 39 2024-09-18T12:51:26.168 INFO:tasks.workunit.client.0.smithi081.stdout:5/671: fdatasync d2/d14/d33/d37/d3b/d6a/fac 0 2024-09-18T12:51:26.186 INFO:tasks.workunit.client.0.smithi081.stdout:2/869: dwrite d15/d16/d33/d53/d7a/dee/fab [4194304,4194304] 0 2024-09-18T12:51:26.187 INFO:tasks.workunit.client.0.smithi081.stdout:5/672: dwrite d2/d14/d33/d37/f95 [0,4194304] 0 2024-09-18T12:51:26.188 INFO:tasks.workunit.client.0.smithi081.stdout:5/673: truncate d2/d14/fb4 33847 0 2024-09-18T12:51:26.188 INFO:tasks.workunit.client.0.smithi081.stdout:5/674: write d2/dd/d5e/fc0 [754059,35252] 0 2024-09-18T12:51:26.191 INFO:tasks.workunit.client.0.smithi081.stdout:5/675: mkdir d2/d14/d33/d37/d3b/d16/dd1 0 2024-09-18T12:51:26.193 INFO:tasks.workunit.client.0.smithi081.stdout:2/870: rename d15/d16/d20/d31 to d15/df9/d10d/d135 0 2024-09-18T12:51:26.194 INFO:tasks.workunit.client.0.smithi081.stdout:5/676: mknod d2/dd/d9e/cd2 0 2024-09-18T12:51:26.195 INFO:tasks.workunit.client.0.smithi081.stdout:5/677: dread d2/dd/fb2 [0,4194304] 0 2024-09-18T12:51:26.195 INFO:tasks.workunit.client.0.smithi081.stdout:2/871: truncate d15/d16/d33/d53/d7a/d2f/dc2/f7d 243946 0 2024-09-18T12:51:26.195 INFO:tasks.workunit.client.0.smithi081.stdout:2/872: read d15/d16/ded/f105 [171925,72852] 0 2024-09-18T12:51:26.196 INFO:tasks.workunit.client.0.smithi081.stdout:5/678: creat d2/d14/d33/d37/d3b/d6a/d20/fd3 x:0 0 0 2024-09-18T12:51:26.197 INFO:tasks.workunit.client.0.smithi081.stdout:5/679: write d2/d14/d33/d37/d3b/d16/dbb/fc7 [204145,115241] 0 2024-09-18T12:51:26.198 INFO:tasks.workunit.client.0.smithi081.stdout:2/873: creat d15/d16/ded/dfc/f136 x:0 0 0 2024-09-18T12:51:26.198 INFO:tasks.workunit.client.0.smithi081.stdout:2/874: write d15/d16/d33/d53/d7a/dee/d6d/fd5 [465172,10035] 0 2024-09-18T12:51:26.198 INFO:tasks.workunit.client.0.smithi081.stdout:2/875: getdents d15/d16/d20/d22/d120/d131 0 2024-09-18T12:51:26.199 INFO:tasks.workunit.client.0.smithi081.stdout:5/680: link d2/d14/d33/d37/d3b/d16/l83 d2/dd/ld4 0 2024-09-18T12:51:26.199 INFO:tasks.workunit.client.0.smithi081.stdout:5/681: creat d2/d14/d33/d37/d3b/d16/fd5 x:0 0 0 2024-09-18T12:51:26.202 INFO:tasks.workunit.client.0.smithi081.stdout:5/682: rename d2/d14/d1d/d1a/c61 to d2/d14/d1d/cd6 0 2024-09-18T12:51:26.203 INFO:tasks.workunit.client.0.smithi081.stdout:5/683: chown d2/d14/d33/d37/d3b/d6a/c53 5 1 2024-09-18T12:51:26.208 INFO:tasks.workunit.client.0.smithi081.stdout:2/876: dread d15/d16/d20/d22/d5a/fea [4194304,4194304] 0 2024-09-18T12:51:26.208 INFO:tasks.workunit.client.0.smithi081.stdout:2/877: write d15/f84 [67306,129424] 0 2024-09-18T12:51:26.210 INFO:tasks.workunit.client.0.smithi081.stdout:2/878: symlink d15/df9/d10d/l137 0 2024-09-18T12:51:26.210 INFO:tasks.workunit.client.0.smithi081.stdout:2/879: read d15/df9/d10d/d135/f10e [2612078,41152] 0 2024-09-18T12:51:26.210 INFO:tasks.workunit.client.0.smithi081.stdout:2/880: write d15/d16/d54/fdc [1196400,100066] 0 2024-09-18T12:51:26.211 INFO:tasks.workunit.client.0.smithi081.stdout:2/881: getdents d15/d16/d20/d22/d120/d121 0 2024-09-18T12:51:26.211 INFO:tasks.workunit.client.0.smithi081.stdout:2/882: truncate d15/d16/d33/d53/d7a/d2f/d61/f90 934164 0 2024-09-18T12:51:26.214 INFO:tasks.workunit.client.0.smithi081.stdout:5/684: dread d2/d14/d33/f7e [0,4194304] 0 2024-09-18T12:51:26.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/685: mknod d2/d14/d33/d37/cd7 0 2024-09-18T12:51:26.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/686: chown d2/dd/d5e/f80 6091255 1 2024-09-18T12:51:26.218 INFO:tasks.workunit.client.0.smithi081.stdout:5/687: symlink d2/ld8 0 2024-09-18T12:51:26.218 INFO:tasks.workunit.client.0.smithi081.stdout:5/688: fsync d2/d14/fb4 0 2024-09-18T12:51:26.221 INFO:tasks.workunit.client.0.smithi081.stdout:5/689: symlink d2/d14/ld9 0 2024-09-18T12:51:26.221 INFO:tasks.workunit.client.0.smithi081.stdout:5/690: write d2/f8d [670067,82727] 0 2024-09-18T12:51:26.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/883: dread d15/d16/f48 [0,4194304] 0 2024-09-18T12:51:26.222 INFO:tasks.workunit.client.0.smithi081.stdout:2/884: fdatasync d15/d16/d20/d22/f2a 0 2024-09-18T12:51:26.223 INFO:tasks.workunit.client.0.smithi081.stdout:5/691: creat d2/d14/d33/d37/d3b/d2a/db0/fda x:0 0 0 2024-09-18T12:51:26.225 INFO:tasks.workunit.client.0.smithi081.stdout:5/692: link d2/d14/d33/d37/d3b/d2a/d8e/dc2/fcf d2/d14/d33/d37/d3b/d5f/fdb 0 2024-09-18T12:51:26.227 INFO:tasks.workunit.client.0.smithi081.stdout:5/693: symlink d2/d14/d33/d37/d3b/d16/dbb/ldc 0 2024-09-18T12:51:26.230 INFO:tasks.workunit.client.0.smithi081.stdout:5/694: link d2/dd/ld4 d2/d14/d33/d37/d3b/d2a/db0/ldd 0 2024-09-18T12:51:26.230 INFO:tasks.workunit.client.0.smithi081.stdout:5/695: chown d2/d14/d33/d37/d3b/d2a 6804 1 2024-09-18T12:51:26.232 INFO:tasks.workunit.client.0.smithi081.stdout:5/696: mknod d2/d14/d33/d37/d3b/d2a/db0/cde 0 2024-09-18T12:51:26.232 INFO:tasks.workunit.client.0.smithi081.stdout:5/697: write d2/d14/d1d/da4/faa [978091,16697] 0 2024-09-18T12:51:26.232 INFO:tasks.workunit.client.0.smithi081.stdout:5/698: write d2/d14/d33/d37/d3b/d2a/db0/fda [97440,10573] 0 2024-09-18T12:51:26.232 INFO:tasks.workunit.client.0.smithi081.stdout:2/885: write d15/d16/f19 [2850887,14026] 0 2024-09-18T12:51:26.234 INFO:tasks.workunit.client.0.smithi081.stdout:5/699: unlink d2/d47/d7f/fb7 0 2024-09-18T12:51:26.234 INFO:tasks.workunit.client.0.smithi081.stdout:5/700: fsync d2/dd/d5e/f42 0 2024-09-18T12:51:26.235 INFO:tasks.workunit.client.0.smithi081.stdout:2/886: rename d15/d16/d33/d53/d7a/f52 to d15/d16/d20/d59/f138 0 2024-09-18T12:51:26.235 INFO:tasks.workunit.client.0.smithi081.stdout:2/887: write d15/d16/def/f9d [1958569,118457] 0 2024-09-18T12:51:26.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/701: creat d2/dd/d5e/fdf x:0 0 0 2024-09-18T12:51:26.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/702: fdatasync d2/d14/d33/f6b 0 2024-09-18T12:51:26.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/703: write d2/d14/d33/d37/d3b/d6a/d20/f7d [183777,7816] 0 2024-09-18T12:51:26.268 INFO:tasks.workunit.client.0.smithi081.stdout:5/704: link d2/d14/d33/d37/d3b/d6a/f71 d2/d14/d33/fe0 0 2024-09-18T12:51:26.270 INFO:tasks.workunit.client.0.smithi081.stdout:5/705: unlink d2/f66 0 2024-09-18T12:51:26.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/706: creat d2/d14/d1d/d1a/fe1 x:0 0 0 2024-09-18T12:51:26.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/707: chown d2/d14/d33/d37/d3b/f43 122 1 2024-09-18T12:51:26.273 INFO:tasks.workunit.client.0.smithi081.stdout:5/708: creat d2/dd/d9e/fe2 x:0 0 0 2024-09-18T12:51:26.273 INFO:tasks.workunit.client.0.smithi081.stdout:5/709: stat d2/d14/f4e 0 2024-09-18T12:51:26.278 INFO:tasks.workunit.client.0.smithi081.stdout:7/598: sync 2024-09-18T12:51:26.285 INFO:tasks.workunit.client.0.smithi081.stdout:7/599: read d2/f34 [2663843,127796] 0 2024-09-18T12:51:26.285 INFO:tasks.workunit.client.0.smithi081.stdout:7/600: truncate d2/d56/d73/d90/f93 796288 0 2024-09-18T12:51:26.287 INFO:tasks.workunit.client.0.smithi081.stdout:7/601: rename d2/d56/dc8/fca to d2/d14/d21/d49/dcc/fd0 0 2024-09-18T12:51:26.287 INFO:tasks.workunit.client.0.smithi081.stdout:7/602: truncate d2/d14/d21/d49/dcc/fcf 858808 0 2024-09-18T12:51:26.287 INFO:tasks.workunit.client.0.smithi081.stdout:7/603: dread - d2/d18/d22/f6e zero size 2024-09-18T12:51:26.288 INFO:tasks.workunit.client.0.smithi081.stdout:5/710: dwrite d2/d14/d33/d37/d3b/f38 [0,4194304] 0 2024-09-18T12:51:26.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/604: creat d2/d18/d3c/fd1 x:0 0 0 2024-09-18T12:51:26.289 INFO:tasks.workunit.client.0.smithi081.stdout:5/711: creat d2/dd/fe3 x:0 0 0 2024-09-18T12:51:26.289 INFO:tasks.workunit.client.0.smithi081.stdout:5/712: write d2/d14/d33/d37/d3b/f77 [4266855,15997] 0 2024-09-18T12:51:26.302 INFO:tasks.workunit.client.0.smithi081.stdout:7/605: dwrite d2/d18/d60/fad [0,4194304] 0 2024-09-18T12:51:26.311 INFO:tasks.workunit.client.0.smithi081.stdout:5/713: dwrite d2/d47/d7f/f96 [0,4194304] 0 2024-09-18T12:51:26.313 INFO:tasks.workunit.client.0.smithi081.stdout:5/714: dread d2/fe [0,4194304] 0 2024-09-18T12:51:26.314 INFO:tasks.workunit.client.0.smithi081.stdout:7/606: dread d2/d18/d3c/f7a [0,4194304] 0 2024-09-18T12:51:26.315 INFO:tasks.workunit.client.0.smithi081.stdout:5/715: link d2/d14/d33/f8c d2/d14/d33/d37/d3b/d2a/fe4 0 2024-09-18T12:51:26.315 INFO:tasks.workunit.client.0.smithi081.stdout:7/607: mknod d2/d56/d73/cd2 0 2024-09-18T12:51:26.317 INFO:tasks.workunit.client.0.smithi081.stdout:5/716: rename d2/d47/d7f/cc8 to d2/d14/d33/d37/dc5/ce5 0 2024-09-18T12:51:26.317 INFO:tasks.workunit.client.0.smithi081.stdout:7/608: truncate d2/d14/d21/d62/da7/f7d 7791875 0 2024-09-18T12:51:26.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/609: fdatasync d2/d14/f16 0 2024-09-18T12:51:26.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/610: read - d2/d18/d60/d85/fb2 zero size 2024-09-18T12:51:26.327 INFO:tasks.workunit.client.0.smithi081.stdout:7/611: dread d2/d18/f20 [0,4194304] 0 2024-09-18T12:51:26.328 INFO:tasks.workunit.client.0.smithi081.stdout:7/612: rmdir d2/d1d/d4e/d84/dcd 0 2024-09-18T12:51:26.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/613: rmdir d2/d18/d3c/da8 0 2024-09-18T12:51:26.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/614: fdatasync d2/d18/f20 0 2024-09-18T12:51:26.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/615: chown d2/d56/d73/d90/l9e 226 1 2024-09-18T12:51:26.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/616: write d2/d14/d21/f72 [1278561,6927] 0 2024-09-18T12:51:26.331 INFO:tasks.workunit.client.0.smithi081.stdout:7/617: mkdir d2/d18/d60/daa/dd3 0 2024-09-18T12:51:26.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/717: dwrite d2/d14/d33/d37/d3b/d2a/d8e/f99 [0,4194304] 0 2024-09-18T12:51:26.331 INFO:tasks.workunit.client.0.smithi081.stdout:5/718: dread - d2/d14/d33/d37/d3b/d2a/d8e/fcb zero size 2024-09-18T12:51:26.337 INFO:tasks.workunit.client.0.smithi081.stdout:5/719: dread d2/dd/d5e/f40 [0,4194304] 0 2024-09-18T12:51:26.338 INFO:tasks.workunit.client.0.smithi081.stdout:5/720: rename d2/d14/d33/d37/d3b/f43 to d2/d14/d33/d37/d3b/d16/dd1/fe6 0 2024-09-18T12:51:26.339 INFO:tasks.workunit.client.0.smithi081.stdout:5/721: stat d2/c2f 0 2024-09-18T12:51:26.340 INFO:tasks.workunit.client.0.smithi081.stdout:5/722: creat d2/d14/d33/d37/d3b/d2a/fe7 x:0 0 0 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/723: mkdir d2/d14/d33/d37/d3b/d16/de8 0 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/724: dread - d2/d14/d1d/fba zero size 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/725: chown d2/f8d 1889 1 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/726: chown d2/d14/fb4 20670 1 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/727: write d2/d14/d33/d37/d3b/d2a/d8e/f99 [4505541,38364] 0 2024-09-18T12:51:26.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/728: write d2/d14/d33/d37/d3b/d6a/f71 [137199,81532] 0 2024-09-18T12:51:26.351 INFO:tasks.workunit.client.0.smithi081.stdout:7/618: dwrite d2/d14/d21/d62/da7/f50 [0,4194304] 0 2024-09-18T12:51:26.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/619: mknod d2/d18/d22/d48/db9/cd4 0 2024-09-18T12:51:26.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/620: write d2/d18/d22/d48/db9/fc3 [179190,17146] 0 2024-09-18T12:51:26.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/621: truncate d2/d18/d3c/f65 434721 0 2024-09-18T12:51:26.359 INFO:tasks.workunit.client.0.smithi081.stdout:5/729: dwrite d2/d14/d1d/d1a/f4a [0,4194304] 0 2024-09-18T12:51:26.360 INFO:tasks.workunit.client.0.smithi081.stdout:5/730: mkdir d2/d14/de9 0 2024-09-18T12:51:26.360 INFO:tasks.workunit.client.0.smithi081.stdout:5/731: chown d2/d14/d33/d37/d3b/d16/de8 222577449 1 2024-09-18T12:51:26.360 INFO:tasks.workunit.client.0.smithi081.stdout:5/732: write d2/d47/f8a [595193,16284] 0 2024-09-18T12:51:26.361 INFO:tasks.workunit.client.0.smithi081.stdout:5/733: symlink d2/d14/d33/d37/d3b/d5f/lea 0 2024-09-18T12:51:26.362 INFO:tasks.workunit.client.0.smithi081.stdout:5/734: creat d2/d14/d33/d37/d3b/feb x:0 0 0 2024-09-18T12:51:26.363 INFO:tasks.workunit.client.0.smithi081.stdout:5/735: rename d2/d14/d33/d37/d3b/d6a/f9b to d2/d14/d33/d37/d3b/fec 0 2024-09-18T12:51:26.364 INFO:tasks.workunit.client.0.smithi081.stdout:5/736: rename d2/d14/d1d/d1a/cc4 to d2/d14/d1d/ced 0 2024-09-18T12:51:26.364 INFO:tasks.workunit.client.0.smithi081.stdout:5/737: write d2/dd/d5e/f7a [951881,13482] 0 2024-09-18T12:51:26.372 INFO:tasks.workunit.client.0.smithi081.stdout:7/622: dwrite d2/d56/d73/d90/f93 [0,4194304] 0 2024-09-18T12:51:26.372 INFO:tasks.workunit.client.0.smithi081.stdout:7/623: truncate d2/d56/d73/da4/fba 735975 0 2024-09-18T12:51:26.372 INFO:tasks.workunit.client.0.smithi081.stdout:7/624: truncate d2/d18/d3c/fd1 551418 0 2024-09-18T12:51:26.378 INFO:tasks.workunit.client.0.smithi081.stdout:5/738: write d2/d14/d33/d37/f95 [1773636,22073] 0 2024-09-18T12:51:26.380 INFO:tasks.workunit.client.0.smithi081.stdout:5/739: creat d2/d14/de9/fee x:0 0 0 2024-09-18T12:51:26.380 INFO:tasks.workunit.client.0.smithi081.stdout:5/740: chown d2/d14/d1d/d1a/f81 162167 1 2024-09-18T12:51:26.380 INFO:tasks.workunit.client.0.smithi081.stdout:5/741: fdatasync d2/dd/f10 0 2024-09-18T12:51:26.381 INFO:tasks.workunit.client.0.smithi081.stdout:5/742: symlink d2/d14/lef 0 2024-09-18T12:51:26.390 INFO:tasks.workunit.client.0.smithi081.stdout:7/625: dwrite d2/d18/d22/d48/f75 [0,4194304] 0 2024-09-18T12:51:26.390 INFO:tasks.workunit.client.0.smithi081.stdout:7/626: truncate d2/d42/fa3 481666 0 2024-09-18T12:51:26.399 INFO:tasks.workunit.client.0.smithi081.stdout:5/743: dwrite d2/d14/d33/d37/d3b/d5f/fdb [0,4194304] 0 2024-09-18T12:51:26.407 INFO:tasks.workunit.client.0.smithi081.stdout:5/744: creat d2/d14/d33/d37/dc5/ff0 x:0 0 0 2024-09-18T12:51:26.408 INFO:tasks.workunit.client.0.smithi081.stdout:5/745: dread d2/d14/d33/d37/d3b/d2a/db0/fda [0,4194304] 0 2024-09-18T12:51:26.409 INFO:tasks.workunit.client.0.smithi081.stdout:5/746: chown d2/dd/d9e/fe2 501746755 1 2024-09-18T12:51:26.409 INFO:tasks.workunit.client.0.smithi081.stdout:5/747: creat d2/d47/ff1 x:0 0 0 2024-09-18T12:51:26.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/748: dread d2/d14/d33/d37/f50 [0,4194304] 0 2024-09-18T12:51:26.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/749: dread - d2/d14/d33/d37/d3b/d16/fd5 zero size 2024-09-18T12:51:26.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/750: write d2/d47/ff1 [433566,83058] 0 2024-09-18T12:51:26.418 INFO:tasks.workunit.client.0.smithi081.stdout:5/751: write d2/d14/d33/d37/d3b/d6a/f98 [750519,25534] 0 2024-09-18T12:51:26.418 INFO:tasks.workunit.client.0.smithi081.stdout:5/752: fsync d2/d14/d1d/d1a/fa0 0 2024-09-18T12:51:26.418 INFO:tasks.workunit.client.0.smithi081.stdout:5/753: symlink d2/d14/de9/lf2 0 2024-09-18T12:51:26.419 INFO:tasks.workunit.client.0.smithi081.stdout:5/754: mknod d2/d14/d33/d37/d3b/d5f/cf3 0 2024-09-18T12:51:26.419 INFO:tasks.workunit.client.0.smithi081.stdout:5/755: write d2/dd/f10 [3076983,62836] 0 2024-09-18T12:51:26.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/756: write d2/d47/d7f/f96 [3705623,86379] 0 2024-09-18T12:51:26.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/757: creat d2/d14/d33/d37/d3b/d6a/d20/ff4 x:0 0 0 2024-09-18T12:51:26.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/758: write d2/d14/fb4 [336354,116204] 0 2024-09-18T12:51:26.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/759: fsync d2/d14/de9/fee 0 2024-09-18T12:51:26.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/760: fsync d2/d14/d33/d37/d3b/d5f/f60 0 2024-09-18T12:51:26.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/761: creat d2/d14/d33/d37/d3b/d2a/d8e/ff5 x:0 0 0 2024-09-18T12:51:26.432 INFO:tasks.workunit.client.0.smithi081.stdout:5/762: link d2/d14/d1d/d1a/c5c d2/d14/d33/d37/d3b/d16/de8/cf6 0 2024-09-18T12:51:26.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/763: dread d2/d14/d1d/d1a/f2b [0,4194304] 0 2024-09-18T12:51:26.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/764: chown d2/d47/d7f/c9d 12347764 1 2024-09-18T12:51:26.479 INFO:tasks.workunit.client.0.smithi081.stdout:1/742: sync 2024-09-18T12:51:26.480 INFO:tasks.workunit.client.0.smithi081.stdout:4/669: sync 2024-09-18T12:51:26.490 INFO:tasks.workunit.client.0.smithi081.stdout:4/670: read d3/d20/f96 [3578662,607] 0 2024-09-18T12:51:26.499 INFO:tasks.workunit.client.0.smithi081.stdout:4/671: write d3/d20/d3d/d65/d14/f1e [4213688,113088] 0 2024-09-18T12:51:26.503 INFO:tasks.workunit.client.0.smithi081.stdout:4/672: link d3/d20/f96 d3/d20/d3d/d65/d45/da4/fd9 0 2024-09-18T12:51:26.503 INFO:tasks.workunit.client.0.smithi081.stdout:4/673: write d3/d20/d3d/d65/d14/d3e/f51 [690491,94149] 0 2024-09-18T12:51:26.503 INFO:tasks.workunit.client.0.smithi081.stdout:4/674: chown d3/d20/d3d/d65/d14/d3e/fce 185525 1 2024-09-18T12:51:26.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/675: dread d3/d20/d3d/d65/d2f/f8b [0,4194304] 0 2024-09-18T12:51:26.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/676: write d3/d20/d3d/d65/d14/d54/fcd [723010,122346] 0 2024-09-18T12:51:26.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/677: stat d3/d20/d3d/d65/d14/d4b/f74 0 2024-09-18T12:51:26.526 INFO:tasks.workunit.client.0.smithi081.stdout:4/678: dwrite d3/d20/d3d/d6b/fb7 [0,4194304] 0 2024-09-18T12:51:26.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/679: truncate d3/d20/d3d/d65/d45/f53 1126307 0 2024-09-18T12:51:26.544 INFO:tasks.workunit.client.0.smithi081.stdout:4/680: dwrite d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:26.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/681: symlink d3/d20/d3d/d65/d14/d4b/dc7/lda 0 2024-09-18T12:51:26.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/682: truncate d3/d20/d3d/fd0 74962 0 2024-09-18T12:51:26.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/683: truncate d3/db/d35/d79/f8e 921899 0 2024-09-18T12:51:26.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/684: dread - d3/d20/d5b/fc2 zero size 2024-09-18T12:51:26.546 INFO:tasks.workunit.client.0.smithi081.stdout:4/685: symlink d3/db/d35/d79/ldb 0 2024-09-18T12:51:26.550 INFO:tasks.workunit.client.0.smithi081.stdout:4/686: write d3/d20/d3d/d65/d45/d6c/fb9 [253366,106932] 0 2024-09-18T12:51:26.553 INFO:tasks.workunit.client.0.smithi081.stdout:4/687: rename d3/d20/d3d/d65/d14/d54/dd3/dc1/cd1 to d3/d20/d3d/d65/d14/d3e/cdc 0 2024-09-18T12:51:26.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/688: dread d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:26.565 INFO:tasks.workunit.client.0.smithi081.stdout:4/689: mkdir d3/d20/d3d/d65/d14/d54/dd3/d8d/d97/ddd 0 2024-09-18T12:51:26.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/690: mkdir d3/db/d58/d9f/dde 0 2024-09-18T12:51:26.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/691: chown d3/d20/d3d/d65/d14/d27/l72 22775 1 2024-09-18T12:51:26.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/692: readlink d3/db/d35/l38 0 2024-09-18T12:51:26.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/693: dwrite d3/d20/d3d/d65/fa5 [0,4194304] 0 2024-09-18T12:51:26.586 INFO:tasks.workunit.client.0.smithi081.stdout:4/694: mknod d3/d20/d3d/d65/d14/d4b/dc7/cdf 0 2024-09-18T12:51:26.587 INFO:tasks.workunit.client.0.smithi081.stdout:4/695: mkdir d3/d20/d3d/d65/d14/d3e/de0 0 2024-09-18T12:51:26.593 INFO:tasks.workunit.client.0.smithi081.stdout:4/696: write d3/d20/d3d/d65/d14/f29 [241162,49914] 0 2024-09-18T12:51:26.593 INFO:tasks.workunit.client.0.smithi081.stdout:4/697: chown d3/d20/d3d/f8f 351021 1 2024-09-18T12:51:26.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/698: rename d3/db/d58/c5c to d3/d20/d5b/ce1 0 2024-09-18T12:51:26.595 INFO:tasks.workunit.client.0.smithi081.stdout:4/699: truncate d3/d20/d3d/d65/d14/d27/fba 244593 0 2024-09-18T12:51:26.596 INFO:tasks.workunit.client.0.smithi081.stdout:4/700: mknod d3/d20/d3d/d65/d14/d3e/de0/ce2 0 2024-09-18T12:51:26.598 INFO:tasks.workunit.client.0.smithi081.stdout:4/701: unlink d3/db/d58/cb6 0 2024-09-18T12:51:26.601 INFO:tasks.workunit.client.0.smithi081.stdout:4/702: dread d3/db/d2d/f7f [0,4194304] 0 2024-09-18T12:51:26.607 INFO:tasks.workunit.client.0.smithi081.stdout:4/703: dread d3/d20/d3d/d65/d14/d54/fcd [0,4194304] 0 2024-09-18T12:51:26.841 INFO:tasks.workunit.client.0.smithi081.stdout:6/738: sync 2024-09-18T12:51:26.847 INFO:tasks.workunit.client.0.smithi081.stdout:6/739: dread d4/d12/f44 [0,4194304] 0 2024-09-18T12:51:26.849 INFO:tasks.workunit.client.0.smithi081.stdout:6/740: dread d4/d12/d1c/d64/f81 [0,4194304] 0 2024-09-18T12:51:26.849 INFO:tasks.workunit.client.0.smithi081.stdout:6/741: stat d4/d12/d56/da8 0 2024-09-18T12:51:26.849 INFO:tasks.workunit.client.0.smithi081.stdout:6/742: write d4/d12/d1c/f72 [853155,91888] 0 2024-09-18T12:51:26.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/743: mkdir d4/d6/d95/df3 0 2024-09-18T12:51:26.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/744: fsync d4/d12/d28/d2a/d74/d8b/fa1 0 2024-09-18T12:51:26.852 INFO:tasks.workunit.client.0.smithi081.stdout:6/745: link d4/d12/c37 d4/d12/d1c/d39/d60/cf4 0 2024-09-18T12:51:26.852 INFO:tasks.workunit.client.0.smithi081.stdout:6/746: creat d4/d12/d1c/d64/ff5 x:0 0 0 2024-09-18T12:51:26.868 INFO:tasks.workunit.client.0.smithi081.stdout:6/747: dwrite d4/d88/fcb [0,4194304] 0 2024-09-18T12:51:26.868 INFO:tasks.workunit.client.0.smithi081.stdout:6/748: chown d4/d12/d56/da8/fe3 464100186 1 2024-09-18T12:51:26.868 INFO:tasks.workunit.client.0.smithi081.stdout:6/749: stat d4/d12/d28/d2a/f45 0 2024-09-18T12:51:26.868 INFO:tasks.workunit.client.0.smithi081.stdout:6/750: fdatasync d4/d12/d28/d2a/fbe 0 2024-09-18T12:51:26.870 INFO:tasks.workunit.client.0.smithi081.stdout:6/751: mkdir d4/d12/d1c/d39/dd3/df6 0 2024-09-18T12:51:26.885 INFO:tasks.workunit.client.0.smithi081.stdout:6/752: dwrite d4/fc4 [0,4194304] 0 2024-09-18T12:51:26.904 INFO:tasks.workunit.client.0.smithi081.stdout:6/753: dwrite d4/d12/f44 [0,4194304] 0 2024-09-18T12:51:26.905 INFO:tasks.workunit.client.0.smithi081.stdout:6/754: write d4/d12/d1c/f57 [785757,65605] 0 2024-09-18T12:51:26.906 INFO:tasks.workunit.client.0.smithi081.stdout:6/755: symlink d4/d12/d56/da8/lf7 0 2024-09-18T12:51:26.906 INFO:tasks.workunit.client.0.smithi081.stdout:6/756: read d4/d6/f26 [2937711,38648] 0 2024-09-18T12:51:26.906 INFO:tasks.workunit.client.0.smithi081.stdout:6/757: write d4/d12/d28/fd5 [478185,125644] 0 2024-09-18T12:51:26.920 INFO:tasks.workunit.client.0.smithi081.stdout:6/758: dwrite d4/d12/d1c/d39/d60/f8c [0,4194304] 0 2024-09-18T12:51:26.935 INFO:tasks.workunit.client.0.smithi081.stdout:6/759: dwrite d4/d12/d56/d7d/d96/db7/fe2 [0,4194304] 0 2024-09-18T12:51:26.939 INFO:tasks.workunit.client.0.smithi081.stdout:6/760: mknod d4/d12/d28/d2a/d74/d8b/d6f/cf8 0 2024-09-18T12:51:26.940 INFO:tasks.workunit.client.0.smithi081.stdout:6/761: rmdir d4/d12/d28/d2a/d2d/d31 39 2024-09-18T12:51:26.941 INFO:tasks.workunit.client.0.smithi081.stdout:6/762: mknod d4/d12/d1c/d39/d60/d90/cf9 0 2024-09-18T12:51:26.944 INFO:tasks.workunit.client.0.smithi081.stdout:6/763: mknod d4/d12/d28/d2a/d97/ddc/cfa 0 2024-09-18T12:51:26.945 INFO:tasks.workunit.client.0.smithi081.stdout:6/764: mknod d4/d12/d56/d7d/d84/dec/dee/cfb 0 2024-09-18T12:51:26.947 INFO:tasks.workunit.client.0.smithi081.stdout:6/765: symlink d4/d12/d56/d7d/d84/dec/lfc 0 2024-09-18T12:51:26.949 INFO:tasks.workunit.client.0.smithi081.stdout:6/766: truncate d4/d12/f32 3912714 0 2024-09-18T12:51:26.953 INFO:tasks.workunit.client.0.smithi081.stdout:6/767: creat d4/d12/d56/ffd x:0 0 0 2024-09-18T12:51:26.962 INFO:tasks.workunit.client.0.smithi081.stdout:6/768: write f0 [10465331,38350] 0 2024-09-18T12:51:26.962 INFO:tasks.workunit.client.0.smithi081.stdout:6/769: chown d4/d12/d1c/d39/dd3 4 1 2024-09-18T12:51:26.962 INFO:tasks.workunit.client.0.smithi081.stdout:6/770: chown d4/d12/d1c/d39/d73/l83 258308 1 2024-09-18T12:51:26.963 INFO:tasks.workunit.client.0.smithi081.stdout:6/771: fdatasync d4/d12/d56/d7d/d84/fad 0 2024-09-18T12:51:27.017 INFO:tasks.workunit.client.0.smithi081.stdout:9/630: sync 2024-09-18T12:51:27.020 INFO:tasks.workunit.client.0.smithi081.stdout:9/631: write dd/d1d/d1e/d39/f3f [4227564,20111] 0 2024-09-18T12:51:27.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/632: link dd/cf dd/d1d/d1e/d24/d48/dc2/cca 0 2024-09-18T12:51:27.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/633: write dd/d15/d1a/d8d/f8e [720251,20589] 0 2024-09-18T12:51:27.038 INFO:tasks.workunit.client.0.smithi081.stdout:9/634: dwrite dd/d1d/d1e/d24/d48/f6c [0,4194304] 0 2024-09-18T12:51:27.038 INFO:tasks.workunit.client.0.smithi081.stdout:9/635: chown dd/d15/d1a/f22 1 1 2024-09-18T12:51:27.039 INFO:tasks.workunit.client.0.smithi081.stdout:9/636: creat dd/de/d4f/fcb x:0 0 0 2024-09-18T12:51:27.039 INFO:tasks.workunit.client.0.smithi081.stdout:9/637: write dd/de/f9b [368264,78983] 0 2024-09-18T12:51:27.039 INFO:tasks.workunit.client.0.smithi081.stdout:9/638: fsync dd/de/d59/f5e 0 2024-09-18T12:51:27.041 INFO:tasks.workunit.client.0.smithi081.stdout:9/639: mkdir dd/d1d/d1e/d2f/dc4/dcc 0 2024-09-18T12:51:27.041 INFO:tasks.workunit.client.0.smithi081.stdout:9/640: fdatasync f7 0 2024-09-18T12:51:27.049 INFO:tasks.workunit.client.0.smithi081.stdout:9/641: write dd/d31/f8b [3115813,66161] 0 2024-09-18T12:51:27.050 INFO:tasks.workunit.client.0.smithi081.stdout:9/642: rename dd/d1d/d1e to dd/d1d/d1e/d24/d2a/dcd 22 2024-09-18T12:51:27.052 INFO:tasks.workunit.client.0.smithi081.stdout:9/643: rename dd/d1d/d1e/d39 to dd/d15/d1a/da7/dce 0 2024-09-18T12:51:27.210 INFO:tasks.workunit.client.0.smithi081.stdout:2/888: sync 2024-09-18T12:51:27.210 INFO:tasks.workunit.client.0.smithi081.stdout:3/800: sync 2024-09-18T12:51:27.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/729: sync 2024-09-18T12:51:27.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/730: chown d3/d1d/d89/df5 97061 1 2024-09-18T12:51:27.211 INFO:tasks.workunit.client.0.smithi081.stdout:3/801: read - d3/db/df/d29/d13/d9d/d107/ff3 zero size 2024-09-18T12:51:27.211 INFO:tasks.workunit.client.0.smithi081.stdout:3/802: fdatasync d3/db/df/d3b/dc0/ff7 0 2024-09-18T12:51:27.212 INFO:tasks.workunit.client.0.smithi081.stdout:2/889: unlink d15/l69 0 2024-09-18T12:51:27.212 INFO:tasks.workunit.client.0.smithi081.stdout:2/890: truncate d15/d16/d33/d53/d7a/d2f/d61/fb4 4498035 0 2024-09-18T12:51:27.216 INFO:tasks.workunit.client.0.smithi081.stdout:3/803: mkdir d3/db/df/d29/d13/d93/d11d 0 2024-09-18T12:51:27.217 INFO:tasks.workunit.client.0.smithi081.stdout:2/891: symlink d15/d16/d33/d53/d7a/dee/d6d/da0/l139 0 2024-09-18T12:51:27.220 INFO:tasks.workunit.client.0.smithi081.stdout:2/892: rename d15/d16/d20/d59/fbc to d15/d16/d20/d59/f13a 0 2024-09-18T12:51:27.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/893: stat d15/d16/d20/d22/c39 0 2024-09-18T12:51:27.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/894: stat d15/d16/d20/c40 0 2024-09-18T12:51:27.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/627: sync 2024-09-18T12:51:27.231 INFO:tasks.workunit.client.0.smithi081.stdout:0/665: sync 2024-09-18T12:51:27.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/628: link d2/d14/d21/d62/da7/f50 d2/fd5 0 2024-09-18T12:51:27.253 INFO:tasks.workunit.client.0.smithi081.stdout:7/629: dwrite d2/d14/d21/d62/da7/f2e [0,4194304] 0 2024-09-18T12:51:27.273 INFO:tasks.workunit.client.0.smithi081.stdout:8/731: dwrite d3/d1e/f78 [0,4194304] 0 2024-09-18T12:51:27.273 INFO:tasks.workunit.client.0.smithi081.stdout:3/804: dwrite d3/db/f56 [0,4194304] 0 2024-09-18T12:51:27.275 INFO:tasks.workunit.client.0.smithi081.stdout:2/895: dwrite d15/d16/d33/d53/d7a/d2f/dc2/f7d [0,4194304] 0 2024-09-18T12:51:27.275 INFO:tasks.workunit.client.0.smithi081.stdout:0/666: dwrite d7/d9/d12/f39 [0,4194304] 0 2024-09-18T12:51:27.276 INFO:tasks.workunit.client.0.smithi081.stdout:8/732: rename d3/d1e/d4c/d53/lbb to d3/d1d/d4a/da9/lf9 0 2024-09-18T12:51:27.279 INFO:tasks.workunit.client.0.smithi081.stdout:2/896: mknod d15/d16/d33/d53/d7a/dee/c13b 0 2024-09-18T12:51:27.286 INFO:tasks.workunit.client.0.smithi081.stdout:3/805: read d3/db/d1b/fd1 [3123804,92171] 0 2024-09-18T12:51:27.286 INFO:tasks.workunit.client.0.smithi081.stdout:0/667: symlink d7/d9/d4b/d33/d7d/le3 0 2024-09-18T12:51:27.289 INFO:tasks.workunit.client.0.smithi081.stdout:2/897: mknod d15/df9/d10d/c13c 0 2024-09-18T12:51:27.289 INFO:tasks.workunit.client.0.smithi081.stdout:2/898: chown d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 6677 1 2024-09-18T12:51:27.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/806: rename d3/db/df/d29/d13/d93/df5 to d3/db/df/d29/d13/d9d/d11e 0 2024-09-18T12:51:27.291 INFO:tasks.workunit.client.0.smithi081.stdout:2/899: dread d15/d16/d20/d59/f77 [0,4194304] 0 2024-09-18T12:51:27.292 INFO:tasks.workunit.client.0.smithi081.stdout:2/900: mkdir d15/d16/d33/d53/d7a/d13d 0 2024-09-18T12:51:27.293 INFO:tasks.workunit.client.0.smithi081.stdout:2/901: dread d15/d16/ded/f105 [0,4194304] 0 2024-09-18T12:51:27.296 INFO:tasks.workunit.client.0.smithi081.stdout:2/902: rename l10 to d15/d16/d33/d53/l13e 0 2024-09-18T12:51:27.296 INFO:tasks.workunit.client.0.smithi081.stdout:2/903: chown d15/df9/d10d/d135/f42 58 1 2024-09-18T12:51:27.298 INFO:tasks.workunit.client.0.smithi081.stdout:2/904: symlink d15/d6e/l13f 0 2024-09-18T12:51:27.298 INFO:tasks.workunit.client.0.smithi081.stdout:0/668: read d7/d9/d4b/d33/d43/fbd [692318,31727] 0 2024-09-18T12:51:27.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/669: rename d7/d9/d12/l40 to d7/d9/d4b/d4a/d92/le4 0 2024-09-18T12:51:27.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/670: chown d7/d9/d4b/d33/db1 10 1 2024-09-18T12:51:27.304 INFO:tasks.workunit.client.0.smithi081.stdout:0/671: unlink d7/d9/d4b/d3d/ld3 0 2024-09-18T12:51:27.305 INFO:tasks.workunit.client.0.smithi081.stdout:0/672: truncate d7/d9/d4b/d4a/d77/fb0 1014876 0 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:5/765: sync 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:4/704: sync 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:6/772: sync 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:9/644: sync 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:9/645: chown fa 0 1 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:4/705: fsync d3/d20/d3d/d65/d45/f86 0 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:1/743: sync 2024-09-18T12:51:27.306 INFO:tasks.workunit.client.0.smithi081.stdout:5/766: write d2/d14/d33/d37/d3b/d2a/d8e/fa1 [545018,110547] 0 2024-09-18T12:51:27.308 INFO:tasks.workunit.client.0.smithi081.stdout:6/773: rename d4/d12/d1c/d39/f4a to d4/d12/d56/d7d/d91/ffe 0 2024-09-18T12:51:27.309 INFO:tasks.workunit.client.0.smithi081.stdout:9/646: symlink dd/de/lcf 0 2024-09-18T12:51:27.310 INFO:tasks.workunit.client.0.smithi081.stdout:4/706: creat d3/d20/d3d/fe3 x:0 0 0 2024-09-18T12:51:27.311 INFO:tasks.workunit.client.0.smithi081.stdout:9/647: getdents dd/d1d/d1e/d2f 0 2024-09-18T12:51:27.312 INFO:tasks.workunit.client.0.smithi081.stdout:1/744: rmdir d0/d6/d33/d42/d83 39 2024-09-18T12:51:27.313 INFO:tasks.workunit.client.0.smithi081.stdout:9/648: mknod dd/de/d7a/cd0 0 2024-09-18T12:51:27.314 INFO:tasks.workunit.client.0.smithi081.stdout:1/745: truncate d0/d18/f25 2078918 0 2024-09-18T12:51:27.315 INFO:tasks.workunit.client.0.smithi081.stdout:1/746: truncate d0/f7e 1613792 0 2024-09-18T12:51:27.315 INFO:tasks.workunit.client.0.smithi081.stdout:9/649: getdents dd/d15/d1a 0 2024-09-18T12:51:27.318 INFO:tasks.workunit.client.0.smithi081.stdout:5/767: write d2/d14/d33/d37/d3b/f13 [4148722,34296] 0 2024-09-18T12:51:27.325 INFO:tasks.workunit.client.0.smithi081.stdout:6/774: dread f1 [0,4194304] 0 2024-09-18T12:51:27.334 INFO:tasks.workunit.client.0.smithi081.stdout:6/775: dread d4/d6/fb [0,4194304] 0 2024-09-18T12:51:27.350 INFO:tasks.workunit.client.0.smithi081.stdout:2/905: dwrite d15/d16/d33/d53/d7a/d2f/dc2/fd2 [0,4194304] 0 2024-09-18T12:51:27.351 INFO:tasks.workunit.client.0.smithi081.stdout:2/906: chown d15/d16/d33/ce8 8718526 1 2024-09-18T12:51:27.352 INFO:tasks.workunit.client.0.smithi081.stdout:2/907: dread d15/d16/d20/d59/f77 [0,4194304] 0 2024-09-18T12:51:27.354 INFO:tasks.workunit.client.0.smithi081.stdout:1/747: dwrite d0/d6/d7/d2e/d51/fca [0,4194304] 0 2024-09-18T12:51:27.354 INFO:tasks.workunit.client.0.smithi081.stdout:1/748: fsync d0/db/f14 0 2024-09-18T12:51:27.355 INFO:tasks.workunit.client.0.smithi081.stdout:0/673: dwrite d7/d9/d12/dba/fd6 [0,4194304] 0 2024-09-18T12:51:27.356 INFO:tasks.workunit.client.0.smithi081.stdout:9/650: dwrite dd/de/d59/f5e [0,4194304] 0 2024-09-18T12:51:27.378 INFO:tasks.workunit.client.0.smithi081.stdout:0/674: dwrite d7/d9/d4b/d53/f8c [0,4194304] 0 2024-09-18T12:51:27.476 INFO:tasks.workunit.client.0.smithi081.stdout:5/768: mknod d2/cf7 0 2024-09-18T12:51:27.476 INFO:tasks.workunit.client.0.smithi081.stdout:5/769: chown d2/d14/d33/fe0 3 1 2024-09-18T12:51:27.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/776: unlink d4/d6/c68 0 2024-09-18T12:51:27.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/777: write d4/d6/fde [3627017,59493] 0 2024-09-18T12:51:27.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/778: truncate d4/d12/d56/d7d/fd7 937114 0 2024-09-18T12:51:27.478 INFO:tasks.workunit.client.0.smithi081.stdout:6/779: chown d4/d6/c1d 24174 1 2024-09-18T12:51:27.482 INFO:tasks.workunit.client.0.smithi081.stdout:2/908: rename d15/d16/d33/d53/d7a/dee/d6d/cc4 to d15/d16/d33/d53/d7a/d2f/d61/d97/c140 0 2024-09-18T12:51:27.482 INFO:tasks.workunit.client.0.smithi081.stdout:2/909: write d15/d16/d20/d22/f2a [532862,108145] 0 2024-09-18T12:51:27.492 INFO:tasks.workunit.client.0.smithi081.stdout:6/780: dread d4/d12/d28/d2a/d2d/d31/f7a [0,4194304] 0 2024-09-18T12:51:27.494 INFO:tasks.workunit.client.0.smithi081.stdout:9/651: mknod dd/d1d/d1e/d2f/dc4/dcc/cd1 0 2024-09-18T12:51:27.496 INFO:tasks.workunit.client.0.smithi081.stdout:0/675: mknod d7/d9/d4b/d53/ce5 0 2024-09-18T12:51:27.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/652: dread dd/d1d/d1e/d24/f67 [0,4194304] 0 2024-09-18T12:51:27.501 INFO:tasks.workunit.client.0.smithi081.stdout:9/653: truncate dd/d31/f8b 9098063 0 2024-09-18T12:51:27.502 INFO:tasks.workunit.client.0.smithi081.stdout:1/749: rename d0/db/d4f/dab/fc7 to d0/d18/df4/ff6 0 2024-09-18T12:51:27.502 INFO:tasks.workunit.client.0.smithi081.stdout:1/750: creat d0/d18/ff7 x:0 0 0 2024-09-18T12:51:27.505 INFO:tasks.workunit.client.0.smithi081.stdout:5/770: link d2/d14/d33/d37/d3b/d16/ccc d2/d14/d33/d37/d3b/d2a/cf8 0 2024-09-18T12:51:27.506 INFO:tasks.workunit.client.0.smithi081.stdout:9/654: symlink dd/de/d4f/ld2 0 2024-09-18T12:51:27.509 INFO:tasks.workunit.client.0.smithi081.stdout:6/781: rename d4/d12/c16 to d4/cff 0 2024-09-18T12:51:27.510 INFO:tasks.workunit.client.0.smithi081.stdout:5/771: mkdir d2/d14/d33/d37/d3b/d6a/df9 0 2024-09-18T12:51:27.512 INFO:tasks.workunit.client.0.smithi081.stdout:5/772: dread d2/d14/d33/d37/d3b/d6a/d20/f92 [0,4194304] 0 2024-09-18T12:51:27.512 INFO:tasks.workunit.client.0.smithi081.stdout:5/773: chown d2/d14/d33/d37/d3b/d2a/c6c 0 1 2024-09-18T12:51:27.512 INFO:tasks.workunit.client.0.smithi081.stdout:0/676: dread f0 [0,4194304] 0 2024-09-18T12:51:27.513 INFO:tasks.workunit.client.0.smithi081.stdout:0/677: creat d7/d9/fe6 x:0 0 0 2024-09-18T12:51:27.517 INFO:tasks.workunit.client.0.smithi081.stdout:1/751: dread d0/d6/d7/d2e/d51/fb6 [0,4194304] 0 2024-09-18T12:51:27.523 INFO:tasks.workunit.client.0.smithi081.stdout:6/782: creat d4/d12/d28/d2a/d98/dd8/de5/f100 x:0 0 0 2024-09-18T12:51:27.526 INFO:tasks.workunit.client.0.smithi081.stdout:2/910: dwrite d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 [0,4194304] 0 2024-09-18T12:51:27.529 INFO:tasks.workunit.client.0.smithi081.stdout:5/774: creat d2/d14/d33/d37/d3b/d16/de8/ffa x:0 0 0 2024-09-18T12:51:27.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/678: symlink d7/d5d/dd9/le7 0 2024-09-18T12:51:27.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/679: chown d7/d9/d4b/d33/d43 457738 1 2024-09-18T12:51:27.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/680: fdatasync d7/f67 0 2024-09-18T12:51:27.537 INFO:tasks.workunit.client.0.smithi081.stdout:6/783: rmdir d4/d12/d28 39 2024-09-18T12:51:27.547 INFO:tasks.workunit.client.0.smithi081.stdout:2/911: rmdir d15/d16/d33/d53/d7a/d2f/d110 39 2024-09-18T12:51:27.550 INFO:tasks.workunit.client.0.smithi081.stdout:6/784: dread d4/f18 [0,4194304] 0 2024-09-18T12:51:27.551 INFO:tasks.workunit.client.0.smithi081.stdout:5/775: dwrite d2/d14/d33/d37/d3b/d5f/f60 [0,4194304] 0 2024-09-18T12:51:27.551 INFO:tasks.workunit.client.0.smithi081.stdout:5/776: write d2/d14/d33/d37/d3b/d5f/f79 [1593067,91728] 0 2024-09-18T12:51:27.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/752: dwrite d0/dd7/de9/f7f [4194304,4194304] 0 2024-09-18T12:51:27.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/753: readlink d0/d6/d7/d2e/la6 0 2024-09-18T12:51:27.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/754: chown d0/dd7/d2d/d75/dc0/ca2 19 1 2024-09-18T12:51:27.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/655: dwrite dd/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:51:27.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/656: write dd/d31/d4a/f62 [4255006,111325] 0 2024-09-18T12:51:27.553 INFO:tasks.workunit.client.0.smithi081.stdout:9/657: truncate dd/d1d/d1e/d24/f82 1515335 0 2024-09-18T12:51:27.558 INFO:tasks.workunit.client.0.smithi081.stdout:0/681: truncate d7/d9/d4b/d4a/d77/f7e 523365 0 2024-09-18T12:51:27.561 INFO:tasks.workunit.client.0.smithi081.stdout:5/777: read d2/d14/f17 [1567573,10290] 0 2024-09-18T12:51:27.561 INFO:tasks.workunit.client.0.smithi081.stdout:5/778: write d2/d14/d33/f7e [4264311,49472] 0 2024-09-18T12:51:27.561 INFO:tasks.workunit.client.0.smithi081.stdout:5/779: creat d2/d14/d33/d37/d3b/d2a/db0/ffb x:0 0 0 2024-09-18T12:51:27.561 INFO:tasks.workunit.client.0.smithi081.stdout:5/780: creat d2/d14/d33/d37/d3b/d5f/ffc x:0 0 0 2024-09-18T12:51:27.570 INFO:tasks.workunit.client.0.smithi081.stdout:2/912: getdents d15/d16/d20/d107 0 2024-09-18T12:51:27.571 INFO:tasks.workunit.client.0.smithi081.stdout:6/785: getdents d4/d12/d56/d7d/d96/db7/de8 0 2024-09-18T12:51:27.575 INFO:tasks.workunit.client.0.smithi081.stdout:9/658: dwrite dd/de/d59/f5e [0,4194304] 0 2024-09-18T12:51:27.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/755: creat d0/dd7/d2d/d75/dc0/da0/d84/ff8 x:0 0 0 2024-09-18T12:51:27.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/756: chown d0/d6/d33/d37/d71/cf0 43495212 1 2024-09-18T12:51:27.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/757: dread - d0/d18/fe5 zero size 2024-09-18T12:51:27.588 INFO:tasks.workunit.client.0.smithi081.stdout:0/682: mkdir d7/d9/d4b/d4a/d77/de8 0 2024-09-18T12:51:27.593 INFO:tasks.workunit.client.0.smithi081.stdout:5/781: unlink d2/d14/de9/fee 0 2024-09-18T12:51:27.593 INFO:tasks.workunit.client.0.smithi081.stdout:5/782: fdatasync d2/d14/d33/d37/d3b/d5f/fca 0 2024-09-18T12:51:27.594 INFO:tasks.workunit.client.0.smithi081.stdout:9/659: dwrite dd/de/fa9 [0,4194304] 0 2024-09-18T12:51:27.594 INFO:tasks.workunit.client.0.smithi081.stdout:9/660: fsync dd/d15/d1a/da7/dce/f98 0 2024-09-18T12:51:27.594 INFO:tasks.workunit.client.0.smithi081.stdout:2/913: mknod d15/d16/d33/d53/d7a/d13d/c141 0 2024-09-18T12:51:27.595 INFO:tasks.workunit.client.0.smithi081.stdout:2/914: dread - d15/d16/d33/d53/d7a/d2f/d61/d97/fd7 zero size 2024-09-18T12:51:27.595 INFO:tasks.workunit.client.0.smithi081.stdout:7/630: sync 2024-09-18T12:51:27.595 INFO:tasks.workunit.client.0.smithi081.stdout:3/807: sync 2024-09-18T12:51:27.598 INFO:tasks.workunit.client.0.smithi081.stdout:0/683: creat d7/d9/d4b/d33/dc7/fe9 x:0 0 0 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/684: write d7/d9/d4b/d4a/f29 [5106384,121412] 0 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/685: fsync d7/d9/f3e 0 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/686: truncate d7/d9/d4b/d33/db1/fb9 4734157 0 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:4/707: sync 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:8/733: sync 2024-09-18T12:51:27.599 INFO:tasks.workunit.client.0.smithi081.stdout:4/708: dread - d3/d20/d3d/d65/d14/d3e/fce zero size 2024-09-18T12:51:27.601 INFO:tasks.workunit.client.0.smithi081.stdout:5/783: symlink d2/d14/d33/d37/lfd 0 2024-09-18T12:51:27.603 INFO:tasks.workunit.client.0.smithi081.stdout:7/631: dread d2/d56/d73/d90/f93 [0,4194304] 0 2024-09-18T12:51:27.607 INFO:tasks.workunit.client.0.smithi081.stdout:9/661: creat dd/d15/d1a/da7/fd3 x:0 0 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/915: getdents d15/d16 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/916: chown d15/d16/d20/d22/d5a/c85 4791115 1 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/917: write d15/d16/d33/d53/d7a/d2f/d61/d97/ddd/f118 [329429,4361] 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/918: truncate d15/d16/d33/d53/db0/f11c 3384395 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/919: readlink d15/d16/d20/d59/l8d 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/920: readlink d15/d16/d33/d53/d7a/d2f/l91 0 2024-09-18T12:51:27.609 INFO:tasks.workunit.client.0.smithi081.stdout:4/709: dread d3/db/fc [0,4194304] 0 2024-09-18T12:51:27.611 INFO:tasks.workunit.client.0.smithi081.stdout:3/808: truncate d3/db/df/d113/d44/d6f/f7c 3429403 0 2024-09-18T12:51:27.611 INFO:tasks.workunit.client.0.smithi081.stdout:3/809: creat d3/db/df/d29/f11f x:0 0 0 2024-09-18T12:51:27.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/687: truncate d7/d9/d4b/d33/d7d/faf 1627286 0 2024-09-18T12:51:27.617 INFO:tasks.workunit.client.0.smithi081.stdout:7/632: write d2/d18/f8c [679077,109202] 0 2024-09-18T12:51:27.620 INFO:tasks.workunit.client.0.smithi081.stdout:7/633: write d2/d14/d66/f69 [1961190,83477] 0 2024-09-18T12:51:27.620 INFO:tasks.workunit.client.0.smithi081.stdout:7/634: write d2/d42/f82 [437711,26760] 0 2024-09-18T12:51:27.620 INFO:tasks.workunit.client.0.smithi081.stdout:7/635: write d2/f11 [1497855,9107] 0 2024-09-18T12:51:27.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/921: creat d15/d16/d33/d53/d7a/dee/d6d/daf/f142 x:0 0 0 2024-09-18T12:51:27.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/922: fsync d15/d26/f29 0 2024-09-18T12:51:27.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/923: write d15/df9/d10d/d135/f10e [3828145,115764] 0 2024-09-18T12:51:27.621 INFO:tasks.workunit.client.0.smithi081.stdout:4/710: mkdir d3/d20/d3d/d65/d2f/de4 0 2024-09-18T12:51:27.621 INFO:tasks.workunit.client.0.smithi081.stdout:4/711: chown d3/d20/d3d/d65/d14 14423 1 2024-09-18T12:51:27.622 INFO:tasks.workunit.client.0.smithi081.stdout:3/810: symlink d3/db/d1b/l120 0 2024-09-18T12:51:27.625 INFO:tasks.workunit.client.0.smithi081.stdout:1/758: rename d0/dd7/d2d/d75 to d0/df9 0 2024-09-18T12:51:27.625 INFO:tasks.workunit.client.0.smithi081.stdout:1/759: fsync d0/d6/fd 0 2024-09-18T12:51:27.628 INFO:tasks.workunit.client.0.smithi081.stdout:0/688: creat d7/d9/d12/fea x:0 0 0 2024-09-18T12:51:27.630 INFO:tasks.workunit.client.0.smithi081.stdout:7/636: mknod d2/d1d/d4e/cd6 0 2024-09-18T12:51:27.633 INFO:tasks.workunit.client.0.smithi081.stdout:2/924: creat d15/d16/d20/d22/d120/d121/f143 x:0 0 0 2024-09-18T12:51:27.635 INFO:tasks.workunit.client.0.smithi081.stdout:4/712: creat d3/dbb/fe5 x:0 0 0 2024-09-18T12:51:27.635 INFO:tasks.workunit.client.0.smithi081.stdout:4/713: readlink l1 0 2024-09-18T12:51:27.636 INFO:tasks.workunit.client.0.smithi081.stdout:3/811: getdents d3/db/df/d60/d58 0 2024-09-18T12:51:27.636 INFO:tasks.workunit.client.0.smithi081.stdout:9/662: dwrite dd/d15/d1a/d35/daf/fb0 [0,4194304] 0 2024-09-18T12:51:27.637 INFO:tasks.workunit.client.0.smithi081.stdout:1/760: creat d0/d6/d7/d2e/ffa x:0 0 0 2024-09-18T12:51:27.640 INFO:tasks.workunit.client.0.smithi081.stdout:7/637: unlink d2/fe 0 2024-09-18T12:51:27.642 INFO:tasks.workunit.client.0.smithi081.stdout:4/714: mkdir d3/d20/d3d/d65/d45/dc4/de6 0 2024-09-18T12:51:27.642 INFO:tasks.workunit.client.0.smithi081.stdout:4/715: truncate d3/d20/d3d/d65/d14/d54/dd3/d8d/fa2 865606 0 2024-09-18T12:51:27.645 INFO:tasks.workunit.client.0.smithi081.stdout:3/812: mkdir d3/db/df/d113/dcc/d121 0 2024-09-18T12:51:27.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/663: creat dd/d15/d1a/d3d/fd4 x:0 0 0 2024-09-18T12:51:27.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/664: fdatasync dd/de/d4f/f65 0 2024-09-18T12:51:27.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/665: fsync dd/d1d/d91/fb4 0 2024-09-18T12:51:27.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/666: stat dd/d1d/d1e/d24/d48/cba 0 2024-09-18T12:51:27.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/689: dwrite d7/d9/f3e [4194304,4194304] 0 2024-09-18T12:51:27.653 INFO:tasks.workunit.client.0.smithi081.stdout:3/813: truncate d3/db/df/d60/d119/f8e 1362568 0 2024-09-18T12:51:27.653 INFO:tasks.workunit.client.0.smithi081.stdout:3/814: readlink d3/db/df/d113/l5d 0 2024-09-18T12:51:27.655 INFO:tasks.workunit.client.0.smithi081.stdout:1/761: getdents d0/db/d4f/d50 0 2024-09-18T12:51:27.655 INFO:tasks.workunit.client.0.smithi081.stdout:1/762: dread - d0/d6/d7/d2e/fb9 zero size 2024-09-18T12:51:27.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/690: mknod d7/d9/d4b/d4a/d77/ceb 0 2024-09-18T12:51:27.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/691: stat d7/d9/d4b/d4a/d77/de8 0 2024-09-18T12:51:27.661 INFO:tasks.workunit.client.0.smithi081.stdout:3/815: unlink d3/l6 0 2024-09-18T12:51:27.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/692: link d7/d9/d4b/c46 d7/d9/d4b/d33/db1/cec 0 2024-09-18T12:51:27.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/693: mknod d7/d9/d4b/d33/d43/d9a/ced 0 2024-09-18T12:51:27.664 INFO:tasks.workunit.client.0.smithi081.stdout:0/694: truncate d7/f67 761324 0 2024-09-18T12:51:27.666 INFO:tasks.workunit.client.0.smithi081.stdout:0/695: getdents d7/d5d 0 2024-09-18T12:51:27.669 INFO:tasks.workunit.client.0.smithi081.stdout:0/696: getdents d7/d9/d4b/d33/dc7 0 2024-09-18T12:51:27.669 INFO:tasks.workunit.client.0.smithi081.stdout:0/697: creat d7/d7c/fee x:0 0 0 2024-09-18T12:51:27.669 INFO:tasks.workunit.client.0.smithi081.stdout:0/698: fdatasync d7/d9/d4b/d4a/d77/fb0 0 2024-09-18T12:51:27.669 INFO:tasks.workunit.client.0.smithi081.stdout:7/638: dwrite d2/d18/d60/fad [4194304,4194304] 0 2024-09-18T12:51:27.673 INFO:tasks.workunit.client.0.smithi081.stdout:2/925: dwrite d15/df9/ff5 [0,4194304] 0 2024-09-18T12:51:27.674 INFO:tasks.workunit.client.0.smithi081.stdout:7/639: mkdir d2/d56/d73/d7c/dd7 0 2024-09-18T12:51:27.674 INFO:tasks.workunit.client.0.smithi081.stdout:7/640: write d2/d18/d3c/f65 [924819,9714] 0 2024-09-18T12:51:27.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/716: dwrite d3/d20/d3d/d65/f19 [0,4194304] 0 2024-09-18T12:51:27.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/717: write d3/d20/d3d/d65/d14/d27/f37 [1914990,112239] 0 2024-09-18T12:51:27.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/718: truncate d3/d20/d3d/d65/d14/d3e/fce 804998 0 2024-09-18T12:51:27.679 INFO:tasks.workunit.client.0.smithi081.stdout:3/816: dread d3/f46 [0,4194304] 0 2024-09-18T12:51:27.683 INFO:tasks.workunit.client.0.smithi081.stdout:3/817: rename d3/db/df/da8/c111 to d3/d84/d118/c122 0 2024-09-18T12:51:27.686 INFO:tasks.workunit.client.0.smithi081.stdout:9/667: dwrite dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:27.686 INFO:tasks.workunit.client.0.smithi081.stdout:2/926: dread d15/f84 [0,4194304] 0 2024-09-18T12:51:27.686 INFO:tasks.workunit.client.0.smithi081.stdout:1/763: dwrite d0/dd7/f22 [0,4194304] 0 2024-09-18T12:51:27.686 INFO:tasks.workunit.client.0.smithi081.stdout:1/764: chown d0/dd7/d55/l7c 207505 1 2024-09-18T12:51:27.686 INFO:tasks.workunit.client.0.smithi081.stdout:1/765: write d0/d6/d7/d8/fbb [955671,72333] 0 2024-09-18T12:51:27.689 INFO:tasks.workunit.client.0.smithi081.stdout:7/641: write d2/d14/d21/d62/da7/f50 [4119850,117602] 0 2024-09-18T12:51:27.689 INFO:tasks.workunit.client.0.smithi081.stdout:7/642: write d2/d18/d60/d85/fb2 [268794,94574] 0 2024-09-18T12:51:27.689 INFO:tasks.workunit.client.0.smithi081.stdout:7/643: write d2/d14/d21/d62/da7/f47 [1149817,66315] 0 2024-09-18T12:51:27.689 INFO:tasks.workunit.client.0.smithi081.stdout:7/644: chown d2/d18/d22/cc6 915351251 1 2024-09-18T12:51:27.689 INFO:tasks.workunit.client.0.smithi081.stdout:2/927: mknod d15/d16/d33/d53/d7a/dee/d6d/c144 0 2024-09-18T12:51:27.690 INFO:tasks.workunit.client.0.smithi081.stdout:2/928: write d15/f84 [968839,95335] 0 2024-09-18T12:51:27.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/699: write d7/d9/d4b/d4a/f1a [213629,21563] 0 2024-09-18T12:51:27.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/700: chown d7/d9/d4b/d3d 209 1 2024-09-18T12:51:27.692 INFO:tasks.workunit.client.0.smithi081.stdout:1/766: symlink d0/d6/d33/d42/d83/lfb 0 2024-09-18T12:51:27.698 INFO:tasks.workunit.client.0.smithi081.stdout:4/719: dwrite d3/d20/d3d/d65/d2f/fa0 [0,4194304] 0 2024-09-18T12:51:27.698 INFO:tasks.workunit.client.0.smithi081.stdout:4/720: read d3/d20/d3d/d65/d45/f81 [139428,22677] 0 2024-09-18T12:51:27.698 INFO:tasks.workunit.client.0.smithi081.stdout:4/721: creat d3/d20/d3d/d6b/fe7 x:0 0 0 2024-09-18T12:51:27.699 INFO:tasks.workunit.client.0.smithi081.stdout:4/722: write d3/d20/d3d/d65/d14/d3e/f51 [412850,42872] 0 2024-09-18T12:51:27.699 INFO:tasks.workunit.client.0.smithi081.stdout:4/723: fsync d3/d20/d3d/d65/d45/f86 0 2024-09-18T12:51:27.699 INFO:tasks.workunit.client.0.smithi081.stdout:4/724: chown d3/d20/d3d/d65/d2f/d8c/fbe 1 1 2024-09-18T12:51:27.699 INFO:tasks.workunit.client.0.smithi081.stdout:9/668: dread dd/d1d/f2e [0,4194304] 0 2024-09-18T12:51:27.699 INFO:tasks.workunit.client.0.smithi081.stdout:2/929: rename d15/d26/f72 to d15/d16/d20/d22/d120/d121/f145 0 2024-09-18T12:51:27.703 INFO:tasks.workunit.client.0.smithi081.stdout:1/767: write d0/dd7/d2d/fd6 [792255,32199] 0 2024-09-18T12:51:27.703 INFO:tasks.workunit.client.0.smithi081.stdout:1/768: fsync d0/d6/d33/d37/d98/d79/ff5 0 2024-09-18T12:51:27.703 INFO:tasks.workunit.client.0.smithi081.stdout:1/769: read - d0/d18/fe5 zero size 2024-09-18T12:51:27.705 INFO:tasks.workunit.client.0.smithi081.stdout:7/645: rmdir d2/d18/d60/daa 39 2024-09-18T12:51:27.709 INFO:tasks.workunit.client.0.smithi081.stdout:9/669: getdents dd/de/d4f/d8c 0 2024-09-18T12:51:27.709 INFO:tasks.workunit.client.0.smithi081.stdout:9/670: truncate dd/de/d4f/f66 659158 0 2024-09-18T12:51:27.710 INFO:tasks.workunit.client.0.smithi081.stdout:2/930: mkdir d15/d26/da8/d146 0 2024-09-18T12:51:27.711 INFO:tasks.workunit.client.0.smithi081.stdout:3/818: getdents d3/db/df/da8 0 2024-09-18T12:51:27.718 INFO:tasks.workunit.client.0.smithi081.stdout:1/770: creat d0/d6/d7/d8/ffc x:0 0 0 2024-09-18T12:51:27.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/931: mkdir d15/df9/d10d/d135/d147 0 2024-09-18T12:51:27.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/932: write d15/d16/d33/d53/d7a/dee/d6d/da0/ff6 [356889,115161] 0 2024-09-18T12:51:27.722 INFO:tasks.workunit.client.0.smithi081.stdout:2/933: write d15/d16/d20/d22/d5a/f74 [4458721,56117] 0 2024-09-18T12:51:27.722 INFO:tasks.workunit.client.0.smithi081.stdout:2/934: stat d15/d16/ded/f105 0 2024-09-18T12:51:27.722 INFO:tasks.workunit.client.0.smithi081.stdout:4/725: dwrite d3/d20/d3d/d65/f21 [0,4194304] 0 2024-09-18T12:51:27.723 INFO:tasks.workunit.client.0.smithi081.stdout:1/771: write d0/d6/d7/d8/f82 [758603,82225] 0 2024-09-18T12:51:27.723 INFO:tasks.workunit.client.0.smithi081.stdout:1/772: chown d0/db/d4f/dd2 18643 1 2024-09-18T12:51:27.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/773: write d0/d6/d33/d37/f94 [5122357,31146] 0 2024-09-18T12:51:27.724 INFO:tasks.workunit.client.0.smithi081.stdout:9/671: getdents dd/d1d/d1e/d24/d2a 0 2024-09-18T12:51:27.727 INFO:tasks.workunit.client.0.smithi081.stdout:7/646: dwrite d2/d14/f24 [4194304,4194304] 0 2024-09-18T12:51:27.728 INFO:tasks.workunit.client.0.smithi081.stdout:2/935: link d15/c35 d15/d6e/d7f/c148 0 2024-09-18T12:51:27.731 INFO:tasks.workunit.client.0.smithi081.stdout:4/726: mkdir d3/d20/d5b/dd8/de8 0 2024-09-18T12:51:27.731 INFO:tasks.workunit.client.0.smithi081.stdout:4/727: chown d3/db/fab 1631357 1 2024-09-18T12:51:27.731 INFO:tasks.workunit.client.0.smithi081.stdout:9/672: dread dd/de/f97 [0,4194304] 0 2024-09-18T12:51:27.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/936: symlink d15/d16/d33/d53/d7a/d2f/d110/d12d/l149 0 2024-09-18T12:51:27.742 INFO:tasks.workunit.client.0.smithi081.stdout:2/937: stat d15/d16/d33/d53/d7a/dee/fab 0 2024-09-18T12:51:27.743 INFO:tasks.workunit.client.0.smithi081.stdout:2/938: write d15/d16/d33/d53/d7a/dee/f3c [698605,31567] 0 2024-09-18T12:51:27.749 INFO:tasks.workunit.client.0.smithi081.stdout:2/939: dread d15/df9/d10d/d135/f5e [0,4194304] 0 2024-09-18T12:51:27.749 INFO:tasks.workunit.client.0.smithi081.stdout:0/701: dwrite d7/d9/d4b/f84 [0,4194304] 0 2024-09-18T12:51:27.751 INFO:tasks.workunit.client.0.smithi081.stdout:3/819: dwrite d3/db/df/d60/d58/d10d/f55 [0,4194304] 0 2024-09-18T12:51:27.752 INFO:tasks.workunit.client.0.smithi081.stdout:3/820: read d3/db/d1b/f94 [747551,93703] 0 2024-09-18T12:51:27.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/728: mknod d3/d20/d5b/ce9 0 2024-09-18T12:51:27.758 INFO:tasks.workunit.client.0.smithi081.stdout:1/774: dwrite d0/db/f39 [4194304,4194304] 0 2024-09-18T12:51:27.760 INFO:tasks.workunit.client.0.smithi081.stdout:7/647: getdents d2/d7f 0 2024-09-18T12:51:27.760 INFO:tasks.workunit.client.0.smithi081.stdout:9/673: unlink dd/d15/d1a/da7/dce/f3e 0 2024-09-18T12:51:27.764 INFO:tasks.workunit.client.0.smithi081.stdout:2/940: dread f7 [0,4194304] 0 2024-09-18T12:51:27.770 INFO:tasks.workunit.client.0.smithi081.stdout:7/648: truncate d2/d18/d22/f95 3120628 0 2024-09-18T12:51:27.771 INFO:tasks.workunit.client.0.smithi081.stdout:9/674: mkdir dd/d31/dd5 0 2024-09-18T12:51:27.773 INFO:tasks.workunit.client.0.smithi081.stdout:2/941: rename d15/d26/ff2 to d15/d16/d33/f14a 0 2024-09-18T12:51:27.774 INFO:tasks.workunit.client.0.smithi081.stdout:0/702: getdents d7/d9/d4b/d33/db1 0 2024-09-18T12:51:27.775 INFO:tasks.workunit.client.0.smithi081.stdout:0/703: write d7/d9/d4b/d33/d43/fbd [3554769,113016] 0 2024-09-18T12:51:27.775 INFO:tasks.workunit.client.0.smithi081.stdout:0/704: read d7/d9/f3e [2269559,16585] 0 2024-09-18T12:51:27.775 INFO:tasks.workunit.client.0.smithi081.stdout:0/705: fdatasync d7/d9/d4b/d4a/f16 0 2024-09-18T12:51:27.776 INFO:tasks.workunit.client.0.smithi081.stdout:3/821: mkdir d3/d123 0 2024-09-18T12:51:27.776 INFO:tasks.workunit.client.0.smithi081.stdout:3/822: chown d3/db/df/d3b/c112 0 1 2024-09-18T12:51:27.777 INFO:tasks.workunit.client.0.smithi081.stdout:7/649: mkdir d2/d14/d66/dd8 0 2024-09-18T12:51:27.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/729: dwrite d3/d20/d3d/d65/fa5 [4194304,4194304] 0 2024-09-18T12:51:27.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/730: read - d3/d20/d3d/d65/d45/d4f/fb1 zero size 2024-09-18T12:51:27.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/675: unlink dd/d1d/d1e/d24/d2a/d55/l61 0 2024-09-18T12:51:27.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/676: creat dd/d15/d1a/da7/fd6 x:0 0 0 2024-09-18T12:51:27.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/942: symlink d15/d6e/d7f/l14b 0 2024-09-18T12:51:27.781 INFO:tasks.workunit.client.0.smithi081.stdout:1/775: dwrite d0/d6/d7/d2e/ffa [0,4194304] 0 2024-09-18T12:51:27.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/731: dread d3/d20/d3d/d65/d14/d54/dd3/d8d/fa2 [0,4194304] 0 2024-09-18T12:51:27.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/732: chown d3/d20/d3d/d65/d2f/c56 1 1 2024-09-18T12:51:27.783 INFO:tasks.workunit.client.0.smithi081.stdout:3/823: unlink d3/db/df/d29/f100 0 2024-09-18T12:51:27.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/650: unlink d2/d1d/cb3 0 2024-09-18T12:51:27.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/651: write d2/f34 [3871378,66772] 0 2024-09-18T12:51:27.789 INFO:tasks.workunit.client.0.smithi081.stdout:9/677: creat dd/d1d/fd7 x:0 0 0 2024-09-18T12:51:27.791 INFO:tasks.workunit.client.0.smithi081.stdout:2/943: link d15/d16/d33/d53/d7a/c4e d15/d16/d33/d53/d7a/d2f/d61/c14c 0 2024-09-18T12:51:27.791 INFO:tasks.workunit.client.0.smithi081.stdout:0/706: dwrite d7/d9/d4b/d33/d7d/f88 [0,4194304] 0 2024-09-18T12:51:27.794 INFO:tasks.workunit.client.0.smithi081.stdout:1/776: mknod d0/d18/cfd 0 2024-09-18T12:51:27.795 INFO:tasks.workunit.client.0.smithi081.stdout:1/777: write d0/d6/d7/d2e/d51/fca [4732424,61834] 0 2024-09-18T12:51:27.795 INFO:tasks.workunit.client.0.smithi081.stdout:1/778: truncate d0/d6/d7/d8/ffc 547676 0 2024-09-18T12:51:27.796 INFO:tasks.workunit.client.0.smithi081.stdout:4/733: mknod d3/d20/d3d/d65/d14/d54/dd3/dc1/cea 0 2024-09-18T12:51:27.796 INFO:tasks.workunit.client.0.smithi081.stdout:4/734: truncate d3/d20/d3d/fe3 498915 0 2024-09-18T12:51:27.797 INFO:tasks.workunit.client.0.smithi081.stdout:3/824: symlink d3/db/df/d29/d13/d9d/dd4/l124 0 2024-09-18T12:51:27.798 INFO:tasks.workunit.client.0.smithi081.stdout:3/825: stat d3/db/df/d29/d13/d9d/d107/c77 0 2024-09-18T12:51:27.802 INFO:tasks.workunit.client.0.smithi081.stdout:9/678: symlink dd/d15/ld8 0 2024-09-18T12:51:27.802 INFO:tasks.workunit.client.0.smithi081.stdout:9/679: chown dd/d1d/d1e/d77/c7e 279162701 1 2024-09-18T12:51:27.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/944: write d15/d16/d33/d53/db0/f11c [462248,48702] 0 2024-09-18T12:51:27.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/707: mkdir d7/d9/d4b/d33/d7d/def 0 2024-09-18T12:51:27.809 INFO:tasks.workunit.client.0.smithi081.stdout:0/708: dread d7/d9/f90 [0,4194304] 0 2024-09-18T12:51:27.810 INFO:tasks.workunit.client.0.smithi081.stdout:1/779: dwrite d0/d6/d33/d42/f5b [0,4194304] 0 2024-09-18T12:51:27.810 INFO:tasks.workunit.client.0.smithi081.stdout:4/735: link d3/db/la6 d3/d20/d3d/d65/d14/d4b/dc7/leb 0 2024-09-18T12:51:27.812 INFO:tasks.workunit.client.0.smithi081.stdout:3/826: write d3/d84/fe8 [4577704,33355] 0 2024-09-18T12:51:27.814 INFO:tasks.workunit.client.0.smithi081.stdout:7/652: link d2/d1d/d4e/d84/fb1 d2/d18/fd9 0 2024-09-18T12:51:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:2/945: rename d15/d16/d20/d59/fc8 to d15/d6e/f14d 0 2024-09-18T12:51:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:2/946: stat d15/d16 0 2024-09-18T12:51:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:9/680: dwrite dd/d1d/fd7 [0,4194304] 0 2024-09-18T12:51:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:9/681: write dd/d1d/d1e/d24/d2a/f88 [1037488,23974] 0 2024-09-18T12:51:27.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/709: mknod d7/d9/d4b/d53/cf0 0 2024-09-18T12:51:27.820 INFO:tasks.workunit.client.0.smithi081.stdout:0/710: readlink d7/d9/d4b/d33/l4e 0 2024-09-18T12:51:27.824 INFO:tasks.workunit.client.0.smithi081.stdout:1/780: link d0/d6/d7/d2e/fc2 d0/df9/ffe 0 2024-09-18T12:51:27.826 INFO:tasks.workunit.client.0.smithi081.stdout:4/736: mkdir d3/d20/d3d/d65/d45/d6c/dec 0 2024-09-18T12:51:27.826 INFO:tasks.workunit.client.0.smithi081.stdout:4/737: truncate d3/d20/d3d/d65/d14/d54/fac 841989 0 2024-09-18T12:51:27.826 INFO:tasks.workunit.client.0.smithi081.stdout:4/738: fdatasync d3/dbb/fe5 0 2024-09-18T12:51:27.827 INFO:tasks.workunit.client.0.smithi081.stdout:3/827: mknod d3/db/df/d29/d13/d9d/dd4/c125 0 2024-09-18T12:51:27.828 INFO:tasks.workunit.client.0.smithi081.stdout:7/653: mknod d2/d14/d21/d49/cda 0 2024-09-18T12:51:27.830 INFO:tasks.workunit.client.0.smithi081.stdout:2/947: mkdir d15/d16/d33/d53/d7a/d2f/dfd/d14e 0 2024-09-18T12:51:27.833 INFO:tasks.workunit.client.0.smithi081.stdout:9/682: creat dd/d15/db1/fd9 x:0 0 0 2024-09-18T12:51:27.835 INFO:tasks.workunit.client.0.smithi081.stdout:0/711: rename d7/d9/d12/dba/fd0 to d7/d9/d4b/ff1 0 2024-09-18T12:51:27.839 INFO:tasks.workunit.client.0.smithi081.stdout:2/948: write d15/d16/d54/fc6 [2434099,20262] 0 2024-09-18T12:51:27.843 INFO:tasks.workunit.client.0.smithi081.stdout:1/781: creat d0/d6/d7/d2e/d51/d2c/d9f/fff x:0 0 0 2024-09-18T12:51:27.843 INFO:tasks.workunit.client.0.smithi081.stdout:1/782: write d0/db/d4f/d50/faf [289055,84713] 0 2024-09-18T12:51:27.845 INFO:tasks.workunit.client.0.smithi081.stdout:4/739: mkdir d3/d20/d5b/dd8/ded 0 2024-09-18T12:51:27.845 INFO:tasks.workunit.client.0.smithi081.stdout:4/740: readlink d3/d20/d3d/d6b/lc0 0 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/828: creat d3/db/df/d29/d13/d9d/d11e/f126 x:0 0 0 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/829: fdatasync d3/db/df/fc6 0 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/830: write d3/db/df/d29/d13/d9d/d107/f73 [398640,130004] 0 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/831: dread - d3/db/df/d29/f48 zero size 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/832: chown d3/db/df/d113/d44/df2/lfd 12 1 2024-09-18T12:51:27.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/833: creat d3/db/df/f127 x:0 0 0 2024-09-18T12:51:27.849 INFO:tasks.workunit.client.0.smithi081.stdout:0/712: dwrite d7/d9/fde [0,4194304] 0 2024-09-18T12:51:27.851 INFO:tasks.workunit.client.0.smithi081.stdout:3/834: write d3/db/df/d60/d119/f8e [1220454,20399] 0 2024-09-18T12:51:27.851 INFO:tasks.workunit.client.0.smithi081.stdout:7/654: unlink d2/f34 0 2024-09-18T12:51:27.853 INFO:tasks.workunit.client.0.smithi081.stdout:9/683: mkdir dd/d15/d1a/d8d/dda 0 2024-09-18T12:51:27.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/949: mknod d15/d16/d33/d53/db0/c14f 0 2024-09-18T12:51:27.860 INFO:tasks.workunit.client.0.smithi081.stdout:1/783: link d0/d6/d33/d37/c58 d0/d6/d7/d2e/d4e/c100 0 2024-09-18T12:51:27.860 INFO:tasks.workunit.client.0.smithi081.stdout:1/784: write d0/db/fba [4634645,111641] 0 2024-09-18T12:51:27.867 INFO:tasks.workunit.client.0.smithi081.stdout:0/713: creat d7/d5d/dd9/ff2 x:0 0 0 2024-09-18T12:51:27.867 INFO:tasks.workunit.client.0.smithi081.stdout:0/714: creat d7/d9/d4b/d33/d43/d9a/ff3 x:0 0 0 2024-09-18T12:51:27.867 INFO:tasks.workunit.client.0.smithi081.stdout:0/715: creat d7/d9/d4b/d33/ff4 x:0 0 0 2024-09-18T12:51:27.868 INFO:tasks.workunit.client.0.smithi081.stdout:7/655: symlink d2/d56/d73/d7c/dd7/ldb 0 2024-09-18T12:51:27.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/684: mkdir dd/d15/d1a/d35/ddb 0 2024-09-18T12:51:27.870 INFO:tasks.workunit.client.0.smithi081.stdout:4/741: dwrite d3/d20/d3d/d65/d14/f88 [0,4194304] 0 2024-09-18T12:51:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/835: dwrite d3/db/df/d29/d13/f4c [4194304,4194304] 0 2024-09-18T12:51:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/836: chown d3/db/df/da8/lbd 433949 1 2024-09-18T12:51:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/837: stat d3/db/df/d113/f92 0 2024-09-18T12:51:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:2/950: dwrite d15/d6e/d7f/ffb [0,4194304] 0 2024-09-18T12:51:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:2/951: fdatasync d15/d16/d20/d59/f77 0 2024-09-18T12:51:27.878 INFO:tasks.workunit.client.0.smithi081.stdout:7/656: mkdir d2/d18/d60/d85/ddc 0 2024-09-18T12:51:27.886 INFO:tasks.workunit.client.0.smithi081.stdout:9/685: symlink dd/d15/d1a/d8d/ldc 0 2024-09-18T12:51:27.886 INFO:tasks.workunit.client.0.smithi081.stdout:2/952: write d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 [794496,37344] 0 2024-09-18T12:51:27.888 INFO:tasks.workunit.client.0.smithi081.stdout:4/742: unlink d3/d20/d3d/d65/d45/d6c/l77 0 2024-09-18T12:51:27.898 INFO:tasks.workunit.client.0.smithi081.stdout:0/716: dwrite d7/d9/d4b/d4a/f1a [0,4194304] 0 2024-09-18T12:51:27.898 INFO:tasks.workunit.client.0.smithi081.stdout:1/785: dwrite d0/d6/d7/d2e/d51/fb6 [0,4194304] 0 2024-09-18T12:51:27.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/786: fdatasync d0/db/d4f/fea 0 2024-09-18T12:51:27.909 INFO:tasks.workunit.client.0.smithi081.stdout:3/838: write d3/db/df/d113/d44/d6f/f7c [23815,118929] 0 2024-09-18T12:51:27.912 INFO:tasks.workunit.client.0.smithi081.stdout:7/657: mknod d2/d56/d73/d7c/cdd 0 2024-09-18T12:51:27.914 INFO:tasks.workunit.client.0.smithi081.stdout:9/686: mkdir dd/d15/d1a/da7/dce/ddd 0 2024-09-18T12:51:27.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/953: truncate d15/d16/d33/d53/d7a/dee/d6d/da0/fcc 4192574 0 2024-09-18T12:51:27.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/954: write d15/d16/def/f12e [179768,68680] 0 2024-09-18T12:51:27.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/955: chown d15/d16/d33/d53/cb8 146 1 2024-09-18T12:51:27.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/743: creat d3/d20/d3d/d65/d14/d54/dd3/fee x:0 0 0 2024-09-18T12:51:27.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/744: chown d3/db/d35/d79/f92 1 1 2024-09-18T12:51:27.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/717: creat d7/d9/d4b/d33/db1/ff5 x:0 0 0 2024-09-18T12:51:27.924 INFO:tasks.workunit.client.0.smithi081.stdout:1/787: mkdir d0/d18/db7/d101 0 2024-09-18T12:51:27.926 INFO:tasks.workunit.client.0.smithi081.stdout:7/658: creat d2/d56/d73/d7c/d86/da6/fde x:0 0 0 2024-09-18T12:51:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/687: fsync dd/d1d/d1e/d24/d2a/f2c 0 2024-09-18T12:51:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/688: readlink dd/d15/d1a/d35/l60 0 2024-09-18T12:51:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/689: chown dd 5 1 2024-09-18T12:51:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/690: write dd/de/d4f/f65 [1106256,115725] 0 2024-09-18T12:51:27.929 INFO:tasks.workunit.client.0.smithi081.stdout:2/956: unlink d15/c35 0 2024-09-18T12:51:27.930 INFO:tasks.workunit.client.0.smithi081.stdout:0/718: getdents d7/d9/d4b 0 2024-09-18T12:51:27.931 INFO:tasks.workunit.client.0.smithi081.stdout:1/788: mknod d0/d18/df4/c102 0 2024-09-18T12:51:27.934 INFO:tasks.workunit.client.0.smithi081.stdout:9/691: symlink dd/d15/d1a/d3d/lde 0 2024-09-18T12:51:27.934 INFO:tasks.workunit.client.0.smithi081.stdout:3/839: dwrite f1 [4194304,4194304] 0 2024-09-18T12:51:27.934 INFO:tasks.workunit.client.0.smithi081.stdout:3/840: fdatasync d3/d84/d118/fa3 0 2024-09-18T12:51:27.940 INFO:tasks.workunit.client.0.smithi081.stdout:1/789: creat d0/db/d32/f103 x:0 0 0 2024-09-18T12:51:27.940 INFO:tasks.workunit.client.0.smithi081.stdout:1/790: fsync d0/db/d4f/dab/fcd 0 2024-09-18T12:51:27.942 INFO:tasks.workunit.client.0.smithi081.stdout:2/957: dread d15/d16/d33/d53/d7a/d2f/d61/f80 [0,4194304] 0 2024-09-18T12:51:27.945 INFO:tasks.workunit.client.0.smithi081.stdout:9/692: link dd/de/d4f/f65 dd/de/d4f/d8c/d94/fdf 0 2024-09-18T12:51:27.946 INFO:tasks.workunit.client.0.smithi081.stdout:9/693: fdatasync dd/d1b/f34 0 2024-09-18T12:51:27.946 INFO:tasks.workunit.client.0.smithi081.stdout:7/659: dread d2/d1d/f2c [0,4194304] 0 2024-09-18T12:51:27.946 INFO:tasks.workunit.client.0.smithi081.stdout:9/694: read - dd/d15/d1a/d3d/fd4 zero size 2024-09-18T12:51:27.946 INFO:tasks.workunit.client.0.smithi081.stdout:1/791: symlink d0/d18/db7/l104 0 2024-09-18T12:51:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:7/660: rename d2/d14/d21/fc4 to d2/d56/d73/d7c/fdf 0 2024-09-18T12:51:27.949 INFO:tasks.workunit.client.0.smithi081.stdout:8/734: sync 2024-09-18T12:51:27.950 INFO:tasks.workunit.client.0.smithi081.stdout:5/784: sync 2024-09-18T12:51:27.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/786: sync 2024-09-18T12:51:27.951 INFO:tasks.workunit.client.0.smithi081.stdout:5/785: write d2/d14/d33/d37/d3b/d16/f69 [575797,80815] 0 2024-09-18T12:51:27.951 INFO:tasks.workunit.client.0.smithi081.stdout:5/786: fdatasync d2/d14/d33/d37/d3b/d5f/fb5 0 2024-09-18T12:51:27.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/735: getdents d3/d1d/d89/db5/db8 0 2024-09-18T12:51:27.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/736: chown d3/d1e/f2b 700 1 2024-09-18T12:51:27.955 INFO:tasks.workunit.client.0.smithi081.stdout:8/737: truncate d3/f6c 1601618 0 2024-09-18T12:51:27.958 INFO:tasks.workunit.client.0.smithi081.stdout:8/738: rmdir d3/d1d/d4a/d7f/df7 0 2024-09-18T12:51:27.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/739: unlink d3/d1e/d4c/d68/fea 0 2024-09-18T12:51:27.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/740: mknod d3/d1e/d4c/dae/cfa 0 2024-09-18T12:51:27.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/741: readlink d3/d1e/d4c/l9a 0 2024-09-18T12:51:27.963 INFO:tasks.workunit.client.0.smithi081.stdout:3/841: dwrite d3/db/df/fc6 [4194304,4194304] 0 2024-09-18T12:51:27.968 INFO:tasks.workunit.client.0.smithi081.stdout:7/661: dread d2/d14/f24 [4194304,4194304] 0 2024-09-18T12:51:27.969 INFO:tasks.workunit.client.0.smithi081.stdout:8/742: truncate d3/d1d/d4a/d7f/f84 1614391 0 2024-09-18T12:51:27.970 INFO:tasks.workunit.client.0.smithi081.stdout:7/662: symlink d2/d56/dc8/le0 0 2024-09-18T12:51:27.970 INFO:tasks.workunit.client.0.smithi081.stdout:7/663: readlink d2/d42/l5a 0 2024-09-18T12:51:27.973 INFO:tasks.workunit.client.0.smithi081.stdout:7/664: truncate d2/d14/f2f 822949 0 2024-09-18T12:51:27.975 INFO:tasks.workunit.client.0.smithi081.stdout:7/665: mknod d2/d56/d73/da4/ce1 0 2024-09-18T12:51:27.975 INFO:tasks.workunit.client.0.smithi081.stdout:0/719: dwrite d7/d5d/dd9/ff2 [0,4194304] 0 2024-09-18T12:51:27.976 INFO:tasks.workunit.client.0.smithi081.stdout:7/666: truncate d2/d18/d3c/f7a 3048382 0 2024-09-18T12:51:27.979 INFO:tasks.workunit.client.0.smithi081.stdout:0/720: symlink d7/d9/d4b/d4a/lf6 0 2024-09-18T12:51:27.979 INFO:tasks.workunit.client.0.smithi081.stdout:0/721: getdents d7/d9/d4b 0 2024-09-18T12:51:27.979 INFO:tasks.workunit.client.0.smithi081.stdout:0/722: chown d7/d9/d4b/d4a/c17 581 1 2024-09-18T12:51:27.981 INFO:tasks.workunit.client.0.smithi081.stdout:0/723: rename d7/d9/d4b/d33/dc7 to d7/d9/d12/df7 0 2024-09-18T12:51:27.988 INFO:tasks.workunit.client.0.smithi081.stdout:1/792: dwrite d0/d6/d33/d42/d83/fc1 [0,4194304] 0 2024-09-18T12:51:27.989 INFO:tasks.workunit.client.0.smithi081.stdout:1/793: fdatasync d0/d6/d7/d2e/d4e/f89 0 2024-09-18T12:51:27.989 INFO:tasks.workunit.client.0.smithi081.stdout:1/794: write d0/db/d4f/d50/faf [1308608,26372] 0 2024-09-18T12:51:27.997 INFO:tasks.workunit.client.0.smithi081.stdout:5/787: dwrite d2/d14/d1d/da4/fa9 [4194304,4194304] 0 2024-09-18T12:51:27.998 INFO:tasks.workunit.client.0.smithi081.stdout:5/788: write d2/d14/d33/d37/d3b/d2a/fa8 [920823,92568] 0 2024-09-18T12:51:27.998 INFO:tasks.workunit.client.0.smithi081.stdout:0/724: read d7/d9/d4b/d4a/f8a [379081,105244] 0 2024-09-18T12:51:27.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/743: dwrite d3/d1e/d4c/d53/f74 [0,4194304] 0 2024-09-18T12:51:27.999 INFO:tasks.workunit.client.0.smithi081.stdout:8/744: stat d3/d1d/d4a/d7f 0 2024-09-18T12:51:27.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/695: dwrite dd/d31/fc0 [0,4194304] 0 2024-09-18T12:51:28.000 INFO:tasks.workunit.client.0.smithi081.stdout:2/958: dwrite d15/d16/d20/d22/f34 [4194304,4194304] 0 2024-09-18T12:51:28.000 INFO:tasks.workunit.client.0.smithi081.stdout:0/725: unlink d7/d9/d4b/f9d 0 2024-09-18T12:51:28.001 INFO:tasks.workunit.client.0.smithi081.stdout:0/726: dread - d7/d7c/fee zero size 2024-09-18T12:51:28.001 INFO:tasks.workunit.client.0.smithi081.stdout:0/727: fdatasync d7/d9/d4b/d4a/fce 0 2024-09-18T12:51:28.003 INFO:tasks.workunit.client.0.smithi081.stdout:8/745: rename d3/dc9/lf2 to d3/d73/lfb 0 2024-09-18T12:51:28.003 INFO:tasks.workunit.client.0.smithi081.stdout:8/746: dread - d3/d1d/d4a/fa3 zero size 2024-09-18T12:51:28.003 INFO:tasks.workunit.client.0.smithi081.stdout:8/747: write d3/d1d/d4a/d8d/f8f [336829,22998] 0 2024-09-18T12:51:28.007 INFO:tasks.workunit.client.0.smithi081.stdout:3/842: dwrite d3/db/f4b [0,4194304] 0 2024-09-18T12:51:28.007 INFO:tasks.workunit.client.0.smithi081.stdout:3/843: write d3/db/df/d113/f92 [2247696,32467] 0 2024-09-18T12:51:28.013 INFO:tasks.workunit.client.0.smithi081.stdout:8/748: link d3/d1d/d4a/d7f/f88 d3/d1d/d9f/dcf/ffc 0 2024-09-18T12:51:28.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/789: read d2/d14/d33/d37/d3b/d2a/d8e/f99 [3572039,30954] 0 2024-09-18T12:51:28.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/790: stat d2/d14/d33/d37/d3b/d6a/l93 0 2024-09-18T12:51:28.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/795: dwrite d0/d6/d7/d2e/fc2 [0,4194304] 0 2024-09-18T12:51:28.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/796: readlink d0/d6/d7/d2e/l3c 0 2024-09-18T12:51:28.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/797: stat d0/dd7/d55/c62 0 2024-09-18T12:51:28.021 INFO:tasks.workunit.client.0.smithi081.stdout:9/696: mkdir dd/d1d/d1e/d24/de0 0 2024-09-18T12:51:28.025 INFO:tasks.workunit.client.0.smithi081.stdout:5/791: symlink d2/d14/d33/d37/d3b/d16/dbb/lfe 0 2024-09-18T12:51:28.026 INFO:tasks.workunit.client.0.smithi081.stdout:5/792: chown d2/f8d 6228942 1 2024-09-18T12:51:28.026 INFO:tasks.workunit.client.0.smithi081.stdout:5/793: write d2/d14/d33/d37/d3b/d2a/db0/fda [846055,127648] 0 2024-09-18T12:51:28.026 INFO:tasks.workunit.client.0.smithi081.stdout:5/794: chown d2/d14/d33/d37/d3b/d6a/d20/c26 85234845 1 2024-09-18T12:51:28.031 INFO:tasks.workunit.client.0.smithi081.stdout:1/798: creat d0/d18/d1a/dd3/f105 x:0 0 0 2024-09-18T12:51:28.033 INFO:tasks.workunit.client.0.smithi081.stdout:9/697: creat dd/de/fe1 x:0 0 0 2024-09-18T12:51:28.035 INFO:tasks.workunit.client.0.smithi081.stdout:9/698: write dd/d15/d1a/d35/f53 [1144046,41487] 0 2024-09-18T12:51:28.035 INFO:tasks.workunit.client.0.smithi081.stdout:9/699: truncate dd/d15/d1a/d8d/f8e 1388029 0 2024-09-18T12:51:28.036 INFO:tasks.workunit.client.0.smithi081.stdout:5/795: link d2/d14/d33/d37/d3b/d2a/d8e/ff5 d2/dd/d5e/fff 0 2024-09-18T12:51:28.037 INFO:tasks.workunit.client.0.smithi081.stdout:1/799: symlink d0/d96/l106 0 2024-09-18T12:51:28.038 INFO:tasks.workunit.client.0.smithi081.stdout:7/667: truncate d2/d18/d3c/f7a 2838739 0 2024-09-18T12:51:28.039 INFO:tasks.workunit.client.0.smithi081.stdout:3/844: dwrite d3/db/df/d113/fae [0,4194304] 0 2024-09-18T12:51:28.041 INFO:tasks.workunit.client.0.smithi081.stdout:9/700: rmdir dd/d1d/d1e/d24/d2a/d55 39 2024-09-18T12:51:28.041 INFO:tasks.workunit.client.0.smithi081.stdout:9/701: write dd/d1d/d1e/d24/d2a/f88 [1779667,42127] 0 2024-09-18T12:51:28.043 INFO:tasks.workunit.client.0.smithi081.stdout:1/800: dread d0/dd7/de9/f8e [0,4194304] 0 2024-09-18T12:51:28.043 INFO:tasks.workunit.client.0.smithi081.stdout:1/801: chown d0/d6/d7/d2e 963 1 2024-09-18T12:51:28.044 INFO:tasks.workunit.client.0.smithi081.stdout:9/702: mkdir dd/d15/db1/de2 0 2024-09-18T12:51:28.044 INFO:tasks.workunit.client.0.smithi081.stdout:9/703: chown dd/d1d/d1e/d24/d2a/d55/d85 2193 1 2024-09-18T12:51:28.047 INFO:tasks.workunit.client.0.smithi081.stdout:1/802: unlink d0/d6/d33/d42/d70/feb 0 2024-09-18T12:51:28.047 INFO:tasks.workunit.client.0.smithi081.stdout:1/803: fsync d0/d6/d7/d8/fbb 0 2024-09-18T12:51:28.047 INFO:tasks.workunit.client.0.smithi081.stdout:1/804: chown d0/db/d4f/dab 3621734 1 2024-09-18T12:51:28.047 INFO:tasks.workunit.client.0.smithi081.stdout:2/959: dwrite d15/d16/d20/fa5 [4194304,4194304] 0 2024-09-18T12:51:28.047 INFO:tasks.workunit.client.0.smithi081.stdout:8/749: dwrite d3/d1d/d89/fc0 [0,4194304] 0 2024-09-18T12:51:28.052 INFO:tasks.workunit.client.0.smithi081.stdout:1/805: mkdir d0/df9/dc0/da0/d84/d107 0 2024-09-18T12:51:28.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/960: truncate d15/d26/f29 260441 0 2024-09-18T12:51:28.055 INFO:tasks.workunit.client.0.smithi081.stdout:0/728: dwrite d7/d9/fe6 [0,4194304] 0 2024-09-18T12:51:28.055 INFO:tasks.workunit.client.0.smithi081.stdout:0/729: chown d7/d9/d4b/d53/cf0 151936 1 2024-09-18T12:51:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/750: creat d3/d1e/d4c/ffd x:0 0 0 2024-09-18T12:51:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/751: chown d3/l3b 806 1 2024-09-18T12:51:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/752: creat d3/d1e/d4c/ffe x:0 0 0 2024-09-18T12:51:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/753: write d3/f18 [1535780,103013] 0 2024-09-18T12:51:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/754: getdents d3/d1d/d9f/dcf/dee 0 2024-09-18T12:51:28.069 INFO:tasks.workunit.client.0.smithi081.stdout:5/796: dwrite d2/d14/d33/d37/d3b/d2a/d8e/fa1 [0,4194304] 0 2024-09-18T12:51:28.069 INFO:tasks.workunit.client.0.smithi081.stdout:5/797: chown d2/d14/d33/d37/d3b/d5f/fb5 2 1 2024-09-18T12:51:28.078 INFO:tasks.workunit.client.0.smithi081.stdout:9/704: dwrite dd/d1d/d1e/d2f/f69 [0,4194304] 0 2024-09-18T12:51:28.081 INFO:tasks.workunit.client.0.smithi081.stdout:9/705: mknod dd/de/d7a/d9e/ce3 0 2024-09-18T12:51:28.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/706: creat dd/d15/d1a/da7/dce/d73/fe4 x:0 0 0 2024-09-18T12:51:28.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/707: write dd/d15/d1a/da7/dce/f3f [2657338,125232] 0 2024-09-18T12:51:28.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/708: write dd/d1d/d1e/d24/d2a/d55/d85/faa [1123047,21482] 0 2024-09-18T12:51:28.086 INFO:tasks.workunit.client.0.smithi081.stdout:9/709: mkdir dd/d15/db1/de5 0 2024-09-18T12:51:28.087 INFO:tasks.workunit.client.0.smithi081.stdout:7/668: dwrite d2/d14/d21/d62/f64 [0,4194304] 0 2024-09-18T12:51:28.087 INFO:tasks.workunit.client.0.smithi081.stdout:9/710: symlink dd/de/d7a/d9e/le6 0 2024-09-18T12:51:28.090 INFO:tasks.workunit.client.0.smithi081.stdout:7/669: truncate d2/d18/d60/fad 5694581 0 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: pgmap v286: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 294 MiB/s rd, 347 MiB/s wr, 500 op/s 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr fail", "who": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:51:28.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: osdmap e48: 6 total, 6 up, 6 in 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "mgr fail", "who": "smithi081.pfnvgp"}]': finished 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: mgrmap e21: smithi136.vdkrdt(active, starting, since 0.00689479s) 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:51:28.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:51:28.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:27 smithi081 ceph-mon[27646]: Manager daemon smithi136.vdkrdt is now available 2024-09-18T12:51:28.099 INFO:tasks.workunit.client.0.smithi081.stdout:3/845: dwrite d3/d84/fab [0,4194304] 0 2024-09-18T12:51:28.099 INFO:tasks.workunit.client.0.smithi081.stdout:1/806: dwrite d0/d6/d7/d2e/ffa [0,4194304] 0 2024-09-18T12:51:28.099 INFO:tasks.workunit.client.0.smithi081.stdout:8/755: dwrite d3/d1d/d4a/f97 [0,4194304] 0 2024-09-18T12:51:28.099 INFO:tasks.workunit.client.0.smithi081.stdout:5/798: dwrite d2/d14/d33/d37/d3b/d5f/fca [0,4194304] 0 2024-09-18T12:51:28.099 INFO:tasks.workunit.client.0.smithi081.stdout:5/799: chown d2/d14/d33/d37/d3b/d6a/f25 1718002931 1 2024-09-18T12:51:28.100 INFO:tasks.workunit.client.0.smithi081.stdout:5/800: readlink d2/d14/d33/d37/d3b/d2a/d8e/dc2/lc3 0 2024-09-18T12:51:28.100 INFO:tasks.workunit.client.0.smithi081.stdout:5/801: readlink d2/l4f 0 2024-09-18T12:51:28.101 INFO:tasks.workunit.client.0.smithi081.stdout:0/730: dwrite d7/d9/d4b/d33/d7d/f8d [0,4194304] 0 2024-09-18T12:51:28.108 INFO:tasks.workunit.client.0.smithi081.stdout:1/807: unlink d0/dd7/cdb 0 2024-09-18T12:51:28.111 INFO:tasks.workunit.client.0.smithi081.stdout:3/846: creat d3/db/df/d60/d58/d10d/f128 x:0 0 0 2024-09-18T12:51:28.111 INFO:tasks.workunit.client.0.smithi081.stdout:3/847: chown d3/db/d1b/ccd 0 1 2024-09-18T12:51:28.112 INFO:tasks.workunit.client.0.smithi081.stdout:8/756: truncate d3/d1d/f49 1218669 0 2024-09-18T12:51:28.112 INFO:tasks.workunit.client.0.smithi081.stdout:8/757: fsync d3/d73/fa2 0 2024-09-18T12:51:28.115 INFO:tasks.workunit.client.0.smithi081.stdout:0/731: symlink d7/d9/d4b/d33/d43/lf8 0 2024-09-18T12:51:28.115 INFO:tasks.workunit.client.0.smithi081.stdout:0/732: fsync d7/d9/d4b/d33/d43/f87 0 2024-09-18T12:51:28.115 INFO:tasks.workunit.client.0.smithi081.stdout:0/733: fsync d7/d9/f90 0 2024-09-18T12:51:28.117 INFO:tasks.workunit.client.0.smithi081.stdout:0/734: dread d7/d9/d4b/d4a/d77/f7e [0,4194304] 0 2024-09-18T12:51:28.117 INFO:tasks.workunit.client.0.smithi081.stdout:9/711: dwrite dd/d1d/d1e/d24/d2a/f2c [0,4194304] 0 2024-09-18T12:51:28.123 INFO:tasks.workunit.client.0.smithi081.stdout:7/670: dwrite d2/d18/d3c/f65 [0,4194304] 0 2024-09-18T12:51:28.124 INFO:tasks.workunit.client.0.smithi081.stdout:3/848: mkdir d3/db/df/d3b/dc0/d129 0 2024-09-18T12:51:28.124 INFO:tasks.workunit.client.0.smithi081.stdout:3/849: chown d3/d123 85781844 1 2024-09-18T12:51:28.128 INFO:tasks.workunit.client.0.smithi081.stdout:0/735: creat d7/d9/d4b/ff9 x:0 0 0 2024-09-18T12:51:28.129 INFO:tasks.workunit.client.0.smithi081.stdout:9/712: creat dd/d1d/d1e/d2f/fe7 x:0 0 0 2024-09-18T12:51:28.132 INFO:tasks.workunit.client.0.smithi081.stdout:5/802: dwrite d2/d14/d1d/da4/fa9 [4194304,4194304] 0 2024-09-18T12:51:28.132 INFO:tasks.workunit.client.0.smithi081.stdout:5/803: stat d2/dd 0 2024-09-18T12:51:28.136 INFO:tasks.workunit.client.0.smithi081.stdout:1/808: dwrite d0/dd7/d55/fb3 [4194304,4194304] 0 2024-09-18T12:51:28.136 INFO:tasks.workunit.client.0.smithi081.stdout:1/809: readlink d0/d6/d7/d2e/l3c 0 2024-09-18T12:51:28.137 INFO:tasks.workunit.client.0.smithi081.stdout:1/810: chown d0/d6/d7/d8/f34 590 1 2024-09-18T12:51:28.137 INFO:tasks.workunit.client.0.smithi081.stdout:3/850: rename d3/db/d1b/c109 to d3/db/df/d60/d58/c12a 0 2024-09-18T12:51:28.140 INFO:tasks.workunit.client.0.smithi081.stdout:8/758: dwrite d3/d1e/f77 [0,4194304] 0 2024-09-18T12:51:28.152 INFO:tasks.workunit.client.0.smithi081.stdout:5/804: dwrite d2/d14/f4e [0,4194304] 0 2024-09-18T12:51:28.152 INFO:tasks.workunit.client.0.smithi081.stdout:5/805: stat d2/d14/f17 0 2024-09-18T12:51:28.168 INFO:tasks.workunit.client.0.smithi081.stdout:0/736: symlink d7/d9/d4b/lfa 0 2024-09-18T12:51:28.169 INFO:tasks.workunit.client.0.smithi081.stdout:0/737: creat d7/d9/d4b/d33/d43/d9a/ffb x:0 0 0 2024-09-18T12:51:28.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/671: mkdir d2/d18/de2 0 2024-09-18T12:51:28.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/672: stat d2/d18/f3b 0 2024-09-18T12:51:28.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/811: symlink d0/d6/d33/d37/d71/l108 0 2024-09-18T12:51:28.170 INFO:tasks.workunit.client.0.smithi081.stdout:3/851: getdents d3/db/d1b 0 2024-09-18T12:51:28.171 INFO:tasks.workunit.client.0.smithi081.stdout:8/759: dwrite d3/d1e/d4c/d53/f5f [0,4194304] 0 2024-09-18T12:51:28.171 INFO:tasks.workunit.client.0.smithi081.stdout:5/806: dwrite d2/d14/d33/d37/d3b/d6a/d20/ff4 [0,4194304] 0 2024-09-18T12:51:28.172 INFO:tasks.workunit.client.0.smithi081.stdout:5/807: stat d2/d14/d1d/da4 0 2024-09-18T12:51:28.174 INFO:tasks.workunit.client.0.smithi081.stdout:9/713: rename dd/de/f13 to dd/d15/d1a/d35/ddb/fe8 0 2024-09-18T12:51:28.178 INFO:tasks.workunit.client.0.smithi081.stdout:0/738: read d7/d9/d4b/d33/d7d/f88 [2926875,73862] 0 2024-09-18T12:51:28.178 INFO:tasks.workunit.client.0.smithi081.stdout:0/739: creat d7/d7c/ffc x:0 0 0 2024-09-18T12:51:28.192 INFO:tasks.workunit.client.0.smithi081.stdout:8/760: mknod d3/d1d/d9f/dcf/dda/cff 0 2024-09-18T12:51:28.192 INFO:tasks.workunit.client.0.smithi081.stdout:8/761: chown d3/d1e/d4c/d53/fab 957 1 2024-09-18T12:51:28.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/673: write d2/d18/f1f [3484001,100332] 0 2024-09-18T12:51:28.199 INFO:tasks.workunit.client.0.smithi081.stdout:5/808: creat d2/d14/d33/d37/d3b/d16/dd1/f100 x:0 0 0 2024-09-18T12:51:28.202 INFO:tasks.workunit.client.0.smithi081.stdout:1/812: rename d0/d6/d33/d37/c58 to d0/d6/d33/d42/d70/dec/c109 0 2024-09-18T12:51:28.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/762: mkdir d3/d1e/d4c/d100 0 2024-09-18T12:51:28.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/763: chown d3/d2f/l61 3866 1 2024-09-18T12:51:28.206 INFO:tasks.workunit.client.0.smithi081.stdout:7/674: rmdir d2/d18/de2 0 2024-09-18T12:51:28.208 INFO:tasks.workunit.client.0.smithi081.stdout:5/809: link d2/d14/d33/d37/d3b/d5f/la2 d2/d14/d33/d37/d3b/d2a/d8e/l101 0 2024-09-18T12:51:28.210 INFO:tasks.workunit.client.0.smithi081.stdout:9/714: link dd/d1d/d1e/d24/d48/dc2/cca dd/d31/d4a/ce9 0 2024-09-18T12:51:28.211 INFO:tasks.workunit.client.0.smithi081.stdout:1/813: link d0/d6/d7/d8/c10 d0/d18/d6a/c10a 0 2024-09-18T12:51:28.211 INFO:tasks.workunit.client.0.smithi081.stdout:1/814: creat d0/d96/f10b x:0 0 0 2024-09-18T12:51:28.213 INFO:tasks.workunit.client.0.smithi081.stdout:8/764: creat d3/d1d/d9f/dcf/dda/f101 x:0 0 0 2024-09-18T12:51:28.213 INFO:tasks.workunit.client.0.smithi081.stdout:7/675: link d2/d56/d73/da4/cb4 d2/d1d/ce3 0 2024-09-18T12:51:28.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/765: truncate d3/d1d/d9f/fad 3061094 0 2024-09-18T12:51:28.219 INFO:tasks.workunit.client.0.smithi081.stdout:9/715: truncate dd/d1d/d1e/d24/f33 2701607 0 2024-09-18T12:51:28.220 INFO:tasks.workunit.client.0.smithi081.stdout:9/716: creat dd/d1d/d1e/d24/d48/fea x:0 0 0 2024-09-18T12:51:28.224 INFO:tasks.workunit.client.0.smithi081.stdout:9/717: write dd/de/d4f/f65 [758761,107560] 0 2024-09-18T12:51:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:9/718: write f8 [2891413,112320] 0 2024-09-18T12:51:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:9/719: stat dd/de/d59/f84 0 2024-09-18T12:51:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:9/720: write dd/d1d/d1e/d24/f82 [1823416,62693] 0 2024-09-18T12:51:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:9/721: write dd/d15/d1a/da7/dce/fa6 [3638105,45207] 0 2024-09-18T12:51:28.229 INFO:tasks.workunit.client.0.smithi081.stdout:8/766: dread d3/d1e/d4c/d53/f5f [0,4194304] 0 2024-09-18T12:51:28.229 INFO:tasks.workunit.client.0.smithi081.stdout:9/722: symlink dd/d15/d1a/da7/dce/leb 0 2024-09-18T12:51:28.231 INFO:tasks.workunit.client.0.smithi081.stdout:9/723: read dd/d15/d1a/fa8 [149852,26235] 0 2024-09-18T12:51:28.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/815: dwrite d0/d6/d7/d2e/d51/fca [0,4194304] 0 2024-09-18T12:51:28.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/816: write d0/db/f65 [639799,18426] 0 2024-09-18T12:51:28.233 INFO:tasks.workunit.client.0.smithi081.stdout:1/817: chown d0/d6/d7/d2e/d51/d2c/l5d 62917617 1 2024-09-18T12:51:28.234 INFO:tasks.workunit.client.0.smithi081.stdout:8/767: dread d3/d1d/f4d [0,4194304] 0 2024-09-18T12:51:28.235 INFO:tasks.workunit.client.0.smithi081.stdout:1/818: creat d0/d6/d66/f10c x:0 0 0 2024-09-18T12:51:28.238 INFO:tasks.workunit.client.0.smithi081.stdout:8/768: mkdir d3/d1d/d102 0 2024-09-18T12:51:28.239 INFO:tasks.workunit.client.0.smithi081.stdout:1/819: truncate d0/f7e 1145095 0 2024-09-18T12:51:28.242 INFO:tasks.workunit.client.0.smithi081.stdout:1/820: mkdir d0/d6/d7/d2e/d4e/d10d 0 2024-09-18T12:51:28.243 INFO:tasks.workunit.client.0.smithi081.stdout:9/724: write dd/de/d4f/d8c/fa1 [3545858,15189] 0 2024-09-18T12:51:28.245 INFO:tasks.workunit.client.0.smithi081.stdout:8/769: write d3/d1d/f51 [674510,19372] 0 2024-09-18T12:51:28.245 INFO:tasks.workunit.client.0.smithi081.stdout:8/770: creat d3/d1e/d4c/f103 x:0 0 0 2024-09-18T12:51:28.249 INFO:tasks.workunit.client.0.smithi081.stdout:8/771: link d3/d1d/f8b d3/d73/f104 0 2024-09-18T12:51:28.252 INFO:tasks.workunit.client.0.smithi081.stdout:1/821: write d0/dd7/d2d/f2f [1971370,40665] 0 2024-09-18T12:51:28.252 INFO:tasks.workunit.client.0.smithi081.stdout:1/822: dread - d0/d18/ff7 zero size 2024-09-18T12:51:28.253 INFO:tasks.workunit.client.0.smithi081.stdout:8/772: getdents d3/d1d/d9f 0 2024-09-18T12:51:28.253 INFO:tasks.workunit.client.0.smithi081.stdout:8/773: write d3/d1d/d4a/d8d/fbd [5015985,21849] 0 2024-09-18T12:51:28.255 INFO:tasks.workunit.client.0.smithi081.stdout:1/823: mkdir d0/d18/df4/d10e 0 2024-09-18T12:51:28.258 INFO:tasks.workunit.client.0.smithi081.stdout:8/774: rmdir d3/d73/dbe 39 2024-09-18T12:51:28.259 INFO:tasks.workunit.client.0.smithi081.stdout:8/775: mkdir d3/d1e/d4c/d68/d105 0 2024-09-18T12:51:28.261 INFO:tasks.workunit.client.0.smithi081.stdout:8/776: creat d3/d1d/d9f/f106 x:0 0 0 2024-09-18T12:51:28.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/777: rename d3/d1d/d4a/cd8 to d3/d1d/d9f/dcf/dee/c107 0 2024-09-18T12:51:28.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/725: dwrite f6 [8388608,4194304] 0 2024-09-18T12:51:28.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/726: chown dd/de/d4f/f66 1951646394 1 2024-09-18T12:51:28.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/727: creat dd/d1d/d1e/d77/fec x:0 0 0 2024-09-18T12:51:28.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/728: symlink dd/led 0 2024-09-18T12:51:28.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/729: write dd/d1d/d91/fb6 [578421,105270] 0 2024-09-18T12:51:28.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/730: rmdir dd/de/d4f/d8c 39 2024-09-18T12:51:28.288 INFO:tasks.workunit.client.0.smithi081.stdout:8/778: dwrite d3/f11 [4194304,4194304] 0 2024-09-18T12:51:28.288 INFO:tasks.workunit.client.0.smithi081.stdout:8/779: chown d3/d2f/cd6 8 1 2024-09-18T12:51:28.288 INFO:tasks.workunit.client.0.smithi081.stdout:8/780: read d3/d1e/d4c/fb9 [2252407,42137] 0 2024-09-18T12:51:28.288 INFO:tasks.workunit.client.0.smithi081.stdout:1/824: dwrite d0/db/f14 [0,4194304] 0 2024-09-18T12:51:28.289 INFO:tasks.workunit.client.0.smithi081.stdout:8/781: rmdir d3/d1d/d9f/dcf/dee 39 2024-09-18T12:51:28.295 INFO:tasks.workunit.client.0.smithi081.stdout:8/782: dread d3/d2f/f8a [0,4194304] 0 2024-09-18T12:51:28.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/783: chown d3/d1e/d4c/d100 329 1 2024-09-18T12:51:28.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/784: creat d3/d1d/d4a/d7f/f108 x:0 0 0 2024-09-18T12:51:28.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/785: fsync d3/f11 0 2024-09-18T12:51:28.298 INFO:tasks.workunit.client.0.smithi081.stdout:9/731: dwrite dd/d1d/d91/fbf [0,4194304] 0 2024-09-18T12:51:28.302 INFO:tasks.workunit.client.0.smithi081.stdout:1/825: dread d0/d6/d7/d2e/f63 [0,4194304] 0 2024-09-18T12:51:28.305 INFO:tasks.workunit.client.0.smithi081.stdout:1/826: rmdir d0/d18/d1a/dd3 39 2024-09-18T12:51:28.313 INFO:tasks.workunit.client.0.smithi081.stdout:9/732: write f6 [8651508,9906] 0 2024-09-18T12:51:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: pgmap v286: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 294 MiB/s rd, 347 MiB/s wr, 500 op/s 2024-09-18T12:51:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr fail", "who": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: osdmap e48: 6 total, 6 up, 6 in 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14213 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "mgr fail", "who": "smithi081.pfnvgp"}]': finished 2024-09-18T12:51:28.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: mgrmap e21: smithi136.vdkrdt(active, starting, since 0.00689479s) 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:51:28.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:51:28.317 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:27 smithi136 ceph-mon[35363]: Manager daemon smithi136.vdkrdt is now available 2024-09-18T12:51:28.318 INFO:tasks.workunit.client.0.smithi081.stdout:9/733: creat dd/d15/d1a/d35/fee x:0 0 0 2024-09-18T12:51:28.319 INFO:tasks.workunit.client.0.smithi081.stdout:1/827: dread d0/dd7/f60 [0,4194304] 0 2024-09-18T12:51:28.319 INFO:tasks.workunit.client.0.smithi081.stdout:9/734: mkdir dd/d15/d1a/da7/dce/ddd/def 0 2024-09-18T12:51:28.325 INFO:tasks.workunit.client.0.smithi081.stdout:9/735: rename dd/de/d7a/cd0 to dd/d1d/d1e/d24/cf0 0 2024-09-18T12:51:28.326 INFO:tasks.workunit.client.0.smithi081.stdout:9/736: read dd/d1d/d1e/d24/f33 [1743986,58821] 0 2024-09-18T12:51:28.326 INFO:tasks.workunit.client.0.smithi081.stdout:9/737: read f8 [1557712,82280] 0 2024-09-18T12:51:28.327 INFO:tasks.workunit.client.0.smithi081.stdout:9/738: symlink dd/de/d4f/lf1 0 2024-09-18T12:51:28.327 INFO:tasks.workunit.client.0.smithi081.stdout:9/739: truncate dd/d15/d1a/da7/dce/d73/fe4 1012990 0 2024-09-18T12:51:28.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/786: dwrite d3/d73/dbe/fc1 [4194304,4194304] 0 2024-09-18T12:51:28.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/787: fsync d3/d1e/d4c/fb6 0 2024-09-18T12:51:28.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/788: creat d3/d73/dbe/f109 x:0 0 0 2024-09-18T12:51:28.337 INFO:tasks.workunit.client.0.smithi081.stdout:1/828: write d0/db/f14 [546402,36610] 0 2024-09-18T12:51:28.337 INFO:tasks.workunit.client.0.smithi081.stdout:8/789: rmdir d3/d1e 39 2024-09-18T12:51:28.338 INFO:tasks.workunit.client.0.smithi081.stdout:9/740: dread dd/d1d/fd7 [0,4194304] 0 2024-09-18T12:51:28.339 INFO:tasks.workunit.client.0.smithi081.stdout:1/829: mknod d0/d6/d7/d2e/d51/c10f 0 2024-09-18T12:51:28.342 INFO:tasks.workunit.client.0.smithi081.stdout:8/790: rename d3/f15 to d3/d1e/d4c/d68/daa/f10a 0 2024-09-18T12:51:28.342 INFO:tasks.workunit.client.0.smithi081.stdout:8/791: fsync d3/db7/fd4 0 2024-09-18T12:51:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/741: mkdir dd/de/d7a/d9e/df2 0 2024-09-18T12:51:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/742: chown dd/de/d4f/f9c 1 1 2024-09-18T12:51:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/743: write dd/d15/d1a/f99 [2188,116509] 0 2024-09-18T12:51:28.344 INFO:tasks.workunit.client.0.smithi081.stdout:1/830: symlink d0/dd7/l110 0 2024-09-18T12:51:28.348 INFO:tasks.workunit.client.0.smithi081.stdout:8/792: symlink d3/d73/l10b 0 2024-09-18T12:51:28.348 INFO:tasks.workunit.client.0.smithi081.stdout:8/793: creat d3/dc9/f10c x:0 0 0 2024-09-18T12:51:28.348 INFO:tasks.workunit.client.0.smithi081.stdout:8/794: dread - d3/d73/fa6 zero size 2024-09-18T12:51:28.349 INFO:tasks.workunit.client.0.smithi081.stdout:9/744: symlink dd/d15/d1a/lf3 0 2024-09-18T12:51:28.349 INFO:tasks.workunit.client.0.smithi081.stdout:9/745: creat dd/de/d4f/ff4 x:0 0 0 2024-09-18T12:51:28.349 INFO:tasks.workunit.client.0.smithi081.stdout:9/746: dread - dd/d31/fc1 zero size 2024-09-18T12:51:28.350 INFO:tasks.workunit.client.0.smithi081.stdout:1/831: rmdir d0/dd7/d2d 39 2024-09-18T12:51:28.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/795: mkdir d3/d1d/d89/d10d 0 2024-09-18T12:51:28.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/796: write d3/d1d/d4a/f92 [2542120,98446] 0 2024-09-18T12:51:28.354 INFO:tasks.workunit.client.0.smithi081.stdout:8/797: dread - d3/d2f/fb2 zero size 2024-09-18T12:51:28.355 INFO:tasks.workunit.client.0.smithi081.stdout:1/832: rmdir d0/d6/d33/d42/d70/dd9 39 2024-09-18T12:51:28.355 INFO:tasks.workunit.client.0.smithi081.stdout:1/833: write d0/db/d4f/dab/fcd [748386,12998] 0 2024-09-18T12:51:28.356 INFO:tasks.workunit.client.0.smithi081.stdout:1/834: rename d0/d6/d7/l19 to d0/d6/d33/d37/d98/l111 0 2024-09-18T12:51:28.357 INFO:tasks.workunit.client.0.smithi081.stdout:1/835: mkdir d0/df9/dc0/d112 0 2024-09-18T12:51:28.358 INFO:tasks.workunit.client.0.smithi081.stdout:1/836: rmdir d0/db/d4f/dd2/dd5 39 2024-09-18T12:51:28.371 INFO:tasks.workunit.client.0.smithi081.stdout:9/747: dwrite dd/d15/d1a/fa8 [0,4194304] 0 2024-09-18T12:51:28.371 INFO:tasks.workunit.client.0.smithi081.stdout:8/798: dread d3/d1e/f34 [0,4194304] 0 2024-09-18T12:51:28.372 INFO:tasks.workunit.client.0.smithi081.stdout:9/748: fsync dd/d1d/d1e/d77/fb5 0 2024-09-18T12:51:28.377 INFO:tasks.workunit.client.0.smithi081.stdout:1/837: write d0/d18/f25 [562021,64954] 0 2024-09-18T12:51:28.378 INFO:tasks.workunit.client.0.smithi081.stdout:1/838: symlink d0/d18/df4/l113 0 2024-09-18T12:51:28.379 INFO:tasks.workunit.client.0.smithi081.stdout:8/799: read d3/d1e/d4c/d53/fac [3265992,63472] 0 2024-09-18T12:51:28.379 INFO:tasks.workunit.client.0.smithi081.stdout:8/800: write d3/d1d/d4a/d7f/fdd [534864,85329] 0 2024-09-18T12:51:28.379 INFO:tasks.workunit.client.0.smithi081.stdout:8/801: fsync d3/d73/dbe/fc1 0 2024-09-18T12:51:28.381 INFO:tasks.workunit.client.0.smithi081.stdout:8/802: read d3/f6c [767068,75488] 0 2024-09-18T12:51:28.381 INFO:tasks.workunit.client.0.smithi081.stdout:8/803: chown d3/l56 1364058 1 2024-09-18T12:51:28.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/804: unlink d3/d1e/l47 0 2024-09-18T12:51:28.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/805: stat d3/d73/c76 0 2024-09-18T12:51:28.384 INFO:tasks.workunit.client.0.smithi081.stdout:8/806: mkdir d3/d1d/d4a/d7f/d10e 0 2024-09-18T12:51:28.384 INFO:tasks.workunit.client.0.smithi081.stdout:8/807: dread - d3/d1d/fe2 zero size 2024-09-18T12:51:28.389 INFO:tasks.workunit.client.0.smithi081.stdout:1/839: write d0/d6/d7/f81 [1870215,30459] 0 2024-09-18T12:51:28.390 INFO:tasks.workunit.client.0.smithi081.stdout:9/749: dwrite dd/d1d/d91/fbf [0,4194304] 0 2024-09-18T12:51:28.390 INFO:tasks.workunit.client.0.smithi081.stdout:9/750: readlink dd/d15/ld8 0 2024-09-18T12:51:28.391 INFO:tasks.workunit.client.0.smithi081.stdout:1/840: symlink d0/db/d4f/d50/l114 0 2024-09-18T12:51:28.394 INFO:tasks.workunit.client.0.smithi081.stdout:9/751: creat dd/d1d/d1e/d2f/dc4/dcc/ff5 x:0 0 0 2024-09-18T12:51:28.413 INFO:tasks.workunit.client.0.smithi081.stdout:1/841: dwrite d0/d6/d33/d37/f6d [0,4194304] 0 2024-09-18T12:51:28.414 INFO:tasks.workunit.client.0.smithi081.stdout:9/752: dwrite dd/d15/d1a/da7/fd6 [0,4194304] 0 2024-09-18T12:51:28.414 INFO:tasks.workunit.client.0.smithi081.stdout:9/753: read - dd/d15/d1a/d3d/fd4 zero size 2024-09-18T12:51:28.419 INFO:tasks.workunit.client.0.smithi081.stdout:1/842: dread d0/d6/d33/d37/d71/f72 [0,4194304] 0 2024-09-18T12:51:28.420 INFO:tasks.workunit.client.0.smithi081.stdout:1/843: dread d0/d6/d7/d8/f52 [0,4194304] 0 2024-09-18T12:51:28.423 INFO:tasks.workunit.client.0.smithi081.stdout:9/754: dread dd/d1d/d1e/d24/d2a/f30 [0,4194304] 0 2024-09-18T12:51:28.424 INFO:tasks.workunit.client.0.smithi081.stdout:9/755: getdents dd/d15/d1a/dc6 0 2024-09-18T12:51:28.426 INFO:tasks.workunit.client.0.smithi081.stdout:9/756: creat dd/d1d/d1e/d24/ff6 x:0 0 0 2024-09-18T12:51:28.426 INFO:tasks.workunit.client.0.smithi081.stdout:9/757: truncate dd/d1d/d1e/d2f/f83 856927 0 2024-09-18T12:51:28.426 INFO:tasks.workunit.client.0.smithi081.stdout:9/758: fdatasync dd/de/d59/f84 0 2024-09-18T12:51:28.438 INFO:tasks.workunit.client.0.smithi081.stdout:1/844: dwrite d0/db/d32/f87 [0,4194304] 0 2024-09-18T12:51:28.445 INFO:tasks.workunit.client.0.smithi081.stdout:1/845: dread d0/d6/d7/d2e/f63 [0,4194304] 0 2024-09-18T12:51:28.445 INFO:tasks.workunit.client.0.smithi081.stdout:1/846: rename d0/db/fba to d0/db/d4f/dd2/f115 0 2024-09-18T12:51:28.445 INFO:tasks.workunit.client.0.smithi081.stdout:1/847: fsync d0/d6/d7/d2e/d4e/f89 0 2024-09-18T12:51:28.446 INFO:tasks.workunit.client.0.smithi081.stdout:9/759: dwrite dd/de/fe1 [0,4194304] 0 2024-09-18T12:51:28.466 INFO:tasks.workunit.client.0.smithi081.stdout:1/848: dwrite d0/d18/df4/ff6 [0,4194304] 0 2024-09-18T12:51:28.467 INFO:tasks.workunit.client.0.smithi081.stdout:9/760: dwrite dd/d1d/d1e/d77/fb5 [0,4194304] 0 2024-09-18T12:51:28.467 INFO:tasks.workunit.client.0.smithi081.stdout:9/761: chown dd/de/c28 15967070 1 2024-09-18T12:51:28.482 INFO:tasks.workunit.client.0.smithi081.stdout:1/849: mknod d0/df9/dc0/d112/c116 0 2024-09-18T12:51:28.485 INFO:tasks.workunit.client.0.smithi081.stdout:9/762: dwrite dd/d15/fbb [0,4194304] 0 2024-09-18T12:51:28.485 INFO:tasks.workunit.client.0.smithi081.stdout:9/763: stat dd/d1b 0 2024-09-18T12:51:28.485 INFO:tasks.workunit.client.0.smithi081.stdout:9/764: chown dd/f20 176847 1 2024-09-18T12:51:28.486 INFO:tasks.workunit.client.0.smithi081.stdout:1/850: rename d0/d6/d7/d8/c10 to d0/c117 0 2024-09-18T12:51:28.493 INFO:tasks.workunit.client.0.smithi081.stdout:1/851: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:1/852: write d0/db/d4f/dd2/dd5/fef [373725,92887] 0 2024-09-18T12:51:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:1/853: chown d0/d18/d1a/cde 1292199940 1 2024-09-18T12:51:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:1/854: dread - d0/d18/fe5 zero size 2024-09-18T12:51:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:9/765: dread dd/de/fe1 [0,4194304] 0 2024-09-18T12:51:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:9/766: fsync dd/d1b/f34 0 2024-09-18T12:51:28.496 INFO:tasks.workunit.client.0.smithi081.stdout:9/767: unlink dd/de/d7a/d9e/lbd 0 2024-09-18T12:51:28.497 INFO:tasks.workunit.client.0.smithi081.stdout:9/768: getdents dd/d1d/d1e/d24/d2a/d55 0 2024-09-18T12:51:28.504 INFO:tasks.workunit.client.0.smithi081.stdout:1/855: write d0/db/d32/f87 [437093,69583] 0 2024-09-18T12:51:28.504 INFO:tasks.workunit.client.0.smithi081.stdout:1/856: write d0/d6/d33/fcc [71540,63845] 0 2024-09-18T12:51:28.504 INFO:tasks.workunit.client.0.smithi081.stdout:1/857: readlink d0/d6/d7/d2e/d4e/lbe 0 2024-09-18T12:51:28.504 INFO:tasks.workunit.client.0.smithi081.stdout:1/858: stat d0/d6/d7/d2e/cc9 0 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:3/852: sync 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:4/745: sync 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:2/961: sync 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:6/787: sync 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:4/746: stat d3/d20/d3d/d65/d14/d4b/faa 0 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:3/853: truncate d3/db/df/fff 827590 0 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:3/854: chown d3/db/df/d29/d13 54 1 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:3/855: write d3/db/df/d29/d13/d9d/d107/f28 [2439392,39822] 0 2024-09-18T12:51:28.672 INFO:tasks.workunit.client.0.smithi081.stdout:3/856: truncate d3/db/d1b/f43 1157279 0 2024-09-18T12:51:28.673 INFO:tasks.workunit.client.0.smithi081.stdout:2/962: write d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 [4760631,104985] 0 2024-09-18T12:51:28.673 INFO:tasks.workunit.client.0.smithi081.stdout:2/963: chown d15/cc0 163 1 2024-09-18T12:51:28.676 INFO:tasks.workunit.client.0.smithi081.stdout:6/788: creat d4/d12/d28/d2a/d74/d8b/d54/f101 x:0 0 0 2024-09-18T12:51:28.676 INFO:tasks.workunit.client.0.smithi081.stdout:6/789: write d4/d12/d28/d2a/d97/fcd [608852,37139] 0 2024-09-18T12:51:28.677 INFO:tasks.workunit.client.0.smithi081.stdout:4/747: creat d3/d20/d5b/dd8/fef x:0 0 0 2024-09-18T12:51:28.678 INFO:tasks.workunit.client.0.smithi081.stdout:3/857: symlink d3/db/df/d60/l12b 0 2024-09-18T12:51:28.684 INFO:tasks.workunit.client.0.smithi081.stdout:4/748: mkdir d3/db/d2d/df0 0 2024-09-18T12:51:28.685 INFO:tasks.workunit.client.0.smithi081.stdout:3/858: symlink d3/db/l12c 0 2024-09-18T12:51:28.687 INFO:tasks.workunit.client.0.smithi081.stdout:4/749: mkdir d3/d20/d3d/d65/d2f/df1 0 2024-09-18T12:51:28.689 INFO:tasks.workunit.client.0.smithi081.stdout:4/750: mkdir d3/db/d58/d9f/df2 0 2024-09-18T12:51:28.689 INFO:tasks.workunit.client.0.smithi081.stdout:4/751: write d3/d20/d3d/d65/d14/d27/fb4 [237317,104933] 0 2024-09-18T12:51:28.702 INFO:tasks.workunit.client.0.smithi081.stdout:4/752: write d3/f22 [872991,93361] 0 2024-09-18T12:51:28.702 INFO:tasks.workunit.client.0.smithi081.stdout:4/753: read - d3/d20/d3d/d65/d14/d4b/faa zero size 2024-09-18T12:51:28.703 INFO:tasks.workunit.client.0.smithi081.stdout:4/754: symlink d3/db/d58/lf3 0 2024-09-18T12:51:28.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/964: dwrite d15/d16/d33/d53/d7a/f27 [0,4194304] 0 2024-09-18T12:51:28.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/965: write d15/d16/d20/d22/fe6 [713811,28268] 0 2024-09-18T12:51:28.705 INFO:tasks.workunit.client.0.smithi081.stdout:4/755: mkdir d3/db/d2d/df4 0 2024-09-18T12:51:28.705 INFO:tasks.workunit.client.0.smithi081.stdout:6/790: dwrite d4/d12/d1c/fc2 [0,4194304] 0 2024-09-18T12:51:28.707 INFO:tasks.workunit.client.0.smithi081.stdout:4/756: creat d3/d20/d3d/d65/d14/d27/ff5 x:0 0 0 2024-09-18T12:51:28.711 INFO:tasks.workunit.client.0.smithi081.stdout:2/966: unlink d15/d16/d33/d53/d7a/dee/d6d/da0/cbf 0 2024-09-18T12:51:28.712 INFO:tasks.workunit.client.0.smithi081.stdout:4/757: rmdir d3/d20/d3d/d6b 39 2024-09-18T12:51:28.713 INFO:tasks.workunit.client.0.smithi081.stdout:4/758: truncate d3/db/d2d/f7f 1782668 0 2024-09-18T12:51:28.713 INFO:tasks.workunit.client.0.smithi081.stdout:4/759: write d3/d20/d3d/d65/d45/d7e/fca [1857,80401] 0 2024-09-18T12:51:28.713 INFO:tasks.workunit.client.0.smithi081.stdout:4/760: write d3/db/d35/fd6 [402439,49088] 0 2024-09-18T12:51:28.713 INFO:tasks.workunit.client.0.smithi081.stdout:2/967: getdents d15/d16/d20/d22/d120 0 2024-09-18T12:51:28.717 INFO:tasks.workunit.client.0.smithi081.stdout:2/968: link d15/d16/d33/d53/d7a/ld0 d15/d16/d20/d107/l150 0 2024-09-18T12:51:28.717 INFO:tasks.workunit.client.0.smithi081.stdout:2/969: write d15/d16/f48 [3571717,15045] 0 2024-09-18T12:51:28.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/970: dread d15/d16/d33/d53/d7a/d2f/dc2/f93 [0,4194304] 0 2024-09-18T12:51:28.725 INFO:tasks.workunit.client.0.smithi081.stdout:6/791: dwrite d4/d12/d28/d2a/d74/d8b/f78 [0,4194304] 0 2024-09-18T12:51:28.726 INFO:tasks.workunit.client.0.smithi081.stdout:2/971: rmdir d15/d26/da8/d146 0 2024-09-18T12:51:28.727 INFO:tasks.workunit.client.0.smithi081.stdout:2/972: getdents d15/d16/d33/d53/d7a/d2f/dc2 0 2024-09-18T12:51:28.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/973: getdents d15/d16/d20/d22 0 2024-09-18T12:51:28.730 INFO:tasks.workunit.client.0.smithi081.stdout:4/761: dread d3/db/d35/fd6 [0,4194304] 0 2024-09-18T12:51:28.735 INFO:tasks.workunit.client.0.smithi081.stdout:2/974: dread d15/d16/d33/d53/d7a/d2f/f5c [0,4194304] 0 2024-09-18T12:51:28.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/975: truncate d15/d16/ded/f105 139788 0 2024-09-18T12:51:28.745 INFO:tasks.workunit.client.0.smithi081.stdout:4/762: dwrite d3/d20/d3d/d65/d14/d3e/f51 [0,4194304] 0 2024-09-18T12:51:28.749 INFO:tasks.workunit.client.0.smithi081.stdout:2/976: write d15/d16/d33/d53/d7a/d2f/dc2/f7c [2564359,122058] 0 2024-09-18T12:51:28.750 INFO:tasks.workunit.client.0.smithi081.stdout:4/763: mkdir d3/d20/d3d/d65/d45/d6c/dec/df6 0 2024-09-18T12:51:28.753 INFO:tasks.workunit.client.0.smithi081.stdout:2/977: stat d15/d16/d33/d53/d7a/f38 0 2024-09-18T12:51:28.753 INFO:tasks.workunit.client.0.smithi081.stdout:2/978: write d15/d16/d33/d53/d7a/d2f/dc2/fd2 [5018318,108752] 0 2024-09-18T12:51:28.753 INFO:tasks.workunit.client.0.smithi081.stdout:2/979: truncate d15/d16/d20/d22/d5a/f74 5070231 0 2024-09-18T12:51:28.755 INFO:tasks.workunit.client.0.smithi081.stdout:4/764: mknod d3/d20/d3d/d65/d14/d4b/dc7/cf7 0 2024-09-18T12:51:28.755 INFO:tasks.workunit.client.0.smithi081.stdout:4/765: fsync d3/d20/d3d/d65/d45/d6c/f7b 0 2024-09-18T12:51:28.755 INFO:tasks.workunit.client.0.smithi081.stdout:4/766: readlink d3/d20/d3d/d65/d45/d4f/l71 0 2024-09-18T12:51:28.755 INFO:tasks.workunit.client.0.smithi081.stdout:4/767: fdatasync d3/db/d2d/faf 0 2024-09-18T12:51:28.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/980: truncate d15/d16/d54/fc6 4143814 0 2024-09-18T12:51:28.758 INFO:tasks.workunit.client.0.smithi081.stdout:2/981: fsync d15/d16/d33/d53/d7a/d2f/dc2/df8/f101 0 2024-09-18T12:51:28.760 INFO:tasks.workunit.client.0.smithi081.stdout:4/768: getdents d3/d20/d3d/d65/d45/dc4 0 2024-09-18T12:51:28.760 INFO:tasks.workunit.client.0.smithi081.stdout:4/769: chown d3/d20/d3d/d65/d14/d27/l72 61164963 1 2024-09-18T12:51:28.761 INFO:tasks.workunit.client.0.smithi081.stdout:2/982: truncate d15/d16/d33/f5b 3790310 0 2024-09-18T12:51:28.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/983: rmdir d15/d16/d33/d53/d7a/dee/d6d 39 2024-09-18T12:51:28.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/984: creat d15/d16/d33/d53/d7a/dee/d6d/daf/f151 x:0 0 0 2024-09-18T12:51:28.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/770: truncate d3/db/d2d/f7f 295042 0 2024-09-18T12:51:28.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/771: chown d3/d20/d3d/d65/d45/d4f/f5a 1 1 2024-09-18T12:51:28.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/985: mknod d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/d122/c152 0 2024-09-18T12:51:28.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/986: chown d15/d16/d20/fbd 7 1 2024-09-18T12:51:28.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/987: truncate d15/d16/d33/d53/d7a/dee/d6d/da0/ff6 626050 0 2024-09-18T12:51:28.769 INFO:tasks.workunit.client.0.smithi081.stdout:2/988: mknod d15/df9/d10d/d135/c153 0 2024-09-18T12:51:28.772 INFO:tasks.workunit.client.0.smithi081.stdout:4/772: rename d3/d20/d3d/d65/l41 to d3/d20/d3d/d65/d14/d3e/lf8 0 2024-09-18T12:51:28.773 INFO:tasks.workunit.client.0.smithi081.stdout:2/989: getdents d15/d16/d33/d53/d7a/dee/d6d 0 2024-09-18T12:51:28.774 INFO:tasks.workunit.client.0.smithi081.stdout:4/773: mknod d3/d20/d3d/d65/d14/d4b/cf9 0 2024-09-18T12:51:28.774 INFO:tasks.workunit.client.0.smithi081.stdout:4/774: fsync d3/d20/d3d/d65/f19 0 2024-09-18T12:51:28.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/990: creat d15/d16/d33/d53/f154 x:0 0 0 2024-09-18T12:51:28.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/991: chown d15/d16/d33/d53/d7a/f27 1 1 2024-09-18T12:51:28.776 INFO:tasks.workunit.client.0.smithi081.stdout:2/992: mkdir d15/d155 0 2024-09-18T12:51:28.776 INFO:tasks.workunit.client.0.smithi081.stdout:2/993: dread - d15/d16/d33/d53/d7a/d2f/fad zero size 2024-09-18T12:51:28.776 INFO:tasks.workunit.client.0.smithi081.stdout:2/994: chown d15/d16/d33/d53/d7a/d2f/d61/dd4/l132 57 1 2024-09-18T12:51:28.777 INFO:tasks.workunit.client.0.smithi081.stdout:4/775: getdents d3/dbb 0 2024-09-18T12:51:28.778 INFO:tasks.workunit.client.0.smithi081.stdout:4/776: mkdir d3/db/d35/d79/dfa 0 2024-09-18T12:51:28.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/777: getdents d3/d20/d3d/d65/d14/d4b/dc7 0 2024-09-18T12:51:28.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/778: stat d3/db/d35/d79/d95 0 2024-09-18T12:51:28.782 INFO:tasks.workunit.client.0.smithi081.stdout:2/995: dread d15/d16/d20/fa5 [0,4194304] 0 2024-09-18T12:51:28.782 INFO:tasks.workunit.client.0.smithi081.stdout:2/996: chown d15/d16/d33/d53/d7a/d2f/d61 3911716 1 2024-09-18T12:51:28.785 INFO:tasks.workunit.client.0.smithi081.stdout:2/997: dread d15/f84 [0,4194304] 0 2024-09-18T12:51:28.787 INFO:tasks.workunit.client.0.smithi081.stdout:2/998: dread d15/d16/d33/d53/d7a/d2f/d61/d97/dc9/fe2 [4194304,4194304] 0 2024-09-18T12:51:28.790 INFO:tasks.workunit.client.0.smithi081.stdout:4/779: write d3/db/d35/f76 [2726700,99841] 0 2024-09-18T12:51:28.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/780: fsync d3/d20/d3d/d65/d45/d6c/fb9 0 2024-09-18T12:51:28.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/781: chown d3/d20/d5b/ce9 1836 1 2024-09-18T12:51:28.809 INFO:tasks.workunit.client.0.smithi081.stdout:2/999: dwrite d15/f84 [0,4194304] 0 2024-09-18T12:51:28.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/782: dwrite d3/d20/f96 [0,4194304] 0 2024-09-18T12:51:28.813 INFO:tasks.workunit.client.0.smithi081.stdout:4/783: read d3/d20/d3d/d65/d14/d27/f37 [4014575,112081] 0 2024-09-18T12:51:28.813 INFO:tasks.workunit.client.0.smithi081.stdout:4/784: readlink d3/d20/d3d/d65/d45/l80 0 2024-09-18T12:51:28.814 INFO:tasks.workunit.client.0.smithi081.stdout:4/785: symlink d3/d20/d5b/lfb 0 2024-09-18T12:51:28.816 INFO:tasks.workunit.client.0.smithi081.stdout:4/786: mknod d3/d20/d3d/d65/d14/d27/cfc 0 2024-09-18T12:51:28.826 INFO:tasks.workunit.client.0.smithi081.stdout:4/787: dread d3/d20/d3d/d65/d45/d6c/f7b [0,4194304] 0 2024-09-18T12:51:28.827 INFO:tasks.workunit.client.0.smithi081.stdout:4/788: dread - d3/dbb/fe5 zero size 2024-09-18T12:51:28.831 INFO:tasks.workunit.client.0.smithi081.stdout:4/789: link d3/db/d2d/l2e d3/d20/d3d/d65/d14/d54/dd3/d8d/lfd 0 2024-09-18T12:51:28.831 INFO:tasks.workunit.client.0.smithi081.stdout:4/790: dread - d3/d20/d3d/d6b/fe7 zero size 2024-09-18T12:51:28.833 INFO:tasks.workunit.client.0.smithi081.stdout:4/791: symlink d3/d20/d3d/d65/d14/d54/dd3/d8d/d97/ddd/lfe 0 2024-09-18T12:51:28.835 INFO:tasks.workunit.client.0.smithi081.stdout:4/792: rename d3/d20/d3d/c68 to d3/d20/d3d/d65/d14/d54/cff 0 2024-09-18T12:51:28.846 INFO:tasks.workunit.client.0.smithi081.stdout:4/793: dread d3/d20/d3d/d65/d45/da4/fd9 [0,4194304] 0 2024-09-18T12:51:28.847 INFO:tasks.workunit.client.0.smithi081.stdout:4/794: mknod d3/db/d2d/df0/c100 0 2024-09-18T12:51:28.848 INFO:tasks.workunit.client.0.smithi081.stdout:4/795: chown d3/d20/d3d/d65/d14/d4b/l55 5 1 2024-09-18T12:51:28.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/796: rename d3/db/d58/d9f to d3/d20/d3d/d65/d45/d6c/dec/df6/d101 0 2024-09-18T12:51:28.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/797: rename d3/d20/d3d/d65/d2f to d3/d20/d3d/d65/d45/d102 0 2024-09-18T12:51:28.853 INFO:tasks.workunit.client.0.smithi081.stdout:4/798: creat d3/d20/d3d/d65/d45/d6c/dec/df6/d101/f103 x:0 0 0 2024-09-18T12:51:28.855 INFO:tasks.workunit.client.0.smithi081.stdout:4/799: rmdir d3/d20/d3d/d65/d45/dc4 39 2024-09-18T12:51:28.855 INFO:tasks.workunit.client.0.smithi081.stdout:4/800: dread - d3/d20/d3d/d65/d14/d54/f62 zero size 2024-09-18T12:51:28.856 INFO:tasks.workunit.client.0.smithi081.stdout:4/801: mknod d3/db/d2d/c104 0 2024-09-18T12:51:28.856 INFO:tasks.workunit.client.0.smithi081.stdout:4/802: fdatasync d3/d20/d3d/f8f 0 2024-09-18T12:51:28.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/803: mkdir d3/db/d35/d79/d95/d105 0 2024-09-18T12:51:28.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/804: mkdir d3/d20/d3d/d65/d45/d102/d106 0 2024-09-18T12:51:28.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/805: stat d3/d20/d3d/d65/d45/d4f/la8 0 2024-09-18T12:51:28.863 INFO:tasks.workunit.client.0.smithi081.stdout:4/806: rename d3/d20/d5b/ccc to d3/db/d2d/df4/c107 0 2024-09-18T12:51:28.873 INFO:tasks.workunit.client.0.smithi081.stdout:4/807: write d3/d20/d3d/d65/d14/f88 [3939447,46318] 0 2024-09-18T12:51:28.873 INFO:tasks.workunit.client.0.smithi081.stdout:4/808: fsync d3/d20/d3d/d65/d14/d27/fba 0 2024-09-18T12:51:28.888 INFO:tasks.workunit.client.0.smithi081.stdout:4/809: dwrite d3/d20/d3d/d65/d14/f29 [0,4194304] 0 2024-09-18T12:51:28.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/810: write d3/d20/d3d/d65/d45/d4f/f5a [3607804,102320] 0 2024-09-18T12:51:28.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/811: write d3/d20/d3d/d65/d14/d27/fb4 [1122110,115414] 0 2024-09-18T12:51:28.900 INFO:tasks.workunit.client.0.smithi081.stdout:0/740: sync 2024-09-18T12:51:28.900 INFO:tasks.workunit.client.0.smithi081.stdout:7/676: sync 2024-09-18T12:51:28.900 INFO:tasks.workunit.client.0.smithi081.stdout:7/677: readlink d2/d1d/l37 0 2024-09-18T12:51:28.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/810: sync 2024-09-18T12:51:28.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/811: stat d2/d14/d33/d37/d3b/d6a/c53 0 2024-09-18T12:51:28.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/812: chown d2/d14/d33/d37/d3b/d2a/f94 3 1 2024-09-18T12:51:28.902 INFO:tasks.workunit.client.0.smithi081.stdout:8/808: sync 2024-09-18T12:51:28.903 INFO:tasks.workunit.client.0.smithi081.stdout:4/812: symlink d3/db/d2d/l108 0 2024-09-18T12:51:28.905 INFO:tasks.workunit.client.0.smithi081.stdout:4/813: creat d3/d20/d3d/d65/d45/d6c/dec/df6/d101/dde/f109 x:0 0 0 2024-09-18T12:51:28.906 INFO:tasks.workunit.client.0.smithi081.stdout:4/814: mknod d3/c10a 0 2024-09-18T12:51:28.909 INFO:tasks.workunit.client.0.smithi081.stdout:4/815: creat d3/d20/d3d/d65/f10b x:0 0 0 2024-09-18T12:51:28.912 INFO:tasks.workunit.client.0.smithi081.stdout:4/816: mkdir d3/db/d2d/d10c 0 2024-09-18T12:51:28.913 INFO:tasks.workunit.client.0.smithi081.stdout:7/678: write d2/d42/f43 [4141964,53118] 0 2024-09-18T12:51:28.918 INFO:tasks.workunit.client.0.smithi081.stdout:8/809: dwrite d3/d1d/d4a/d8d/fba [0,4194304] 0 2024-09-18T12:51:28.925 INFO:tasks.workunit.client.0.smithi081.stdout:0/741: dwrite d7/d5d/dd9/ff2 [0,4194304] 0 2024-09-18T12:51:28.949 INFO:tasks.workunit.client.0.smithi081.stdout:7/679: dwrite d2/d18/d3c/f65 [0,4194304] 0 2024-09-18T12:51:28.949 INFO:tasks.workunit.client.0.smithi081.stdout:7/680: creat d2/d14/d21/d49/fe4 x:0 0 0 2024-09-18T12:51:28.949 INFO:tasks.workunit.client.0.smithi081.stdout:8/810: dwrite d3/d1e/f77 [0,4194304] 0 2024-09-18T12:51:28.950 INFO:tasks.workunit.client.0.smithi081.stdout:8/811: chown d3/d1d/d4a/d8d 854478878 1 2024-09-18T12:51:28.950 INFO:tasks.workunit.client.0.smithi081.stdout:8/812: read - d3/d1d/d9f/f106 zero size 2024-09-18T12:51:28.950 INFO:tasks.workunit.client.0.smithi081.stdout:4/817: dwrite d3/d20/d3d/d65/d14/d4b/f74 [0,4194304] 0 2024-09-18T12:51:28.950 INFO:tasks.workunit.client.0.smithi081.stdout:0/742: dwrite d7/d9/d4b/d4a/d92/f9b [0,4194304] 0 2024-09-18T12:51:28.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/813: link d3/d1e/d4c/d53/f5f d3/d1d/d9f/dcf/dee/f10f 0 2024-09-18T12:51:28.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/814: read - d3/d1e/d4c/d68/daa/fdf zero size 2024-09-18T12:51:28.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/815: creat d3/d1d/d4a/d7f/f110 x:0 0 0 2024-09-18T12:51:28.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/816: readlink d3/d1e/d4c/lc4 0 2024-09-18T12:51:28.962 INFO:tasks.workunit.client.0.smithi081.stdout:0/743: write d7/d9/d4b/d4a/f16 [160495,116561] 0 2024-09-18T12:51:28.962 INFO:tasks.workunit.client.0.smithi081.stdout:0/744: chown d7/d9/d4b/d33/d43/d9a/ff3 185 1 2024-09-18T12:51:28.962 INFO:tasks.workunit.client.0.smithi081.stdout:0/745: chown d7/d9/d12/dba 38182061 1 2024-09-18T12:51:28.964 INFO:tasks.workunit.client.0.smithi081.stdout:4/818: dread d3/d20/d3d/fcf [0,4194304] 0 2024-09-18T12:51:28.965 INFO:tasks.workunit.client.0.smithi081.stdout:0/746: symlink d7/d9/d4b/d33/d43/lfd 0 2024-09-18T12:51:28.965 INFO:tasks.workunit.client.0.smithi081.stdout:0/747: dread - d7/d9/d4b/d4a/fc6 zero size 2024-09-18T12:51:28.968 INFO:tasks.workunit.client.0.smithi081.stdout:8/817: write d3/d1e/d4c/d68/f82 [2894184,103279] 0 2024-09-18T12:51:28.969 INFO:tasks.workunit.client.0.smithi081.stdout:4/819: mkdir d3/d20/d3d/d65/d45/d6c/dec/d10d 0 2024-09-18T12:51:28.969 INFO:tasks.workunit.client.0.smithi081.stdout:4/820: write d3/d20/d3d/d65/d14/d54/fac [1560998,78093] 0 2024-09-18T12:51:28.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/821: read d3/d20/d3d/d65/d14/d27/fba [31042,15390] 0 2024-09-18T12:51:28.973 INFO:tasks.workunit.client.0.smithi081.stdout:4/822: unlink d3/d20/d3d/d65/fa5 0 2024-09-18T12:51:28.980 INFO:tasks.workunit.client.0.smithi081.stdout:7/681: dwrite d2/d18/d22/f25 [0,4194304] 0 2024-09-18T12:51:28.980 INFO:tasks.workunit.client.0.smithi081.stdout:7/682: write d2/d14/d21/d62/da7/f47 [1509317,30798] 0 2024-09-18T12:51:28.980 INFO:tasks.workunit.client.0.smithi081.stdout:7/683: chown d2/d14/d21/d62/da7/c4d 19 1 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:3/859: sync 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:6/792: sync 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:1/859: sync 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:1/860: chown d0/d6/d33/d37 3 1 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:6/793: truncate d4/d88/fb9 181862 0 2024-09-18T12:51:28.983 INFO:tasks.workunit.client.0.smithi081.stdout:7/684: unlink d2/d1d/l46 0 2024-09-18T12:51:28.986 INFO:tasks.workunit.client.0.smithi081.stdout:6/794: creat d4/d12/f102 x:0 0 0 2024-09-18T12:51:28.986 INFO:tasks.workunit.client.0.smithi081.stdout:6/795: chown d4/d12/d28/d2a/d74/d8b/fa1 57953 1 2024-09-18T12:51:28.986 INFO:tasks.workunit.client.0.smithi081.stdout:6/796: chown d4/d6/db4 122 1 2024-09-18T12:51:28.987 INFO:tasks.workunit.client.0.smithi081.stdout:7/685: mknod d2/d14/d21/d49/dcc/ce5 0 2024-09-18T12:51:28.988 INFO:tasks.workunit.client.0.smithi081.stdout:1/861: rmdir d0/db/d4f 39 2024-09-18T12:51:28.990 INFO:tasks.workunit.client.0.smithi081.stdout:7/686: truncate d2/f4a 5788328 0 2024-09-18T12:51:28.990 INFO:tasks.workunit.client.0.smithi081.stdout:7/687: write d2/d42/f43 [4760585,3528] 0 2024-09-18T12:51:28.990 INFO:tasks.workunit.client.0.smithi081.stdout:7/688: fsync d2/d18/f3b 0 2024-09-18T12:51:28.991 INFO:tasks.workunit.client.0.smithi081.stdout:9/769: sync 2024-09-18T12:51:28.991 INFO:tasks.workunit.client.0.smithi081.stdout:9/770: creat dd/d15/d1a/da7/dce/d73/ff7 x:0 0 0 2024-09-18T12:51:28.991 INFO:tasks.workunit.client.0.smithi081.stdout:9/771: write dd/de/d59/f84 [2032557,63886] 0 2024-09-18T12:51:28.991 INFO:tasks.workunit.client.0.smithi081.stdout:9/772: read dd/d1d/d1e/d24/f33 [1774951,4734] 0 2024-09-18T12:51:28.991 INFO:tasks.workunit.client.0.smithi081.stdout:3/860: dread d3/db/f4b [0,4194304] 0 2024-09-18T12:51:28.992 INFO:tasks.workunit.client.0.smithi081.stdout:3/861: dread - d3/db/df/d29/d13/d9d/d11e/f126 zero size 2024-09-18T12:51:28.992 INFO:tasks.workunit.client.0.smithi081.stdout:7/689: symlink d2/d56/d73/le6 0 2024-09-18T12:51:28.992 INFO:tasks.workunit.client.0.smithi081.stdout:7/690: creat d2/d18/d3c/fe7 x:0 0 0 2024-09-18T12:51:28.993 INFO:tasks.workunit.client.0.smithi081.stdout:9/773: truncate dd/d15/d1a/da7/dce/d73/fe4 33242 0 2024-09-18T12:51:28.993 INFO:tasks.workunit.client.0.smithi081.stdout:9/774: fdatasync dd/d15/d1a/da7/fd3 0 2024-09-18T12:51:28.993 INFO:tasks.workunit.client.0.smithi081.stdout:9/775: fdatasync dd/d15/d1a/da7/dce/fa6 0 2024-09-18T12:51:28.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/862: mkdir d3/db/df/d29/d13/d9d/d12d 0 2024-09-18T12:51:28.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/863: stat d3/db/df/d113/d44/d51/dde/ld3 0 2024-09-18T12:51:28.996 INFO:tasks.workunit.client.0.smithi081.stdout:6/797: write d4/d12/d28/d2a/d2d/d31/fb6 [2851326,48946] 0 2024-09-18T12:51:28.996 INFO:tasks.workunit.client.0.smithi081.stdout:0/748: dwrite d7/d9/d12/dba/f85 [0,4194304] 0 2024-09-18T12:51:28.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/818: dwrite d3/d1d/f55 [0,4194304] 0 2024-09-18T12:51:28.998 INFO:tasks.workunit.client.0.smithi081.stdout:7/691: rename d2/d14/d21/d49/cda to d2/d18/d60/ce8 0 2024-09-18T12:51:29.003 INFO:tasks.workunit.client.0.smithi081.stdout:6/798: creat d4/d6/d95/f103 x:0 0 0 2024-09-18T12:51:29.008 INFO:tasks.workunit.client.0.smithi081.stdout:3/864: dread d3/db/df/d113/d44/f62 [0,4194304] 0 2024-09-18T12:51:29.008 INFO:tasks.workunit.client.0.smithi081.stdout:3/865: truncate d3/db/df/d60/fd2 1762585 0 2024-09-18T12:51:29.010 INFO:tasks.workunit.client.0.smithi081.stdout:7/692: creat d2/d56/d73/d7c/fe9 x:0 0 0 2024-09-18T12:51:29.012 INFO:tasks.workunit.client.0.smithi081.stdout:9/776: rmdir dd/d31 39 2024-09-18T12:51:29.012 INFO:tasks.workunit.client.0.smithi081.stdout:9/777: write f8 [1892128,94165] 0 2024-09-18T12:51:29.012 INFO:tasks.workunit.client.0.smithi081.stdout:9/778: fsync dd/de/d4f/f9c 0 2024-09-18T12:51:29.013 INFO:tasks.workunit.client.0.smithi081.stdout:9/779: fsync dd/de/d4f/d8c/fa1 0 2024-09-18T12:51:29.015 INFO:tasks.workunit.client.0.smithi081.stdout:0/749: getdents d7/d5d/dd9 0 2024-09-18T12:51:29.015 INFO:tasks.workunit.client.0.smithi081.stdout:0/750: readlink d7/d9/d12/dba/l8b 0 2024-09-18T12:51:29.019 INFO:tasks.workunit.client.0.smithi081.stdout:3/866: rename d3/db/df/d29/d13/d9d/d107/lb4 to d3/db/df/d29/d13/d9d/l12e 0 2024-09-18T12:51:29.019 INFO:tasks.workunit.client.0.smithi081.stdout:3/867: creat d3/db/df/d29/d13/d9d/f12f x:0 0 0 2024-09-18T12:51:29.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/819: dwrite d3/f57 [4194304,4194304] 0 2024-09-18T12:51:29.022 INFO:tasks.workunit.client.0.smithi081.stdout:7/693: dread d2/d14/f44 [0,4194304] 0 2024-09-18T12:51:29.023 INFO:tasks.workunit.client.0.smithi081.stdout:9/780: creat dd/d31/dd5/ff8 x:0 0 0 2024-09-18T12:51:29.024 INFO:tasks.workunit.client.0.smithi081.stdout:9/781: chown dd/d1d/d1e/d24/f33 8625836 1 2024-09-18T12:51:29.024 INFO:tasks.workunit.client.0.smithi081.stdout:9/782: fdatasync dd/d31/f8b 0 2024-09-18T12:51:29.024 INFO:tasks.workunit.client.0.smithi081.stdout:9/783: dread - dd/f74 zero size 2024-09-18T12:51:29.026 INFO:tasks.workunit.client.0.smithi081.stdout:6/799: mknod d4/d12/d1c/d39/d60/db8/c104 0 2024-09-18T12:51:29.031 INFO:tasks.workunit.client.0.smithi081.stdout:0/751: mkdir d7/d9/d4b/d33/d7d/dfe 0 2024-09-18T12:51:29.031 INFO:tasks.workunit.client.0.smithi081.stdout:0/752: write d7/d9/d4b/d4a/d77/fdc [738042,110580] 0 2024-09-18T12:51:29.038 INFO:tasks.workunit.client.0.smithi081.stdout:3/868: creat d3/db/df/d113/d44/d51/dde/de1/f130 x:0 0 0 2024-09-18T12:51:29.043 INFO:tasks.workunit.client.0.smithi081.stdout:9/784: creat dd/d15/d1a/da7/dce/ddd/def/ff9 x:0 0 0 2024-09-18T12:51:29.045 INFO:tasks.workunit.client.0.smithi081.stdout:6/800: symlink d4/d12/d56/d7d/d84/l105 0 2024-09-18T12:51:29.049 INFO:tasks.workunit.client.0.smithi081.stdout:0/753: creat d7/d9/d4b/d4a/d92/fff x:0 0 0 2024-09-18T12:51:29.049 INFO:tasks.workunit.client.0.smithi081.stdout:0/754: creat d7/d9/d12/dba/f100 x:0 0 0 2024-09-18T12:51:29.049 INFO:tasks.workunit.client.0.smithi081.stdout:0/755: stat d7/d9/d12/dba/f100 0 2024-09-18T12:51:29.052 INFO:tasks.workunit.client.0.smithi081.stdout:7/694: getdents d2/d56/d73/da4 0 2024-09-18T12:51:29.055 INFO:tasks.workunit.client.0.smithi081.stdout:3/869: dread d3/d84/fda [0,4194304] 0 2024-09-18T12:51:29.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/820: dwrite d3/d1e/d4c/d53/f7d [0,4194304] 0 2024-09-18T12:51:29.058 INFO:tasks.workunit.client.0.smithi081.stdout:6/801: rename d4/d12/d1c/d39/f89 to d4/d12/d28/d2a/d98/dd8/f106 0 2024-09-18T12:51:29.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/870: dread d3/db/df/d113/d44/d6f/f9a [0,4194304] 0 2024-09-18T12:51:29.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/871: write d3/db/f56 [4402542,90364] 0 2024-09-18T12:51:29.069 INFO:tasks.workunit.client.0.smithi081.stdout:9/785: dwrite dd/d1d/d1e/d77/fec [0,4194304] 0 2024-09-18T12:51:29.069 INFO:tasks.workunit.client.0.smithi081.stdout:9/786: truncate dd/d1d/d1e/d2f/dc4/dcc/ff5 882682 0 2024-09-18T12:51:29.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/802: getdents d4/d88 0 2024-09-18T12:51:29.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/803: creat d4/d12/d56/f107 x:0 0 0 2024-09-18T12:51:29.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/804: chown d4/d6/d95/ldd 130 1 2024-09-18T12:51:29.072 INFO:tasks.workunit.client.0.smithi081.stdout:0/756: getdents d7/d9/d4b/d33/db1 0 2024-09-18T12:51:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/695: getdents d2/d56/dc8 0 2024-09-18T12:51:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/696: fdatasync d2/d56/d73/d90/f93 0 2024-09-18T12:51:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/697: write d2/d14/d21/f72 [1550890,33969] 0 2024-09-18T12:51:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:8/821: dwrite d3/d1e/d4c/d53/f7d [0,4194304] 0 2024-09-18T12:51:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:8/822: stat d3/d1d/d4a/c65 0 2024-09-18T12:51:29.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/787: dread dd/d15/d1a/da7/fd6 [0,4194304] 0 2024-09-18T12:51:29.088 INFO:tasks.workunit.client.0.smithi081.stdout:7/698: creat d2/d18/d60/daa/fea x:0 0 0 2024-09-18T12:51:29.092 INFO:tasks.workunit.client.0.smithi081.stdout:6/805: link d4/d12/d1c/d64/ff5 d4/d12/d56/d7d/d91/f108 0 2024-09-18T12:51:29.093 INFO:tasks.workunit.client.0.smithi081.stdout:7/699: creat d2/d56/d73/da4/feb x:0 0 0 2024-09-18T12:51:29.095 INFO:tasks.workunit.client.0.smithi081.stdout:9/788: rename dd/de/d7a to dd/d1d/d1e/d77/dfa 0 2024-09-18T12:51:29.097 INFO:tasks.workunit.client.0.smithi081.stdout:6/806: mknod d4/d12/d56/d7d/d91/c109 0 2024-09-18T12:51:29.097 INFO:tasks.workunit.client.0.smithi081.stdout:6/807: rmdir d4 39 2024-09-18T12:51:29.098 INFO:tasks.workunit.client.0.smithi081.stdout:6/808: mkdir d4/d12/d28/d2a/d97/ddc/d10a 0 2024-09-18T12:51:29.099 INFO:tasks.workunit.client.0.smithi081.stdout:6/809: mkdir d4/d6/d95/d10b 0 2024-09-18T12:51:29.099 INFO:tasks.workunit.client.0.smithi081.stdout:6/810: write d4/d12/d28/d2a/d2d/d31/fb6 [5046872,34796] 0 2024-09-18T12:51:29.101 INFO:tasks.workunit.client.0.smithi081.stdout:6/811: creat d4/d12/d28/d2a/d74/d8b/f10c x:0 0 0 2024-09-18T12:51:29.105 INFO:tasks.workunit.client.0.smithi081.stdout:3/872: dwrite d3/db/df/f6d [0,4194304] 0 2024-09-18T12:51:29.105 INFO:tasks.workunit.client.0.smithi081.stdout:3/873: readlink d3/db/df/d113/d44/df2/lfd 0 2024-09-18T12:51:29.105 INFO:tasks.workunit.client.0.smithi081.stdout:3/874: fsync d3/db/df/d29/f11f 0 2024-09-18T12:51:29.105 INFO:tasks.workunit.client.0.smithi081.stdout:0/757: dwrite d7/d9/d4b/d33/f52 [0,4194304] 0 2024-09-18T12:51:29.105 INFO:tasks.workunit.client.0.smithi081.stdout:3/875: truncate d3/db/df/d29/d13/d9d/f12f 386682 0 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:0/758: write d7/d9/d4b/d33/d7d/fd1 [158007,110811] 0 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:0/759: creat d7/d9/d4b/f101 x:0 0 0 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:0/760: fsync d7/d9/d4b/d3d/f91 0 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:8/823: dwrite d3/d1e/d4c/f103 [0,4194304] 0 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:8/824: dread - d3/d1d/d4a/d7f/f108 zero size 2024-09-18T12:51:29.106 INFO:tasks.workunit.client.0.smithi081.stdout:8/825: read - d3/d1d/f5e zero size 2024-09-18T12:51:29.112 INFO:tasks.workunit.client.0.smithi081.stdout:3/876: creat d3/db/df/d29/d13/d93/d11d/f131 x:0 0 0 2024-09-18T12:51:29.115 INFO:tasks.workunit.client.0.smithi081.stdout:0/761: mknod d7/d9/d4b/d4a/d77/c102 0 2024-09-18T12:51:29.118 INFO:tasks.workunit.client.0.smithi081.stdout:8/826: link d3/d1e/d4c/d53/c6d d3/d1d/d4a/c111 0 2024-09-18T12:51:29.119 INFO:tasks.workunit.client.0.smithi081.stdout:3/877: mknod d3/db/df/d113/d44/df2/df6/c132 0 2024-09-18T12:51:29.121 INFO:tasks.workunit.client.0.smithi081.stdout:0/762: readlink d7/d9/d12/l6b 0 2024-09-18T12:51:29.122 INFO:tasks.workunit.client.0.smithi081.stdout:7/700: dwrite d2/d18/d3c/fd1 [0,4194304] 0 2024-09-18T12:51:29.122 INFO:tasks.workunit.client.0.smithi081.stdout:7/701: creat d2/d18/d22/d48/db9/fec x:0 0 0 2024-09-18T12:51:29.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/827: creat d3/d1e/d4c/f112 x:0 0 0 2024-09-18T12:51:29.123 INFO:tasks.workunit.client.0.smithi081.stdout:6/812: dwrite d4/d12/d1c/f57 [0,4194304] 0 2024-09-18T12:51:29.125 INFO:tasks.workunit.client.0.smithi081.stdout:0/763: mknod d7/d5d/c103 0 2024-09-18T12:51:29.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/828: rmdir d3/d1d/d4a/da9 39 2024-09-18T12:51:29.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/829: fsync d3/d1e/d4c/d68/f83 0 2024-09-18T12:51:29.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/830: fdatasync d3/d1d/f8b 0 2024-09-18T12:51:29.139 INFO:tasks.workunit.client.0.smithi081.stdout:6/813: creat d4/d12/d56/d7d/d84/dc9/f10d x:0 0 0 2024-09-18T12:51:29.139 INFO:tasks.workunit.client.0.smithi081.stdout:7/702: dread d2/d14/d21/d62/da7/f2e [0,4194304] 0 2024-09-18T12:51:29.143 INFO:tasks.workunit.client.0.smithi081.stdout:6/814: mkdir d4/d12/d28/d2a/d74/d10e 0 2024-09-18T12:51:29.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/815: creat d4/d12/d28/d2a/d74/d8b/d6f/f10f x:0 0 0 2024-09-18T12:51:29.148 INFO:tasks.workunit.client.0.smithi081.stdout:6/816: rmdir d4/d12/d56/d7d/d84 39 2024-09-18T12:51:29.148 INFO:tasks.workunit.client.0.smithi081.stdout:6/817: fdatasync d4/d6/f27 0 2024-09-18T12:51:29.150 INFO:tasks.workunit.client.0.smithi081.stdout:6/818: mknod d4/d12/d28/d2a/c110 0 2024-09-18T12:51:29.150 INFO:tasks.workunit.client.0.smithi081.stdout:7/703: dread d2/d18/d3c/fd1 [0,4194304] 0 2024-09-18T12:51:29.150 INFO:tasks.workunit.client.0.smithi081.stdout:0/764: dwrite d7/d9/d4b/d4a/fce [0,4194304] 0 2024-09-18T12:51:29.150 INFO:tasks.workunit.client.0.smithi081.stdout:0/765: chown d7/d9/d4b/d4a/d92/f9b 56 1 2024-09-18T12:51:29.150 INFO:tasks.workunit.client.0.smithi081.stdout:0/766: creat d7/d9/d4b/d33/d43/d9a/f104 x:0 0 0 2024-09-18T12:51:29.156 INFO:tasks.workunit.client.0.smithi081.stdout:6/819: mknod d4/d12/d28/d2a/d74/d10e/c111 0 2024-09-18T12:51:29.163 INFO:tasks.workunit.client.0.smithi081.stdout:6/820: symlink d4/d12/d28/d2a/d98/dd8/de5/l112 0 2024-09-18T12:51:29.164 INFO:tasks.workunit.client.0.smithi081.stdout:3/878: dwrite d3/db/df/f6d [0,4194304] 0 2024-09-18T12:51:29.164 INFO:tasks.workunit.client.0.smithi081.stdout:3/879: chown d3/db/d1b/d57/l52 102331330 1 2024-09-18T12:51:29.164 INFO:tasks.workunit.client.0.smithi081.stdout:8/831: dwrite d3/d1d/d4a/d8d/f8f [0,4194304] 0 2024-09-18T12:51:29.168 INFO:tasks.workunit.client.0.smithi081.stdout:3/880: mkdir d3/db/df/d3b/dc0/d133 0 2024-09-18T12:51:29.168 INFO:tasks.workunit.client.0.smithi081.stdout:3/881: fdatasync d3/d84/fda 0 2024-09-18T12:51:29.170 INFO:tasks.workunit.client.0.smithi081.stdout:8/832: rename d3/d1e/d4c/lc4 to d3/d1e/d4c/d68/l113 0 2024-09-18T12:51:29.172 INFO:tasks.workunit.client.0.smithi081.stdout:8/833: truncate d3/d1e/f34 5917822 0 2024-09-18T12:51:29.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/882: creat d3/db/df/d29/d13/f134 x:0 0 0 2024-09-18T12:51:29.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/883: stat d3/db/df/d29/d13/d9d/d107/f28 0 2024-09-18T12:51:29.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/884: readlink d3/db/df/d113/d44/d51/dde/de1/ldf 0 2024-09-18T12:51:29.173 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: mgrmap e22: smithi136.vdkrdt(active, since 1.03511s) 2024-09-18T12:51:29.173 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: pgmap v3: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:29.173 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:29.174 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:29 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:29.175 INFO:tasks.workunit.client.0.smithi081.stdout:8/834: mkdir d3/d1d/d9f/d114 0 2024-09-18T12:51:29.175 INFO:tasks.workunit.client.0.smithi081.stdout:8/835: dread - d3/d1e/d4c/ffe zero size 2024-09-18T12:51:29.175 INFO:tasks.workunit.client.0.smithi081.stdout:8/836: truncate d3/d2f/fe3 870521 0 2024-09-18T12:51:29.175 INFO:tasks.workunit.client.0.smithi081.stdout:3/885: mkdir d3/db/d1b/d135 0 2024-09-18T12:51:29.175 INFO:tasks.workunit.client.0.smithi081.stdout:3/886: fdatasync d3/db/df/f10a 0 2024-09-18T12:51:29.177 INFO:tasks.workunit.client.0.smithi081.stdout:8/837: mknod d3/d1e/d4c/d100/c115 0 2024-09-18T12:51:29.179 INFO:tasks.workunit.client.0.smithi081.stdout:0/767: dwrite d7/d9/d4b/d33/d7d/f88 [0,4194304] 0 2024-09-18T12:51:29.179 INFO:tasks.workunit.client.0.smithi081.stdout:8/838: creat d3/d1d/d89/db5/db8/f116 x:0 0 0 2024-09-18T12:51:29.179 INFO:tasks.workunit.client.0.smithi081.stdout:8/839: stat d3/d1d/d4a/le8 0 2024-09-18T12:51:29.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/704: dwrite d2/d18/d60/daa/fce [0,4194304] 0 2024-09-18T12:51:29.181 INFO:tasks.workunit.client.0.smithi081.stdout:8/840: mknod d3/d1d/d4a/c117 0 2024-09-18T12:51:29.182 INFO:tasks.workunit.client.0.smithi081.stdout:8/841: creat d3/d1d/d9f/f118 x:0 0 0 2024-09-18T12:51:29.186 INFO:tasks.workunit.client.0.smithi081.stdout:7/705: creat d2/d18/d22/fed x:0 0 0 2024-09-18T12:51:29.186 INFO:tasks.workunit.client.0.smithi081.stdout:0/768: dread d7/d9/d4b/d3d/f89 [0,4194304] 0 2024-09-18T12:51:29.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/769: link d7/d9/d4b/d4a/d77/ca6 d7/d7c/c105 0 2024-09-18T12:51:29.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/770: read d7/d9/d4b/d4a/f1e [953249,26666] 0 2024-09-18T12:51:29.193 INFO:tasks.workunit.client.0.smithi081.stdout:0/771: write d7/d9/d12/dba/f100 [149777,12180] 0 2024-09-18T12:51:29.193 INFO:tasks.workunit.client.0.smithi081.stdout:0/772: fdatasync d7/d9/d4b/d33/d43/fe2 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/706: getdents d2 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/707: write d2/d56/d73/da4/feb [17164,130402] 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/708: dread - d2/d18/d22/d48/db9/fec zero size 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/709: readlink d2/l1a 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/710: stat d2/d42 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:6/821: write d4/d6/f70 [1750356,98217] 0 2024-09-18T12:51:29.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/887: dwrite d3/db/df/d113/d44/d6f/fa6 [0,4194304] 0 2024-09-18T12:51:29.202 INFO:tasks.workunit.client.0.smithi081.stdout:6/822: rename d4/d12/d56/d7d/d84/dc9/f10d to d4/d12/d28/d2a/d97/f113 0 2024-09-18T12:51:29.204 INFO:tasks.workunit.client.0.smithi081.stdout:8/842: dwrite d3/d1e/d4c/f112 [0,4194304] 0 2024-09-18T12:51:29.211 INFO:tasks.workunit.client.0.smithi081.stdout:0/773: getdents d7/d9 0 2024-09-18T12:51:29.212 INFO:tasks.workunit.client.0.smithi081.stdout:6/823: symlink d4/d88/l114 0 2024-09-18T12:51:29.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/843: rmdir d3/d1e/d4c/d68/d105 0 2024-09-18T12:51:29.217 INFO:tasks.workunit.client.0.smithi081.stdout:8/844: write d3/d1e/d4c/d53/fab [645897,54197] 0 2024-09-18T12:51:29.220 INFO:tasks.workunit.client.0.smithi081.stdout:6/824: mkdir d4/d12/d1c/d39/d115 0 2024-09-18T12:51:29.224 INFO:tasks.workunit.client.0.smithi081.stdout:8/845: mknod d3/d1d/d4a/d7f/d10e/c119 0 2024-09-18T12:51:29.226 INFO:tasks.workunit.client.0.smithi081.stdout:0/774: dread d7/d9/d4b/d4a/fce [0,4194304] 0 2024-09-18T12:51:29.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/888: dwrite d3/db/df/d113/d44/f62 [0,4194304] 0 2024-09-18T12:51:29.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/889: chown d3/db/df/d29/d13/d9d/d107/cb1 61473 1 2024-09-18T12:51:29.229 INFO:tasks.workunit.client.0.smithi081.stdout:6/825: mkdir d4/d12/d56/d7d/d116 0 2024-09-18T12:51:29.230 INFO:tasks.workunit.client.0.smithi081.stdout:8/846: creat d3/d1e/d4c/dae/f11a x:0 0 0 2024-09-18T12:51:29.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/711: dwrite d2/d1d/d4e/d84/fb1 [0,4194304] 0 2024-09-18T12:51:29.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/712: write d2/d56/d73/d7c/fdf [329569,28912] 0 2024-09-18T12:51:29.239 INFO:tasks.workunit.client.0.smithi081.stdout:0/775: rename d7/d9/d4b/ff1 to d7/d9/d4b/d53/f106 0 2024-09-18T12:51:29.241 INFO:tasks.workunit.client.0.smithi081.stdout:6/826: creat d4/d12/d56/d7d/d9f/da2/f117 x:0 0 0 2024-09-18T12:51:29.241 INFO:tasks.workunit.client.0.smithi081.stdout:6/827: stat d4/d12/d1c/d39/lab 0 2024-09-18T12:51:29.242 INFO:tasks.workunit.client.0.smithi081.stdout:6/828: write d4/d12/d28/d2a/d74/d8b/fa1 [1242229,25114] 0 2024-09-18T12:51:29.244 INFO:tasks.workunit.client.0.smithi081.stdout:7/713: mkdir d2/d18/d60/d85/dee 0 2024-09-18T12:51:29.244 INFO:tasks.workunit.client.0.smithi081.stdout:7/714: chown d2/d14/d21/l57 19 1 2024-09-18T12:51:29.246 INFO:tasks.workunit.client.0.smithi081.stdout:8/847: rename d3/d2f/f8a to d3/d1e/d4c/d68/f11b 0 2024-09-18T12:51:29.248 INFO:tasks.workunit.client.0.smithi081.stdout:6/829: symlink d4/d12/d28/d2a/d98/dd8/de5/l118 0 2024-09-18T12:51:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:0/776: dread d7/d9/d4b/d33/d43/d9a/f9e [0,4194304] 0 2024-09-18T12:51:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:0/777: stat d7/d9/d4b/d33/c35 0 2024-09-18T12:51:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:0/778: dread - d7/d9/d4b/d4a/fc6 zero size 2024-09-18T12:51:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:0/779: readlink d7/d9/d12/l37 0 2024-09-18T12:51:29.251 INFO:tasks.workunit.client.0.smithi081.stdout:7/715: mkdir d2/d56/d73/d7c/d86/da6/def 0 2024-09-18T12:51:29.253 INFO:tasks.workunit.client.0.smithi081.stdout:3/890: dwrite d3/db/df/d113/dcc/f104 [0,4194304] 0 2024-09-18T12:51:29.254 INFO:tasks.workunit.client.0.smithi081.stdout:6/830: symlink d4/d12/d1c/d39/dd3/l119 0 2024-09-18T12:51:29.254 INFO:tasks.workunit.client.0.smithi081.stdout:6/831: creat d4/d12/d28/d2a/d74/d8b/d6f/f11a x:0 0 0 2024-09-18T12:51:29.258 INFO:tasks.workunit.client.0.smithi081.stdout:0/780: mknod d7/d9/d4b/d33/d7d/dfe/c107 0 2024-09-18T12:51:29.259 INFO:tasks.workunit.client.0.smithi081.stdout:7/716: mknod d2/d18/d60/d85/ddc/cf0 0 2024-09-18T12:51:29.259 INFO:tasks.workunit.client.0.smithi081.stdout:3/891: dread d3/db/df/fb9 [0,4194304] 0 2024-09-18T12:51:29.262 INFO:tasks.workunit.client.0.smithi081.stdout:0/781: dread d7/d9/d12/dba/f100 [0,4194304] 0 2024-09-18T12:51:29.263 INFO:tasks.workunit.client.0.smithi081.stdout:6/832: link d4/d12/d28/d2a/d74/d8b/f78 d4/d12/d56/d7d/f11b 0 2024-09-18T12:51:29.265 INFO:tasks.workunit.client.0.smithi081.stdout:3/892: truncate d3/db/df/d60/d119/fb5 2647919 0 2024-09-18T12:51:29.265 INFO:tasks.workunit.client.0.smithi081.stdout:3/893: chown d3/db/df/d29/d13/d9d/l11b 2010125 1 2024-09-18T12:51:29.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/782: symlink d7/l108 0 2024-09-18T12:51:29.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/783: dread - d7/d9/d12/df7/fe9 zero size 2024-09-18T12:51:29.267 INFO:tasks.workunit.client.0.smithi081.stdout:6/833: rmdir d4/d12/d28/d2a/d97 39 2024-09-18T12:51:29.269 INFO:tasks.workunit.client.0.smithi081.stdout:6/834: mknod d4/d12/d1c/d8f/da0/c11c 0 2024-09-18T12:51:29.271 INFO:tasks.workunit.client.0.smithi081.stdout:0/784: dread d7/d9/d12/dba/f5a [0,4194304] 0 2024-09-18T12:51:29.271 INFO:tasks.workunit.client.0.smithi081.stdout:0/785: chown d7/d9/l2f 695634528 1 2024-09-18T12:51:29.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/894: dread d3/db/df/d29/d13/d9d/d107/fd6 [0,4194304] 0 2024-09-18T12:51:29.277 INFO:tasks.workunit.client.0.smithi081.stdout:0/786: rename d7/d9/d4b/d3d/f5e to d7/d9/d4b/d33/d43/d9a/f109 0 2024-09-18T12:51:29.277 INFO:tasks.workunit.client.0.smithi081.stdout:0/787: dread - d7/d9/d4b/d33/d43/d9a/ff3 zero size 2024-09-18T12:51:29.277 INFO:tasks.workunit.client.0.smithi081.stdout:0/788: dread - d7/d9/d4b/d33/db1/ff5 zero size 2024-09-18T12:51:29.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/717: dwrite d2/d14/d21/fbb [0,4194304] 0 2024-09-18T12:51:29.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/718: stat d2/d14/d21/d62/da7/f47 0 2024-09-18T12:51:29.290 INFO:tasks.workunit.client.0.smithi081.stdout:8/848: dwrite d3/d1d/d4a/f4e [0,4194304] 0 2024-09-18T12:51:29.291 INFO:tasks.workunit.client.0.smithi081.stdout:8/849: read d3/d1e/d4c/f64 [2429898,9753] 0 2024-09-18T12:51:29.291 INFO:tasks.workunit.client.0.smithi081.stdout:8/850: chown d3/lb3 0 1 2024-09-18T12:51:29.292 INFO:tasks.workunit.client.0.smithi081.stdout:7/719: dread d2/d14/d21/fbb [0,4194304] 0 2024-09-18T12:51:29.298 INFO:tasks.workunit.client.0.smithi081.stdout:7/720: read d2/d14/d21/d49/fb7 [198455,38821] 0 2024-09-18T12:51:29.301 INFO:tasks.workunit.client.0.smithi081.stdout:3/895: rmdir d3/db/df/d60 39 2024-09-18T12:51:29.304 INFO:tasks.workunit.client.0.smithi081.stdout:7/721: mkdir d2/d18/d22/d48/df1 0 2024-09-18T12:51:29.305 INFO:tasks.workunit.client.0.smithi081.stdout:3/896: mknod d3/db/df/d29/d13/d9d/c136 0 2024-09-18T12:51:29.305 INFO:tasks.workunit.client.0.smithi081.stdout:3/897: write d3/db/df/d113/d44/d6f/fe2 [1328629,79903] 0 2024-09-18T12:51:29.306 INFO:tasks.workunit.client.0.smithi081.stdout:6/835: dwrite d4/f7 [0,4194304] 0 2024-09-18T12:51:29.307 INFO:tasks.workunit.client.0.smithi081.stdout:6/836: creat d4/d6/d95/f11d x:0 0 0 2024-09-18T12:51:29.307 INFO:tasks.workunit.client.0.smithi081.stdout:7/722: creat d2/d18/d60/ff2 x:0 0 0 2024-09-18T12:51:29.307 INFO:tasks.workunit.client.0.smithi081.stdout:7/723: write d2/d18/d22/fed [771116,94178] 0 2024-09-18T12:51:29.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/837: symlink d4/d12/d1c/d39/l11e 0 2024-09-18T12:51:29.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/838: stat d4/d12/d1c/d39/c5f 0 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: mgrmap e22: smithi136.vdkrdt(active, since 1.03511s) 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: pgmap v3: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:29 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi136.vdkrdt/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:29.316 INFO:tasks.workunit.client.0.smithi081.stdout:6/839: truncate d4/f21 2494928 0 2024-09-18T12:51:29.319 INFO:tasks.workunit.client.0.smithi081.stdout:6/840: rename d4/d12/d1c/d39/d60/c76 to d4/d12/d56/d7d/d84/dec/dee/c11f 0 2024-09-18T12:51:29.321 INFO:tasks.workunit.client.0.smithi081.stdout:6/841: creat d4/d12/d56/d7d/d84/dec/dee/f120 x:0 0 0 2024-09-18T12:51:29.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/851: dwrite d3/dc9/fca [0,4194304] 0 2024-09-18T12:51:29.325 INFO:tasks.workunit.client.0.smithi081.stdout:6/842: symlink d4/d12/d28/d2a/d74/d8b/d6f/l121 0 2024-09-18T12:51:29.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/852: link d3/d1e/f2b d3/d1d/d89/db5/db8/f11c 0 2024-09-18T12:51:29.329 INFO:tasks.workunit.client.0.smithi081.stdout:0/789: dwrite d7/d9/d4b/d4a/f72 [0,4194304] 0 2024-09-18T12:51:29.330 INFO:tasks.workunit.client.0.smithi081.stdout:8/853: link d3/d1d/d4a/fa7 d3/d1d/d9f/dcf/dee/f11d 0 2024-09-18T12:51:29.336 INFO:tasks.workunit.client.0.smithi081.stdout:6/843: dread f1 [0,4194304] 0 2024-09-18T12:51:29.343 INFO:tasks.workunit.client.0.smithi081.stdout:0/790: symlink d7/d5d/l10a 0 2024-09-18T12:51:29.344 INFO:tasks.workunit.client.0.smithi081.stdout:0/791: creat d7/d9/d4b/d33/d43/d9a/f10b x:0 0 0 2024-09-18T12:51:29.364 INFO:tasks.workunit.client.0.smithi081.stdout:6/844: dwrite d4/d12/d56/d7d/d96/fef [0,4194304] 0 2024-09-18T12:51:29.364 INFO:tasks.workunit.client.0.smithi081.stdout:6/845: chown d4/d12/d1c/d64/l6a 468353039 1 2024-09-18T12:51:29.367 INFO:tasks.workunit.client.0.smithi081.stdout:6/846: symlink d4/d12/d28/l122 0 2024-09-18T12:51:29.368 INFO:tasks.workunit.client.0.smithi081.stdout:6/847: mkdir d4/d12/d56/d7d/d116/d123 0 2024-09-18T12:51:29.368 INFO:tasks.workunit.client.0.smithi081.stdout:6/848: write d4/d12/d56/da8/fe3 [750349,110233] 0 2024-09-18T12:51:29.376 INFO:tasks.workunit.client.0.smithi081.stdout:0/792: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:51:29.380 INFO:tasks.workunit.client.0.smithi081.stdout:7/724: dwrite d2/d18/d22/f95 [0,4194304] 0 2024-09-18T12:51:29.381 INFO:tasks.workunit.client.0.smithi081.stdout:6/849: write d4/f7 [659108,6011] 0 2024-09-18T12:51:29.381 INFO:tasks.workunit.client.0.smithi081.stdout:6/850: dread - d4/d12/d56/d7d/d9f/da2/fb1 zero size 2024-09-18T12:51:29.381 INFO:tasks.workunit.client.0.smithi081.stdout:0/793: write d7/d9/d4b/d3d/f91 [913812,46545] 0 2024-09-18T12:51:29.381 INFO:tasks.workunit.client.0.smithi081.stdout:0/794: readlink d7/l60 0 2024-09-18T12:51:29.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/854: rmdir d3/d1d/d89/db5 39 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:5/813: sync 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:5/814: creat d2/d47/d7f/f102 x:0 0 0 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:5/815: readlink d2/d14/d33/d37/d3b/lc6 0 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:4/823: sync 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:9/789: sync 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:1/862: sync 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:7/725: mkdir d2/d18/d22/d48/db9/df3 0 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:7/726: write d2/d14/d21/d62/da7/f47 [5160187,88156] 0 2024-09-18T12:51:29.386 INFO:tasks.workunit.client.0.smithi081.stdout:7/727: write d2/fd5 [4367707,87683] 0 2024-09-18T12:51:29.394 INFO:tasks.workunit.client.0.smithi081.stdout:5/816: symlink d2/d14/d33/d37/d3b/d16/l103 0 2024-09-18T12:51:29.396 INFO:tasks.workunit.client.0.smithi081.stdout:4/824: symlink d3/d20/d3d/d65/d14/d4b/dc7/l10e 0 2024-09-18T12:51:29.396 INFO:tasks.workunit.client.0.smithi081.stdout:4/825: write d3/d20/d3d/d65/d14/d54/dd3/d8d/fa2 [1704349,39396] 0 2024-09-18T12:51:29.396 INFO:tasks.workunit.client.0.smithi081.stdout:4/826: chown d3/d20/d3d/d65/d45/d102/d106 11774 1 2024-09-18T12:51:29.396 INFO:tasks.workunit.client.0.smithi081.stdout:4/827: fsync d3/d20/d3d/d65/d45/d102/d8c/fbe 0 2024-09-18T12:51:29.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/790: mknod dd/d1d/d1e/d77/dfa/d9e/df2/cfb 0 2024-09-18T12:51:29.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/791: readlink dd/d15/d1a/l79 0 2024-09-18T12:51:29.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/792: write dd/d1d/d1e/d24/f33 [1511676,114117] 0 2024-09-18T12:51:29.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/793: creat dd/d31/dd5/ffc x:0 0 0 2024-09-18T12:51:29.399 INFO:tasks.workunit.client.0.smithi081.stdout:1/863: write d0/d6/d7/d2e/d51/fb6 [3688464,5905] 0 2024-09-18T12:51:29.400 INFO:tasks.workunit.client.0.smithi081.stdout:7/728: symlink d2/d1d/d4e/d84/lf4 0 2024-09-18T12:51:29.400 INFO:tasks.workunit.client.0.smithi081.stdout:0/795: mknod d7/d9/d12/c10c 0 2024-09-18T12:51:29.401 INFO:tasks.workunit.client.0.smithi081.stdout:5/817: mkdir d2/d47/d7f/d104 0 2024-09-18T12:51:29.403 INFO:tasks.workunit.client.0.smithi081.stdout:4/828: creat d3/d20/d3d/d65/d45/dc4/de6/f10f x:0 0 0 2024-09-18T12:51:29.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/864: creat d0/db/d4f/dd2/dd5/f118 x:0 0 0 2024-09-18T12:51:29.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/865: chown d0/d6/d7/d8/l4d 21 1 2024-09-18T12:51:29.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/866: truncate d0/d96/fad 353675 0 2024-09-18T12:51:29.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/867: chown d0/d6/d33/d42/f5b 902102 1 2024-09-18T12:51:29.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/868: fdatasync d0/db/d32/f103 0 2024-09-18T12:51:29.406 INFO:tasks.workunit.client.0.smithi081.stdout:8/855: dwrite d3/d1d/d4a/fa7 [0,4194304] 0 2024-09-18T12:51:29.407 INFO:tasks.workunit.client.0.smithi081.stdout:7/729: unlink d2/d1d/d4e/d84/lf4 0 2024-09-18T12:51:29.408 INFO:tasks.workunit.client.0.smithi081.stdout:0/796: creat d7/d5d/f10d x:0 0 0 2024-09-18T12:51:29.408 INFO:tasks.workunit.client.0.smithi081.stdout:0/797: creat d7/d9/d4b/d53/f10e x:0 0 0 2024-09-18T12:51:29.409 INFO:tasks.workunit.client.0.smithi081.stdout:5/818: creat d2/d47/d7f/d104/f105 x:0 0 0 2024-09-18T12:51:29.411 INFO:tasks.workunit.client.0.smithi081.stdout:4/829: creat d3/d20/d3d/d65/d45/d6c/dec/df6/d101/df2/f110 x:0 0 0 2024-09-18T12:51:29.411 INFO:tasks.workunit.client.0.smithi081.stdout:4/830: fdatasync d3/d20/d3d/d65/f10b 0 2024-09-18T12:51:29.415 INFO:tasks.workunit.client.0.smithi081.stdout:9/794: read dd/d1d/f2e [6478807,128175] 0 2024-09-18T12:51:29.415 INFO:tasks.workunit.client.0.smithi081.stdout:6/851: dwrite d4/d12/d28/d2a/d74/d8b/f78 [4194304,4194304] 0 2024-09-18T12:51:29.415 INFO:tasks.workunit.client.0.smithi081.stdout:6/852: truncate d4/d12/d56/d7d/d84/fdf 999812 0 2024-09-18T12:51:29.416 INFO:tasks.workunit.client.0.smithi081.stdout:7/730: dread d2/f11 [0,4194304] 0 2024-09-18T12:51:29.416 INFO:tasks.workunit.client.0.smithi081.stdout:7/731: chown d2/d14/d21/d62/da7/f47 496 1 2024-09-18T12:51:29.419 INFO:tasks.workunit.client.0.smithi081.stdout:0/798: unlink d7/d9/d4b/d4a/d77/fa5 0 2024-09-18T12:51:29.420 INFO:tasks.workunit.client.0.smithi081.stdout:5/819: link d2/d14/d33/d37/d3b/d2a/f94 d2/d14/d33/d37/d3b/d16/f106 0 2024-09-18T12:51:29.420 INFO:tasks.workunit.client.0.smithi081.stdout:1/869: dread d0/d6/fd [4194304,4194304] 0 2024-09-18T12:51:29.423 INFO:tasks.workunit.client.0.smithi081.stdout:4/831: creat d3/d20/d3d/d65/d45/d102/df1/f111 x:0 0 0 2024-09-18T12:51:29.423 INFO:tasks.workunit.client.0.smithi081.stdout:6/853: mknod d4/d12/d28/d2a/d97/c124 0 2024-09-18T12:51:29.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/820: dread d2/d14/d33/d37/d3b/d2a/fa8 [0,4194304] 0 2024-09-18T12:51:29.427 INFO:tasks.workunit.client.0.smithi081.stdout:1/870: link d0/d6/d33/d37/d71/d90/ce8 d0/dd7/d55/c119 0 2024-09-18T12:51:29.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/854: creat d4/d12/d28/d2a/d97/ddc/d10a/f125 x:0 0 0 2024-09-18T12:51:29.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/855: chown d4/d12/d1c/d39/cc3 0 1 2024-09-18T12:51:29.432 INFO:tasks.workunit.client.0.smithi081.stdout:0/799: dread d7/d9/d4b/d33/d7d/f88 [0,4194304] 0 2024-09-18T12:51:29.432 INFO:tasks.workunit.client.0.smithi081.stdout:0/800: dread - d7/d9/d4b/d53/f10e zero size 2024-09-18T12:51:29.433 INFO:tasks.workunit.client.0.smithi081.stdout:4/832: link d3/db/d58/l7a d3/d20/l112 0 2024-09-18T12:51:29.438 INFO:tasks.workunit.client.0.smithi081.stdout:4/833: mknod d3/d20/d3d/d65/d45/d102/d106/c113 0 2024-09-18T12:51:29.438 INFO:tasks.workunit.client.0.smithi081.stdout:4/834: fsync d3/db/d35/f76 0 2024-09-18T12:51:29.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/821: dread d2/d14/d33/d37/d3b/d2a/d8e/fa1 [0,4194304] 0 2024-09-18T12:51:29.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/822: creat d2/d14/d33/d37/d3b/d2a/db0/f107 x:0 0 0 2024-09-18T12:51:29.439 INFO:tasks.workunit.client.0.smithi081.stdout:8/856: dwrite d3/f6c [0,4194304] 0 2024-09-18T12:51:29.439 INFO:tasks.workunit.client.0.smithi081.stdout:1/871: dread d0/d18/db7/fd1 [0,4194304] 0 2024-09-18T12:51:29.440 INFO:tasks.workunit.client.0.smithi081.stdout:9/795: dwrite dd/d1d/f2e [4194304,4194304] 0 2024-09-18T12:51:29.440 INFO:tasks.workunit.client.0.smithi081.stdout:4/835: truncate d3/d20/d3d/d65/d45/da4/fd9 2114307 0 2024-09-18T12:51:29.440 INFO:tasks.workunit.client.0.smithi081.stdout:4/836: chown d3/d20/d3d/d65/d14/d54/dd3/c5e 1788400524 1 2024-09-18T12:51:29.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/801: dread d7/d9/d4b/d3d/f91 [0,4194304] 0 2024-09-18T12:51:29.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/802: creat d7/d9/d4b/d33/d43/d9a/f10f x:0 0 0 2024-09-18T12:51:29.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/803: write d7/d9/d4b/d4a/d92/fff [530650,63799] 0 2024-09-18T12:51:29.450 INFO:tasks.workunit.client.0.smithi081.stdout:4/837: dread d3/db/d35/d79/f92 [0,4194304] 0 2024-09-18T12:51:29.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/856: dwrite d4/f18 [4194304,4194304] 0 2024-09-18T12:51:29.454 INFO:tasks.workunit.client.0.smithi081.stdout:6/857: read d4/d12/d56/d7d/d84/fad [1189999,107845] 0 2024-09-18T12:51:29.454 INFO:tasks.workunit.client.0.smithi081.stdout:6/858: read d4/f7 [2521836,75518] 0 2024-09-18T12:51:29.458 INFO:tasks.workunit.client.0.smithi081.stdout:1/872: unlink d0/d6/d33/d42/dcf/lf3 0 2024-09-18T12:51:29.458 INFO:tasks.workunit.client.0.smithi081.stdout:0/804: dwrite d7/d9/f90 [0,4194304] 0 2024-09-18T12:51:29.459 INFO:tasks.workunit.client.0.smithi081.stdout:8/857: mknod d3/d1e/d4c/d100/c11e 0 2024-09-18T12:51:29.460 INFO:tasks.workunit.client.0.smithi081.stdout:8/858: write d3/d1e/d4c/ffd [102148,75439] 0 2024-09-18T12:51:29.464 INFO:tasks.workunit.client.0.smithi081.stdout:9/796: mknod dd/d15/db1/cfd 0 2024-09-18T12:51:29.465 INFO:tasks.workunit.client.0.smithi081.stdout:7/732: truncate d2/d18/d22/f95 1412171 0 2024-09-18T12:51:29.465 INFO:tasks.workunit.client.0.smithi081.stdout:7/733: truncate d2/d56/d73/d7c/fdf 1268953 0 2024-09-18T12:51:29.465 INFO:tasks.workunit.client.0.smithi081.stdout:4/838: creat d3/d20/f114 x:0 0 0 2024-09-18T12:51:29.466 INFO:tasks.workunit.client.0.smithi081.stdout:6/859: chown d4/d12/d1c/ld0 58454625 1 2024-09-18T12:51:29.468 INFO:tasks.workunit.client.0.smithi081.stdout:1/873: link d0/d6/d33/d37/d71/cdd d0/d96/c11a 0 2024-09-18T12:51:29.468 INFO:tasks.workunit.client.0.smithi081.stdout:1/874: creat d0/db/d4f/dd2/dd5/f11b x:0 0 0 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:8/859: dread d3/f32 [0,4194304] 0 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:8/860: chown d3/d1d/d4a/fa3 202 1 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:8/861: fsync d3/d1e/d4c/d68/f83 0 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:0/805: dread d7/d9/d4b/d33/d7d/f8d [0,4194304] 0 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:0/806: readlink d7/d9/d4b/l79 0 2024-09-18T12:51:29.469 INFO:tasks.workunit.client.0.smithi081.stdout:0/807: truncate d7/d9/d4b/d33/d43/d9a/fc4 316883 0 2024-09-18T12:51:29.473 INFO:tasks.workunit.client.0.smithi081.stdout:7/734: mknod d2/d18/d60/d85/cf5 0 2024-09-18T12:51:29.477 INFO:tasks.workunit.client.0.smithi081.stdout:6/860: mkdir d4/d12/d126 0 2024-09-18T12:51:29.478 INFO:tasks.workunit.client.0.smithi081.stdout:7/735: write d2/d14/d21/d62/da7/f2e [1021226,18726] 0 2024-09-18T12:51:29.481 INFO:tasks.workunit.client.0.smithi081.stdout:1/875: rmdir d0/d6/d33/d42/d70/dd9 39 2024-09-18T12:51:29.481 INFO:tasks.workunit.client.0.smithi081.stdout:1/876: fdatasync d0/d6/d7/d2e/d4e/f9b 0 2024-09-18T12:51:29.482 INFO:tasks.workunit.client.0.smithi081.stdout:8/862: mknod d3/d1d/c11f 0 2024-09-18T12:51:29.482 INFO:tasks.workunit.client.0.smithi081.stdout:8/863: chown d3/d1e/d4c/d68/f83 14 1 2024-09-18T12:51:29.485 INFO:tasks.workunit.client.0.smithi081.stdout:6/861: rename d4/fc4 to d4/d12/d1c/d39/dd3/df6/f127 0 2024-09-18T12:51:29.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/864: mkdir d3/d1e/d4c/d68/daa/d120 0 2024-09-18T12:51:29.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/865: chown d3/f6c 738024 1 2024-09-18T12:51:29.488 INFO:tasks.workunit.client.0.smithi081.stdout:0/808: symlink d7/d9/d12/l110 0 2024-09-18T12:51:29.488 INFO:tasks.workunit.client.0.smithi081.stdout:0/809: chown d7/d5d/dd9 992678211 1 2024-09-18T12:51:29.489 INFO:tasks.workunit.client.0.smithi081.stdout:0/810: dread d7/d9/d4b/d33/d43/d9a/fc4 [0,4194304] 0 2024-09-18T12:51:29.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/877: rename d0/d6/d66/f10c to d0/d6/d7/f11c 0 2024-09-18T12:51:29.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/878: write d0/d6/fd [9109479,8099] 0 2024-09-18T12:51:29.491 INFO:tasks.workunit.client.0.smithi081.stdout:8/866: symlink d3/d1d/d4a/da9/l121 0 2024-09-18T12:51:29.495 INFO:tasks.workunit.client.0.smithi081.stdout:6/862: rename d4/d12/d28/d2a/lb0 to d4/d12/d56/d7d/d116/l128 0 2024-09-18T12:51:29.496 INFO:tasks.workunit.client.0.smithi081.stdout:7/736: dwrite d2/d56/d73/d90/f93 [0,4194304] 0 2024-09-18T12:51:29.497 INFO:tasks.workunit.client.0.smithi081.stdout:1/879: creat d0/dd7/de9/db0/f11d x:0 0 0 2024-09-18T12:51:29.497 INFO:tasks.workunit.client.0.smithi081.stdout:1/880: creat d0/d6/d66/f11e x:0 0 0 2024-09-18T12:51:29.498 INFO:tasks.workunit.client.0.smithi081.stdout:0/811: rmdir d7/d9/d4b/d3d 39 2024-09-18T12:51:29.503 INFO:tasks.workunit.client.0.smithi081.stdout:8/867: rename d3/d1e/f34 to d3/f122 0 2024-09-18T12:51:29.508 INFO:tasks.workunit.client.0.smithi081.stdout:1/881: symlink d0/d6/d7/d2e/d51/d2c/d9f/l11f 0 2024-09-18T12:51:29.513 INFO:tasks.workunit.client.0.smithi081.stdout:7/737: dwrite d2/d18/d60/ff2 [0,4194304] 0 2024-09-18T12:51:29.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/863: rmdir d4/d12 39 2024-09-18T12:51:29.523 INFO:tasks.workunit.client.0.smithi081.stdout:4/839: dwrite d3/db/d35/d79/f8e [0,4194304] 0 2024-09-18T12:51:29.525 INFO:tasks.workunit.client.0.smithi081.stdout:8/868: unlink d3/d1e/d4c/d68/f83 0 2024-09-18T12:51:29.525 INFO:tasks.workunit.client.0.smithi081.stdout:8/869: chown d3/d1d/c11f 487113722 1 2024-09-18T12:51:29.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/812: rename d7/d9/d4b/d4a/d77/f7e to d7/d7c/f111 0 2024-09-18T12:51:29.528 INFO:tasks.workunit.client.0.smithi081.stdout:0/813: write d7/d5d/dd9/ff2 [5036696,1785] 0 2024-09-18T12:51:29.529 INFO:tasks.workunit.client.0.smithi081.stdout:1/882: symlink d0/d6/d33/d37/d71/l120 0 2024-09-18T12:51:29.529 INFO:tasks.workunit.client.0.smithi081.stdout:1/883: read - d0/d96/f10b zero size 2024-09-18T12:51:29.529 INFO:tasks.workunit.client.0.smithi081.stdout:1/884: fsync d0/d6/d33/d42/f5b 0 2024-09-18T12:51:29.532 INFO:tasks.workunit.client.0.smithi081.stdout:6/864: unlink d4/d12/d1c/d39/l11e 0 2024-09-18T12:51:29.534 INFO:tasks.workunit.client.0.smithi081.stdout:4/840: creat d3/d20/d3d/d65/d45/d6c/dec/df6/d101/f115 x:0 0 0 2024-09-18T12:51:29.535 INFO:tasks.workunit.client.0.smithi081.stdout:8/870: mkdir d3/d1d/d123 0 2024-09-18T12:51:29.535 INFO:tasks.workunit.client.0.smithi081.stdout:8/871: stat d3/d1d/d89/db5/db8/f11c 0 2024-09-18T12:51:29.536 INFO:tasks.workunit.client.0.smithi081.stdout:7/738: rename d2/d1d/d4e/cd6 to d2/d18/d22/d48/df1/cf6 0 2024-09-18T12:51:29.538 INFO:tasks.workunit.client.0.smithi081.stdout:0/814: link d7/d9/d12/dba/l8b d7/dbf/l112 0 2024-09-18T12:51:29.538 INFO:tasks.workunit.client.0.smithi081.stdout:6/865: symlink d4/d12/d1c/d39/dd3/l129 0 2024-09-18T12:51:29.539 INFO:tasks.workunit.client.0.smithi081.stdout:4/841: truncate d3/d20/d3d/d65/d45/d102/f8b 859260 0 2024-09-18T12:51:29.539 INFO:tasks.workunit.client.0.smithi081.stdout:4/842: chown d3/db/d35/d79/dfa 49 1 2024-09-18T12:51:29.539 INFO:tasks.workunit.client.0.smithi081.stdout:4/843: write d3/d20/d3d/d65/d45/d6c/fb9 [126407,1311] 0 2024-09-18T12:51:29.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/872: creat d3/d1e/d4c/d68/daa/d120/f124 x:0 0 0 2024-09-18T12:51:29.541 INFO:tasks.workunit.client.0.smithi081.stdout:0/815: creat d7/d9/d12/f113 x:0 0 0 2024-09-18T12:51:29.541 INFO:tasks.workunit.client.0.smithi081.stdout:6/866: mknod d4/d12/d28/d2a/d98/dd8/c12a 0 2024-09-18T12:51:29.545 INFO:tasks.workunit.client.0.smithi081.stdout:8/873: symlink d3/dc9/l125 0 2024-09-18T12:51:29.547 INFO:tasks.workunit.client.0.smithi081.stdout:0/816: mknod d7/d9/c114 0 2024-09-18T12:51:29.547 INFO:tasks.workunit.client.0.smithi081.stdout:0/817: dread - d7/d5d/fda zero size 2024-09-18T12:51:29.547 INFO:tasks.workunit.client.0.smithi081.stdout:7/739: dread d2/d14/d21/d62/da7/f47 [0,4194304] 0 2024-09-18T12:51:29.547 INFO:tasks.workunit.client.0.smithi081.stdout:1/885: dwrite d0/d6/d7/f11c [0,4194304] 0 2024-09-18T12:51:29.549 INFO:tasks.workunit.client.0.smithi081.stdout:6/867: getdents d4/d12/d56/d7d/d91 0 2024-09-18T12:51:29.550 INFO:tasks.workunit.client.0.smithi081.stdout:4/844: mkdir d3/d20/d3d/d65/d116 0 2024-09-18T12:51:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:8/874: mkdir d3/d1d/d9f/dcf/dee/d126 0 2024-09-18T12:51:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:8/875: getdents d3/d1d/d123 0 2024-09-18T12:51:29.553 INFO:tasks.workunit.client.0.smithi081.stdout:0/818: creat d7/d9/d12/df7/f115 x:0 0 0 2024-09-18T12:51:29.554 INFO:tasks.workunit.client.0.smithi081.stdout:7/740: mknod d2/d56/d73/d7c/d86/da6/cf7 0 2024-09-18T12:51:29.556 INFO:tasks.workunit.client.0.smithi081.stdout:7/741: dread d2/d18/f3b [0,4194304] 0 2024-09-18T12:51:29.559 INFO:tasks.workunit.client.0.smithi081.stdout:6/868: rename d4/d12/l35 to d4/d12/d1c/d39/d60/l12b 0 2024-09-18T12:51:29.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/869: write d4/d12/d28/d2a/fbe [133944,124793] 0 2024-09-18T12:51:29.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/870: fsync d4/d12/d28/d2a/d2d/d31/f3b 0 2024-09-18T12:51:29.560 INFO:tasks.workunit.client.0.smithi081.stdout:6/871: dread - d4/d12/d28/d2a/d74/d8b/d54/f101 zero size 2024-09-18T12:51:29.563 INFO:tasks.workunit.client.0.smithi081.stdout:0/819: write d7/d9/f10 [3682424,111724] 0 2024-09-18T12:51:29.563 INFO:tasks.workunit.client.0.smithi081.stdout:0/820: fdatasync d7/d9/d4b/d4a/f29 0 2024-09-18T12:51:29.563 INFO:tasks.workunit.client.0.smithi081.stdout:0/821: read - d7/d9/d12/df7/f115 zero size 2024-09-18T12:51:29.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/845: symlink d3/d20/d3d/d6b/l117 0 2024-09-18T12:51:29.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/846: write d3/d20/d5b/dd8/fef [516487,58698] 0 2024-09-18T12:51:29.564 INFO:tasks.workunit.client.0.smithi081.stdout:7/742: dread d2/d18/f1f [0,4194304] 0 2024-09-18T12:51:29.564 INFO:tasks.workunit.client.0.smithi081.stdout:1/886: dwrite d0/d6/f36 [0,4194304] 0 2024-09-18T12:51:29.564 INFO:tasks.workunit.client.0.smithi081.stdout:1/887: chown d0/d6/d7/d2e/d4e/lbe 1614082 1 2024-09-18T12:51:29.565 INFO:tasks.workunit.client.0.smithi081.stdout:8/876: symlink d3/d1d/d4a/d7f/d10e/l127 0 2024-09-18T12:51:29.569 INFO:tasks.workunit.client.0.smithi081.stdout:0/822: link d7/d9/d4b/d4a/lf6 d7/l116 0 2024-09-18T12:51:29.573 INFO:tasks.workunit.client.0.smithi081.stdout:1/888: mkdir d0/db/d121 0 2024-09-18T12:51:29.577 INFO:tasks.workunit.client.0.smithi081.stdout:8/877: link d3/cbc d3/d73/dbe/c128 0 2024-09-18T12:51:29.579 INFO:tasks.workunit.client.0.smithi081.stdout:6/872: rename d4/d12/d1c/f23 to d4/d12/d56/d7d/d116/f12c 0 2024-09-18T12:51:29.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/823: truncate d7/f6f 528987 0 2024-09-18T12:51:29.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/824: creat d7/d9/d4b/d53/f117 x:0 0 0 2024-09-18T12:51:29.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/825: read d7/d9/d4b/d4a/d92/f9b [440537,91313] 0 2024-09-18T12:51:29.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/826: read d7/dbf/fd2 [260980,95589] 0 2024-09-18T12:51:29.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/827: chown d7/d9/d4b/c49 8759 1 2024-09-18T12:51:29.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/873: rmdir d4/d6/db4 39 2024-09-18T12:51:29.587 INFO:tasks.workunit.client.0.smithi081.stdout:0/828: symlink d7/dbf/l118 0 2024-09-18T12:51:29.588 INFO:tasks.workunit.client.0.smithi081.stdout:6/874: mknod d4/d12/d28/d2a/d98/c12d 0 2024-09-18T12:51:29.588 INFO:tasks.workunit.client.0.smithi081.stdout:8/878: dread d3/d1e/d4c/d53/f74 [0,4194304] 0 2024-09-18T12:51:29.589 INFO:tasks.workunit.client.0.smithi081.stdout:8/879: fsync d3/d1e/d4c/d53/f7d 0 2024-09-18T12:51:29.589 INFO:tasks.workunit.client.0.smithi081.stdout:0/829: mknod d7/d9/d4b/d4a/d77/de8/c119 0 2024-09-18T12:51:29.590 INFO:tasks.workunit.client.0.smithi081.stdout:6/875: mkdir d4/d12/d28/d2a/d2d/d12e 0 2024-09-18T12:51:29.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/847: dwrite d3/db/d2d/faf [0,4194304] 0 2024-09-18T12:51:29.592 INFO:tasks.workunit.client.0.smithi081.stdout:7/743: dwrite d2/d42/f43 [4194304,4194304] 0 2024-09-18T12:51:29.592 INFO:tasks.workunit.client.0.smithi081.stdout:0/830: mknod d7/d9/d4b/d53/c11a 0 2024-09-18T12:51:29.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/876: unlink d4/d88/l114 0 2024-09-18T12:51:29.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/877: chown d4/d12/d28/d2a/d74/d8b/d54/ld6 384139 1 2024-09-18T12:51:29.598 INFO:tasks.workunit.client.0.smithi081.stdout:8/880: dread d3/d1e/d4c/fb9 [0,4194304] 0 2024-09-18T12:51:29.601 INFO:tasks.workunit.client.0.smithi081.stdout:7/744: unlink d2/d14/d21/d49/lac 0 2024-09-18T12:51:29.603 INFO:tasks.workunit.client.0.smithi081.stdout:6/878: write d4/d12/d1c/d39/d60/db8/fcc [3579366,126696] 0 2024-09-18T12:51:29.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/831: symlink d7/d5d/dd9/l11b 0 2024-09-18T12:51:29.605 INFO:tasks.workunit.client.0.smithi081.stdout:4/848: symlink d3/d20/l118 0 2024-09-18T12:51:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:8/881: unlink d3/d1d/d4a/fbf 0 2024-09-18T12:51:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:8/882: fdatasync d3/dc9/fca 0 2024-09-18T12:51:29.613 INFO:tasks.workunit.client.0.smithi081.stdout:0/832: mkdir d7/dbf/d11c 0 2024-09-18T12:51:29.613 INFO:tasks.workunit.client.0.smithi081.stdout:6/879: dread d4/d12/d28/d2a/f4b [0,4194304] 0 2024-09-18T12:51:29.613 INFO:tasks.workunit.client.0.smithi081.stdout:8/883: creat d3/d1d/d102/f129 x:0 0 0 2024-09-18T12:51:29.614 INFO:tasks.workunit.client.0.smithi081.stdout:7/745: symlink d2/d14/d66/dd8/lf8 0 2024-09-18T12:51:29.616 INFO:tasks.workunit.client.0.smithi081.stdout:6/880: rename d4/d12/d28/l122 to d4/d12/d56/d7d/d84/l12f 0 2024-09-18T12:51:29.616 INFO:tasks.workunit.client.0.smithi081.stdout:6/881: truncate d4/d12/d1c/d39/d73/f87 46312 0 2024-09-18T12:51:29.616 INFO:tasks.workunit.client.0.smithi081.stdout:8/884: creat d3/d1e/d4c/d53/de5/f12a x:0 0 0 2024-09-18T12:51:29.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/833: write d7/d9/d4b/d33/d43/d9a/f9e [1438862,8699] 0 2024-09-18T12:51:29.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/834: fdatasync d7/d9/d4b/d33/d7d/f88 0 2024-09-18T12:51:29.618 INFO:tasks.workunit.client.0.smithi081.stdout:0/835: fsync d7/d9/d4b/d4a/f16 0 2024-09-18T12:51:29.618 INFO:tasks.workunit.client.0.smithi081.stdout:7/746: rename d2/d14/d21/d49/dcc/fcf to d2/d56/d73/d7c/d86/da6/ff9 0 2024-09-18T12:51:29.619 INFO:tasks.workunit.client.0.smithi081.stdout:4/849: dwrite d3/dbb/fe5 [0,4194304] 0 2024-09-18T12:51:29.619 INFO:tasks.workunit.client.0.smithi081.stdout:4/850: creat d3/d20/d3d/d65/d45/d7e/f119 x:0 0 0 2024-09-18T12:51:29.620 INFO:tasks.workunit.client.0.smithi081.stdout:6/882: creat d4/d12/d56/d7d/d84/dec/dee/f130 x:0 0 0 2024-09-18T12:51:29.620 INFO:tasks.workunit.client.0.smithi081.stdout:6/883: write d4/d12/d28/d2a/d2d/d31/fb6 [4073968,17769] 0 2024-09-18T12:51:29.622 INFO:tasks.workunit.client.0.smithi081.stdout:8/885: mkdir d3/d1d/d9f/d12b 0 2024-09-18T12:51:29.639 INFO:tasks.workunit.client.0.smithi081.stdout:0/836: dwrite d7/d9/d4b/fa3 [0,4194304] 0 2024-09-18T12:51:29.647 INFO:tasks.workunit.client.0.smithi081.stdout:7/747: dwrite d2/d14/f44 [4194304,4194304] 0 2024-09-18T12:51:29.648 INFO:tasks.workunit.client.0.smithi081.stdout:6/884: dwrite d4/d6/f26 [0,4194304] 0 2024-09-18T12:51:29.648 INFO:tasks.workunit.client.0.smithi081.stdout:6/885: chown d4/d12/d56/da8/fe3 21 1 2024-09-18T12:51:29.673 INFO:tasks.workunit.client.0.smithi081.stdout:0/837: truncate d7/d9/d4b/d3d/f89 1549376 0 2024-09-18T12:51:29.673 INFO:tasks.workunit.client.0.smithi081.stdout:0/838: getdents d7/dbf/d11c 0 2024-09-18T12:51:29.673 INFO:tasks.workunit.client.0.smithi081.stdout:0/839: write d7/d9/d4b/d33/d43/f87 [829434,30741] 0 2024-09-18T12:51:29.673 INFO:tasks.workunit.client.0.smithi081.stdout:0/840: stat d7/d9/d4b/d4a/d77/de8 0 2024-09-18T12:51:29.690 INFO:tasks.workunit.client.0.smithi081.stdout:0/841: dwrite d7/d9/f44 [4194304,4194304] 0 2024-09-18T12:51:29.711 INFO:tasks.workunit.client.0.smithi081.stdout:7/748: truncate d2/d1d/f2c 1021815 0 2024-09-18T12:51:29.713 INFO:tasks.workunit.client.0.smithi081.stdout:6/886: symlink d4/d12/d28/d2a/d74/d8b/d6f/l131 0 2024-09-18T12:51:29.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/749: write d2/d18/f20 [2823182,100249] 0 2024-09-18T12:51:29.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/750: chown d2/d18/d60/daa/fce 5 1 2024-09-18T12:51:29.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/751: readlink d2/d7f/lae 0 2024-09-18T12:51:29.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/842: creat d7/d9/d4b/d4a/f11d x:0 0 0 2024-09-18T12:51:29.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/843: fsync d7/d9/d4b/f101 0 2024-09-18T12:51:29.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/844: truncate d7/d9/d12/dba/f5a 2018361 0 2024-09-18T12:51:29.811 INFO:tasks.workunit.client.0.smithi081.stdout:4/851: rename d3/d20/d3d/d65 to d3/db/d35/d79/dfa/d11a 0 2024-09-18T12:51:29.811 INFO:tasks.workunit.client.0.smithi081.stdout:4/852: fsync d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/f115 0 2024-09-18T12:51:29.811 INFO:tasks.workunit.client.0.smithi081.stdout:4/853: fdatasync d3/db/d35/d79/dfa/d11a/d14/d54/fac 0 2024-09-18T12:51:29.811 INFO:tasks.workunit.client.0.smithi081.stdout:4/854: chown d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/db8 436 1 2024-09-18T12:51:29.812 INFO:tasks.workunit.client.0.smithi081.stdout:0/845: dwrite d7/d9/d4b/d33/ff4 [0,4194304] 0 2024-09-18T12:51:29.812 INFO:tasks.workunit.client.0.smithi081.stdout:6/887: rmdir d4/d12/d28/d2a/d97/ddc/d10a 39 2024-09-18T12:51:29.813 INFO:tasks.workunit.client.0.smithi081.stdout:6/888: chown d4/d6/d95/d10b 168347447 1 2024-09-18T12:51:29.813 INFO:tasks.workunit.client.0.smithi081.stdout:6/889: read - d4/d12/d56/d7d/d9f/da2/fb1 zero size 2024-09-18T12:51:29.814 INFO:tasks.workunit.client.0.smithi081.stdout:7/752: symlink d2/d56/lfa 0 2024-09-18T12:51:29.817 INFO:tasks.workunit.client.0.smithi081.stdout:4/855: creat d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/f11b x:0 0 0 2024-09-18T12:51:29.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/856: truncate d3/db/d35/d79/dfa/d11a/d14/d54/dd3/fee 799188 0 2024-09-18T12:51:29.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/846: dread d7/d9/d4b/d53/fad [0,4194304] 0 2024-09-18T12:51:29.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/847: write d7/d9/d4b/d33/d43/d9a/f104 [467835,10132] 0 2024-09-18T12:51:29.822 INFO:tasks.workunit.client.0.smithi081.stdout:6/890: mkdir d4/d12/d1c/d8f/d132 0 2024-09-18T12:51:29.825 INFO:tasks.workunit.client.0.smithi081.stdout:4/857: mknod d3/db/d35/d79/dfa/d11a/d45/da4/c11c 0 2024-09-18T12:51:29.825 INFO:tasks.workunit.client.0.smithi081.stdout:4/858: chown d3/db/d35/d79/dfa/d11a/d45/d6c/dec/d10d 8 1 2024-09-18T12:51:29.827 INFO:tasks.workunit.client.0.smithi081.stdout:0/848: truncate d7/d7c/f111 364306 0 2024-09-18T12:51:29.829 INFO:tasks.workunit.client.0.smithi081.stdout:4/859: truncate d3/db/d35/d79/dfa/d11a/d45/d6c/fb3 1022077 0 2024-09-18T12:51:29.847 INFO:tasks.workunit.client.0.smithi081.stdout:7/753: dwrite d2/d42/f41 [0,4194304] 0 2024-09-18T12:51:29.848 INFO:tasks.workunit.client.0.smithi081.stdout:4/860: dwrite d3/db/d35/d79/dfa/d11a/f21 [0,4194304] 0 2024-09-18T12:51:29.848 INFO:tasks.workunit.client.0.smithi081.stdout:4/861: write d3/db/d35/d79/dfa/d11a/d45/dc4/de6/f10f [695279,126073] 0 2024-09-18T12:51:29.850 INFO:tasks.workunit.client.0.smithi081.stdout:7/754: truncate d2/d18/d3c/f7a 2745855 0 2024-09-18T12:51:29.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/862: link d3/db/d35/d79/dfa/d11a/d14/d27/l72 d3/db/d35/l11d 0 2024-09-18T12:51:29.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/863: stat d3/db/d35/d79/dfa/d11a/d14/d27/f94 0 2024-09-18T12:51:29.859 INFO:tasks.workunit.client.0.smithi081.stdout:4/864: dread - d3/db/d35/d79/dfa/d11a/d14/d4b/faa zero size 2024-09-18T12:51:29.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/865: truncate d3/db/d35/d79/dfa/d11a/d14/d3e/f51 1761400 0 2024-09-18T12:51:29.860 INFO:tasks.workunit.client.0.smithi081.stdout:4/866: dread - d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/f115 zero size 2024-09-18T12:51:29.864 INFO:tasks.workunit.client.0.smithi081.stdout:0/849: mkdir d7/d9/d12/d11e 0 2024-09-18T12:51:29.866 INFO:tasks.workunit.client.0.smithi081.stdout:4/867: symlink d3/db/d58/l11e 0 2024-09-18T12:51:29.867 INFO:tasks.workunit.client.0.smithi081.stdout:4/868: symlink d3/db/d2d/d10c/l11f 0 2024-09-18T12:51:29.872 INFO:tasks.workunit.client.0.smithi081.stdout:0/850: mkdir d7/d11f 0 2024-09-18T12:51:29.876 INFO:tasks.workunit.client.0.smithi081.stdout:0/851: link d7/d9/d4b/d33/c3b d7/d5d/dd9/c120 0 2024-09-18T12:51:29.876 INFO:tasks.workunit.client.0.smithi081.stdout:0/852: readlink d7/d9/d4b/d33/d43/la9 0 2024-09-18T12:51:29.877 INFO:tasks.workunit.client.0.smithi081.stdout:7/755: dwrite d2/d18/f20 [0,4194304] 0 2024-09-18T12:51:29.877 INFO:tasks.workunit.client.0.smithi081.stdout:7/756: truncate d2/d14/d21/d49/fe4 1006908 0 2024-09-18T12:51:29.877 INFO:tasks.workunit.client.0.smithi081.stdout:0/853: link d7/d9/d4b/d33/d43/c75 d7/d9/d4b/d33/d7d/dfe/c121 0 2024-09-18T12:51:29.877 INFO:tasks.workunit.client.0.smithi081.stdout:4/869: dread d3/db/d35/d79/dfa/d11a/d45/da4/fd9 [0,4194304] 0 2024-09-18T12:51:29.880 INFO:tasks.workunit.client.0.smithi081.stdout:0/854: link d7/d9/d4b/d33/d43/d9a/ff3 d7/d9/d12/dba/f122 0 2024-09-18T12:51:29.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/870: creat d3/db/d35/d79/dfa/d11a/d14/f120 x:0 0 0 2024-09-18T12:51:29.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/871: fdatasync d3/db/d35/d79/dfa/d11a/d14/d27/f3a 0 2024-09-18T12:51:29.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/872: write d3/db/f25 [667984,47096] 0 2024-09-18T12:51:29.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/873: write d3/db/d35/d79/dfa/d11a/d14/d27/f94 [1009808,108721] 0 2024-09-18T12:51:29.883 INFO:tasks.workunit.client.0.smithi081.stdout:0/855: mkdir d7/d5d/d9f/d123 0 2024-09-18T12:51:29.884 INFO:tasks.workunit.client.0.smithi081.stdout:0/856: stat d7/d9/d4b/d33/d43/fbd 0 2024-09-18T12:51:29.886 INFO:tasks.workunit.client.0.smithi081.stdout:0/857: symlink d7/d5d/dd9/l124 0 2024-09-18T12:51:29.890 INFO:tasks.workunit.client.0.smithi081.stdout:0/858: rename d7/d9/d12/dba/c5b to d7/d9/d12/dba/c125 0 2024-09-18T12:51:29.890 INFO:tasks.workunit.client.0.smithi081.stdout:0/859: truncate d7/d9/d4b/d4a/d68/fd8 749528 0 2024-09-18T12:51:29.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/860: mkdir d7/dbf/d11c/d126 0 2024-09-18T12:51:29.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/861: write d7/d9/d4b/d33/d7d/f88 [4212796,6343] 0 2024-09-18T12:51:29.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/862: write d7/d9/d4b/d4a/fce [4390744,23675] 0 2024-09-18T12:51:29.896 INFO:tasks.workunit.client.0.smithi081.stdout:4/874: dwrite d3/f22 [4194304,4194304] 0 2024-09-18T12:51:29.898 INFO:tasks.workunit.client.0.smithi081.stdout:4/875: creat d3/db/d35/d79/dfa/d11a/d14/d54/dd3/f121 x:0 0 0 2024-09-18T12:51:29.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/876: symlink d3/db/d35/d79/dfa/d11a/d14/l122 0 2024-09-18T12:51:29.901 INFO:tasks.workunit.client.0.smithi081.stdout:4/877: creat d3/db/d35/d79/dfa/d11a/d14/d54/f123 x:0 0 0 2024-09-18T12:51:29.902 INFO:tasks.workunit.client.0.smithi081.stdout:7/757: mkdir d2/d18/d22/dfb 0 2024-09-18T12:51:29.903 INFO:tasks.workunit.client.0.smithi081.stdout:0/863: write d7/d9/d4b/d4a/f1a [1008924,86743] 0 2024-09-18T12:51:29.903 INFO:tasks.workunit.client.0.smithi081.stdout:0/864: truncate d7/d9/d4b/d53/f117 183663 0 2024-09-18T12:51:29.907 INFO:tasks.workunit.client.0.smithi081.stdout:0/865: symlink d7/d9/d4b/d4a/d77/l127 0 2024-09-18T12:51:29.908 INFO:tasks.workunit.client.0.smithi081.stdout:7/758: mkdir d2/d18/dfc 0 2024-09-18T12:51:29.910 INFO:tasks.workunit.client.0.smithi081.stdout:7/759: unlink d2/d56/d73/d7c/f63 0 2024-09-18T12:51:29.910 INFO:tasks.workunit.client.0.smithi081.stdout:7/760: readlink d2/d18/d22/l5f 0 2024-09-18T12:51:29.911 INFO:tasks.workunit.client.0.smithi081.stdout:7/761: fsync d2/d14/d21/f72 0 2024-09-18T12:51:29.915 INFO:tasks.workunit.client.0.smithi081.stdout:6/891: rmdir d4/d6/db4 39 2024-09-18T12:51:29.917 INFO:tasks.workunit.client.0.smithi081.stdout:4/878: dwrite d3/db/d35/d79/dfa/d11a/d14/d4b/f74 [4194304,4194304] 0 2024-09-18T12:51:29.919 INFO:tasks.workunit.client.0.smithi081.stdout:0/866: dread d7/d5d/f7f [0,4194304] 0 2024-09-18T12:51:29.927 INFO:tasks.workunit.client.0.smithi081.stdout:0/867: link d7/d9/d4b/d33/d43/d9a/fc4 d7/d9/d12/f128 0 2024-09-18T12:51:29.927 INFO:tasks.workunit.client.0.smithi081.stdout:0/868: write d7/d9/d4b/d4a/f8a [1452134,63499] 0 2024-09-18T12:51:29.927 INFO:tasks.workunit.client.0.smithi081.stdout:6/892: dread d4/d12/d1c/d39/d60/f9d [0,4194304] 0 2024-09-18T12:51:29.928 INFO:tasks.workunit.client.0.smithi081.stdout:7/762: dwrite d2/d18/d22/f32 [0,4194304] 0 2024-09-18T12:51:29.928 INFO:tasks.workunit.client.0.smithi081.stdout:7/763: chown d2/d1d/d4e/d84/fb1 215 1 2024-09-18T12:51:29.930 INFO:tasks.workunit.client.0.smithi081.stdout:0/869: mkdir d7/d9/d4b/d4a/d77/d129 0 2024-09-18T12:51:29.933 INFO:tasks.workunit.client.0.smithi081.stdout:4/879: dwrite d3/d20/d3d/fd0 [0,4194304] 0 2024-09-18T12:51:29.933 INFO:tasks.workunit.client.0.smithi081.stdout:4/880: stat d3/db/d35/d79/dfa/d11a/d14/f120 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/893: mknod d4/d12/d56/d7d/d84/dc9/c133 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/894: truncate d4/d12/d28/d2a/d2d/f52 4758685 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/895: stat d4/d12/d28/d2a/d74/d8b/c7c 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/896: readlink d4/d12/d28/d2a/d74/d8b/d6f/l131 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:6/897: truncate d4/d12/d28/d2a/d97/ddc/d10a/f125 816690 0 2024-09-18T12:51:29.934 INFO:tasks.workunit.client.0.smithi081.stdout:7/764: mknod d2/d18/d60/d85/cfd 0 2024-09-18T12:51:29.935 INFO:tasks.workunit.client.0.smithi081.stdout:7/765: dread d2/d56/d73/d7c/d86/da6/ff9 [0,4194304] 0 2024-09-18T12:51:29.940 INFO:tasks.workunit.client.0.smithi081.stdout:0/870: truncate d7/d9/d4b/d4a/f72 6946721 0 2024-09-18T12:51:29.947 INFO:tasks.workunit.client.0.smithi081.stdout:3/898: sync 2024-09-18T12:51:29.952 INFO:tasks.workunit.client.0.smithi081.stdout:7/766: dwrite d2/d18/fd9 [0,4194304] 0 2024-09-18T12:51:29.959 INFO:tasks.workunit.client.0.smithi081.stdout:0/871: write d7/d9/d12/f26 [2485213,76985] 0 2024-09-18T12:51:29.962 INFO:tasks.workunit.client.0.smithi081.stdout:3/899: creat d3/db/df/d29/d13/f137 x:0 0 0 2024-09-18T12:51:29.962 INFO:tasks.workunit.client.0.smithi081.stdout:3/900: stat d3/db/df/d3b/c69 0 2024-09-18T12:51:29.962 INFO:tasks.workunit.client.0.smithi081.stdout:3/901: read d3/db/df/d29/d13/d9d/d107/f28 [1816204,46582] 0 2024-09-18T12:51:29.967 INFO:tasks.workunit.client.0.smithi081.stdout:0/872: mknod d7/d9/d4b/d33/d7d/def/c12a 0 2024-09-18T12:51:29.968 INFO:tasks.workunit.client.0.smithi081.stdout:7/767: getdents d2/d18/d22/d48/db9 0 2024-09-18T12:51:29.968 INFO:tasks.workunit.client.0.smithi081.stdout:7/768: getdents d2/d18/d60/daa/dd3 0 2024-09-18T12:51:29.971 INFO:tasks.workunit.client.0.smithi081.stdout:0/873: mkdir d7/d12b 0 2024-09-18T12:51:29.971 INFO:tasks.workunit.client.0.smithi081.stdout:3/902: dread d3/db/df/d113/d44/f62 [0,4194304] 0 2024-09-18T12:51:29.972 INFO:tasks.workunit.client.0.smithi081.stdout:3/903: symlink d3/db/df/d29/d13/d9d/d12d/l138 0 2024-09-18T12:51:29.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/904: truncate d3/db/df/d60/fd2 2028510 0 2024-09-18T12:51:29.976 INFO:tasks.workunit.client.0.smithi081.stdout:3/905: mkdir d3/db/df/d29/d13/d9d/d107/d139 0 2024-09-18T12:51:29.976 INFO:tasks.workunit.client.0.smithi081.stdout:3/906: write d3/db/df/d29/d13/f1e [2752448,36599] 0 2024-09-18T12:51:29.979 INFO:tasks.workunit.client.0.smithi081.stdout:0/874: dread d7/d9/d4b/d33/d43/fbd [0,4194304] 0 2024-09-18T12:51:29.979 INFO:tasks.workunit.client.0.smithi081.stdout:3/907: creat d3/db/df/d113/d44/d6f/f13a x:0 0 0 2024-09-18T12:51:29.982 INFO:tasks.workunit.client.0.smithi081.stdout:3/908: symlink d3/db/df/d60/l13b 0 2024-09-18T12:51:29.984 INFO:tasks.workunit.client.0.smithi081.stdout:0/875: dread d7/d5d/f7f [0,4194304] 0 2024-09-18T12:51:29.985 INFO:tasks.workunit.client.0.smithi081.stdout:0/876: mkdir d7/d12c 0 2024-09-18T12:51:29.986 INFO:tasks.workunit.client.0.smithi081.stdout:0/877: creat d7/d9/d4b/d33/db1/f12d x:0 0 0 2024-09-18T12:51:29.987 INFO:tasks.workunit.client.0.smithi081.stdout:0/878: dread d7/d9/d4b/d33/d43/d9a/fc4 [0,4194304] 0 2024-09-18T12:51:29.987 INFO:tasks.workunit.client.0.smithi081.stdout:0/879: stat d7/d9/d12/dba/f85 0 2024-09-18T12:51:29.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/880: write d7/d9/d4b/d4a/d92/fff [147183,96804] 0 2024-09-18T12:51:29.988 INFO:tasks.workunit.client.0.smithi081.stdout:7/769: dwrite d2/d18/d22/d48/db9/fc3 [0,4194304] 0 2024-09-18T12:51:29.989 INFO:tasks.workunit.client.0.smithi081.stdout:0/881: mknod d7/d11f/c12e 0 2024-09-18T12:51:29.989 INFO:tasks.workunit.client.0.smithi081.stdout:0/882: readlink d7/d9/d12/dba/l6c 0 2024-09-18T12:51:29.989 INFO:tasks.workunit.client.0.smithi081.stdout:0/883: chown d7/d5d/d9f 102 1 2024-09-18T12:51:29.989 INFO:tasks.workunit.client.0.smithi081.stdout:0/884: chown d7/d9/d4b/d4a/d77/fb0 1036618425 1 2024-09-18T12:51:29.993 INFO:tasks.workunit.client.0.smithi081.stdout:7/770: mkdir d2/dfe 0 2024-09-18T12:51:29.993 INFO:tasks.workunit.client.0.smithi081.stdout:3/909: dread d3/db/df/d113/dcc/f104 [0,4194304] 0 2024-09-18T12:51:29.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/910: mknod d3/db/df/d3b/dc0/c13c 0 2024-09-18T12:51:29.998 INFO:tasks.workunit.client.0.smithi081.stdout:3/911: rmdir d3/db/d1b/d135 0 2024-09-18T12:51:30.007 INFO:tasks.workunit.client.0.smithi081.stdout:5/823: sync 2024-09-18T12:51:30.007 INFO:tasks.workunit.client.0.smithi081.stdout:5/824: fdatasync d2/d14/d33/d37/d3b/d5f/ffc 0 2024-09-18T12:51:30.010 INFO:tasks.workunit.client.0.smithi081.stdout:7/771: dwrite d2/d14/d21/d49/fb7 [0,4194304] 0 2024-09-18T12:51:30.011 INFO:tasks.workunit.client.0.smithi081.stdout:5/825: rename d2/dd/d5e to d2/d14/d1d/d108 0 2024-09-18T12:51:30.018 INFO:tasks.workunit.client.0.smithi081.stdout:0/885: dwrite d7/d5d/f7f [0,4194304] 0 2024-09-18T12:51:30.018 INFO:tasks.workunit.client.0.smithi081.stdout:0/886: chown d7/dbf/d11c/d126 26878316 1 2024-09-18T12:51:30.018 INFO:tasks.workunit.client.0.smithi081.stdout:0/887: write d7/d9/d4b/d4a/f1b [36966,41561] 0 2024-09-18T12:51:30.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/888: unlink d7/d9/d12/df7/f115 0 2024-09-18T12:51:30.021 INFO:tasks.workunit.client.0.smithi081.stdout:3/912: dwrite d3/db/d1b/d57/fce [0,4194304] 0 2024-09-18T12:51:30.023 INFO:tasks.workunit.client.0.smithi081.stdout:7/772: dread d2/d14/d21/f26 [0,4194304] 0 2024-09-18T12:51:30.041 INFO:tasks.workunit.client.0.smithi081.stdout:7/773: dwrite d2/d14/d21/d49/f81 [0,4194304] 0 2024-09-18T12:51:30.041 INFO:tasks.workunit.client.0.smithi081.stdout:5/826: dwrite d2/dd/f10 [0,4194304] 0 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: Checking for cert/key for grafana.smithi081 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: Migrating grafana.smithi081 cert to cert store 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: Migrating grafana.smithi081 key to cert store 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: pgmap v4: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: Deploying cephadm binary to smithi136 2024-09-18T12:51:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:30 smithi136 ceph-mon[35363]: Deploying cephadm binary to smithi081 2024-09-18T12:51:30.081 INFO:tasks.workunit.client.0.smithi081.stdout:0/889: rmdir d7/d12c 0 2024-09-18T12:51:30.103 INFO:tasks.workunit.client.0.smithi081.stdout:7/774: mkdir d2/d7f/dff 0 2024-09-18T12:51:30.105 INFO:tasks.workunit.client.0.smithi081.stdout:5/827: mknod d2/c109 0 2024-09-18T12:51:30.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/828: write d2/d14/d1d/d108/f80 [549878,130412] 0 2024-09-18T12:51:30.108 INFO:tasks.workunit.client.0.smithi081.stdout:0/890: rename d7/d9/d4b/d3d/f89 to d7/d9/d4b/d33/f12f 0 2024-09-18T12:51:30.111 INFO:tasks.workunit.client.0.smithi081.stdout:5/829: truncate d2/d14/d33/d37/d3b/d2a/d8e/fa1 1974389 0 2024-09-18T12:51:30.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/830: fdatasync d2/d14/d33/d37/f50 0 2024-09-18T12:51:30.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/831: chown d2/d14/d33/d37/d3b/d16/de8/ffa 139 1 2024-09-18T12:51:30.112 INFO:tasks.workunit.client.0.smithi081.stdout:7/775: getdents d2/d56/d73/d7c 0 2024-09-18T12:51:30.114 INFO:tasks.workunit.client.0.smithi081.stdout:5/832: mkdir d2/d14/d1d/d1a/d10a 0 2024-09-18T12:51:30.116 INFO:tasks.workunit.client.0.smithi081.stdout:7/776: creat d2/d56/d73/d7c/f100 x:0 0 0 2024-09-18T12:51:30.117 INFO:tasks.workunit.client.0.smithi081.stdout:0/891: dread d7/d9/d4b/d53/f61 [0,4194304] 0 2024-09-18T12:51:30.117 INFO:tasks.workunit.client.0.smithi081.stdout:0/892: read - d7/d7c/ffc zero size 2024-09-18T12:51:30.118 INFO:tasks.workunit.client.0.smithi081.stdout:5/833: mkdir d2/d14/d1d/d108/d10b 0 2024-09-18T12:51:30.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/834: getdents d2/d14/d33/d37/d3b/d16/dbb 0 2024-09-18T12:51:30.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/835: write d2/d14/d33/d37/d3b/d16/f73 [5044565,105809] 0 2024-09-18T12:51:30.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/836: fsync d2/d14/d1d/d108/f7a 0 2024-09-18T12:51:30.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/837: creat d2/dd/f10c x:0 0 0 2024-09-18T12:51:30.122 INFO:tasks.workunit.client.0.smithi081.stdout:7/777: unlink d2/d18/d22/d48/l59 0 2024-09-18T12:51:30.128 INFO:tasks.workunit.client.0.smithi081.stdout:5/838: symlink d2/d14/d1d/d108/l10d 0 2024-09-18T12:51:30.129 INFO:tasks.workunit.client.0.smithi081.stdout:5/839: getdents d2/d14/d33/d37/d3b/d2a/db0 0 2024-09-18T12:51:30.130 INFO:tasks.workunit.client.0.smithi081.stdout:5/840: chown d2/d14/d33/d37/d3b/d6a/df9 23027475 1 2024-09-18T12:51:30.131 INFO:tasks.workunit.client.0.smithi081.stdout:5/841: mkdir d2/d14/d33/d37/d10e 0 2024-09-18T12:51:30.132 INFO:tasks.workunit.client.0.smithi081.stdout:5/842: symlink d2/d14/d33/d37/d3b/d2a/db0/l10f 0 2024-09-18T12:51:30.133 INFO:tasks.workunit.client.0.smithi081.stdout:5/843: fdatasync d2/d14/d33/d37/d3b/d6a/fac 0 2024-09-18T12:51:30.148 INFO:tasks.workunit.client.0.smithi081.stdout:7/778: dwrite d2/f11 [0,4194304] 0 2024-09-18T12:51:30.148 INFO:tasks.workunit.client.0.smithi081.stdout:0/893: dwrite d7/d9/d4b/d4a/d92/fc8 [0,4194304] 0 2024-09-18T12:51:30.148 INFO:tasks.workunit.client.0.smithi081.stdout:0/894: fsync d7/d9/d4b/d4a/f1b 0 2024-09-18T12:51:30.148 INFO:tasks.workunit.client.0.smithi081.stdout:0/895: write d7/d9/d4b/d53/f117 [1082655,54317] 0 2024-09-18T12:51:30.148 INFO:tasks.workunit.client.0.smithi081.stdout:0/896: creat d7/d9/d4b/d33/d43/d9a/f130 x:0 0 0 2024-09-18T12:51:30.149 INFO:tasks.workunit.client.0.smithi081.stdout:7/779: creat d2/d1d/f101 x:0 0 0 2024-09-18T12:51:30.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/780: read d2/d18/d22/fed [243474,96466] 0 2024-09-18T12:51:30.154 INFO:tasks.workunit.client.0.smithi081.stdout:5/844: dwrite d2/d14/d33/d37/d3b/d6a/d20/f92 [0,4194304] 0 2024-09-18T12:51:30.154 INFO:tasks.workunit.client.0.smithi081.stdout:5/845: chown d2/c109 15711397 1 2024-09-18T12:51:30.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/846: unlink d2/d14/d33/d37/d3b/d16/fd5 0 2024-09-18T12:51:30.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/781: dwrite d2/d14/d21/f7e [0,4194304] 0 2024-09-18T12:51:30.172 INFO:tasks.workunit.client.0.smithi081.stdout:7/782: creat d2/d18/d22/d48/df1/f102 x:0 0 0 2024-09-18T12:51:30.180 INFO:tasks.workunit.client.0.smithi081.stdout:5/847: dwrite d2/d14/d33/d37/d3b/d16/fb8 [0,4194304] 0 2024-09-18T12:51:30.185 INFO:tasks.workunit.client.0.smithi081.stdout:5/848: creat d2/d14/d33/f110 x:0 0 0 2024-09-18T12:51:30.187 INFO:tasks.workunit.client.0.smithi081.stdout:5/849: rmdir d2 39 2024-09-18T12:51:30.190 INFO:tasks.workunit.client.0.smithi081.stdout:5/850: dread d2/d14/d33/fe0 [0,4194304] 0 2024-09-18T12:51:30.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/783: dwrite d2/d18/d22/f95 [0,4194304] 0 2024-09-18T12:51:30.198 INFO:tasks.workunit.client.0.smithi081.stdout:7/784: truncate d2/d42/f43 4249275 0 2024-09-18T12:51:30.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/851: write d2/d14/d33/d37/d3b/d16/dd1/fe6 [1868351,27410] 0 2024-09-18T12:51:30.201 INFO:tasks.workunit.client.0.smithi081.stdout:5/852: fsync d2/f8d 0 2024-09-18T12:51:30.201 INFO:tasks.workunit.client.0.smithi081.stdout:5/853: stat d2/d14/d33/d37/d3b/d2a/f8b 0 2024-09-18T12:51:30.201 INFO:tasks.workunit.client.0.smithi081.stdout:5/854: chown d2/d14/d1d/da4 1679123 1 2024-09-18T12:51:30.204 INFO:tasks.workunit.client.0.smithi081.stdout:5/855: creat d2/d14/d33/d37/d3b/d16/dbb/f111 x:0 0 0 2024-09-18T12:51:30.207 INFO:tasks.workunit.client.0.smithi081.stdout:5/856: mkdir d2/d14/d112 0 2024-09-18T12:51:30.209 INFO:tasks.workunit.client.0.smithi081.stdout:5/857: mknod d2/d14/d33/c113 0 2024-09-18T12:51:30.209 INFO:tasks.workunit.client.0.smithi081.stdout:5/858: dread - d2/d14/d33/d37/d3b/d6a/d20/f97 zero size 2024-09-18T12:51:30.211 INFO:tasks.workunit.client.0.smithi081.stdout:5/859: rename d2/d14/d33/d37/d3b/d6a to d2/d14/d112/d114 0 2024-09-18T12:51:30.212 INFO:tasks.workunit.client.0.smithi081.stdout:5/860: creat d2/d14/d1d/f115 x:0 0 0 2024-09-18T12:51:30.214 INFO:tasks.workunit.client.0.smithi081.stdout:5/861: rmdir d2/d14/d112 39 2024-09-18T12:51:30.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/862: dread d2/d14/fb4 [0,4194304] 0 2024-09-18T12:51:30.218 INFO:tasks.workunit.client.0.smithi081.stdout:5/863: unlink d2/d14/d33/d37/d3b/d16/dbb/ldc 0 2024-09-18T12:51:30.219 INFO:tasks.workunit.client.0.smithi081.stdout:5/864: truncate d2/d14/d33/d37/d3b/d16/f73 1716009 0 2024-09-18T12:51:30.220 INFO:tasks.workunit.client.0.smithi081.stdout:7/785: dwrite d2/d14/d21/d62/da7/f50 [0,4194304] 0 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/865: rename d2/d47/l5d to d2/d47/d7f/l116 0 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/866: chown d2/d14/d1d 21826 1 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/867: readlink d2/d14/de9/lf2 0 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/868: write d2/d47/ff1 [1414748,55065] 0 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/869: write d2/f8d [1674344,118101] 0 2024-09-18T12:51:30.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/870: write d2/d14/d33/d37/d3b/d5f/fb5 [5024570,129327] 0 2024-09-18T12:51:30.223 INFO:tasks.workunit.client.0.smithi081.stdout:7/786: unlink d2/d56/d73/d90/lb6 0 2024-09-18T12:51:30.228 INFO:tasks.workunit.client.0.smithi081.stdout:5/871: symlink d2/d14/l117 0 2024-09-18T12:51:30.229 INFO:tasks.workunit.client.0.smithi081.stdout:5/872: read d2/d47/ff1 [661943,92356] 0 2024-09-18T12:51:30.229 INFO:tasks.workunit.client.0.smithi081.stdout:5/873: fsync d2/d14/d33/d37/d3b/d16/dbb/f111 0 2024-09-18T12:51:30.229 INFO:tasks.workunit.client.0.smithi081.stdout:5/874: creat d2/d14/d33/d37/dc5/f118 x:0 0 0 2024-09-18T12:51:30.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/787: dread d2/d56/d73/d7c/d86/da6/ff9 [0,4194304] 0 2024-09-18T12:51:30.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/788: rmdir d2/d18/d22 39 2024-09-18T12:51:30.236 INFO:tasks.workunit.client.0.smithi081.stdout:7/789: truncate d2/d18/d22/d48/df1/f102 111383 0 2024-09-18T12:51:30.239 INFO:tasks.workunit.client.0.smithi081.stdout:7/790: creat d2/d1d/d4e/d84/f103 x:0 0 0 2024-09-18T12:51:30.239 INFO:tasks.workunit.client.0.smithi081.stdout:7/791: readlink d2/d56/dc8/le0 0 2024-09-18T12:51:30.239 INFO:tasks.workunit.client.0.smithi081.stdout:7/792: write d2/d14/d21/d62/da7/f47 [2863696,291] 0 2024-09-18T12:51:30.241 INFO:tasks.workunit.client.0.smithi081.stdout:7/793: symlink d2/d42/l104 0 2024-09-18T12:51:30.241 INFO:tasks.workunit.client.0.smithi081.stdout:7/794: fsync d2/d18/d60/ff2 0 2024-09-18T12:51:30.243 INFO:tasks.workunit.client.0.smithi081.stdout:7/795: symlink d2/d18/dfc/l105 0 2024-09-18T12:51:30.244 INFO:tasks.workunit.client.0.smithi081.stdout:7/796: readlink d2/d18/d60/daa/lb0 0 2024-09-18T12:51:30.251 INFO:tasks.workunit.client.0.smithi081.stdout:5/875: dwrite d2/d14/d33/d37/d3b/d5f/f79 [0,4194304] 0 2024-09-18T12:51:30.255 INFO:tasks.workunit.client.0.smithi081.stdout:5/876: getdents d2/d14/d1d/d108 0 2024-09-18T12:51:30.271 INFO:tasks.workunit.client.0.smithi081.stdout:7/797: dwrite d2/d1d/f28 [0,4194304] 0 2024-09-18T12:51:30.271 INFO:tasks.workunit.client.0.smithi081.stdout:7/798: fdatasync d2/d18/f3b 0 2024-09-18T12:51:30.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/877: dwrite d2/d14/d33/d37/d3b/d2a/db0/ffb [0,4194304] 0 2024-09-18T12:51:30.282 INFO:tasks.workunit.client.0.smithi081.stdout:7/799: dread d2/f9 [0,4194304] 0 2024-09-18T12:51:30.285 INFO:tasks.workunit.client.0.smithi081.stdout:7/800: link d2/d18/c5d d2/d56/d73/d7c/d86/c106 0 2024-09-18T12:51:30.286 INFO:tasks.workunit.client.0.smithi081.stdout:7/801: chown d2/d18/d22/d48/la1 343247 1 2024-09-18T12:51:30.286 INFO:tasks.workunit.client.0.smithi081.stdout:7/802: fdatasync d2/f12 0 2024-09-18T12:51:30.289 INFO:tasks.workunit.client.0.smithi081.stdout:7/803: symlink d2/d56/d73/d7c/dd7/l107 0 2024-09-18T12:51:30.291 INFO:tasks.workunit.client.0.smithi081.stdout:7/804: creat d2/d14/d21/d62/da7/f108 x:0 0 0 2024-09-18T12:51:30.291 INFO:tasks.workunit.client.0.smithi081.stdout:7/805: write d2/d56/d73/da4/fba [937024,116285] 0 2024-09-18T12:51:30.293 INFO:tasks.workunit.client.0.smithi081.stdout:7/806: unlink d2/d18/f3b 0 2024-09-18T12:51:30.293 INFO:tasks.workunit.client.0.smithi081.stdout:7/807: fdatasync d2/d56/d73/d7c/d86/da6/fde 0 2024-09-18T12:51:30.293 INFO:tasks.workunit.client.0.smithi081.stdout:7/808: write d2/d18/d60/daa/fea [769327,79603] 0 2024-09-18T12:51:30.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/809: dwrite d2/d14/d21/d62/da7/f2e [0,4194304] 0 2024-09-18T12:51:30.316 INFO:tasks.workunit.client.0.smithi081.stdout:7/810: dread d2/d14/d21/f26 [0,4194304] 0 2024-09-18T12:51:30.317 INFO:tasks.workunit.client.0.smithi081.stdout:7/811: write d2/d56/d73/da4/fba [913673,51782] 0 2024-09-18T12:51:30.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/812: creat d2/d18/dfc/f109 x:0 0 0 2024-09-18T12:51:30.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/813: mknod d2/d1d/d4e/dc7/c10a 0 2024-09-18T12:51:30.321 INFO:tasks.workunit.client.0.smithi081.stdout:7/814: mknod d2/d18/d3c/c10b 0 2024-09-18T12:51:30.321 INFO:tasks.workunit.client.0.smithi081.stdout:7/815: write d2/d1d/d4e/d84/f103 [170224,13350] 0 2024-09-18T12:51:30.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/816: creat d2/d56/d73/f10c x:0 0 0 2024-09-18T12:51:30.324 INFO:tasks.workunit.client.0.smithi081.stdout:7/817: symlink d2/d18/d22/d48/df1/l10d 0 2024-09-18T12:51:30.325 INFO:tasks.workunit.client.0.smithi081.stdout:7/818: truncate d2/d18/d60/d85/f89 128191 0 2024-09-18T12:51:30.345 INFO:tasks.workunit.client.0.smithi081.stdout:7/819: dwrite d2/d14/d66/f69 [0,4194304] 0 2024-09-18T12:51:30.345 INFO:tasks.workunit.client.0.smithi081.stdout:7/820: write d2/d14/f2f [4477115,50145] 0 2024-09-18T12:51:30.346 INFO:tasks.workunit.client.0.smithi081.stdout:7/821: read d2/d7f/f83 [184803,93303] 0 2024-09-18T12:51:30.346 INFO:tasks.workunit.client.0.smithi081.stdout:7/822: chown d2/d14/d21/fbb 131485950 1 2024-09-18T12:51:30.349 INFO:tasks.workunit.client.0.smithi081.stdout:7/823: unlink d2/d14/f24 0 2024-09-18T12:51:30.349 INFO:tasks.workunit.client.0.smithi081.stdout:7/824: fsync d2/d18/d22/f2a 0 2024-09-18T12:51:30.349 INFO:tasks.workunit.client.0.smithi081.stdout:7/825: chown d2/d18/d60/d85/dee 0 1 2024-09-18T12:51:30.351 INFO:tasks.workunit.client.0.smithi081.stdout:7/826: rmdir d2/d56/d73/da4 39 2024-09-18T12:51:30.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/827: stat d2/d18/d3c/f7a 0 2024-09-18T12:51:30.353 INFO:tasks.workunit.client.0.smithi081.stdout:7/828: getdents d2/d56/d73/da4 0 2024-09-18T12:51:30.354 INFO:tasks.workunit.client.0.smithi081.stdout:7/829: creat d2/d14/d21/f10e x:0 0 0 2024-09-18T12:51:30.356 INFO:tasks.workunit.client.0.smithi081.stdout:7/830: creat d2/dfe/f10f x:0 0 0 2024-09-18T12:51:30.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: Checking for cert/key for grafana.smithi081 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: Migrating grafana.smithi081 cert to cert store 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: Migrating grafana.smithi081 key to cert store 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: pgmap v4: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: Deploying cephadm binary to smithi136 2024-09-18T12:51:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:30 smithi081 ceph-mon[27646]: Deploying cephadm binary to smithi081 2024-09-18T12:51:30.359 INFO:tasks.workunit.client.0.smithi081.stdout:7/831: symlink d2/d14/d21/d62/l110 0 2024-09-18T12:51:30.366 INFO:tasks.workunit.client.0.smithi081.stdout:7/832: dread d2/d18/d60/daa/fea [0,4194304] 0 2024-09-18T12:51:30.366 INFO:tasks.workunit.client.0.smithi081.stdout:7/833: write d2/d14/d21/d62/da7/f3d [1949752,99272] 0 2024-09-18T12:51:30.385 INFO:tasks.workunit.client.0.smithi081.stdout:7/834: dwrite d2/d18/f8c [0,4194304] 0 2024-09-18T12:51:30.385 INFO:tasks.workunit.client.0.smithi081.stdout:7/835: getdents d2/d18/d60/d85/dee 0 2024-09-18T12:51:30.385 INFO:tasks.workunit.client.0.smithi081.stdout:7/836: dread - d2/d18/d22/d48/db9/fec zero size 2024-09-18T12:51:30.388 INFO:tasks.workunit.client.0.smithi081.stdout:7/837: unlink d2/d7f/f88 0 2024-09-18T12:51:30.404 INFO:tasks.workunit.client.0.smithi081.stdout:7/838: dwrite d2/d18/d3c/f65 [0,4194304] 0 2024-09-18T12:51:30.404 INFO:tasks.workunit.client.0.smithi081.stdout:7/839: chown d2/d18/f1f 321502 1 2024-09-18T12:51:30.404 INFO:tasks.workunit.client.0.smithi081.stdout:7/840: truncate d2/d18/d22/d48/db9/fc3 4626239 0 2024-09-18T12:51:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:9/797: sync 2024-09-18T12:51:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:6/898: sync 2024-09-18T12:51:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:3/913: sync 2024-09-18T12:51:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:4/881: sync 2024-09-18T12:51:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/886: sync 2024-09-18T12:51:30.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/889: sync 2024-09-18T12:51:30.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/897: sync 2024-09-18T12:51:30.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/898: fsync d7/d9/d4b/d33/d43/d9a/f10f 0 2024-09-18T12:51:30.664 INFO:tasks.workunit.client.0.smithi081.stdout:8/887: mkdir d3/d1d/d4a/da9/d12c 0 2024-09-18T12:51:30.664 INFO:tasks.workunit.client.0.smithi081.stdout:8/888: fsync d3/d1e/f78 0 2024-09-18T12:51:30.666 INFO:tasks.workunit.client.0.smithi081.stdout:3/914: mknod d3/d123/c13d 0 2024-09-18T12:51:30.667 INFO:tasks.workunit.client.0.smithi081.stdout:9/798: creat dd/d15/d1a/d8d/dda/ffe x:0 0 0 2024-09-18T12:51:30.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/899: rename d4/d12/d1c/l7f to d4/d12/d28/d2a/d2d/d31/l134 0 2024-09-18T12:51:30.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/900: chown d4/d12/d28/d2a/d97/f113 33092525 1 2024-09-18T12:51:30.671 INFO:tasks.workunit.client.0.smithi081.stdout:8/889: symlink d3/d1e/d4c/d53/l12d 0 2024-09-18T12:51:30.673 INFO:tasks.workunit.client.0.smithi081.stdout:1/890: dread d0/f7e [0,4194304] 0 2024-09-18T12:51:30.673 INFO:tasks.workunit.client.0.smithi081.stdout:6/901: mknod d4/d12/d1c/d39/d60/c135 0 2024-09-18T12:51:30.674 INFO:tasks.workunit.client.0.smithi081.stdout:8/890: rmdir d3/d73 39 2024-09-18T12:51:30.675 INFO:tasks.workunit.client.0.smithi081.stdout:6/902: symlink d4/d12/d28/d2a/d2d/d12e/l136 0 2024-09-18T12:51:30.678 INFO:tasks.workunit.client.0.smithi081.stdout:8/891: rename d3/d1e/fa4 to d3/d73/dbe/f12e 0 2024-09-18T12:51:30.678 INFO:tasks.workunit.client.0.smithi081.stdout:8/892: creat d3/d1e/d4c/dae/f12f x:0 0 0 2024-09-18T12:51:30.678 INFO:tasks.workunit.client.0.smithi081.stdout:8/893: chown d3/d1d/d9f/d114 122526 1 2024-09-18T12:51:30.680 INFO:tasks.workunit.client.0.smithi081.stdout:3/915: dread d3/f46 [0,4194304] 0 2024-09-18T12:51:30.680 INFO:tasks.workunit.client.0.smithi081.stdout:8/894: write d3/d1d/d4a/d8d/fd3 [117901,115884] 0 2024-09-18T12:51:30.681 INFO:tasks.workunit.client.0.smithi081.stdout:4/882: dwrite d3/db/d35/d79/dfa/d11a/d14/f120 [0,4194304] 0 2024-09-18T12:51:30.683 INFO:tasks.workunit.client.0.smithi081.stdout:3/916: truncate d3/db/df/d113/d44/d6f/f7c 2821457 0 2024-09-18T12:51:30.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/895: creat d3/d1e/d4c/d68/dd2/f130 x:0 0 0 2024-09-18T12:51:30.686 INFO:tasks.workunit.client.0.smithi081.stdout:9/799: dread dd/de/fe1 [0,4194304] 0 2024-09-18T12:51:30.686 INFO:tasks.workunit.client.0.smithi081.stdout:6/903: dread d4/f58 [0,4194304] 0 2024-09-18T12:51:30.687 INFO:tasks.workunit.client.0.smithi081.stdout:0/899: dwrite d7/d5d/dd9/ff2 [4194304,4194304] 0 2024-09-18T12:51:30.689 INFO:tasks.workunit.client.0.smithi081.stdout:4/883: symlink d3/db/d35/d79/dfa/d11a/d45/d102/d106/l124 0 2024-09-18T12:51:30.690 INFO:tasks.workunit.client.0.smithi081.stdout:9/800: fdatasync dd/d1d/d1e/d24/fa4 0 2024-09-18T12:51:30.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/904: creat d4/d12/d56/d7d/d116/f137 x:0 0 0 2024-09-18T12:51:30.692 INFO:tasks.workunit.client.0.smithi081.stdout:9/801: symlink dd/d31/dd5/lff 0 2024-09-18T12:51:30.696 INFO:tasks.workunit.client.0.smithi081.stdout:6/905: mknod d4/d12/d28/d2a/d74/d8b/d6f/c138 0 2024-09-18T12:51:30.696 INFO:tasks.workunit.client.0.smithi081.stdout:0/900: rmdir d7/dbf 39 2024-09-18T12:51:30.696 INFO:tasks.workunit.client.0.smithi081.stdout:9/802: getdents dd/d15/d1a/d8d 0 2024-09-18T12:51:30.696 INFO:tasks.workunit.client.0.smithi081.stdout:9/803: fsync dd/de/d59/f5e 0 2024-09-18T12:51:30.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/901: mknod d7/d9/d4b/d33/db1/c131 0 2024-09-18T12:51:30.702 INFO:tasks.workunit.client.0.smithi081.stdout:8/896: dread d3/d1d/d4a/f7e [0,4194304] 0 2024-09-18T12:51:30.702 INFO:tasks.workunit.client.0.smithi081.stdout:4/884: read d3/db/d35/d79/dfa/d11a/d14/d54/dd3/fee [323068,31208] 0 2024-09-18T12:51:30.702 INFO:tasks.workunit.client.0.smithi081.stdout:0/902: mknod d7/d9/d4b/d4a/d77/d129/c132 0 2024-09-18T12:51:30.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/897: rename d3/d73/fc7 to d3/d1d/d89/d10d/f131 0 2024-09-18T12:51:30.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/898: creat d3/d1d/d4a/d7f/f132 x:0 0 0 2024-09-18T12:51:30.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/899: chown d3/d1e/d4c/dae/leb 0 1 2024-09-18T12:51:30.705 INFO:tasks.workunit.client.0.smithi081.stdout:3/917: dwrite d3/db/df/fb9 [0,4194304] 0 2024-09-18T12:51:30.705 INFO:tasks.workunit.client.0.smithi081.stdout:3/918: write d3/db/df/d113/d44/d51/dde/de1/f130 [814694,88077] 0 2024-09-18T12:51:30.706 INFO:tasks.workunit.client.0.smithi081.stdout:4/885: mkdir d3/db/d35/d79/dfa/d11a/d45/dc4/d125 0 2024-09-18T12:51:30.706 INFO:tasks.workunit.client.0.smithi081.stdout:4/886: readlink d3/d20/d3d/d6b/lc0 0 2024-09-18T12:51:30.709 INFO:tasks.workunit.client.0.smithi081.stdout:9/804: write dd/d1d/d1e/d2f/f69 [614476,72550] 0 2024-09-18T12:51:30.710 INFO:tasks.workunit.client.0.smithi081.stdout:1/891: dwrite d0/d6/f36 [4194304,4194304] 0 2024-09-18T12:51:30.711 INFO:tasks.workunit.client.0.smithi081.stdout:6/906: dwrite d4/d12/d1c/d39/d60/db8/fbb [0,4194304] 0 2024-09-18T12:51:30.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/900: rename d3/d1e/f2b to d3/d73/dbe/f133 0 2024-09-18T12:51:30.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/901: fsync d3/dc9/fef 0 2024-09-18T12:51:30.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/902: dread - d3/d1d/d102/f129 zero size 2024-09-18T12:51:30.716 INFO:tasks.workunit.client.0.smithi081.stdout:0/903: dread d7/d9/f90 [0,4194304] 0 2024-09-18T12:51:30.721 INFO:tasks.workunit.client.0.smithi081.stdout:4/887: dread d3/db/d35/d79/dfa/d11a/f2c [0,4194304] 0 2024-09-18T12:51:30.721 INFO:tasks.workunit.client.0.smithi081.stdout:4/888: write d3/db/d35/d79/dfa/d11a/d14/d27/f37 [3056854,49028] 0 2024-09-18T12:51:30.721 INFO:tasks.workunit.client.0.smithi081.stdout:4/889: chown d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/df2 18409685 1 2024-09-18T12:51:30.721 INFO:tasks.workunit.client.0.smithi081.stdout:3/919: symlink d3/db/df/d29/d13/d93/l13e 0 2024-09-18T12:51:30.727 INFO:tasks.workunit.client.0.smithi081.stdout:4/890: read d3/db/d35/d79/dfa/d11a/d45/d102/f8b [503065,84221] 0 2024-09-18T12:51:30.729 INFO:tasks.workunit.client.0.smithi081.stdout:6/907: creat d4/d12/d28/d2a/d74/f139 x:0 0 0 2024-09-18T12:51:30.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/904: mkdir d7/d9/d4b/d4a/d133 0 2024-09-18T12:51:30.731 INFO:tasks.workunit.client.0.smithi081.stdout:3/920: creat d3/db/df/d3b/dc0/d129/f13f x:0 0 0 2024-09-18T12:51:30.731 INFO:tasks.workunit.client.0.smithi081.stdout:9/805: getdents dd/d15/db1 0 2024-09-18T12:51:30.732 INFO:tasks.workunit.client.0.smithi081.stdout:9/806: dread dd/d1d/d1e/d2f/f83 [0,4194304] 0 2024-09-18T12:51:30.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/891: mkdir d3/d20/d5b/dd8/de8/d126 0 2024-09-18T12:51:30.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/908: write d4/d12/d1c/f72 [1090966,116248] 0 2024-09-18T12:51:30.734 INFO:tasks.workunit.client.0.smithi081.stdout:3/921: dread d3/db/df/d3b/dc0/ff7 [0,4194304] 0 2024-09-18T12:51:30.736 INFO:tasks.workunit.client.0.smithi081.stdout:0/905: truncate d7/d9/d4b/d33/d43/d9a/f9e 1736852 0 2024-09-18T12:51:30.736 INFO:tasks.workunit.client.0.smithi081.stdout:0/906: fdatasync d7/d9/d4b/d33/d43/d9a/f104 0 2024-09-18T12:51:30.736 INFO:tasks.workunit.client.0.smithi081.stdout:1/892: dwrite d0/dd7/d2d/faa [0,4194304] 0 2024-09-18T12:51:30.737 INFO:tasks.workunit.client.0.smithi081.stdout:4/892: creat d3/db/d35/d79/dfa/d11a/d45/d7e/f127 x:0 0 0 2024-09-18T12:51:30.738 INFO:tasks.workunit.client.0.smithi081.stdout:8/903: dwrite d3/d1d/d89/db5/db8/f116 [0,4194304] 0 2024-09-18T12:51:30.739 INFO:tasks.workunit.client.0.smithi081.stdout:3/922: creat d3/db/df/d60/d119/f140 x:0 0 0 2024-09-18T12:51:30.740 INFO:tasks.workunit.client.0.smithi081.stdout:0/907: mknod d7/c134 0 2024-09-18T12:51:30.745 INFO:tasks.workunit.client.0.smithi081.stdout:1/893: rmdir d0/d6/d7/d2e/d4e/dce 0 2024-09-18T12:51:30.745 INFO:tasks.workunit.client.0.smithi081.stdout:1/894: dread - d0/d6/d33/d37/d98/d79/ff5 zero size 2024-09-18T12:51:30.747 INFO:tasks.workunit.client.0.smithi081.stdout:4/893: unlink d3/db/d2d/c104 0 2024-09-18T12:51:30.750 INFO:tasks.workunit.client.0.smithi081.stdout:6/909: dwrite d4/d6/f85 [0,4194304] 0 2024-09-18T12:51:30.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/910: dread d4/d12/d56/d7d/fa5 [0,4194304] 0 2024-09-18T12:51:30.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/911: fdatasync d4/d12/d56/d7d/d9f/da2/fb1 0 2024-09-18T12:51:30.762 INFO:tasks.workunit.client.0.smithi081.stdout:8/904: rename d3/d1d/d4a/da9/lf9 to d3/d1d/l134 0 2024-09-18T12:51:30.764 INFO:tasks.workunit.client.0.smithi081.stdout:3/923: symlink d3/db/df/d29/d13/d9d/d12d/l141 0 2024-09-18T12:51:30.766 INFO:tasks.workunit.client.0.smithi081.stdout:1/895: creat d0/db/d4f/dab/f122 x:0 0 0 2024-09-18T12:51:30.768 INFO:tasks.workunit.client.0.smithi081.stdout:4/894: rmdir d3/db/d2d/df0 39 2024-09-18T12:51:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:6/912: dread d4/d12/d1c/d39/d60/f8c [0,4194304] 0 2024-09-18T12:51:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:6/913: chown d4/d12/d1c/d39/dd3 345 1 2024-09-18T12:51:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:6/914: stat d4/d12/d28/d2a/d97/ddc/d10a 0 2024-09-18T12:51:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:6/915: truncate d4/d12/d56/d7d/d84/fdf 2015065 0 2024-09-18T12:51:30.773 INFO:tasks.workunit.client.0.smithi081.stdout:3/924: write d3/db/df/fc6 [5538891,27678] 0 2024-09-18T12:51:30.775 INFO:tasks.workunit.client.0.smithi081.stdout:8/905: truncate d3/d1d/d4a/d8d/fe4 7525804 0 2024-09-18T12:51:30.776 INFO:tasks.workunit.client.0.smithi081.stdout:1/896: symlink d0/d18/df4/d10e/l123 0 2024-09-18T12:51:30.778 INFO:tasks.workunit.client.0.smithi081.stdout:4/895: creat d3/f128 x:0 0 0 2024-09-18T12:51:30.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/916: mknod d4/d12/d56/d7d/d84/dec/dee/c13a 0 2024-09-18T12:51:30.780 INFO:tasks.workunit.client.0.smithi081.stdout:3/925: write d3/d84/fda [1486071,90703] 0 2024-09-18T12:51:30.782 INFO:tasks.workunit.client.0.smithi081.stdout:8/906: symlink d3/d1d/d89/db5/l135 0 2024-09-18T12:51:30.783 INFO:tasks.workunit.client.0.smithi081.stdout:1/897: mkdir d0/db/d4f/dd2/dd5/d124 0 2024-09-18T12:51:30.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/878: sync 2024-09-18T12:51:30.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/841: sync 2024-09-18T12:51:30.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/879: readlink d2/d14/d33/d37/d3b/d2a/db0/l7c 0 2024-09-18T12:51:30.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/880: chown d2/d14/d33/d37/d3b/d2a/c6c 192 1 2024-09-18T12:51:30.787 INFO:tasks.workunit.client.0.smithi081.stdout:6/917: creat d4/d12/d56/da8/f13b x:0 0 0 2024-09-18T12:51:30.787 INFO:tasks.workunit.client.0.smithi081.stdout:6/918: chown d4/d12/d1c/f72 1 1 2024-09-18T12:51:30.789 INFO:tasks.workunit.client.0.smithi081.stdout:3/926: symlink d3/db/df/d29/d13/d65/l142 0 2024-09-18T12:51:30.791 INFO:tasks.workunit.client.0.smithi081.stdout:8/907: link d3/d1e/c2a d3/db7/c136 0 2024-09-18T12:51:30.793 INFO:tasks.workunit.client.0.smithi081.stdout:7/842: creat d2/d14/d21/d62/f111 x:0 0 0 2024-09-18T12:51:30.795 INFO:tasks.workunit.client.0.smithi081.stdout:5/881: symlink d2/d14/d1d/l119 0 2024-09-18T12:51:30.799 INFO:tasks.workunit.client.0.smithi081.stdout:6/919: rename d4/d6/d95/f103 to d4/d12/d1c/d8f/dea/f13c 0 2024-09-18T12:51:30.800 INFO:tasks.workunit.client.0.smithi081.stdout:8/908: dread d3/d1e/d4c/d68/daa/f10a [0,4194304] 0 2024-09-18T12:51:30.800 INFO:tasks.workunit.client.0.smithi081.stdout:4/896: dwrite d3/db/f23 [4194304,4194304] 0 2024-09-18T12:51:30.800 INFO:tasks.workunit.client.0.smithi081.stdout:8/909: chown d3/d1d/d9f/dcf/dda/f101 171375 1 2024-09-18T12:51:30.801 INFO:tasks.workunit.client.0.smithi081.stdout:3/927: mknod d3/db/df/d113/dcc/c143 0 2024-09-18T12:51:30.805 INFO:tasks.workunit.client.0.smithi081.stdout:5/882: link d2/d14/d33/d37/d3b/d16/fb8 d2/d14/d33/d37/dc5/f11a 0 2024-09-18T12:51:30.807 INFO:tasks.workunit.client.0.smithi081.stdout:6/920: truncate f0 10273776 0 2024-09-18T12:51:30.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/897: mknod d3/db/d35/d79/dfa/d11a/d45/d6c/dec/c129 0 2024-09-18T12:51:30.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/898: truncate d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/df2/f110 259604 0 2024-09-18T12:51:30.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/899: fsync d3/db/d35/d79/dfa/d11a/d14/d54/dd3/fee 0 2024-09-18T12:51:30.813 INFO:tasks.workunit.client.0.smithi081.stdout:4/900: write d3/d20/d5b/dd8/fef [516092,92521] 0 2024-09-18T12:51:30.815 INFO:tasks.workunit.client.0.smithi081.stdout:7/843: getdents d2/d14/d21 0 2024-09-18T12:51:30.815 INFO:tasks.workunit.client.0.smithi081.stdout:7/844: getdents d2/d18/d60/d85/d9c 0 2024-09-18T12:51:30.815 INFO:tasks.workunit.client.0.smithi081.stdout:7/845: creat d2/d14/d21/d49/f112 x:0 0 0 2024-09-18T12:51:30.817 INFO:tasks.workunit.client.0.smithi081.stdout:5/883: mknod d2/d14/d112/c11b 0 2024-09-18T12:51:30.817 INFO:tasks.workunit.client.0.smithi081.stdout:3/928: dwrite d3/db/df/d3b/dc0/ff1 [0,4194304] 0 2024-09-18T12:51:30.819 INFO:tasks.workunit.client.0.smithi081.stdout:4/901: link d3/db/d58/l7a d3/db/d35/d79/dfa/d11a/d14/d54/dd3/l12a 0 2024-09-18T12:51:30.822 INFO:tasks.workunit.client.0.smithi081.stdout:7/846: symlink d2/d18/d60/d85/dee/l113 0 2024-09-18T12:51:30.825 INFO:tasks.workunit.client.0.smithi081.stdout:5/884: dread d2/dd/f21 [0,4194304] 0 2024-09-18T12:51:30.826 INFO:tasks.workunit.client.0.smithi081.stdout:8/910: dread d3/d1d/f49 [0,4194304] 0 2024-09-18T12:51:30.827 INFO:tasks.workunit.client.0.smithi081.stdout:3/929: rename d3 to d3/db/df/d60/d119/d144 22 2024-09-18T12:51:30.829 INFO:tasks.workunit.client.0.smithi081.stdout:4/902: rmdir d3/db/d35/d79/dfa/d11a/d45/d102/df1 39 2024-09-18T12:51:30.830 INFO:tasks.workunit.client.0.smithi081.stdout:8/911: symlink d3/d1d/d9f/d12b/l137 0 2024-09-18T12:51:30.832 INFO:tasks.workunit.client.0.smithi081.stdout:7/847: dread d2/d1d/d4e/d84/fb1 [0,4194304] 0 2024-09-18T12:51:30.832 INFO:tasks.workunit.client.0.smithi081.stdout:7/848: creat d2/d1d/d4e/d84/f114 x:0 0 0 2024-09-18T12:51:30.833 INFO:tasks.workunit.client.0.smithi081.stdout:4/903: link d3/f22 d3/d20/d5b/dd8/de8/f12b 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/921: dwrite d4/d12/d28/d2a/d2d/d31/f51 [0,4194304] 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/922: fdatasync d4/d12/d28/d2a/d97/ddc/d10a/f125 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/923: write d4/d12/d56/da8/f13b [1031984,99687] 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/924: write d4/d12/d28/d2a/d98/dd8/de5/f100 [574758,99367] 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/925: write d4/d12/d56/d7d/d91/faa [413936,111048] 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/926: readlink d4/d12/d56/d7d/d84/dec/lfc 0 2024-09-18T12:51:30.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/885: dread d2/d14/d1d/d1a/f4a [0,4194304] 0 2024-09-18T12:51:30.840 INFO:tasks.workunit.client.0.smithi081.stdout:5/886: dread d2/d14/fb4 [0,4194304] 0 2024-09-18T12:51:30.842 INFO:tasks.workunit.client.0.smithi081.stdout:5/887: mknod d2/dd/d9e/c11c 0 2024-09-18T12:51:30.843 INFO:tasks.workunit.client.0.smithi081.stdout:3/930: dread d3/db/df/d3b/dc0/f110 [0,4194304] 0 2024-09-18T12:51:30.843 INFO:tasks.workunit.client.0.smithi081.stdout:3/931: truncate d3/db/df/d29/fb8 208799 0 2024-09-18T12:51:30.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/888: mkdir d2/d14/d33/d37/d3b/d16/de8/d11d 0 2024-09-18T12:51:30.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/889: stat d2/d14/de9/lf2 0 2024-09-18T12:51:30.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/890: creat d2/d14/d33/d37/d3b/d16/de8/d11d/f11e x:0 0 0 2024-09-18T12:51:30.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/891: stat d2/d14/d33/d37/d3b/d5f/cf3 0 2024-09-18T12:51:30.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/892: chown d2/d14/d1d/c67 139 1 2024-09-18T12:51:30.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/927: dread d4/d12/d1c/d39/f9a [4194304,4194304] 0 2024-09-18T12:51:30.855 INFO:tasks.workunit.client.0.smithi081.stdout:3/932: write d3/db/d1b/d57/fce [2995926,113739] 0 2024-09-18T12:51:30.859 INFO:tasks.workunit.client.0.smithi081.stdout:5/893: dread d2/d14/d33/d37/d3b/d5f/fb5 [0,4194304] 0 2024-09-18T12:51:30.859 INFO:tasks.workunit.client.0.smithi081.stdout:5/894: readlink d2/d14/lef 0 2024-09-18T12:51:30.861 INFO:tasks.workunit.client.0.smithi081.stdout:8/912: dwrite d3/d1d/d4a/f92 [0,4194304] 0 2024-09-18T12:51:30.861 INFO:tasks.workunit.client.0.smithi081.stdout:8/913: write d3/d1d/d4a/d7f/f110 [349059,106452] 0 2024-09-18T12:51:30.862 INFO:tasks.workunit.client.0.smithi081.stdout:7/849: dwrite d2/d18/d3c/f65 [4194304,4194304] 0 2024-09-18T12:51:30.862 INFO:tasks.workunit.client.0.smithi081.stdout:7/850: chown d2/d18/d60/daa/dd3 186120682 1 2024-09-18T12:51:30.864 INFO:tasks.workunit.client.0.smithi081.stdout:5/895: rename d2/d14/d33/d37/d3b/d2a/f8b to d2/d14/d33/f11f 0 2024-09-18T12:51:30.868 INFO:tasks.workunit.client.0.smithi081.stdout:5/896: creat d2/d14/d33/d37/d3b/d2a/db0/f120 x:0 0 0 2024-09-18T12:51:30.868 INFO:tasks.workunit.client.0.smithi081.stdout:5/897: fsync d2/d14/d33/d37/d3b/d2a/d8e/dc2/fcf 0 2024-09-18T12:51:30.876 INFO:tasks.workunit.client.0.smithi081.stdout:8/914: write d3/f6c [1787405,101161] 0 2024-09-18T12:51:30.878 INFO:tasks.workunit.client.0.smithi081.stdout:3/933: dwrite d3/db/d1b/d57/fce [0,4194304] 0 2024-09-18T12:51:30.880 INFO:tasks.workunit.client.0.smithi081.stdout:3/934: unlink d3/db/df/d29/d13/d65/ld7 0 2024-09-18T12:51:30.881 INFO:tasks.workunit.client.0.smithi081.stdout:3/935: symlink d3/db/df/d3b/d47/l145 0 2024-09-18T12:51:30.883 INFO:tasks.workunit.client.0.smithi081.stdout:3/936: symlink d3/db/df/da8/l146 0 2024-09-18T12:51:30.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/937: creat d3/db/df/d113/d44/d51/dde/de1/f147 x:0 0 0 2024-09-18T12:51:30.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/938: chown d3/db/d1b/l120 151975 1 2024-09-18T12:51:30.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/939: creat d3/db/df/d3b/dc0/f148 x:0 0 0 2024-09-18T12:51:30.886 INFO:tasks.workunit.client.0.smithi081.stdout:5/898: write d2/d14/d33/d37/f95 [2372117,19830] 0 2024-09-18T12:51:30.886 INFO:tasks.workunit.client.0.smithi081.stdout:3/940: chown d3/c53 124 1 2024-09-18T12:51:30.894 INFO:tasks.workunit.client.0.smithi081.stdout:6/928: dwrite d4/d12/d56/da8/fe3 [0,4194304] 0 2024-09-18T12:51:30.897 INFO:tasks.workunit.client.0.smithi081.stdout:7/851: dwrite d2/f11 [0,4194304] 0 2024-09-18T12:51:30.915 INFO:tasks.workunit.client.0.smithi081.stdout:8/915: dwrite d3/d1d/d4a/f4e [0,4194304] 0 2024-09-18T12:51:30.917 INFO:tasks.workunit.client.0.smithi081.stdout:3/941: write d3/db/df/d60/fd2 [2426824,85517] 0 2024-09-18T12:51:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:7/852: dwrite d2/d14/d21/fbb [4194304,4194304] 0 2024-09-18T12:51:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:6/929: dwrite d4/d12/d1c/d39/f9a [0,4194304] 0 2024-09-18T12:51:30.921 INFO:tasks.workunit.client.0.smithi081.stdout:6/930: write d4/d12/d56/d7d/d9f/da2/fa4 [4247927,26921] 0 2024-09-18T12:51:30.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/942: link d3/db/df/d113/d44/d51/dde/de1/f147 d3/db/d1b/f149 0 2024-09-18T12:51:30.942 INFO:tasks.workunit.client.0.smithi081.stdout:3/943: write d3/db/df/d29/d13/d9d/d107/fd6 [916151,16799] 0 2024-09-18T12:51:30.945 INFO:tasks.workunit.client.0.smithi081.stdout:3/944: mkdir d3/db/df/d113/dcc/d14a 0 2024-09-18T12:51:30.948 INFO:tasks.workunit.client.0.smithi081.stdout:6/931: dwrite d4/d12/d28/d2a/d98/dd8/f106 [0,4194304] 0 2024-09-18T12:51:30.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/932: dread d4/d12/d28/d2a/fbe [0,4194304] 0 2024-09-18T12:51:30.954 INFO:tasks.workunit.client.0.smithi081.stdout:3/945: dread d3/db/df/da8/fa9 [0,4194304] 0 2024-09-18T12:51:30.955 INFO:tasks.workunit.client.0.smithi081.stdout:3/946: mkdir d3/db/df/d29/d13/d93/d11d/d14b 0 2024-09-18T12:51:30.957 INFO:tasks.workunit.client.0.smithi081.stdout:3/947: mkdir d3/db/df/d29/d13/d93/d11d/d14c 0 2024-09-18T12:51:30.961 INFO:tasks.workunit.client.0.smithi081.stdout:7/853: dwrite d2/d18/d22/f95 [0,4194304] 0 2024-09-18T12:51:30.964 INFO:tasks.workunit.client.0.smithi081.stdout:6/933: dread d4/d12/d56/d7d/d96/fef [0,4194304] 0 2024-09-18T12:51:30.964 INFO:tasks.workunit.client.0.smithi081.stdout:7/854: rename d2/d18/d22/dfb to d2/d1d/d4e/d115 0 2024-09-18T12:51:30.966 INFO:tasks.workunit.client.0.smithi081.stdout:6/934: getdents d4/d12/d28/d2a/d74/d10e 0 2024-09-18T12:51:30.966 INFO:tasks.workunit.client.0.smithi081.stdout:6/935: chown d4/d12/d1c/d39/d60/d90/cf9 607962 1 2024-09-18T12:51:30.967 INFO:tasks.workunit.client.0.smithi081.stdout:7/855: symlink d2/d7f/dff/l116 0 2024-09-18T12:51:30.969 INFO:tasks.workunit.client.0.smithi081.stdout:7/856: creat d2/d42/f117 x:0 0 0 2024-09-18T12:51:30.975 INFO:tasks.workunit.client.0.smithi081.stdout:7/857: dread d2/d56/d73/d7c/fdf [0,4194304] 0 2024-09-18T12:51:30.978 INFO:tasks.workunit.client.0.smithi081.stdout:7/858: link d2/d18/d60/d85/dee/l113 d2/d1d/d4e/l118 0 2024-09-18T12:51:30.978 INFO:tasks.workunit.client.0.smithi081.stdout:7/859: truncate d2/d1d/d4e/d84/f114 37849 0 2024-09-18T12:51:30.981 INFO:tasks.workunit.client.0.smithi081.stdout:6/936: write d4/d12/f44 [1365745,85429] 0 2024-09-18T12:51:30.983 INFO:tasks.workunit.client.0.smithi081.stdout:6/937: rmdir d4/d12/d56/d7d/d84 39 2024-09-18T12:51:30.983 INFO:tasks.workunit.client.0.smithi081.stdout:6/938: chown d4/d88/fcb 3176 1 2024-09-18T12:51:30.992 INFO:tasks.workunit.client.0.smithi081.stdout:7/860: write d2/d14/d21/d49/f81 [999745,78530] 0 2024-09-18T12:51:30.993 INFO:tasks.workunit.client.0.smithi081.stdout:7/861: truncate d2/d14/f44 1156224 0 2024-09-18T12:51:30.994 INFO:tasks.workunit.client.0.smithi081.stdout:7/862: getdents d2/d56/d73 0 2024-09-18T12:51:30.995 INFO:tasks.workunit.client.0.smithi081.stdout:3/948: dwrite d3/db/df/d3b/d47/f2f [0,4194304] 0 2024-09-18T12:51:30.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/863: rename d2/d14/lbf to d2/d1d/d4e/dc7/l119 0 2024-09-18T12:51:30.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/864: fsync d2/d56/d73/da4/feb 0 2024-09-18T12:51:31.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/865: write d2/d56/d73/d7c/fe9 [909419,78027] 0 2024-09-18T12:51:31.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/866: write d2/d56/d73/d7c/f100 [959143,72066] 0 2024-09-18T12:51:31.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/867: truncate d2/d14/d21/d62/f111 29123 0 2024-09-18T12:51:31.000 INFO:tasks.workunit.client.0.smithi081.stdout:3/949: rmdir d3/d84 39 2024-09-18T12:51:31.004 INFO:tasks.workunit.client.0.smithi081.stdout:7/868: mknod d2/d14/d66/c11a 0 2024-09-18T12:51:31.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/869: stat d2/d1d/d4e/dc7/l119 0 2024-09-18T12:51:31.007 INFO:tasks.workunit.client.0.smithi081.stdout:7/870: chown d2/d14/d21/d62/f64 1 1 2024-09-18T12:51:31.022 INFO:tasks.workunit.client.0.smithi081.stdout:7/871: dwrite d2/d14/d21/d49/f112 [0,4194304] 0 2024-09-18T12:51:31.022 INFO:tasks.workunit.client.0.smithi081.stdout:7/872: dread - d2/d18/fab zero size 2024-09-18T12:51:31.024 INFO:tasks.workunit.client.0.smithi081.stdout:7/873: symlink d2/d14/d21/d49/l11b 0 2024-09-18T12:51:31.163 INFO:tasks.workunit.client.0.smithi081.stdout:9/807: sync 2024-09-18T12:51:31.165 INFO:tasks.workunit.client.0.smithi081.stdout:9/808: link dd/d1d/d1e/d24/d2a/f30 dd/d1d/d1e/f100 0 2024-09-18T12:51:31.165 INFO:tasks.workunit.client.0.smithi081.stdout:9/809: fdatasync dd/d15/d1a/d35/fee 0 2024-09-18T12:51:31.165 INFO:tasks.workunit.client.0.smithi081.stdout:9/810: readlink dd/d1d/d1e/d77/dfa/d9e/le6 0 2024-09-18T12:51:31.166 INFO:tasks.workunit.client.0.smithi081.stdout:9/811: creat dd/d15/d1a/d35/f101 x:0 0 0 2024-09-18T12:51:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:9/812: mkdir dd/d1d/d1e/d24/d48/d102 0 2024-09-18T12:51:31.170 INFO:tasks.workunit.client.0.smithi081.stdout:9/813: symlink dd/d1d/d1e/d24/l103 0 2024-09-18T12:51:31.170 INFO:tasks.workunit.client.0.smithi081.stdout:9/814: truncate dd/de/d4f/ff4 479337 0 2024-09-18T12:51:31.172 INFO:tasks.workunit.client.0.smithi081.stdout:9/815: unlink dd/d1d/f2e 0 2024-09-18T12:51:31.179 INFO:tasks.workunit.client.0.smithi081.stdout:9/816: write dd/d15/fbb [518693,73801] 0 2024-09-18T12:51:31.184 INFO:tasks.workunit.client.0.smithi081.stdout:9/817: rename dd/d1d/d91 to dd/d15/db1/d104 0 2024-09-18T12:51:31.184 INFO:tasks.workunit.client.0.smithi081.stdout:9/818: readlink dd/de/la3 0 2024-09-18T12:51:31.201 INFO:tasks.workunit.client.0.smithi081.stdout:9/819: dwrite dd/d15/d1a/da7/fd3 [0,4194304] 0 2024-09-18T12:51:31.204 INFO:tasks.workunit.client.0.smithi081.stdout:9/820: unlink dd/d1d/d1e/d24/d2a/d55/c72 0 2024-09-18T12:51:31.204 INFO:tasks.workunit.client.0.smithi081.stdout:9/821: chown dd/d15/d1a 52 1 2024-09-18T12:51:31.204 INFO:tasks.workunit.client.0.smithi081.stdout:9/822: write dd/d15/d1a/da7/dce/ddd/def/ff9 [874090,99376] 0 2024-09-18T12:51:31.206 INFO:tasks.workunit.client.0.smithi081.stdout:9/823: unlink dd/d1d/d1e/f100 0 2024-09-18T12:51:31.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/824: unlink dd/de/fa9 0 2024-09-18T12:51:31.209 INFO:tasks.workunit.client.0.smithi081.stdout:9/825: symlink dd/d1d/d1e/d77/dfa/d9e/l105 0 2024-09-18T12:51:31.209 INFO:tasks.workunit.client.0.smithi081.stdout:9/826: stat dd/de/d4f/d8c/d94/fdf 0 2024-09-18T12:51:31.234 INFO:tasks.workunit.client.0.smithi081.stdout:9/827: dwrite dd/d15/db1/d104/fbf [0,4194304] 0 2024-09-18T12:51:31.234 INFO:tasks.workunit.client.0.smithi081.stdout:9/828: write dd/d31/dd5/ffc [312826,87380] 0 2024-09-18T12:51:31.235 INFO:tasks.workunit.client.0.smithi081.stdout:9/829: getdents dd/d31 0 2024-09-18T12:51:31.236 INFO:tasks.workunit.client.0.smithi081.stdout:9/830: mknod dd/d15/d1a/d8d/c106 0 2024-09-18T12:51:31.259 INFO:tasks.workunit.client.0.smithi081.stdout:9/831: dwrite dd/d1d/d1e/d77/fb5 [0,4194304] 0 2024-09-18T12:51:31.259 INFO:tasks.workunit.client.0.smithi081.stdout:9/832: getdents dd/d15/db1/de5 0 2024-09-18T12:51:31.262 INFO:tasks.workunit.client.0.smithi081.stdout:9/833: mkdir dd/d1d/d1e/d24/d107 0 2024-09-18T12:51:31.262 INFO:tasks.workunit.client.0.smithi081.stdout:9/834: readlink dd/l86 0 2024-09-18T12:51:31.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/908: sync 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:31 smithi136 ceph-mon[35363]: [18/Sep/2024:12:51:29] ENGINE Bus STARTING 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:31 smithi136 ceph-mon[35363]: [18/Sep/2024:12:51:29] ENGINE Serving on https://172.21.15.136:7150 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:31 smithi136 ceph-mon[35363]: [18/Sep/2024:12:51:29] ENGINE Error in HTTPServer.serve 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Traceback (most recent call last): 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._run(expiration_interval) 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:51:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s = self.context.wrap_socket( 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: return self.sslsocket_class._create( 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self.do_handshake() 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._sslobj.do_handshake() 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:31 smithi136 ceph-mon[35363]: [18/Sep/2024:12:51:29] ENGINE Serving on http://172.21.15.136:8765 2024-09-18T12:51:31.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:31 smithi136 ceph-mon[35363]: [18/Sep/2024:12:51:29] ENGINE Bus STARTED 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:31 smithi081 ceph-mon[27646]: [18/Sep/2024:12:51:29] ENGINE Bus STARTING 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:31 smithi081 ceph-mon[27646]: [18/Sep/2024:12:51:29] ENGINE Serving on https://172.21.15.136:7150 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:31 smithi081 ceph-mon[27646]: [18/Sep/2024:12:51:29] ENGINE Error in HTTPServer.serve 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Traceback (most recent call last): 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._run(expiration_interval) 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:51:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s = self.context.wrap_socket( 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: return self.sslsocket_class._create( 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self.do_handshake() 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._sslobj.do_handshake() 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:31 smithi081 ceph-mon[27646]: [18/Sep/2024:12:51:29] ENGINE Serving on http://172.21.15.136:8765 2024-09-18T12:51:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:31 smithi081 ceph-mon[27646]: [18/Sep/2024:12:51:29] ENGINE Bus STARTED 2024-09-18T12:51:31.488 INFO:tasks.workunit.client.0.smithi081.stdout:4/904: sync 2024-09-18T12:51:31.489 INFO:tasks.workunit.client.0.smithi081.stdout:1/898: sync 2024-09-18T12:51:31.489 INFO:tasks.workunit.client.0.smithi081.stdout:8/916: sync 2024-09-18T12:51:31.489 INFO:tasks.workunit.client.0.smithi081.stdout:4/905: truncate d3/f67 970158 0 2024-09-18T12:51:31.489 INFO:tasks.workunit.client.0.smithi081.stdout:1/899: rmdir d0/d18/df4 39 2024-09-18T12:51:31.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/900: chown d0/d18/d6a 60 1 2024-09-18T12:51:31.491 INFO:tasks.workunit.client.0.smithi081.stdout:8/917: mknod d3/d1d/d89/d10d/c138 0 2024-09-18T12:51:31.504 INFO:tasks.workunit.client.0.smithi081.stdout:4/906: write d3/d20/d3d/d6b/fb7 [175056,21465] 0 2024-09-18T12:51:31.505 INFO:tasks.workunit.client.0.smithi081.stdout:1/901: dwrite d0/df9/fe2 [0,4194304] 0 2024-09-18T12:51:31.505 INFO:tasks.workunit.client.0.smithi081.stdout:4/907: mknod d3/db/d35/d79/dfa/d11a/d14/d54/c12c 0 2024-09-18T12:51:31.506 INFO:tasks.workunit.client.0.smithi081.stdout:4/908: creat d3/d20/d5b/dd8/f12d x:0 0 0 2024-09-18T12:51:31.506 INFO:tasks.workunit.client.0.smithi081.stdout:4/909: chown d3/d20/d3d 1757779 1 2024-09-18T12:51:31.508 INFO:tasks.workunit.client.0.smithi081.stdout:1/902: truncate d0/d6/d7/d8/f11 3824091 0 2024-09-18T12:51:31.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/910: mknod d3/db/d35/d79/dfa/d11a/d45/d4f/c12e 0 2024-09-18T12:51:31.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/911: creat d3/d20/d5b/dd8/f12f x:0 0 0 2024-09-18T12:51:31.512 INFO:tasks.workunit.client.0.smithi081.stdout:1/903: symlink d0/df9/dc0/da0/l125 0 2024-09-18T12:51:31.516 INFO:tasks.workunit.client.0.smithi081.stdout:4/912: rename d3/d20/d3d/dbd to d3/db/d2d/d130 0 2024-09-18T12:51:31.519 INFO:tasks.workunit.client.0.smithi081.stdout:1/904: link d0/d6/d33/d37/f6d d0/d54/f126 0 2024-09-18T12:51:31.540 INFO:tasks.workunit.client.0.smithi081.stdout:1/905: dread d0/db/d4f/dd2/f115 [0,4194304] 0 2024-09-18T12:51:31.540 INFO:tasks.workunit.client.0.smithi081.stdout:1/906: read d0/d6/d33/fcc [119799,22361] 0 2024-09-18T12:51:31.540 INFO:tasks.workunit.client.0.smithi081.stdout:4/913: dwrite d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/f11b [0,4194304] 0 2024-09-18T12:51:31.542 INFO:tasks.workunit.client.0.smithi081.stdout:1/907: rename d0/d18/db7 to d0/d6/d33/d37/dbc/d127 0 2024-09-18T12:51:31.543 INFO:tasks.workunit.client.0.smithi081.stdout:1/908: chown d0/d6/d33 7 1 2024-09-18T12:51:31.546 INFO:tasks.workunit.client.0.smithi081.stdout:4/914: mknod d3/db/d2d/d130/c131 0 2024-09-18T12:51:31.547 INFO:tasks.workunit.client.0.smithi081.stdout:1/909: unlink d0/d6/d66/f11e 0 2024-09-18T12:51:31.548 INFO:tasks.workunit.client.0.smithi081.stdout:1/910: write d0/db/d32/f103 [970780,116833] 0 2024-09-18T12:51:31.549 INFO:tasks.workunit.client.0.smithi081.stdout:1/911: getdents d0/d6/d7/d2e 0 2024-09-18T12:51:31.557 INFO:tasks.workunit.client.0.smithi081.stdout:1/912: write d0/d96/fad [1343670,95149] 0 2024-09-18T12:51:31.557 INFO:tasks.workunit.client.0.smithi081.stdout:1/913: truncate d0/d6/d7/d8/f82 1476235 0 2024-09-18T12:51:31.564 INFO:tasks.workunit.client.0.smithi081.stdout:1/914: write d0/d6/d7/d2e/d51/f56 [2819766,35238] 0 2024-09-18T12:51:31.566 INFO:tasks.workunit.client.0.smithi081.stdout:1/915: creat d0/df9/f128 x:0 0 0 2024-09-18T12:51:31.567 INFO:tasks.workunit.client.0.smithi081.stdout:1/916: creat d0/dd7/d2d/f129 x:0 0 0 2024-09-18T12:51:31.567 INFO:tasks.workunit.client.0.smithi081.stdout:1/917: write d0/dd7/f22 [4757742,26315] 0 2024-09-18T12:51:31.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/918: mknod d0/d6/d7/d2e/d51/d2c/c12a 0 2024-09-18T12:51:31.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/919: dread - d0/d6/d7/d2e/fb9 zero size 2024-09-18T12:51:31.571 INFO:tasks.workunit.client.0.smithi081.stdout:4/915: dwrite d3/db/f9e [0,4194304] 0 2024-09-18T12:51:31.571 INFO:tasks.workunit.client.0.smithi081.stdout:4/916: stat d3/d20/d5b/ce9 0 2024-09-18T12:51:31.571 INFO:tasks.workunit.client.0.smithi081.stdout:4/917: read d3/db/d35/d79/dfa/d11a/d14/f88 [2538636,23392] 0 2024-09-18T12:51:31.571 INFO:tasks.workunit.client.0.smithi081.stdout:4/918: write d3/db/fc [3017917,30214] 0 2024-09-18T12:51:31.571 INFO:tasks.workunit.client.0.smithi081.stdout:1/920: rename d0/d6/d7/d8/f82 to d0/d6/d33/d42/dcf/f12b 0 2024-09-18T12:51:31.577 INFO:tasks.workunit.client.0.smithi081.stdout:4/919: unlink d3/db/d35/d79/dfa/d11a/d45/cc6 0 2024-09-18T12:51:31.578 INFO:tasks.workunit.client.0.smithi081.stdout:4/920: symlink d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/df2/l132 0 2024-09-18T12:51:31.598 INFO:tasks.workunit.client.0.smithi081.stdout:4/921: dwrite d3/db/d35/d79/dfa/d11a/f19 [0,4194304] 0 2024-09-18T12:51:31.600 INFO:tasks.workunit.client.0.smithi081.stdout:4/922: truncate d3/db/d35/d79/dfa/d11a/d14/f88 147371 0 2024-09-18T12:51:31.602 INFO:tasks.workunit.client.0.smithi081.stdout:4/923: truncate d3/db/d35/d79/dfa/d11a/d45/d102/d8c/fbe 206194 0 2024-09-18T12:51:31.602 INFO:tasks.workunit.client.0.smithi081.stdout:4/924: chown d3/db/d2d/d10c 3 1 2024-09-18T12:51:31.630 INFO:tasks.workunit.client.0.smithi081.stdout:4/925: dwrite d3/db/d35/d79/dfa/d11a/d45/d4f/f5a [0,4194304] 0 2024-09-18T12:51:31.646 INFO:tasks.workunit.client.0.smithi081.stdout:4/926: dwrite d3/db/d35/d79/dfa/d11a/d45/d6c/f7b [0,4194304] 0 2024-09-18T12:51:31.646 INFO:tasks.workunit.client.0.smithi081.stdout:4/927: write d3/db/f9e [5055200,65277] 0 2024-09-18T12:51:31.646 INFO:tasks.workunit.client.0.smithi081.stdout:4/928: write d3/db/d35/d79/dfa/d11a/d45/f81 [221172,119410] 0 2024-09-18T12:51:31.648 INFO:tasks.workunit.client.0.smithi081.stdout:4/929: unlink d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/fa2 0 2024-09-18T12:51:31.649 INFO:tasks.workunit.client.0.smithi081.stdout:4/930: mknod d3/d20/d3d/c133 0 2024-09-18T12:51:31.650 INFO:tasks.workunit.client.0.smithi081.stdout:4/931: creat d3/db/d35/d79/dfa/d11a/d45/d102/de4/f134 x:0 0 0 2024-09-18T12:51:31.651 INFO:tasks.workunit.client.0.smithi081.stdout:4/932: getdents d3/db/d35/d79/dfa/d11a/d45/d7e 0 2024-09-18T12:51:31.664 INFO:tasks.workunit.client.0.smithi081.stdout:4/933: dwrite d3/db/d2d/f7f [0,4194304] 0 2024-09-18T12:51:31.668 INFO:tasks.workunit.client.0.smithi081.stdout:4/934: dread d3/db/fab [0,4194304] 0 2024-09-18T12:51:31.669 INFO:tasks.workunit.client.0.smithi081.stdout:4/935: symlink d3/db/d35/d79/dfa/d11a/d14/d54/dd3/dc1/l135 0 2024-09-18T12:51:31.670 INFO:tasks.workunit.client.0.smithi081.stdout:4/936: fsync d3/db/d35/d79/dfa/d11a/d14/d54/f123 0 2024-09-18T12:51:31.670 INFO:tasks.workunit.client.0.smithi081.stdout:4/937: dread - d3/d20/d5b/fc2 zero size 2024-09-18T12:51:31.670 INFO:tasks.workunit.client.0.smithi081.stdout:4/938: mknod d3/d20/d3d/d6b/c136 0 2024-09-18T12:51:31.670 INFO:tasks.workunit.client.0.smithi081.stdout:4/939: truncate d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/d97/fd2 473911 0 2024-09-18T12:51:31.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/940: dread d3/f22 [4194304,4194304] 0 2024-09-18T12:51:31.680 INFO:tasks.workunit.client.0.smithi081.stdout:4/941: creat d3/db/d35/d79/dfa/d11a/d45/d4f/f137 x:0 0 0 2024-09-18T12:51:31.680 INFO:tasks.workunit.client.0.smithi081.stdout:4/942: readlink d3/db/d2d/l2e 0 2024-09-18T12:51:31.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/943: dwrite d3/d20/d3d/f8f [0,4194304] 0 2024-09-18T12:51:31.701 INFO:tasks.workunit.client.0.smithi081.stdout:4/944: creat d3/db/f138 x:0 0 0 2024-09-18T12:51:31.701 INFO:tasks.workunit.client.0.smithi081.stdout:4/945: fdatasync d3/db/f36 0 2024-09-18T12:51:31.708 INFO:tasks.workunit.client.0.smithi081.stdout:4/946: link d3/d20/d3d/d6b/fae d3/db/d35/d79/dfa/d11a/d14/d4b/dc7/f139 0 2024-09-18T12:51:31.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/947: unlink d3/db/d35/d79/dfa/d11a/d45/d102/c56 0 2024-09-18T12:51:31.728 INFO:tasks.workunit.client.0.smithi081.stdout:4/948: dwrite d3/db/d35/d79/dfa/d11a/d14/d3e/f51 [0,4194304] 0 2024-09-18T12:51:31.728 INFO:tasks.workunit.client.0.smithi081.stdout:4/949: truncate d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/f115 373042 0 2024-09-18T12:51:31.728 INFO:tasks.workunit.client.0.smithi081.stdout:4/950: truncate d3/db/d35/d79/dfa/d11a/d45/d102/f8b 921914 0 2024-09-18T12:51:31.729 INFO:tasks.workunit.client.0.smithi081.stdout:4/951: chown d3/db/d35 10536908 1 2024-09-18T12:51:31.730 INFO:tasks.workunit.client.0.smithi081.stdout:4/952: creat d3/db/d35/d79/dfa/d11a/d45/d7e/f13a x:0 0 0 2024-09-18T12:51:31.730 INFO:tasks.workunit.client.0.smithi081.stdout:4/953: chown d3/db/f36 32311 1 2024-09-18T12:51:31.731 INFO:tasks.workunit.client.0.smithi081.stdout:4/954: symlink d3/db/d35/d79/dfa/d11a/d45/d102/df1/l13b 0 2024-09-18T12:51:31.739 INFO:tasks.workunit.client.0.smithi081.stdout:4/955: dread d3/dbb/fe5 [0,4194304] 0 2024-09-18T12:51:31.740 INFO:tasks.workunit.client.0.smithi081.stdout:4/956: creat d3/db/d2d/f13c x:0 0 0 2024-09-18T12:51:31.740 INFO:tasks.workunit.client.0.smithi081.stdout:4/957: write d3/db/fc [3381669,12767] 0 2024-09-18T12:51:31.740 INFO:tasks.workunit.client.0.smithi081.stdout:4/958: stat d3/db/d35/d79/dfa/d11a/d14/f29 0 2024-09-18T12:51:31.740 INFO:tasks.workunit.client.0.smithi081.stdout:4/959: dread - d3/db/d35/d79/dfa/d11a/d45/d7e/f119 zero size 2024-09-18T12:51:31.741 INFO:tasks.workunit.client.0.smithi081.stdout:4/960: unlink d3/db/d2d/f3b 0 2024-09-18T12:51:31.746 INFO:tasks.workunit.client.0.smithi081.stdout:4/961: rmdir d3/db/d35/d79/dfa/d11a/d45 39 2024-09-18T12:51:31.748 INFO:tasks.workunit.client.0.smithi081.stdout:4/962: truncate d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/d97/fd2 1516682 0 2024-09-18T12:51:31.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/963: rename d3/d20/d5b to d3/db/d35/d13d 0 2024-09-18T12:51:31.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/964: mknod d3/db/d35/d79/dfa/d11a/d45/dc4/c13e 0 2024-09-18T12:51:31.757 INFO:tasks.workunit.client.0.smithi081.stdout:4/965: rename d3/db/d35/d79/dfa/d11a/d45/d6c/dec to d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/dde/d13f 22 2024-09-18T12:51:31.758 INFO:tasks.workunit.client.0.smithi081.stdout:4/966: link d3/db/d2d/df4/c107 d3/db/d35/d79/dfa/d11a/d14/d27/c140 0 2024-09-18T12:51:31.758 INFO:tasks.workunit.client.0.smithi081.stdout:4/967: write d3/db/d35/d79/dfa/d11a/d45/d7e/fca [423935,117759] 0 2024-09-18T12:51:31.759 INFO:tasks.workunit.client.0.smithi081.stdout:4/968: rename d3/db/d35/d79/dfa/d11a/d45/d102/f8b to d3/db/d35/d79/dfa/d11a/d14/d27/f141 0 2024-09-18T12:51:31.759 INFO:tasks.workunit.client.0.smithi081.stdout:4/969: fsync d3/db/d35/d79/dfa/d11a/d14/f9a 0 2024-09-18T12:51:31.780 INFO:tasks.workunit.client.0.smithi081.stdout:4/970: dwrite d3/db/d35/d79/dfa/d11a/d45/d4f/f137 [0,4194304] 0 2024-09-18T12:51:31.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/971: mkdir d3/db/d35/d79/dfa/d11a/d14/d4b/dc7/d142 0 2024-09-18T12:51:31.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/972: fdatasync d3/db/d35/d79/dfa/d11a/d14/d54/dd3/f121 0 2024-09-18T12:51:31.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/973: truncate d3/db/d35/d79/dfa/d11a/d14/d27/ff5 865825 0 2024-09-18T12:51:31.793 INFO:tasks.workunit.client.0.smithi081.stdout:5/899: sync 2024-09-18T12:51:31.810 INFO:tasks.workunit.client.0.smithi081.stdout:4/974: dwrite d3/d20/d3d/fd0 [4194304,4194304] 0 2024-09-18T12:51:31.810 INFO:tasks.workunit.client.0.smithi081.stdout:4/975: creat d3/db/d35/d79/dfa/d11a/d14/d54/f143 x:0 0 0 2024-09-18T12:51:31.861 INFO:tasks.workunit.client.0.smithi081.stdout:6/939: sync 2024-09-18T12:51:31.862 INFO:tasks.workunit.client.0.smithi081.stdout:6/940: truncate d4/d12/d1c/d64/f81 1048027 0 2024-09-18T12:51:31.884 INFO:tasks.workunit.client.0.smithi081.stdout:6/941: dwrite d4/d12/d28/d2a/d2d/f82 [0,4194304] 0 2024-09-18T12:51:31.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/942: dread d4/d6/f26 [0,4194304] 0 2024-09-18T12:51:31.893 INFO:tasks.workunit.client.0.smithi081.stdout:6/943: creat d4/d6/db4/f13d x:0 0 0 2024-09-18T12:51:31.896 INFO:tasks.workunit.client.0.smithi081.stdout:6/944: dread d4/d12/d28/d2a/d97/fcd [0,4194304] 0 2024-09-18T12:51:31.896 INFO:tasks.workunit.client.0.smithi081.stdout:6/945: readlink d4/d12/d1c/d39/d60/l12b 0 2024-09-18T12:51:31.896 INFO:tasks.workunit.client.0.smithi081.stdout:6/946: stat d4/d12/d28/d2a/d74/f139 0 2024-09-18T12:51:31.897 INFO:tasks.workunit.client.0.smithi081.stdout:6/947: rename d4/d12/d56/ceb to d4/d12/d56/d7d/d96/db7/de8/c13e 0 2024-09-18T12:51:31.898 INFO:tasks.workunit.client.0.smithi081.stdout:6/948: symlink d4/d12/d1c/d39/d115/l13f 0 2024-09-18T12:51:31.898 INFO:tasks.workunit.client.0.smithi081.stdout:6/949: readlink d4/l3e 0 2024-09-18T12:51:31.899 INFO:tasks.workunit.client.0.smithi081.stdout:6/950: mkdir d4/d12/d56/d140 0 2024-09-18T12:51:31.899 INFO:tasks.workunit.client.0.smithi081.stdout:6/951: symlink d4/d12/d56/d7d/d84/l141 0 2024-09-18T12:51:31.900 INFO:tasks.workunit.client.0.smithi081.stdout:6/952: chown d4/f7 3 1 2024-09-18T12:51:31.900 INFO:tasks.workunit.client.0.smithi081.stdout:6/953: dread - d4/d12/d1c/d64/ff5 zero size 2024-09-18T12:51:31.922 INFO:tasks.workunit.client.0.smithi081.stdout:6/954: dwrite d4/d12/d1c/f48 [0,4194304] 0 2024-09-18T12:51:31.923 INFO:tasks.workunit.client.0.smithi081.stdout:6/955: link d4/d6/db4/ce7 d4/d12/d1c/d8f/dea/c142 0 2024-09-18T12:51:31.924 INFO:tasks.workunit.client.0.smithi081.stdout:6/956: creat d4/d12/d28/d2a/f143 x:0 0 0 2024-09-18T12:51:31.925 INFO:tasks.workunit.client.0.smithi081.stdout:6/957: dread d4/d12/d28/d2a/d97/ddc/d10a/f125 [0,4194304] 0 2024-09-18T12:51:31.935 INFO:tasks.workunit.client.0.smithi081.stdout:6/958: dread d4/d12/d1c/d39/d60/db8/fcc [0,4194304] 0 2024-09-18T12:51:31.937 INFO:tasks.workunit.client.0.smithi081.stdout:6/959: rename d4/d12/d56/d7d/d84/dec/dee/c13a to d4/d12/d1c/d39/d60/db8/c144 0 2024-09-18T12:51:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:32 smithi136 ceph-mon[35363]: pgmap v5: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:32.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:32 smithi136 ceph-mon[35363]: mgrmap e23: smithi136.vdkrdt(active, since 4s) 2024-09-18T12:51:32.146 INFO:tasks.workunit.client.0.smithi081.stdout:0/909: sync 2024-09-18T12:51:32.146 INFO:tasks.workunit.client.0.smithi081.stdout:7/874: sync 2024-09-18T12:51:32.146 INFO:tasks.workunit.client.0.smithi081.stdout:1/921: sync 2024-09-18T12:51:32.146 INFO:tasks.workunit.client.0.smithi081.stdout:8/918: sync 2024-09-18T12:51:32.146 INFO:tasks.workunit.client.0.smithi081.stdout:1/922: fdatasync d0/df9/dc0/da0/d84/ff8 0 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/923: dread - d0/dd7/d2d/f129 zero size 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:9/835: sync 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:0/910: creat d7/d9/d4b/d4a/d92/f135 x:0 0 0 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:7/875: creat d2/d14/d21/d62/f11c x:0 0 0 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/924: write d0/db/d4f/dd2/dd5/f11b [389426,84729] 0 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:0/911: chown d7/d9/d4b/d33/db1/cec 111 1 2024-09-18T12:51:32.147 INFO:tasks.workunit.client.0.smithi081.stdout:3/950: sync 2024-09-18T12:51:32.149 INFO:tasks.workunit.client.0.smithi081.stdout:8/919: creat d3/d1d/d4a/d7f/d10e/f139 x:0 0 0 2024-09-18T12:51:32.154 INFO:tasks.workunit.client.0.smithi081.stdout:1/925: link d0/d6/d7/d2e/d51/d2c/f7b d0/d6/d33/d42/d70/dec/f12c 0 2024-09-18T12:51:32.156 INFO:tasks.workunit.client.0.smithi081.stdout:1/926: creat d0/db/d4f/f12d x:0 0 0 2024-09-18T12:51:32.159 INFO:tasks.workunit.client.0.smithi081.stdout:1/927: symlink d0/d6/d33/d42/l12e 0 2024-09-18T12:51:32.163 INFO:tasks.workunit.client.0.smithi081.stdout:7/876: dread d2/d1d/d4e/d84/fb1 [0,4194304] 0 2024-09-18T12:51:32.164 INFO:tasks.workunit.client.0.smithi081.stdout:7/877: symlink d2/d18/d22/l11d 0 2024-09-18T12:51:32.164 INFO:tasks.workunit.client.0.smithi081.stdout:7/878: stat d2/f3a 0 2024-09-18T12:51:32.166 INFO:tasks.workunit.client.0.smithi081.stdout:0/912: dread d7/d9/d12/dba/fd6 [0,4194304] 0 2024-09-18T12:51:32.166 INFO:tasks.workunit.client.0.smithi081.stdout:0/913: creat d7/d5d/f136 x:0 0 0 2024-09-18T12:51:32.166 INFO:tasks.workunit.client.0.smithi081.stdout:0/914: chown d7/d9/d4b 114 1 2024-09-18T12:51:32.168 INFO:tasks.workunit.client.0.smithi081.stdout:0/915: mkdir d7/d9/d4b/d3d/d137 0 2024-09-18T12:51:32.168 INFO:tasks.workunit.client.0.smithi081.stdout:0/916: chown d7/fb8 0 1 2024-09-18T12:51:32.168 INFO:tasks.workunit.client.0.smithi081.stdout:0/917: truncate d7/d9/d4b/d4a/fce 4474187 0 2024-09-18T12:51:32.175 INFO:tasks.workunit.client.0.smithi081.stdout:7/879: dread d2/d18/d60/daa/fce [0,4194304] 0 2024-09-18T12:51:32.177 INFO:tasks.workunit.client.0.smithi081.stdout:7/880: creat d2/d7f/f11e x:0 0 0 2024-09-18T12:51:32.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/951: dwrite d3/db/df/da8/fa9 [0,4194304] 0 2024-09-18T12:51:32.178 INFO:tasks.workunit.client.0.smithi081.stdout:3/952: fsync d3/db/df/d29/d13/d9d/f12f 0 2024-09-18T12:51:32.179 INFO:tasks.workunit.client.0.smithi081.stdout:9/836: dwrite dd/d15/d1a/da7/dce/ddd/def/ff9 [0,4194304] 0 2024-09-18T12:51:32.179 INFO:tasks.workunit.client.0.smithi081.stdout:9/837: write dd/f74 [565792,20683] 0 2024-09-18T12:51:32.179 INFO:tasks.workunit.client.0.smithi081.stdout:9/838: dread - dd/d15/db1/fd9 zero size 2024-09-18T12:51:32.179 INFO:tasks.workunit.client.0.smithi081.stdout:7/881: creat d2/d14/f11f x:0 0 0 2024-09-18T12:51:32.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/953: rmdir d3/db/d1b/d57 39 2024-09-18T12:51:32.181 INFO:tasks.workunit.client.0.smithi081.stdout:1/928: fsync d0/db/d4f/dd2/dd5/f11b 0 2024-09-18T12:51:32.182 INFO:tasks.workunit.client.0.smithi081.stdout:3/954: dread d3/db/df/d113/d44/d6f/f99 [0,4194304] 0 2024-09-18T12:51:32.183 INFO:tasks.workunit.client.0.smithi081.stdout:8/920: dwrite d3/d1d/d4a/f97 [0,4194304] 0 2024-09-18T12:51:32.183 INFO:tasks.workunit.client.0.smithi081.stdout:8/921: creat d3/d1e/d4c/d53/de5/f13a x:0 0 0 2024-09-18T12:51:32.184 INFO:tasks.workunit.client.0.smithi081.stdout:7/882: rename d2/f9 to d2/d14/d21/f120 0 2024-09-18T12:51:32.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/918: read d7/d9/d4b/d33/f52 [1838484,124401] 0 2024-09-18T12:51:32.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/919: fsync d7/d5d/fda 0 2024-09-18T12:51:32.188 INFO:tasks.workunit.client.0.smithi081.stdout:1/929: unlink d0/d18/f38 0 2024-09-18T12:51:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:7/883: mknod d2/d14/d21/d49/dcc/c121 0 2024-09-18T12:51:32.193 INFO:tasks.workunit.client.0.smithi081.stdout:3/955: rename d3/db/df/f10a to d3/db/df/d113/dcc/d14a/f14d 0 2024-09-18T12:51:32.193 INFO:tasks.workunit.client.0.smithi081.stdout:9/839: dread f6 [8388608,4194304] 0 2024-09-18T12:51:32.197 INFO:tasks.workunit.client.0.smithi081.stdout:3/956: symlink d3/db/l14e 0 2024-09-18T12:51:32.197 INFO:tasks.workunit.client.0.smithi081.stdout:3/957: dread - d3/db/df/d60/d58/d10d/f128 zero size 2024-09-18T12:51:32.200 INFO:tasks.workunit.client.0.smithi081.stdout:7/884: write d2/d14/d21/d49/f112 [139669,125925] 0 2024-09-18T12:51:32.200 INFO:tasks.workunit.client.0.smithi081.stdout:0/920: write d7/d9/d12/f39 [2386074,122005] 0 2024-09-18T12:51:32.200 INFO:tasks.workunit.client.0.smithi081.stdout:9/840: truncate dd/de/f97 519398 0 2024-09-18T12:51:32.201 INFO:tasks.workunit.client.0.smithi081.stdout:9/841: creat dd/d15/d1a/d35/f108 x:0 0 0 2024-09-18T12:51:32.211 INFO:tasks.workunit.client.0.smithi081.stdout:0/921: rename d7/d9/d4b/d33/d7d/f8d to d7/d9/d4b/d33/d7d/def/f138 0 2024-09-18T12:51:32.213 INFO:tasks.workunit.client.0.smithi081.stdout:9/842: rmdir dd/de/d59 39 2024-09-18T12:51:32.215 INFO:tasks.workunit.client.0.smithi081.stdout:0/922: symlink d7/d12b/l139 0 2024-09-18T12:51:32.217 INFO:tasks.workunit.client.0.smithi081.stdout:9/843: symlink dd/d1d/d1e/d24/d48/d102/l109 0 2024-09-18T12:51:32.219 INFO:tasks.workunit.client.0.smithi081.stdout:0/923: symlink d7/d9/d4b/l13a 0 2024-09-18T12:51:32.219 INFO:tasks.workunit.client.0.smithi081.stdout:0/924: chown d7/d9/d4b/d33/l56 13 1 2024-09-18T12:51:32.221 INFO:tasks.workunit.client.0.smithi081.stdout:9/844: mknod dd/d1d/d1e/d77/c10a 0 2024-09-18T12:51:32.223 INFO:tasks.workunit.client.0.smithi081.stdout:9/845: mkdir dd/d1d/d1e/d24/d2a/d10b 0 2024-09-18T12:51:32.224 INFO:tasks.workunit.client.0.smithi081.stdout:7/885: dwrite d2/d18/d22/d48/df1/f102 [0,4194304] 0 2024-09-18T12:51:32.225 INFO:tasks.workunit.client.0.smithi081.stdout:0/925: write d7/d9/d4b/d33/d7d/f88 [3076915,62918] 0 2024-09-18T12:51:32.226 INFO:tasks.workunit.client.0.smithi081.stdout:0/926: chown d7/d9/d12/dba/l71 69648 1 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:9/846: truncate fa 1447654 0 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:9/847: chown dd/d31/d4a/ce9 552123579 1 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:9/848: chown dd/d15/d1a/l2d 233042 1 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:9/849: write dd/d1d/d1e/d2f/fe7 [26840,42856] 0 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:9/850: write dd/d1d/d1e/d24/d2a/f68 [746426,91306] 0 2024-09-18T12:51:32.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/958: dwrite d3/db/df/d113/d44/f62 [0,4194304] 0 2024-09-18T12:51:32.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/927: mknod d7/d9/d4b/c13b 0 2024-09-18T12:51:32.237 INFO:tasks.workunit.client.0.smithi081.stdout:9/851: mkdir dd/d1d/d1e/d24/d48/d10c 0 2024-09-18T12:51:32.237 INFO:tasks.workunit.client.0.smithi081.stdout:9/852: creat dd/d15/d1a/da7/f10d x:0 0 0 2024-09-18T12:51:32.238 INFO:tasks.workunit.client.0.smithi081.stdout:7/886: write d2/d14/d21/f7e [1587684,40641] 0 2024-09-18T12:51:32.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/959: link d3/db/df/d29/d13/d65/c83 d3/db/df/d29/d13/d65/c14f 0 2024-09-18T12:51:32.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/928: link d7/d9/d4b/d53/f69 d7/dbf/f13c 0 2024-09-18T12:51:32.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/929: creat d7/d7c/f13d x:0 0 0 2024-09-18T12:51:32.245 INFO:tasks.workunit.client.0.smithi081.stdout:9/853: creat dd/d15/d1a/dc6/f10e x:0 0 0 2024-09-18T12:51:32.249 INFO:tasks.workunit.client.0.smithi081.stdout:7/887: symlink d2/d1d/d4e/d115/l122 0 2024-09-18T12:51:32.252 INFO:tasks.workunit.client.0.smithi081.stdout:3/960: mknod d3/db/df/d113/dcc/d14a/c150 0 2024-09-18T12:51:32.264 INFO:tasks.workunit.client.0.smithi081.stdout:7/888: write d2/d18/d22/d48/df1/f102 [4019371,51383] 0 2024-09-18T12:51:32.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/961: write d3/f4e [2625974,107516] 0 2024-09-18T12:51:32.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/962: fsync d3/db/d1b/f43 0 2024-09-18T12:51:32.277 INFO:tasks.workunit.client.0.smithi081.stdout:7/889: dread d2/d18/d22/d48/f75 [0,4194304] 0 2024-09-18T12:51:32.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/963: dread d3/db/df/d29/d13/d9d/d107/f28 [0,4194304] 0 2024-09-18T12:51:32.290 INFO:tasks.workunit.client.0.smithi081.stdout:3/964: fsync d3/db/df/d3b/dc0/f110 0 2024-09-18T12:51:32.291 INFO:tasks.workunit.client.0.smithi081.stdout:0/930: dwrite d7/d9/d4b/d4a/d68/fd8 [0,4194304] 0 2024-09-18T12:51:32.291 INFO:tasks.workunit.client.0.smithi081.stdout:0/931: truncate d7/d9/d12/fea 638394 0 2024-09-18T12:51:32.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/965: creat d3/db/df/d29/d13/d9d/d12d/f151 x:0 0 0 2024-09-18T12:51:32.294 INFO:tasks.workunit.client.0.smithi081.stdout:0/932: symlink d7/d9/d4b/d4a/d133/l13e 0 2024-09-18T12:51:32.294 INFO:tasks.workunit.client.0.smithi081.stdout:0/933: chown d7/d5d/c103 227 1 2024-09-18T12:51:32.298 INFO:tasks.workunit.client.0.smithi081.stdout:3/966: rename d3/db/df/d3b to d3/db/df/d29/d13/d9d/d152 0 2024-09-18T12:51:32.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/934: rename d7/d9/fe6 to d7/d9/d4b/d4a/d77/d129/f13f 0 2024-09-18T12:51:32.303 INFO:tasks.workunit.client.0.smithi081.stdout:3/967: rename d3/db/df/d113/d44/f105 to d3/db/df/d60/d58/d10f/f153 0 2024-09-18T12:51:32.304 INFO:tasks.workunit.client.0.smithi081.stdout:7/890: dwrite d2/d56/d73/d90/f93 [0,4194304] 0 2024-09-18T12:51:32.304 INFO:tasks.workunit.client.0.smithi081.stdout:0/935: creat d7/d9/d4b/d4a/d77/de8/f140 x:0 0 0 2024-09-18T12:51:32.307 INFO:tasks.workunit.client.0.smithi081.stdout:0/936: link d7/d9/d12/dba/l6c d7/d9/d4b/d33/l141 0 2024-09-18T12:51:32.309 INFO:tasks.workunit.client.0.smithi081.stdout:7/891: mkdir d2/d18/d123 0 2024-09-18T12:51:32.310 INFO:tasks.workunit.client.0.smithi081.stdout:0/937: symlink d7/d9/l142 0 2024-09-18T12:51:32.311 INFO:tasks.workunit.client.0.smithi081.stdout:0/938: readlink d7/l9c 0 2024-09-18T12:51:32.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/892: creat d2/d18/d60/d85/ddc/f124 x:0 0 0 2024-09-18T12:51:32.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/893: fdatasync d2/d56/d73/da4/fba 0 2024-09-18T12:51:32.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/894: readlink d2/d18/d22/d48/df1/l10d 0 2024-09-18T12:51:32.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/895: fdatasync d2/d18/d22/f2a 0 2024-09-18T12:51:32.312 INFO:tasks.workunit.client.0.smithi081.stdout:7/896: write d2/d14/d21/f26 [2476249,72159] 0 2024-09-18T12:51:32.313 INFO:tasks.workunit.client.0.smithi081.stdout:0/939: creat d7/d9/d4b/f143 x:0 0 0 2024-09-18T12:51:32.314 INFO:tasks.workunit.client.0.smithi081.stdout:0/940: dread d7/f67 [0,4194304] 0 2024-09-18T12:51:32.318 INFO:tasks.workunit.client.0.smithi081.stdout:3/968: write d3/db/f56 [2827200,29560] 0 2024-09-18T12:51:32.320 INFO:tasks.workunit.client.0.smithi081.stdout:0/941: dread d7/dbf/fd2 [0,4194304] 0 2024-09-18T12:51:32.322 INFO:tasks.workunit.client.0.smithi081.stdout:3/969: unlink d3/db/df/d29/d13/d9d/d152/d47/c114 0 2024-09-18T12:51:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:0/942: dwrite d7/d9/d4b/f101 [0,4194304] 0 2024-09-18T12:51:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:0/943: write d7/d9/d4b/d33/d43/d9a/f130 [745847,121920] 0 2024-09-18T12:51:32.354 INFO:tasks.workunit.client.0.smithi081.stdout:0/944: mknod d7/d5d/dd9/c144 0 2024-09-18T12:51:32.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:32 smithi081 ceph-mon[27646]: pgmap v5: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:32 smithi081 ceph-mon[27646]: mgrmap e23: smithi136.vdkrdt(active, since 4s) 2024-09-18T12:51:32.357 INFO:tasks.workunit.client.0.smithi081.stdout:3/970: dwrite d3/db/df/d29/d13/f95 [0,4194304] 0 2024-09-18T12:51:32.358 INFO:tasks.workunit.client.0.smithi081.stdout:3/971: mknod d3/db/df/d113/d44/df2/c154 0 2024-09-18T12:51:32.360 INFO:tasks.workunit.client.0.smithi081.stdout:3/972: creat d3/db/df/d113/dcc/d14a/f155 x:0 0 0 2024-09-18T12:51:32.363 INFO:tasks.workunit.client.0.smithi081.stdout:3/973: rename d3/db/df/d113/dcc/d14a/f155 to d3/db/df/d60/d58/d10d/f156 0 2024-09-18T12:51:32.363 INFO:tasks.workunit.client.0.smithi081.stdout:3/974: dread - d3/db/df/d29/d13/d93/d11d/f131 zero size 2024-09-18T12:51:32.363 INFO:tasks.workunit.client.0.smithi081.stdout:3/975: fsync d3/db/df/d29/d13/d9d/d152/d47/f2f 0 2024-09-18T12:51:32.366 INFO:tasks.workunit.client.0.smithi081.stdout:3/976: symlink d3/db/d1b/d57/l157 0 2024-09-18T12:51:32.380 INFO:tasks.workunit.client.0.smithi081.stdout:3/977: dread d3/db/df/d113/d44/d6f/fa6 [0,4194304] 0 2024-09-18T12:51:32.380 INFO:tasks.workunit.client.0.smithi081.stdout:3/978: creat d3/db/df/d29/d13/d93/f158 x:0 0 0 2024-09-18T12:51:32.380 INFO:tasks.workunit.client.0.smithi081.stdout:3/979: write d3/db/df/d113/dcc/f104 [5146537,5089] 0 2024-09-18T12:51:32.383 INFO:tasks.workunit.client.0.smithi081.stdout:3/980: creat d3/db/df/d29/d13/d9d/d152/dc0/d129/f159 x:0 0 0 2024-09-18T12:51:32.384 INFO:tasks.workunit.client.0.smithi081.stdout:3/981: creat d3/db/df/d29/d13/d9d/d107/f15a x:0 0 0 2024-09-18T12:51:32.385 INFO:tasks.workunit.client.0.smithi081.stdout:3/982: creat d3/db/df/d29/d13/d93/d11d/d14c/f15b x:0 0 0 2024-09-18T12:51:32.387 INFO:tasks.workunit.client.0.smithi081.stdout:3/983: symlink d3/db/df/d113/d44/d51/dde/de1/l15c 0 2024-09-18T12:51:32.387 INFO:tasks.workunit.client.0.smithi081.stdout:3/984: fsync d3/f46 0 2024-09-18T12:51:32.387 INFO:tasks.workunit.client.0.smithi081.stdout:3/985: chown d3/db/df/d29/f64 2441 1 2024-09-18T12:51:32.396 INFO:tasks.workunit.client.0.smithi081.stdout:3/986: dread d3/db/df/d60/d119/fdd [0,4194304] 0 2024-09-18T12:51:32.405 INFO:tasks.workunit.client.0.smithi081.stdout:3/987: dread d3/db/df/d29/d13/d9d/d107/fd6 [0,4194304] 0 2024-09-18T12:51:32.407 INFO:tasks.workunit.client.0.smithi081.stdout:3/988: mknod d3/db/d1b/d57/c15d 0 2024-09-18T12:51:32.408 INFO:tasks.workunit.client.0.smithi081.stdout:3/989: creat d3/db/df/d29/f15e x:0 0 0 2024-09-18T12:51:32.409 INFO:tasks.workunit.client.0.smithi081.stdout:3/990: read d3/db/df/d29/ff4 [54101,34557] 0 2024-09-18T12:51:32.409 INFO:tasks.workunit.client.0.smithi081.stdout:3/991: fsync d3/d84/d118/fe3 0 2024-09-18T12:51:32.410 INFO:tasks.workunit.client.0.smithi081.stdout:3/992: mknod d3/db/df/d29/d13/d9d/d107/d139/c15f 0 2024-09-18T12:51:32.424 INFO:tasks.workunit.client.0.smithi081.stdout:3/993: write d3/db/df/d113/d44/d51/fa7 [3486028,57168] 0 2024-09-18T12:51:32.426 INFO:tasks.workunit.client.0.smithi081.stdout:3/994: creat d3/db/df/d113/dcc/d121/f160 x:0 0 0 2024-09-18T12:51:32.426 INFO:tasks.workunit.client.0.smithi081.stdout:3/995: stat d3/db/df/d29/d13/d9d/d152/d47/f2f 0 2024-09-18T12:51:32.426 INFO:tasks.workunit.client.0.smithi081.stdout:3/996: read - d3/db/df/d113/d44/d76/fbe zero size 2024-09-18T12:51:32.428 INFO:tasks.workunit.client.0.smithi081.stdout:3/997: link d3/db/df/da8/fba d3/db/df/d29/d13/d9d/d152/dc0/d129/f161 0 2024-09-18T12:51:32.428 INFO:tasks.workunit.client.0.smithi081.stdout:3/998: chown d3/db/df/d113/f92 12 1 2024-09-18T12:51:32.431 INFO:tasks.workunit.client.0.smithi081.stdout:3/999: truncate d3/db/df/d29/f30 1076134 0 2024-09-18T12:51:32.581 INFO:tasks.workunit.client.0.smithi081.stdout:5/900: sync 2024-09-18T12:51:32.581 INFO:tasks.workunit.client.0.smithi081.stdout:5/901: dread - d2/d14/d1d/d108/fdf zero size 2024-09-18T12:51:32.581 INFO:tasks.workunit.client.0.smithi081.stdout:5/902: dread - d2/d14/d33/d37/d3b/fec zero size 2024-09-18T12:51:32.581 INFO:tasks.workunit.client.0.smithi081.stdout:5/903: getdents d2/d14/d1d/d1a 0 2024-09-18T12:51:32.583 INFO:tasks.workunit.client.0.smithi081.stdout:5/904: unlink d2/d14/d33/d37/dc5/ce5 0 2024-09-18T12:51:32.584 INFO:tasks.workunit.client.0.smithi081.stdout:4/976: sync 2024-09-18T12:51:32.584 INFO:tasks.workunit.client.0.smithi081.stdout:6/960: sync 2024-09-18T12:51:32.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/905: creat d2/d14/d112/d114/f121 x:0 0 0 2024-09-18T12:51:32.585 INFO:tasks.workunit.client.0.smithi081.stdout:6/961: mknod d4/d6/db4/c145 0 2024-09-18T12:51:32.586 INFO:tasks.workunit.client.0.smithi081.stdout:4/977: rmdir d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/df2 39 2024-09-18T12:51:32.588 INFO:tasks.workunit.client.0.smithi081.stdout:6/962: creat d4/d12/d28/d2a/d74/d10e/f146 x:0 0 0 2024-09-18T12:51:32.590 INFO:tasks.workunit.client.0.smithi081.stdout:6/963: unlink d4/d12/d56/d7d/d84/dec/dee/f120 0 2024-09-18T12:51:32.592 INFO:tasks.workunit.client.0.smithi081.stdout:6/964: unlink d4/d12/d56/d7d/f11b 0 2024-09-18T12:51:32.592 INFO:tasks.workunit.client.0.smithi081.stdout:6/965: readlink d4/d12/d28/d2a/d74/d8b/d54/ld6 0 2024-09-18T12:51:32.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/966: creat d4/d12/d28/d2a/d97/ddc/f147 x:0 0 0 2024-09-18T12:51:32.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/967: chown d4/f21 24178473 1 2024-09-18T12:51:32.595 INFO:tasks.workunit.client.0.smithi081.stdout:5/906: dread d2/d14/d33/d37/d3b/d2a/fe4 [4194304,4194304] 0 2024-09-18T12:51:32.595 INFO:tasks.workunit.client.0.smithi081.stdout:5/907: write d2/d47/d7f/f102 [383045,11377] 0 2024-09-18T12:51:32.595 INFO:tasks.workunit.client.0.smithi081.stdout:5/908: dread - d2/d14/d33/d37/d3b/d2a/d8e/fcb zero size 2024-09-18T12:51:32.595 INFO:tasks.workunit.client.0.smithi081.stdout:6/968: truncate d4/d12/d28/d2a/d74/d8b/f78 9296163 0 2024-09-18T12:51:32.595 INFO:tasks.workunit.client.0.smithi081.stdout:5/909: symlink d2/d14/d33/d37/d10e/l122 0 2024-09-18T12:51:32.596 INFO:tasks.workunit.client.0.smithi081.stdout:5/910: write d2/d14/d33/d37/d3b/d16/f69 [1567718,121003] 0 2024-09-18T12:51:32.603 INFO:tasks.workunit.client.0.smithi081.stdout:6/969: write d4/d12/d1c/f57 [2576808,72371] 0 2024-09-18T12:51:32.605 INFO:tasks.workunit.client.0.smithi081.stdout:6/970: link d4/d6/f27 d4/d12/d56/d7d/d116/d123/f148 0 2024-09-18T12:51:32.605 INFO:tasks.workunit.client.0.smithi081.stdout:6/971: write d4/d12/d56/d7d/d116/f137 [977964,127550] 0 2024-09-18T12:51:32.605 INFO:tasks.workunit.client.0.smithi081.stdout:6/972: readlink d4/d12/d56/d7d/d96/lc7 0 2024-09-18T12:51:32.607 INFO:tasks.workunit.client.0.smithi081.stdout:6/973: dread d4/d12/d56/d7d/d91/faa [0,4194304] 0 2024-09-18T12:51:32.632 INFO:tasks.workunit.client.0.smithi081.stdout:4/978: dwrite d3/f128 [0,4194304] 0 2024-09-18T12:51:32.632 INFO:tasks.workunit.client.0.smithi081.stdout:5/911: dwrite d2/d14/d33/d37/d3b/d16/f106 [0,4194304] 0 2024-09-18T12:51:32.632 INFO:tasks.workunit.client.0.smithi081.stdout:5/912: chown d2/d14/d33/d37/d3b/d2a/f94 1821984 1 2024-09-18T12:51:32.636 INFO:tasks.workunit.client.0.smithi081.stdout:5/913: mknod d2/d14/d112/d114/c123 0 2024-09-18T12:51:32.636 INFO:tasks.workunit.client.0.smithi081.stdout:6/974: dwrite d4/d12/d56/d7d/d116/f12c [0,4194304] 0 2024-09-18T12:51:32.637 INFO:tasks.workunit.client.0.smithi081.stdout:5/914: symlink d2/d14/d112/d114/df9/l124 0 2024-09-18T12:51:32.637 INFO:tasks.workunit.client.0.smithi081.stdout:5/915: chown d2/d14/d33/f110 0 1 2024-09-18T12:51:32.637 INFO:tasks.workunit.client.0.smithi081.stdout:5/916: stat d2/d14/d112/d114/d20/cb3 0 2024-09-18T12:51:32.637 INFO:tasks.workunit.client.0.smithi081.stdout:5/917: write d2/d14/d112/d114/d20/f30 [2631407,16095] 0 2024-09-18T12:51:32.638 INFO:tasks.workunit.client.0.smithi081.stdout:6/975: symlink d4/d12/d56/d7d/d84/dc9/l149 0 2024-09-18T12:51:32.640 INFO:tasks.workunit.client.0.smithi081.stdout:5/918: rename d2/d14/d33/d37/d3b/f77 to d2/d14/d1d/d108/d10b/f125 0 2024-09-18T12:51:32.640 INFO:tasks.workunit.client.0.smithi081.stdout:6/976: stat d4/d12/d28/f4e 0 2024-09-18T12:51:32.641 INFO:tasks.workunit.client.0.smithi081.stdout:4/979: write d3/db/d35/d79/dfa/d11a/d14/d3e/f51 [3478162,32436] 0 2024-09-18T12:51:32.642 INFO:tasks.workunit.client.0.smithi081.stdout:6/977: mknod d4/d12/d28/d2a/d74/d8b/d6f/c14a 0 2024-09-18T12:51:32.644 INFO:tasks.workunit.client.0.smithi081.stdout:6/978: rename d4/d12/d56/d7d/d84/l141 to d4/d6/db4/l14b 0 2024-09-18T12:51:32.656 INFO:tasks.workunit.client.0.smithi081.stdout:5/919: dread d2/d14/d33/d37/d3b/d5f/fdb [0,4194304] 0 2024-09-18T12:51:32.657 INFO:tasks.workunit.client.0.smithi081.stdout:5/920: mkdir d2/d14/d33/d37/d126 0 2024-09-18T12:51:32.657 INFO:tasks.workunit.client.0.smithi081.stdout:5/921: fsync d2/d14/d33/d37/d3b/d16/f73 0 2024-09-18T12:51:32.658 INFO:tasks.workunit.client.0.smithi081.stdout:6/979: dread d4/d12/d1c/f48 [0,4194304] 0 2024-09-18T12:51:32.659 INFO:tasks.workunit.client.0.smithi081.stdout:5/922: dread d2/d47/f76 [0,4194304] 0 2024-09-18T12:51:32.660 INFO:tasks.workunit.client.0.smithi081.stdout:5/923: mknod d2/d47/d7f/c127 0 2024-09-18T12:51:32.661 INFO:tasks.workunit.client.0.smithi081.stdout:5/924: creat d2/d14/d33/d37/d126/f128 x:0 0 0 2024-09-18T12:51:32.664 INFO:tasks.workunit.client.0.smithi081.stdout:4/980: dwrite d3/f22 [8388608,4194304] 0 2024-09-18T12:51:32.666 INFO:tasks.workunit.client.0.smithi081.stdout:4/981: dread d3/db/d35/f83 [0,4194304] 0 2024-09-18T12:51:32.668 INFO:tasks.workunit.client.0.smithi081.stdout:6/980: dread d4/f21 [0,4194304] 0 2024-09-18T12:51:32.668 INFO:tasks.workunit.client.0.smithi081.stdout:4/982: mknod d3/db/d35/d13d/c144 0 2024-09-18T12:51:32.668 INFO:tasks.workunit.client.0.smithi081.stdout:5/925: dread d2/d14/f1e [0,4194304] 0 2024-09-18T12:51:32.668 INFO:tasks.workunit.client.0.smithi081.stdout:4/983: read d3/db/d35/d79/dfa/d11a/d45/f4a [251,96757] 0 2024-09-18T12:51:32.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/926: unlink d2/d14/d33/f110 0 2024-09-18T12:51:32.670 INFO:tasks.workunit.client.0.smithi081.stdout:5/927: symlink d2/d14/d33/d37/d3b/d16/dd1/l129 0 2024-09-18T12:51:32.672 INFO:tasks.workunit.client.0.smithi081.stdout:5/928: creat d2/d14/d33/d37/d3b/d5f/f12a x:0 0 0 2024-09-18T12:51:32.672 INFO:tasks.workunit.client.0.smithi081.stdout:5/929: creat d2/d14/d33/d37/d3b/d16/de8/f12b x:0 0 0 2024-09-18T12:51:32.675 INFO:tasks.workunit.client.0.smithi081.stdout:5/930: rename d2/dd/fe3 to d2/d47/f12c 0 2024-09-18T12:51:32.678 INFO:tasks.workunit.client.0.smithi081.stdout:6/981: write f0 [2087479,44602] 0 2024-09-18T12:51:32.679 INFO:tasks.workunit.client.0.smithi081.stdout:6/982: write d4/d12/d56/d7d/d91/faa [37680,81462] 0 2024-09-18T12:51:32.682 INFO:tasks.workunit.client.0.smithi081.stdout:6/983: rename d4/d12/d28/d2a/d74/f139 to d4/d6/d95/d10b/f14c 0 2024-09-18T12:51:32.684 INFO:tasks.workunit.client.0.smithi081.stdout:5/931: rmdir d2/d14/d33/d37/d126 39 2024-09-18T12:51:32.684 INFO:tasks.workunit.client.0.smithi081.stdout:5/932: fdatasync d2/d14/d1d/d108/fce 0 2024-09-18T12:51:32.687 INFO:tasks.workunit.client.0.smithi081.stdout:6/984: write d4/d12/d56/d7d/d96/fef [3016821,126892] 0 2024-09-18T12:51:32.688 INFO:tasks.workunit.client.0.smithi081.stdout:6/985: creat d4/d12/d28/d2a/d98/f14d x:0 0 0 2024-09-18T12:51:32.689 INFO:tasks.workunit.client.0.smithi081.stdout:6/986: stat d4/d12/d1c/d39/d60/f8c 0 2024-09-18T12:51:32.689 INFO:tasks.workunit.client.0.smithi081.stdout:5/933: dread d2/d14/d33/d37/d3b/d16/dbb/fc7 [0,4194304] 0 2024-09-18T12:51:32.689 INFO:tasks.workunit.client.0.smithi081.stdout:5/934: truncate d2/d14/d112/d114/d20/f7d 241843 0 2024-09-18T12:51:32.690 INFO:tasks.workunit.client.0.smithi081.stdout:6/987: creat d4/d6/d95/d10b/f14e x:0 0 0 2024-09-18T12:51:32.691 INFO:tasks.workunit.client.0.smithi081.stdout:4/984: dwrite d3/db/d35/d79/dfa/d11a/d45/d6c/dec/df6/d101/df2/f110 [0,4194304] 0 2024-09-18T12:51:32.693 INFO:tasks.workunit.client.0.smithi081.stdout:4/985: mknod d3/db/d35/d79/dfa/d11a/d45/dc4/d125/c145 0 2024-09-18T12:51:32.694 INFO:tasks.workunit.client.0.smithi081.stdout:6/988: mkdir d4/d12/d1c/d14f 0 2024-09-18T12:51:32.695 INFO:tasks.workunit.client.0.smithi081.stdout:4/986: mknod d3/db/d2d/d10c/c146 0 2024-09-18T12:51:32.696 INFO:tasks.workunit.client.0.smithi081.stdout:5/935: write d2/d14/d1d/d108/f3a [1370334,57100] 0 2024-09-18T12:51:32.696 INFO:tasks.workunit.client.0.smithi081.stdout:5/936: write d2/d14/f1e [1253294,42999] 0 2024-09-18T12:51:32.697 INFO:tasks.workunit.client.0.smithi081.stdout:4/987: creat d3/db/d35/d79/dfa/d11a/d14/d54/dd3/d8d/d97/ddd/f147 x:0 0 0 2024-09-18T12:51:32.698 INFO:tasks.workunit.client.0.smithi081.stdout:5/937: creat d2/d14/f12d x:0 0 0 2024-09-18T12:51:32.699 INFO:tasks.workunit.client.0.smithi081.stdout:4/988: mknod d3/db/d35/d79/dfa/d11a/d116/c148 0 2024-09-18T12:51:32.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/989: read - d3/db/d35/d79/dfa/d11a/d14/d54/f143 zero size 2024-09-18T12:51:32.701 INFO:tasks.workunit.client.0.smithi081.stdout:5/938: truncate d2/d14/d33/d37/d3b/d16/dd1/fe6 2835464 0 2024-09-18T12:51:32.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/989: write d4/d12/d28/f4e [4017075,52017] 0 2024-09-18T12:51:32.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/990: chown d4/d12/d28/d2a/c110 1 1 2024-09-18T12:51:32.703 INFO:tasks.workunit.client.0.smithi081.stdout:4/990: rename d3/db/d35/d79/dfa/d11a/d14/d3e/c89 to d3/db/d35/d79/dfa/d11a/d116/c149 0 2024-09-18T12:51:32.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/939: getdents d2/d14/d112 0 2024-09-18T12:51:32.705 INFO:tasks.workunit.client.0.smithi081.stdout:4/991: unlink d3/db/d58/l11e 0 2024-09-18T12:51:32.712 INFO:tasks.workunit.client.0.smithi081.stdout:5/940: dread d2/d14/d33/d37/d3b/d5f/f79 [0,4194304] 0 2024-09-18T12:51:32.713 INFO:tasks.workunit.client.0.smithi081.stdout:5/941: write d2/d14/d112/d114/d20/f92 [4232407,12353] 0 2024-09-18T12:51:32.716 INFO:tasks.workunit.client.0.smithi081.stdout:5/942: write d2/d14/d33/d37/f50 [4560793,126906] 0 2024-09-18T12:51:32.718 INFO:tasks.workunit.client.0.smithi081.stdout:5/943: mknod d2/d14/d1d/c12e 0 2024-09-18T12:51:32.718 INFO:tasks.workunit.client.0.smithi081.stdout:5/944: creat d2/d14/d33/d37/d3b/d16/de8/f12f x:0 0 0 2024-09-18T12:51:32.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/991: write d4/d12/d28/d2a/d98/dd8/f106 [1321501,22508] 0 2024-09-18T12:51:32.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/992: write d4/d12/d56/ffd [762365,39536] 0 2024-09-18T12:51:32.721 INFO:tasks.workunit.client.0.smithi081.stdout:6/993: dread - d4/d12/d28/d2a/d97/ddc/f147 zero size 2024-09-18T12:51:32.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/945: truncate d2/d14/d33/d37/d3b/d2a/db0/fda 54863 0 2024-09-18T12:51:32.723 INFO:tasks.workunit.client.0.smithi081.stdout:6/994: rmdir d4/d12/d28/d2a/d74/d8b 39 2024-09-18T12:51:32.723 INFO:tasks.workunit.client.0.smithi081.stdout:6/995: chown d4/d12/d28/d2a/d2d/d31/f51 106031387 1 2024-09-18T12:51:32.725 INFO:tasks.workunit.client.0.smithi081.stdout:6/996: symlink d4/d12/d56/d7d/d9f/l150 0 2024-09-18T12:51:32.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/997: symlink d4/d12/d1c/d14f/l151 0 2024-09-18T12:51:32.728 INFO:tasks.workunit.client.0.smithi081.stdout:4/992: dwrite d3/db/d35/d13d/dd8/fef [0,4194304] 0 2024-09-18T12:51:32.728 INFO:tasks.workunit.client.0.smithi081.stdout:4/993: chown d3/db/d35/d79/dfa/d11a/d14/d54/f123 0 1 2024-09-18T12:51:32.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/994: dread d3/db/d35/d79/dfa/d11a/d45/f81 [0,4194304] 0 2024-09-18T12:51:32.734 INFO:tasks.workunit.client.0.smithi081.stdout:4/995: fdatasync d3/db/d35/d79/dfa/d11a/d14/d27/ff5 0 2024-09-18T12:51:32.745 INFO:tasks.workunit.client.0.smithi081.stdout:6/998: truncate d4/d12/d56/d7d/d116/f137 714550 0 2024-09-18T12:51:32.749 INFO:tasks.workunit.client.0.smithi081.stdout:4/996: dwrite d3/db/d35/d79/dfa/d11a/d45/f4a [0,4194304] 0 2024-09-18T12:51:32.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/997: creat d3/db/d35/d79/dfa/d11a/d45/dc4/f14a x:0 0 0 2024-09-18T12:51:32.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/998: chown d3/db/d35/d79/f8e 0 1 2024-09-18T12:51:32.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/999: dwrite d3/d20/f96 [0,4194304] 0 2024-09-18T12:51:32.793 INFO:tasks.workunit.client.0.smithi081.stdout:8/922: sync 2024-09-18T12:51:32.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/923: creat d3/d1d/d9f/d12b/f13b x:0 0 0 2024-09-18T12:51:32.802 INFO:tasks.workunit.client.0.smithi081.stdout:8/924: read d3/d1e/d4c/dae/fdc [1062516,56747] 0 2024-09-18T12:51:32.802 INFO:tasks.workunit.client.0.smithi081.stdout:8/925: write d3/d2f/fe3 [508333,108462] 0 2024-09-18T12:51:32.824 INFO:tasks.workunit.client.0.smithi081.stdout:8/926: dwrite d3/d1d/d4a/d7f/f88 [0,4194304] 0 2024-09-18T12:51:32.844 INFO:tasks.workunit.client.0.smithi081.stdout:8/927: dwrite d3/d1d/d4a/d8d/fbd [4194304,4194304] 0 2024-09-18T12:51:32.845 INFO:tasks.workunit.client.0.smithi081.stdout:8/928: getdents d3/d1e/d4c/d68/daa/d120 0 2024-09-18T12:51:32.845 INFO:tasks.workunit.client.0.smithi081.stdout:8/929: chown d3/d1e/d4c/d53/fac 854 1 2024-09-18T12:51:32.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/930: fsync d3/d1d/d89/db5/db8/f116 0 2024-09-18T12:51:32.847 INFO:tasks.workunit.client.0.smithi081.stdout:8/931: creat d3/d1d/d9f/dcf/dee/f13c x:0 0 0 2024-09-18T12:51:32.847 INFO:tasks.workunit.client.0.smithi081.stdout:8/932: write d3/d2f/f40 [759078,91966] 0 2024-09-18T12:51:32.847 INFO:tasks.workunit.client.0.smithi081.stdout:8/933: write d3/d73/fa6 [2943,90979] 0 2024-09-18T12:51:32.847 INFO:tasks.workunit.client.0.smithi081.stdout:8/934: mknod d3/d1d/d9f/dcf/dee/d126/c13d 0 2024-09-18T12:51:32.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/935: unlink d3/d1e/d4c/ffd 0 2024-09-18T12:51:32.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/936: chown d3/d1d/d4a/d8d/lc3 442337765 1 2024-09-18T12:51:32.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/937: write d3/d1d/fe2 [205003,3709] 0 2024-09-18T12:51:32.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/938: write d3/d1d/d4a/d8d/f8f [4798168,118599] 0 2024-09-18T12:51:32.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/939: truncate d3/d73/dbe/f109 157403 0 2024-09-18T12:51:32.850 INFO:tasks.workunit.client.0.smithi081.stdout:8/940: chown d3/dc9/fca 5110786 1 2024-09-18T12:51:32.850 INFO:tasks.workunit.client.0.smithi081.stdout:8/941: read - d3/f85 zero size 2024-09-18T12:51:32.850 INFO:tasks.workunit.client.0.smithi081.stdout:8/942: truncate d3/d1d/d89/d10d/f131 738475 0 2024-09-18T12:51:32.850 INFO:tasks.workunit.client.0.smithi081.stdout:8/943: truncate d3/d73/fa2 78886 0 2024-09-18T12:51:32.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/944: getdents d3/d1e/d4c/d68 0 2024-09-18T12:51:32.852 INFO:tasks.workunit.client.0.smithi081.stdout:8/945: write d3/dc9/fef [359205,23197] 0 2024-09-18T12:51:32.852 INFO:tasks.workunit.client.0.smithi081.stdout:8/946: chown d3/d1d/d9f/dcf/dee/f11d 329 1 2024-09-18T12:51:32.852 INFO:tasks.workunit.client.0.smithi081.stdout:8/947: read - d3/d1d/d102/f129 zero size 2024-09-18T12:51:33.001 INFO:tasks.workunit.client.0.smithi081.stdout:7/897: sync 2024-09-18T12:51:33.002 INFO:tasks.workunit.client.0.smithi081.stdout:1/930: sync 2024-09-18T12:51:33.002 INFO:tasks.workunit.client.0.smithi081.stdout:9/854: sync 2024-09-18T12:51:33.002 INFO:tasks.workunit.client.0.smithi081.stdout:0/945: sync 2024-09-18T12:51:33.004 INFO:tasks.workunit.client.0.smithi081.stdout:7/898: rename d2/d18/d60/d85/fb2 to d2/d18/d60/d85/f125 0 2024-09-18T12:51:33.005 INFO:tasks.workunit.client.0.smithi081.stdout:1/931: getdents d0/d18 0 2024-09-18T12:51:33.017 INFO:tasks.workunit.client.0.smithi081.stdout:7/899: write d2/d18/d3c/f65 [6358613,109680] 0 2024-09-18T12:51:33.017 INFO:tasks.workunit.client.0.smithi081.stdout:7/900: write d2/d18/fd9 [6986239,78044] 0 2024-09-18T12:51:33.020 INFO:tasks.workunit.client.0.smithi081.stdout:1/932: read d0/dd7/d2d/fd6 [3166739,14542] 0 2024-09-18T12:51:33.021 INFO:tasks.workunit.client.0.smithi081.stdout:7/901: rename d2/d18/l2b to d2/d18/l126 0 2024-09-18T12:51:33.022 INFO:tasks.workunit.client.0.smithi081.stdout:1/933: symlink d0/d18/df4/d10e/l12f 0 2024-09-18T12:51:33.022 INFO:tasks.workunit.client.0.smithi081.stdout:1/934: chown d0/db/d4f/f12d 96 1 2024-09-18T12:51:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:7/902: link d2/d42/l68 d2/d56/d73/d90/l127 0 2024-09-18T12:51:33.026 INFO:tasks.workunit.client.0.smithi081.stdout:7/903: creat d2/d18/d22/f128 x:0 0 0 2024-09-18T12:51:33.027 INFO:tasks.workunit.client.0.smithi081.stdout:1/935: dread d0/db/d4f/dab/fcd [0,4194304] 0 2024-09-18T12:51:33.030 INFO:tasks.workunit.client.0.smithi081.stdout:1/936: symlink d0/d6/d7/d2e/d4e/l130 0 2024-09-18T12:51:33.034 INFO:tasks.workunit.client.0.smithi081.stdout:7/904: write d2/d18/d3c/f7a [1483319,100609] 0 2024-09-18T12:51:33.036 INFO:tasks.workunit.client.0.smithi081.stdout:7/905: rename d2/f4a to d2/d7f/f129 0 2024-09-18T12:51:33.037 INFO:tasks.workunit.client.0.smithi081.stdout:0/946: dwrite d7/d9/d4b/d4a/d77/fb0 [0,4194304] 0 2024-09-18T12:51:33.037 INFO:tasks.workunit.client.0.smithi081.stdout:0/947: dread - d7/d5d/fda zero size 2024-09-18T12:51:33.037 INFO:tasks.workunit.client.0.smithi081.stdout:0/948: write d7/d9/d4b/d33/db1/ff5 [260517,10872] 0 2024-09-18T12:51:33.038 INFO:tasks.workunit.client.0.smithi081.stdout:9/855: dwrite dd/d1d/d1e/d2f/f69 [0,4194304] 0 2024-09-18T12:51:33.041 INFO:tasks.workunit.client.0.smithi081.stdout:1/937: dread d0/d6/d7/d8/f11 [0,4194304] 0 2024-09-18T12:51:33.043 INFO:tasks.workunit.client.0.smithi081.stdout:0/949: mknod d7/d9/d4b/d33/d7d/c145 0 2024-09-18T12:51:33.046 INFO:tasks.workunit.client.0.smithi081.stdout:7/906: link d2/d56/d73/da4/fba d2/d18/f12a 0 2024-09-18T12:51:33.048 INFO:tasks.workunit.client.0.smithi081.stdout:9/856: rmdir dd/d31/d4a 39 2024-09-18T12:51:33.052 INFO:tasks.workunit.client.0.smithi081.stdout:1/938: link d0/d6/d33/d42/l57 d0/d6/d33/d37/l131 0 2024-09-18T12:51:33.052 INFO:tasks.workunit.client.0.smithi081.stdout:1/939: read d0/d6/fe [2627264,95833] 0 2024-09-18T12:51:33.053 INFO:tasks.workunit.client.0.smithi081.stdout:0/950: dread d7/f93 [0,4194304] 0 2024-09-18T12:51:33.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/907: creat d2/d1d/d4e/dc7/f12b x:0 0 0 2024-09-18T12:51:33.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/908: dread - d2/d14/d21/d62/da7/f108 zero size 2024-09-18T12:51:33.057 INFO:tasks.workunit.client.0.smithi081.stdout:0/951: getdents d7/d9/d4b/d33/d7d/dfe 0 2024-09-18T12:51:33.058 INFO:tasks.workunit.client.0.smithi081.stdout:0/952: write d7/d9/d4b/d33/d43/d9a/f10b [588182,71265] 0 2024-09-18T12:51:33.059 INFO:tasks.workunit.client.0.smithi081.stdout:0/953: dread d7/d9/d4b/d33/d7d/fd1 [0,4194304] 0 2024-09-18T12:51:33.060 INFO:tasks.workunit.client.0.smithi081.stdout:0/954: chown d7/d9/d4b/d4a/d77/l127 79 1 2024-09-18T12:51:33.060 INFO:tasks.workunit.client.0.smithi081.stdout:0/955: truncate d7/d9/d4b/d33/d7d/fd1 796926 0 2024-09-18T12:51:33.060 INFO:tasks.workunit.client.0.smithi081.stdout:0/956: chown d7/d9/d4b/d33/db1 101540984 1 2024-09-18T12:51:33.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/940: rename d0/d6/d7/d2e to d0/d6/d33/d37/dbc/d132 0 2024-09-18T12:51:33.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/941: fsync d0/df9/ffe 0 2024-09-18T12:51:33.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/942: write d0/ff [1604755,5894] 0 2024-09-18T12:51:33.069 INFO:tasks.workunit.client.0.smithi081.stdout:1/943: dread d0/db/f65 [0,4194304] 0 2024-09-18T12:51:33.074 INFO:tasks.workunit.client.0.smithi081.stdout:0/957: dread d7/d9/f10 [0,4194304] 0 2024-09-18T12:51:33.075 INFO:tasks.workunit.client.0.smithi081.stdout:9/857: dwrite dd/d1d/d1e/d2f/f69 [0,4194304] 0 2024-09-18T12:51:33.076 INFO:tasks.workunit.client.0.smithi081.stdout:0/958: link d7/d9/d4b/d4a/l62 d7/dbf/d11c/l146 0 2024-09-18T12:51:33.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/909: dwrite d2/d14/d21/d62/f11c [0,4194304] 0 2024-09-18T12:51:33.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/944: read d0/db/f39 [8188785,15896] 0 2024-09-18T12:51:33.080 INFO:tasks.workunit.client.0.smithi081.stdout:9/858: symlink dd/d15/db1/d104/l10f 0 2024-09-18T12:51:33.082 INFO:tasks.workunit.client.0.smithi081.stdout:1/945: mknod d0/d6/d33/d42/dcf/c133 0 2024-09-18T12:51:33.085 INFO:tasks.workunit.client.0.smithi081.stdout:0/959: write d7/d9/d4b/d53/f64 [789843,70226] 0 2024-09-18T12:51:33.085 INFO:tasks.workunit.client.0.smithi081.stdout:0/960: dread - d7/d9/d12/df7/fe9 zero size 2024-09-18T12:51:33.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/910: link d2/d18/d3c/c91 d2/d42/c12c 0 2024-09-18T12:51:33.086 INFO:tasks.workunit.client.0.smithi081.stdout:1/946: mkdir d0/d96/d134 0 2024-09-18T12:51:33.088 INFO:tasks.workunit.client.0.smithi081.stdout:0/961: rename d7/d9/d4b/d4a/d133/l13e to d7/d9/d4b/d4a/d68/l147 0 2024-09-18T12:51:33.089 INFO:tasks.workunit.client.0.smithi081.stdout:0/962: write d7/d9/d4b/d4a/f16 [3634190,17814] 0 2024-09-18T12:51:33.090 INFO:tasks.workunit.client.0.smithi081.stdout:7/911: truncate d2/d18/f1e 3907170 0 2024-09-18T12:51:33.090 INFO:tasks.workunit.client.0.smithi081.stdout:7/912: fdatasync d2/d18/fab 0 2024-09-18T12:51:33.091 INFO:tasks.workunit.client.0.smithi081.stdout:0/963: rename d7/d5d/f7f to d7/f148 0 2024-09-18T12:51:33.095 INFO:tasks.workunit.client.0.smithi081.stdout:9/859: read dd/d31/d4a/f93 [2559812,21187] 0 2024-09-18T12:51:33.097 INFO:tasks.workunit.client.0.smithi081.stdout:7/913: link d2/d14/d21/l6c d2/d14/d21/d62/da7/l12d 0 2024-09-18T12:51:33.097 INFO:tasks.workunit.client.0.smithi081.stdout:7/914: stat d2/d18/d22/f32 0 2024-09-18T12:51:33.098 INFO:tasks.workunit.client.0.smithi081.stdout:0/964: mkdir d7/d9/d4b/d33/d7d/dfe/d149 0 2024-09-18T12:51:33.099 INFO:tasks.workunit.client.0.smithi081.stdout:1/947: dread d0/d6/d33/d37/dbc/d132/f63 [0,4194304] 0 2024-09-18T12:51:33.099 INFO:tasks.workunit.client.0.smithi081.stdout:1/948: dread - d0/dd7/d2d/f129 zero size 2024-09-18T12:51:33.099 INFO:tasks.workunit.client.0.smithi081.stdout:7/915: unlink d2/d18/d60/d85/cf5 0 2024-09-18T12:51:33.100 INFO:tasks.workunit.client.0.smithi081.stdout:0/965: mknod d7/d9/d4b/d4a/d77/de8/c14a 0 2024-09-18T12:51:33.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/949: creat d0/db/f135 x:0 0 0 2024-09-18T12:51:33.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/950: creat d0/d6/d66/f136 x:0 0 0 2024-09-18T12:51:33.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/951: readlink d0/dd7/l1e 0 2024-09-18T12:51:33.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/952: fsync d0/d6/d7/d8/f52 0 2024-09-18T12:51:33.102 INFO:tasks.workunit.client.0.smithi081.stdout:1/953: creat d0/db/d4f/dab/f137 x:0 0 0 2024-09-18T12:51:33.107 INFO:tasks.workunit.client.0.smithi081.stdout:7/916: mknod d2/d56/d73/d7c/d86/da6/def/c12e 0 2024-09-18T12:51:33.113 INFO:tasks.workunit.client.0.smithi081.stdout:1/954: unlink d0/d96/f10b 0 2024-09-18T12:51:33.115 INFO:tasks.workunit.client.0.smithi081.stdout:7/917: rename d2/d42/f43 to d2/f12f 0 2024-09-18T12:51:33.115 INFO:tasks.workunit.client.0.smithi081.stdout:7/918: write d2/d18/dfc/f109 [73493,29582] 0 2024-09-18T12:51:33.115 INFO:tasks.workunit.client.0.smithi081.stdout:7/919: chown d2/d1d/d4e/d84/f114 1628681171 1 2024-09-18T12:51:33.116 INFO:tasks.workunit.client.0.smithi081.stdout:0/966: dread d7/d9/d4b/d4a/d77/d129/f13f [0,4194304] 0 2024-09-18T12:51:33.116 INFO:tasks.workunit.client.0.smithi081.stdout:1/955: getdents d0/d6/d33/d37/dbc/d132/d51 0 2024-09-18T12:51:33.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/967: symlink d7/d5d/l14b 0 2024-09-18T12:51:33.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/968: fsync d7/d9/d4b/d53/f106 0 2024-09-18T12:51:33.120 INFO:tasks.workunit.client.0.smithi081.stdout:1/956: creat d0/d6/d33/d37/d71/d90/f138 x:0 0 0 2024-09-18T12:51:33.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/946: sync 2024-09-18T12:51:33.121 INFO:tasks.workunit.client.0.smithi081.stdout:5/947: chown d2/d14/d33/d37/d3b/f13 14 1 2024-09-18T12:51:33.122 INFO:tasks.workunit.client.0.smithi081.stdout:7/920: rmdir d2/d18/d3c 39 2024-09-18T12:51:33.125 INFO:tasks.workunit.client.0.smithi081.stdout:5/948: dread d2/d14/d33/fe0 [0,4194304] 0 2024-09-18T12:51:33.125 INFO:tasks.workunit.client.0.smithi081.stdout:1/957: mkdir d0/db/d4f/dd2/dd5/d139 0 2024-09-18T12:51:33.127 INFO:tasks.workunit.client.0.smithi081.stdout:7/921: creat d2/d18/d22/d48/f130 x:0 0 0 2024-09-18T12:51:33.129 INFO:tasks.workunit.client.0.smithi081.stdout:1/958: mknod d0/d6/d33/d37/dbc/d132/d51/c13a 0 2024-09-18T12:51:33.129 INFO:tasks.workunit.client.0.smithi081.stdout:1/959: chown d0/d6/d33/d37/dbc/d132/l3c 98746 1 2024-09-18T12:51:33.130 INFO:tasks.workunit.client.0.smithi081.stdout:7/922: getdents d2/d56/d73/d7c/dd7 0 2024-09-18T12:51:33.130 INFO:tasks.workunit.client.0.smithi081.stdout:7/923: creat d2/d56/d73/d7c/d86/da6/f131 x:0 0 0 2024-09-18T12:51:33.130 INFO:tasks.workunit.client.0.smithi081.stdout:1/960: read d0/db/d4f/dab/fcd [604742,99384] 0 2024-09-18T12:51:33.131 INFO:tasks.workunit.client.0.smithi081.stdout:1/961: creat d0/dd7/de9/db0/f13b x:0 0 0 2024-09-18T12:51:33.131 INFO:tasks.workunit.client.0.smithi081.stdout:5/949: dread d2/d14/d33/d37/d3b/d2a/d8e/dc2/fcf [0,4194304] 0 2024-09-18T12:51:33.135 INFO:tasks.workunit.client.0.smithi081.stdout:5/950: mkdir d2/d14/d112/d114/df9/d130 0 2024-09-18T12:51:33.137 INFO:tasks.workunit.client.0.smithi081.stdout:5/951: rename d2/d14/d1d/d108/d10b to d2/d14/d33/d37/d126/d131 0 2024-09-18T12:51:33.142 INFO:tasks.workunit.client.0.smithi081.stdout:0/969: dwrite d7/d9/d4b/d4a/d68/fd8 [4194304,4194304] 0 2024-09-18T12:51:33.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/970: creat d7/dbf/d11c/d126/f14c x:0 0 0 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/962: dread d0/d6/d33/d37/dbc/d132/ffa [0,4194304] 0 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/963: link d0/dd7/d2d/f129 d0/d6/d33/d37/dbc/d132/d4e/f13c 0 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/964: dread - d0/db/d4f/dd2/dd5/f118 zero size 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:5/952: dread d2/d14/d112/d114/f25 [0,4194304] 0 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/965: creat d0/d18/f13d x:0 0 0 2024-09-18T12:51:33.150 INFO:tasks.workunit.client.0.smithi081.stdout:1/966: fdatasync d0/db/d4f/dab/f137 0 2024-09-18T12:51:33.154 INFO:tasks.workunit.client.0.smithi081.stdout:5/953: link d2/c2f d2/d14/d33/d37/d3b/d16/dbb/c132 0 2024-09-18T12:51:33.156 INFO:tasks.workunit.client.0.smithi081.stdout:0/971: dread d7/d9/d4b/d53/f8c [0,4194304] 0 2024-09-18T12:51:33.157 INFO:tasks.workunit.client.0.smithi081.stdout:0/972: symlink d7/d9/d4b/d33/d7d/l14d 0 2024-09-18T12:51:33.159 INFO:tasks.workunit.client.0.smithi081.stdout:0/973: unlink d7/d9/d12/l37 0 2024-09-18T12:51:33.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/967: dwrite d0/dd7/d2d/f129 [0,4194304] 0 2024-09-18T12:51:33.176 INFO:tasks.workunit.client.0.smithi081.stdout:1/968: symlink d0/d6/d33/d42/l13e 0 2024-09-18T12:51:33.179 INFO:tasks.workunit.client.0.smithi081.stdout:1/969: rmdir d0/d96 39 2024-09-18T12:51:33.182 INFO:tasks.workunit.client.0.smithi081.stdout:1/970: rename d0/dd7/de9/f8e to d0/d6/d33/d37/d98/f13f 0 2024-09-18T12:51:33.182 INFO:tasks.workunit.client.0.smithi081.stdout:1/971: fsync d0/d6/d33/d37/f94 0 2024-09-18T12:51:33.183 INFO:tasks.workunit.client.0.smithi081.stdout:1/972: mknod d0/d96/d134/c140 0 2024-09-18T12:51:33.183 INFO:tasks.workunit.client.0.smithi081.stdout:1/973: mkdir d0/db/d4f/dd2/dd5/d124/d141 0 2024-09-18T12:51:33.185 INFO:tasks.workunit.client.0.smithi081.stdout:1/974: rename d0/db/d32/l3b to d0/d6/d33/d37/dbc/d132/d51/d2c/l142 0 2024-09-18T12:51:33.186 INFO:tasks.workunit.client.0.smithi081.stdout:1/975: truncate d0/db/d4f/dd2/dd5/fef 1419557 0 2024-09-18T12:51:33.189 INFO:tasks.workunit.client.0.smithi081.stdout:1/976: dread d0/d6/d33/d37/d98/f13f [0,4194304] 0 2024-09-18T12:51:33.198 INFO:tasks.workunit.client.0.smithi081.stdout:0/974: dwrite d7/f6f [0,4194304] 0 2024-09-18T12:51:33.202 INFO:tasks.workunit.client.0.smithi081.stdout:0/975: truncate d7/d9/f10 4177155 0 2024-09-18T12:51:33.202 INFO:tasks.workunit.client.0.smithi081.stdout:0/976: getdents d7/d5d/d9f/d123 0 2024-09-18T12:51:33.204 INFO:tasks.workunit.client.0.smithi081.stdout:0/977: rename d7/d9/d4b/d33/f12f to d7/d9/d4b/d4a/d92/f14e 0 2024-09-18T12:51:33.212 INFO:tasks.workunit.client.0.smithi081.stdout:1/977: dwrite d0/dd7/d2d/f2f [4194304,4194304] 0 2024-09-18T12:51:33.214 INFO:tasks.workunit.client.0.smithi081.stdout:1/978: mkdir d0/d6/d33/d42/d143 0 2024-09-18T12:51:33.215 INFO:tasks.workunit.client.0.smithi081.stdout:1/979: stat d0/c117 0 2024-09-18T12:51:33.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/980: creat d0/df9/dc0/d112/f144 x:0 0 0 2024-09-18T12:51:33.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/978: write d7/f6f [1785493,98175] 0 2024-09-18T12:51:33.219 INFO:tasks.workunit.client.0.smithi081.stdout:1/981: getdents d0/dd7/de9 0 2024-09-18T12:51:33.219 INFO:tasks.workunit.client.0.smithi081.stdout:1/982: truncate d0/d6/d7/d8/fbb 1118898 0 2024-09-18T12:51:33.223 INFO:tasks.workunit.client.0.smithi081.stdout:0/979: rename d7/d9/d4b/d4a/d92/lab to d7/d9/d4b/d4a/d68/l14f 0 2024-09-18T12:51:33.240 INFO:tasks.workunit.client.0.smithi081.stdout:0/980: dread d7/d9/d4b/d33/d43/d9a/faa [0,4194304] 0 2024-09-18T12:51:33.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/981: mknod d7/c150 0 2024-09-18T12:51:33.243 INFO:tasks.workunit.client.0.smithi081.stdout:0/982: unlink d7/d9/cae 0 2024-09-18T12:51:33.243 INFO:tasks.workunit.client.0.smithi081.stdout:0/983: readlink d7/d9/d4b/d4a/d77/l127 0 2024-09-18T12:51:33.245 INFO:tasks.workunit.client.0.smithi081.stdout:0/984: mknod d7/d7c/c151 0 2024-09-18T12:51:33.245 INFO:tasks.workunit.client.0.smithi081.stdout:0/985: read d7/dbf/f13c [10350,116360] 0 2024-09-18T12:51:33.246 INFO:tasks.workunit.client.0.smithi081.stdout:0/986: write d7/d9/d4b/d33/d43/fe2 [861041,31692] 0 2024-09-18T12:51:33.246 INFO:tasks.workunit.client.0.smithi081.stdout:1/983: dwrite d0/d6/f9 [0,4194304] 0 2024-09-18T12:51:33.247 INFO:tasks.workunit.client.0.smithi081.stdout:0/987: truncate d7/d9/d4b/d4a/f8a 2041549 0 2024-09-18T12:51:33.250 INFO:tasks.workunit.client.0.smithi081.stdout:1/984: creat d0/d18/df4/f145 x:0 0 0 2024-09-18T12:51:33.250 INFO:tasks.workunit.client.0.smithi081.stdout:1/985: write d0/db/f135 [1007640,49457] 0 2024-09-18T12:51:33.252 INFO:tasks.workunit.client.0.smithi081.stdout:1/986: rmdir d0/dd7/de9 39 2024-09-18T12:51:33.255 INFO:tasks.workunit.client.0.smithi081.stdout:1/987: truncate d0/d6/d33/d37/fe1 3146677 0 2024-09-18T12:51:33.279 INFO:tasks.workunit.client.0.smithi081.stdout:0/988: dwrite d7/d9/d4b/d4a/d92/fc8 [0,4194304] 0 2024-09-18T12:51:33.280 INFO:tasks.workunit.client.0.smithi081.stdout:1/988: dwrite d0/db/d4f/dab/f122 [0,4194304] 0 2024-09-18T12:51:33.280 INFO:tasks.workunit.client.0.smithi081.stdout:1/989: write d0/db/f135 [684237,80168] 0 2024-09-18T12:51:33.281 INFO:tasks.workunit.client.0.smithi081.stdout:0/989: rmdir d7/d11f 39 2024-09-18T12:51:33.285 INFO:tasks.workunit.client.0.smithi081.stdout:1/990: mkdir d0/d6/d66/d146 0 2024-09-18T12:51:33.288 INFO:tasks.workunit.client.0.smithi081.stdout:1/991: truncate d0/ff 1705922 0 2024-09-18T12:51:33.289 INFO:tasks.workunit.client.0.smithi081.stdout:0/990: mkdir d7/d9/d12/d152 0 2024-09-18T12:51:33.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/992: mkdir d0/d6/d7/d8/d147 0 2024-09-18T12:51:33.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/993: dread - d0/d18/fe5 zero size 2024-09-18T12:51:33.290 INFO:tasks.workunit.client.0.smithi081.stdout:1/994: chown d0/d6/d33/d37/dbc/d132/d51/d2c/d9f/fff 242179003 1 2024-09-18T12:51:33.292 INFO:tasks.workunit.client.0.smithi081.stdout:0/991: rename d7/d9/cb4 to d7/d9/d12/d152/c153 0 2024-09-18T12:51:33.295 INFO:tasks.workunit.client.0.smithi081.stdout:0/992: rename d7/d9/d4b/d3d/lb5 to d7/d9/d4b/d33/db1/l154 0 2024-09-18T12:51:33.296 INFO:tasks.workunit.client.0.smithi081.stdout:0/993: dread d7/d9/d4b/d33/d43/f87 [0,4194304] 0 2024-09-18T12:51:33.297 INFO:tasks.workunit.client.0.smithi081.stdout:0/994: write d7/dbf/d11c/d126/f14c [565310,112964] 0 2024-09-18T12:51:33.297 INFO:tasks.workunit.client.0.smithi081.stdout:1/995: rename d0/d6/d33/d37/dbc/d132/d4e/f13c to d0/d6/d33/d37/dbc/d132/f148 0 2024-09-18T12:51:33.299 INFO:tasks.workunit.client.0.smithi081.stdout:0/995: mknod d7/d5d/dd9/c155 0 2024-09-18T12:51:33.300 INFO:tasks.workunit.client.0.smithi081.stdout:8/948: sync 2024-09-18T12:51:33.300 INFO:tasks.workunit.client.0.smithi081.stdout:8/949: truncate d3/d1d/d89/db5/db8/f11c 4841297 0 2024-09-18T12:51:33.300 INFO:tasks.workunit.client.0.smithi081.stdout:6/999: sync 2024-09-18T12:51:33.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/996: mkdir d7/dbf/d156 0 2024-09-18T12:51:33.304 INFO:tasks.workunit.client.0.smithi081.stdout:8/950: rename d3/db7 to d3/d1d/d9f/d114/d13e 0 2024-09-18T12:51:33.305 INFO:tasks.workunit.client.0.smithi081.stdout:8/951: unlink d3/d1d/d9f/d114/d13e/cec 0 2024-09-18T12:51:33.305 INFO:tasks.workunit.client.0.smithi081.stdout:8/952: chown d3/c7 317 1 2024-09-18T12:51:33.306 INFO:tasks.workunit.client.0.smithi081.stdout:8/953: dread - d3/d1e/d4c/ffe zero size 2024-09-18T12:51:33.313 INFO:tasks.workunit.client.0.smithi081.stdout:1/996: dread d0/d6/d33/d37/f94 [0,4194304] 0 2024-09-18T12:51:33.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/954: dread d3/d1d/d89/fa0 [0,4194304] 0 2024-09-18T12:51:33.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/955: fdatasync d3/d1d/d89/db5/db8/f11c 0 2024-09-18T12:51:33.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/956: fdatasync d3/d73/fb4 0 2024-09-18T12:51:33.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/957: getdents d3/d1e/d4c/d68 0 2024-09-18T12:51:33.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/958: creat d3/d1d/d89/db5/db8/f13f x:0 0 0 2024-09-18T12:51:33.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/959: creat d3/d1d/d9f/dcf/f140 x:0 0 0 2024-09-18T12:51:33.338 INFO:tasks.workunit.client.0.smithi081.stdout:1/997: dread d0/dd7/d2d/f2f [0,4194304] 0 2024-09-18T12:51:33.356 INFO:tasks.workunit.client.0.smithi081.stdout:0/997: dwrite d7/d9/d4b/d33/d7d/fd1 [0,4194304] 0 2024-09-18T12:51:33.358 INFO:tasks.workunit.client.0.smithi081.stdout:8/960: dwrite d3/d1d/d4a/d7f/fdd [0,4194304] 0 2024-09-18T12:51:33.359 INFO:tasks.workunit.client.0.smithi081.stdout:1/998: dread d0/d6/d33/d42/d70/dec/f12c [4194304,4194304] 0 2024-09-18T12:51:33.359 INFO:tasks.workunit.client.0.smithi081.stdout:1/999: creat d0/db/d4f/f149 x:0 0 0 2024-09-18T12:51:33.361 INFO:tasks.workunit.client.0.smithi081.stdout:0/998: getdents d7 0 2024-09-18T12:51:33.374 INFO:tasks.workunit.client.0.smithi081.stdout:8/961: dread d3/d1e/d4c/d68/f82 [0,4194304] 0 2024-09-18T12:51:33.374 INFO:tasks.workunit.client.0.smithi081.stdout:8/962: truncate d3/d2f/fb2 1047609 0 2024-09-18T12:51:33.376 INFO:tasks.workunit.client.0.smithi081.stdout:8/963: rmdir d3/d1d/d9f/dcf/dda 39 2024-09-18T12:51:33.377 INFO:tasks.workunit.client.0.smithi081.stdout:8/964: rmdir d3/d1d/d89/db5 39 2024-09-18T12:51:33.377 INFO:tasks.workunit.client.0.smithi081.stdout:8/965: fdatasync d3/d73/dbe/f109 0 2024-09-18T12:51:33.388 INFO:tasks.workunit.client.0.smithi081.stdout:0/999: dwrite d7/d9/d12/dba/f5a [0,4194304] 0 2024-09-18T12:51:33.394 INFO:tasks.workunit.client.0.smithi081.stdout:8/966: write d3/f122 [4849702,84286] 0 2024-09-18T12:51:33.395 INFO:tasks.workunit.client.0.smithi081.stdout:8/967: mkdir d3/d2f/d141 0 2024-09-18T12:51:33.396 INFO:tasks.workunit.client.0.smithi081.stdout:8/968: link d3/d1d/d4a/d7f/d10e/f139 d3/d1d/d4a/da9/d12c/f142 0 2024-09-18T12:51:33.396 INFO:tasks.workunit.client.0.smithi081.stdout:8/969: fdatasync d3/d1e/d4c/d68/f82 0 2024-09-18T12:51:33.398 INFO:tasks.workunit.client.0.smithi081.stdout:8/970: truncate d3/d1d/d4a/d7f/fa8 751640 0 2024-09-18T12:51:33.402 INFO:tasks.workunit.client.0.smithi081.stdout:8/971: dread d3/d1e/d4c/d68/f82 [0,4194304] 0 2024-09-18T12:51:33.437 INFO:tasks.workunit.client.0.smithi081.stdout:8/972: dwrite d3/d2f/f87 [8388608,4194304] 0 2024-09-18T12:51:33.449 INFO:tasks.workunit.client.0.smithi081.stdout:8/973: write d3/d1e/f77 [3716806,78088] 0 2024-09-18T12:51:33.451 INFO:tasks.workunit.client.0.smithi081.stdout:8/974: getdents d3/d1d/d4a/d7f 0 2024-09-18T12:51:33.452 INFO:tasks.workunit.client.0.smithi081.stdout:8/975: mknod d3/d1d/d4a/da9/d12c/c143 0 2024-09-18T12:51:33.452 INFO:tasks.workunit.client.0.smithi081.stdout:8/976: read - d3/d1e/d4c/fa1 zero size 2024-09-18T12:51:33.456 INFO:tasks.workunit.client.0.smithi081.stdout:8/977: symlink d3/d1e/l144 0 2024-09-18T12:51:33.456 INFO:tasks.workunit.client.0.smithi081.stdout:8/978: write d3/d1d/d4a/da9/d12c/f142 [596459,12976] 0 2024-09-18T12:51:33.457 INFO:tasks.workunit.client.0.smithi081.stdout:8/979: rmdir d3/d1e/d4c/d68 39 2024-09-18T12:51:33.463 INFO:tasks.workunit.client.0.smithi081.stdout:8/980: fsync d3/d1e/f77 0 2024-09-18T12:51:33.466 INFO:tasks.workunit.client.0.smithi081.stdout:8/981: rmdir d3/dc9 39 2024-09-18T12:51:33.481 INFO:tasks.workunit.client.0.smithi081.stdout:8/982: dwrite d3/d73/dbe/f12e [0,4194304] 0 2024-09-18T12:51:33.483 INFO:tasks.workunit.client.0.smithi081.stdout:8/983: truncate d3/d1e/d4c/d68/f82 3170202 0 2024-09-18T12:51:33.484 INFO:tasks.workunit.client.0.smithi081.stdout:8/984: getdents d3 0 2024-09-18T12:51:33.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/985: truncate d3/d1d/f49 1233983 0 2024-09-18T12:51:33.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/986: write d3/f25 [76982,85679] 0 2024-09-18T12:51:33.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/987: readlink d3/d1d/l75 0 2024-09-18T12:51:33.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/988: creat d3/d2f/f145 x:0 0 0 2024-09-18T12:51:33.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/989: chown d3/d1e/d4c/dae/leb 143 1 2024-09-18T12:51:33.507 INFO:tasks.workunit.client.0.smithi081.stdout:8/990: dwrite d3/f13 [4194304,4194304] 0 2024-09-18T12:51:33.508 INFO:tasks.workunit.client.0.smithi081.stdout:8/991: mknod d3/d73/dbe/c146 0 2024-09-18T12:51:33.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/992: write d3/d1d/d4a/f7e [1720487,122079] 0 2024-09-18T12:51:33.537 INFO:tasks.workunit.client.0.smithi081.stdout:8/993: dwrite d3/d1d/d9f/f106 [0,4194304] 0 2024-09-18T12:51:33.537 INFO:tasks.workunit.client.0.smithi081.stdout:8/994: chown d3/l20 9791243 1 2024-09-18T12:51:33.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/995: link d3/d73/dbe/f133 d3/d1d/d9f/d114/f147 0 2024-09-18T12:51:33.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/996: fdatasync d3/d1d/d9f/dcf/dee/f11d 0 2024-09-18T12:51:33.541 INFO:tasks.workunit.client.0.smithi081.stdout:8/997: truncate d3/d1d/d89/f93 2716501 0 2024-09-18T12:51:33.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/998: dwrite d3/d1e/d4c/dae/f12f [0,4194304] 0 2024-09-18T12:51:33.560 INFO:tasks.workunit.client.0.smithi081.stdout:8/999: write d3/d1d/d89/db5/db8/f13f [604934,100021] 0 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:9/860: sync 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/954: sync 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:7/924: sync 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/955: write d2/d14/d33/d37/d3b/d16/f69 [481666,15633] 0 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:7/925: write d2/f12 [145295,30587] 0 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:7/926: creat d2/d56/d73/d90/f132 x:0 0 0 2024-09-18T12:51:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/956: creat d2/d14/d112/d114/f133 x:0 0 0 2024-09-18T12:51:33.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/957: mknod d2/dd/c134 0 2024-09-18T12:51:33.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/958: write d2/d14/d33/d37/d126/f128 [928646,93657] 0 2024-09-18T12:51:33.626 INFO:tasks.workunit.client.0.smithi081.stdout:7/927: mkdir d2/d18/d60/d85/dee/d133 0 2024-09-18T12:51:33.627 INFO:tasks.workunit.client.0.smithi081.stdout:5/959: mkdir d2/d14/d33/d37/d3b/d135 0 2024-09-18T12:51:33.630 INFO:tasks.workunit.client.0.smithi081.stdout:7/928: mknod d2/d18/d22/d48/c134 0 2024-09-18T12:51:33.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/929: truncate d2/d42/f41 555992 0 2024-09-18T12:51:33.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/930: fdatasync d2/f13 0 2024-09-18T12:51:33.633 INFO:tasks.workunit.client.0.smithi081.stdout:9/861: write dd/d15/d1a/fa8 [17300,106495] 0 2024-09-18T12:51:33.633 INFO:tasks.workunit.client.0.smithi081.stdout:9/862: creat dd/d15/d1a/dc6/f110 x:0 0 0 2024-09-18T12:51:33.634 INFO:tasks.workunit.client.0.smithi081.stdout:5/960: rename d2/d14/d33/d37/d3b/d2a/db0 to d2/d14/d112/d136 0 2024-09-18T12:51:33.634 INFO:tasks.workunit.client.0.smithi081.stdout:5/961: fdatasync d2/d14/d112/d114/d20/ff4 0 2024-09-18T12:51:33.634 INFO:tasks.workunit.client.0.smithi081.stdout:5/962: write d2/d14/d33/d37/d3b/d2a/d8e/ff5 [504040,14364] 0 2024-09-18T12:51:33.641 INFO:tasks.workunit.client.0.smithi081.stdout:7/931: dread d2/d14/d21/d49/f81 [0,4194304] 0 2024-09-18T12:51:33.642 INFO:tasks.workunit.client.0.smithi081.stdout:7/932: mkdir d2/d14/d21/d49/dcc/d135 0 2024-09-18T12:51:33.644 INFO:tasks.workunit.client.0.smithi081.stdout:7/933: rename d2/d14/d21/d49/fe4 to d2/d18/d60/daa/dd3/f136 0 2024-09-18T12:51:33.646 INFO:tasks.workunit.client.0.smithi081.stdout:7/934: symlink d2/d1d/d4e/dc7/l137 0 2024-09-18T12:51:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/963: dwrite d2/d14/d33/d37/dc5/f118 [0,4194304] 0 2024-09-18T12:51:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/964: chown d2/d47/d7f/l116 23057 1 2024-09-18T12:51:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/965: fsync d2/d14/d112/d114/f71 0 2024-09-18T12:51:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:5/966: chown d2/d14/d33/d37/d3b/f13 130804 1 2024-09-18T12:51:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:9/863: dwrite dd/de/d4f/ff4 [0,4194304] 0 2024-09-18T12:51:33.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/967: dread d2/d14/d1d/d108/fc0 [0,4194304] 0 2024-09-18T12:51:33.671 INFO:tasks.workunit.client.0.smithi081.stdout:9/864: creat dd/d1d/d1e/d24/d2a/d10b/f111 x:0 0 0 2024-09-18T12:51:33.671 INFO:tasks.workunit.client.0.smithi081.stdout:9/865: truncate dd/d15/d1a/f99 816098 0 2024-09-18T12:51:33.671 INFO:tasks.workunit.client.0.smithi081.stdout:9/866: dread - dd/d15/d1a/dc6/f110 zero size 2024-09-18T12:51:33.673 INFO:tasks.workunit.client.0.smithi081.stdout:5/968: symlink d2/d14/l137 0 2024-09-18T12:51:33.673 INFO:tasks.workunit.client.0.smithi081.stdout:5/969: fdatasync d2/d14/d112/d114/f133 0 2024-09-18T12:51:33.673 INFO:tasks.workunit.client.0.smithi081.stdout:5/970: write d2/d14/d112/d114/f25 [3069148,51922] 0 2024-09-18T12:51:33.676 INFO:tasks.workunit.client.0.smithi081.stdout:9/867: rename dd/d1d/d1e/d24/d48/fea to dd/d1d/d1e/d24/f112 0 2024-09-18T12:51:33.676 INFO:tasks.workunit.client.0.smithi081.stdout:9/868: creat dd/de/d4f/f113 x:0 0 0 2024-09-18T12:51:33.680 INFO:tasks.workunit.client.0.smithi081.stdout:9/869: rename dd/d15/d1a/da7/cc5 to dd/de/db3/c114 0 2024-09-18T12:51:33.688 INFO:tasks.workunit.client.0.smithi081.stdout:9/870: dread dd/d15/d1a/d35/ddb/fe8 [4194304,4194304] 0 2024-09-18T12:51:33.689 INFO:tasks.workunit.client.0.smithi081.stdout:9/871: mknod dd/d1d/d1e/d24/d48/d10c/c115 0 2024-09-18T12:51:33.691 INFO:tasks.workunit.client.0.smithi081.stdout:9/872: mkdir dd/d1d/d1e/d2f/dc4/d116 0 2024-09-18T12:51:33.691 INFO:tasks.workunit.client.0.smithi081.stdout:9/873: readlink dd/d1d/d1e/d77/l9f 0 2024-09-18T12:51:33.691 INFO:tasks.workunit.client.0.smithi081.stdout:5/971: dwrite d2/d14/d112/d114/d20/f30 [4194304,4194304] 0 2024-09-18T12:51:33.702 INFO:tasks.workunit.client.0.smithi081.stdout:9/874: dread dd/d1d/d1e/d24/f33 [0,4194304] 0 2024-09-18T12:51:33.703 INFO:tasks.workunit.client.0.smithi081.stdout:9/875: write f8 [4129980,110785] 0 2024-09-18T12:51:33.703 INFO:tasks.workunit.client.0.smithi081.stdout:9/876: dread - dd/de/d4f/fcb zero size 2024-09-18T12:51:33.710 INFO:tasks.workunit.client.0.smithi081.stdout:9/877: dread dd/d1d/f6b [0,4194304] 0 2024-09-18T12:51:33.711 INFO:tasks.workunit.client.0.smithi081.stdout:5/972: dwrite d2/d14/d33/d37/d3b/d2a/d8e/fa1 [0,4194304] 0 2024-09-18T12:51:33.711 INFO:tasks.workunit.client.0.smithi081.stdout:9/878: mknod dd/d15/d1a/dc6/c117 0 2024-09-18T12:51:33.711 INFO:tasks.workunit.client.0.smithi081.stdout:9/879: stat dd/de/db3 0 2024-09-18T12:51:33.714 INFO:tasks.workunit.client.0.smithi081.stdout:9/880: symlink dd/d1d/d1e/d24/l118 0 2024-09-18T12:51:33.714 INFO:tasks.workunit.client.0.smithi081.stdout:9/881: fsync dd/d15/d1a/da7/fd3 0 2024-09-18T12:51:33.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/882: mknod dd/d1d/d1e/c119 0 2024-09-18T12:51:33.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/883: chown dd/d15/d1a/d8d/f8e 0 1 2024-09-18T12:51:33.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/884: readlink dd/led 0 2024-09-18T12:51:33.716 INFO:tasks.workunit.client.0.smithi081.stdout:9/885: mkdir dd/d15/d1a/d8d/dbc/d11a 0 2024-09-18T12:51:33.718 INFO:tasks.workunit.client.0.smithi081.stdout:9/886: dread dd/de/f9b [0,4194304] 0 2024-09-18T12:51:33.719 INFO:tasks.workunit.client.0.smithi081.stdout:9/887: getdents dd/d1d/d1e/d77 0 2024-09-18T12:51:33.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/973: write d2/d14/d33/d37/d3b/d16/f106 [95465,66935] 0 2024-09-18T12:51:33.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/974: write d2/d14/d112/d114/f121 [981946,5574] 0 2024-09-18T12:51:33.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/975: chown d2/d14/d112/d114/d20/f9a 222349 1 2024-09-18T12:51:33.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/976: chown d2/d14/d112/d136/ffb 1874896907 1 2024-09-18T12:51:33.724 INFO:tasks.workunit.client.0.smithi081.stdout:5/977: mknod d2/d14/d112/d136/c138 0 2024-09-18T12:51:33.761 INFO:tasks.workunit.client.0.smithi081.stdout:9/888: dwrite f8 [0,4194304] 0 2024-09-18T12:51:33.761 INFO:tasks.workunit.client.0.smithi081.stdout:5/978: dwrite d2/d14/d1d/d108/fc0 [0,4194304] 0 2024-09-18T12:51:33.761 INFO:tasks.workunit.client.0.smithi081.stdout:5/979: mknod d2/d14/d33/d37/c139 0 2024-09-18T12:51:33.761 INFO:tasks.workunit.client.0.smithi081.stdout:5/980: dread - d2/d14/d112/d114/d20/f97 zero size 2024-09-18T12:51:33.762 INFO:tasks.workunit.client.0.smithi081.stdout:5/981: creat d2/d14/d112/d114/df9/f13a x:0 0 0 2024-09-18T12:51:33.763 INFO:tasks.workunit.client.0.smithi081.stdout:5/982: creat d2/f13b x:0 0 0 2024-09-18T12:51:33.765 INFO:tasks.workunit.client.0.smithi081.stdout:5/983: creat d2/d14/d33/d37/d3b/d2a/d8e/f13c x:0 0 0 2024-09-18T12:51:33.767 INFO:tasks.workunit.client.0.smithi081.stdout:5/984: mkdir d2/d14/d33/d37/d3b/d16/d13d 0 2024-09-18T12:51:33.767 INFO:tasks.workunit.client.0.smithi081.stdout:5/985: read - d2/d14/d1d/fba zero size 2024-09-18T12:51:33.767 INFO:tasks.workunit.client.0.smithi081.stdout:5/986: write d2/d14/d33/d37/f50 [2194202,14452] 0 2024-09-18T12:51:33.769 INFO:tasks.workunit.client.0.smithi081.stdout:5/987: mkdir d2/d14/d33/d37/d3b/d16/de8/d13e 0 2024-09-18T12:51:33.770 INFO:tasks.workunit.client.0.smithi081.stdout:5/988: getdents d2/d14/d33/d37/d3b/d16/de8/d11d 0 2024-09-18T12:51:33.770 INFO:tasks.workunit.client.0.smithi081.stdout:5/989: fsync d2/d14/d1d/d1a/f2b 0 2024-09-18T12:51:33.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/889: dwrite dd/de/f9b [0,4194304] 0 2024-09-18T12:51:33.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/890: write dd/d15/db1/d104/fb4 [81488,8842] 0 2024-09-18T12:51:33.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/891: stat dd/d1d/d1e/d24/f33 0 2024-09-18T12:51:33.783 INFO:tasks.workunit.client.0.smithi081.stdout:9/892: chown dd/d1d/d1e/d24/c50 25659 1 2024-09-18T12:51:33.785 INFO:tasks.workunit.client.0.smithi081.stdout:5/990: dwrite d2/d14/d33/d37/dc5/ff0 [0,4194304] 0 2024-09-18T12:51:33.787 INFO:tasks.workunit.client.0.smithi081.stdout:5/991: getdents d2/d14/d33/d37 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/893: dread dd/d15/d1a/d8d/f8e [0,4194304] 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/894: creat dd/d15/d1a/da7/f11b x:0 0 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/895: truncate dd/d15/d1a/d35/f101 811564 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/896: fsync dd/d1d/d1e/d77/fec 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/897: creat dd/de/d4f/f11c x:0 0 0 2024-09-18T12:51:33.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/898: creat dd/d15/d1a/da7/f11d x:0 0 0 2024-09-18T12:51:33.789 INFO:tasks.workunit.client.0.smithi081.stdout:5/992: unlink d2/d14/d1d/d1a/f81 0 2024-09-18T12:51:33.792 INFO:tasks.workunit.client.0.smithi081.stdout:9/899: rmdir dd/d15/d1a/d35/ddb 39 2024-09-18T12:51:33.792 INFO:tasks.workunit.client.0.smithi081.stdout:9/900: stat dd/d31/c47 0 2024-09-18T12:51:33.800 INFO:tasks.workunit.client.0.smithi081.stdout:9/901: dread dd/d1d/d1e/d24/d48/f6c [0,4194304] 0 2024-09-18T12:51:33.804 INFO:tasks.workunit.client.0.smithi081.stdout:9/902: dread fa [0,4194304] 0 2024-09-18T12:51:33.811 INFO:tasks.workunit.client.0.smithi081.stdout:5/993: dwrite d2/d14/d33/d37/d126/f128 [0,4194304] 0 2024-09-18T12:51:33.811 INFO:tasks.workunit.client.0.smithi081.stdout:5/994: read d2/d14/d112/d136/fda [50004,36930] 0 2024-09-18T12:51:33.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/995: mknod d2/c13f 0 2024-09-18T12:51:33.821 INFO:tasks.workunit.client.0.smithi081.stdout:9/903: dread dd/d15/d1a/da7/fd3 [0,4194304] 0 2024-09-18T12:51:33.825 INFO:tasks.workunit.client.0.smithi081.stdout:9/904: mknod dd/d15/d1a/d8d/c11e 0 2024-09-18T12:51:33.825 INFO:tasks.workunit.client.0.smithi081.stdout:9/905: fsync dd/d15/d1a/f81 0 2024-09-18T12:51:33.827 INFO:tasks.workunit.client.0.smithi081.stdout:9/906: mkdir dd/d1d/d1e/d77/dfa/d9e/df2/d11f 0 2024-09-18T12:51:33.832 INFO:tasks.workunit.client.0.smithi081.stdout:9/907: dread dd/d1d/d1e/d24/d2a/f30 [0,4194304] 0 2024-09-18T12:51:33.833 INFO:tasks.workunit.client.0.smithi081.stdout:5/996: dwrite d2/d14/d33/d37/d3b/d2a/d8e/fa1 [0,4194304] 0 2024-09-18T12:51:33.833 INFO:tasks.workunit.client.0.smithi081.stdout:5/997: fdatasync d2/d14/d33/d37/d3b/d5f/f12a 0 2024-09-18T12:51:33.834 INFO:tasks.workunit.client.0.smithi081.stdout:9/908: unlink dd/d1d/d1e/d24/d2a/f30 0 2024-09-18T12:51:33.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/909: symlink dd/d15/d1a/d35/ddb/l120 0 2024-09-18T12:51:33.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/910: write dd/d1d/d1e/d24/d2a/d10b/f111 [662971,6890] 0 2024-09-18T12:51:33.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/911: write dd/d31/fc1 [429979,40918] 0 2024-09-18T12:51:33.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/912: write dd/d15/fbb [2684539,38053] 0 2024-09-18T12:51:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/998: dwrite d2/d14/d1d/d108/f3c [0,4194304] 0 2024-09-18T12:51:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/999: readlink d2/d14/l117 0 2024-09-18T12:51:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:9/913: dwrite dd/d15/db1/d104/fbf [0,4194304] 0 2024-09-18T12:51:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:9/914: read dd/d15/d1a/fa8 [2261410,90438] 0 2024-09-18T12:51:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:9/915: truncate dd/d1d/d1e/d24/f112 122740 0 2024-09-18T12:51:33.866 INFO:tasks.workunit.client.0.smithi081.stdout:9/916: write dd/d15/d1a/f99 [1345022,3481] 0 2024-09-18T12:51:33.868 INFO:tasks.workunit.client.0.smithi081.stdout:9/917: creat dd/d15/d1a/d35/ddb/f121 x:0 0 0 2024-09-18T12:51:33.869 INFO:tasks.workunit.client.0.smithi081.stdout:9/918: creat dd/d1d/f122 x:0 0 0 2024-09-18T12:51:33.883 INFO:tasks.workunit.client.0.smithi081.stdout:9/919: dwrite f7 [4194304,4194304] 0 2024-09-18T12:51:33.886 INFO:tasks.workunit.client.0.smithi081.stdout:9/920: dread dd/d31/dd5/ffc [0,4194304] 0 2024-09-18T12:51:33.889 INFO:tasks.workunit.client.0.smithi081.stdout:9/921: dread dd/de/d59/f84 [0,4194304] 0 2024-09-18T12:51:33.889 INFO:tasks.workunit.client.0.smithi081.stdout:9/922: mknod dd/d15/c123 0 2024-09-18T12:51:33.890 INFO:tasks.workunit.client.0.smithi081.stdout:9/923: unlink dd/d1d/d1e/d24/ff6 0 2024-09-18T12:51:33.891 INFO:tasks.workunit.client.0.smithi081.stdout:9/924: mknod dd/d15/d1a/dc6/c124 0 2024-09-18T12:51:33.892 INFO:tasks.workunit.client.0.smithi081.stdout:9/925: symlink dd/d1d/d1e/d77/l125 0 2024-09-18T12:51:33.892 INFO:tasks.workunit.client.0.smithi081.stdout:9/926: symlink dd/de/l126 0 2024-09-18T12:51:33.894 INFO:tasks.workunit.client.0.smithi081.stdout:9/927: unlink dd/d31/dd5/lff 0 2024-09-18T12:51:33.895 INFO:tasks.workunit.client.0.smithi081.stdout:9/928: mkdir dd/d15/d1a/d35/ddb/d127 0 2024-09-18T12:51:33.896 INFO:tasks.workunit.client.0.smithi081.stdout:9/929: mknod dd/d1d/d1e/d77/dfa/d9e/df2/d11f/c128 0 2024-09-18T12:51:33.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/930: rename dd/d1d/d1e/d77/dfa/cc8 to dd/d1d/d1e/d24/d48/d10c/c129 0 2024-09-18T12:51:33.900 INFO:tasks.workunit.client.0.smithi081.stdout:9/931: rename dd/d15/db1/cfd to dd/d1d/d1e/d77/c12a 0 2024-09-18T12:51:33.900 INFO:tasks.workunit.client.0.smithi081.stdout:9/932: write dd/d31/dd5/ffc [480088,111412] 0 2024-09-18T12:51:33.920 INFO:tasks.workunit.client.0.smithi081.stdout:9/933: dwrite dd/d1d/d1e/d24/f67 [0,4194304] 0 2024-09-18T12:51:33.920 INFO:tasks.workunit.client.0.smithi081.stdout:9/934: write dd/de/d59/f84 [973119,83932] 0 2024-09-18T12:51:33.920 INFO:tasks.workunit.client.0.smithi081.stdout:9/935: chown dd/de/l37 13261 1 2024-09-18T12:51:33.926 INFO:tasks.workunit.client.0.smithi081.stdout:9/936: mkdir dd/d15/d1a/d8d/dbc/d11a/d12b 0 2024-09-18T12:51:33.928 INFO:tasks.workunit.client.0.smithi081.stdout:9/937: creat dd/de/d59/f12c x:0 0 0 2024-09-18T12:51:33.928 INFO:tasks.workunit.client.0.smithi081.stdout:9/938: fsync f7 0 2024-09-18T12:51:33.928 INFO:tasks.workunit.client.0.smithi081.stdout:9/939: creat dd/d15/d1a/d35/ddb/f12d x:0 0 0 2024-09-18T12:51:33.931 INFO:tasks.workunit.client.0.smithi081.stdout:9/940: getdents dd/d15/db1/d104 0 2024-09-18T12:51:33.931 INFO:tasks.workunit.client.0.smithi081.stdout:9/941: chown dd/d1d/d1e/d77/c10a 2659 1 2024-09-18T12:51:33.932 INFO:tasks.workunit.client.0.smithi081.stdout:9/942: truncate dd/d15/d1a/da7/fd6 3253506 0 2024-09-18T12:51:33.935 INFO:tasks.workunit.client.0.smithi081.stdout:9/943: truncate dd/de/f97 444704 0 2024-09-18T12:51:33.937 INFO:tasks.workunit.client.0.smithi081.stdout:9/944: mkdir dd/d15/d1a/da7/dce/d73/d12e 0 2024-09-18T12:51:33.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/945: mknod dd/d15/d1a/da7/dce/c12f 0 2024-09-18T12:51:33.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/946: read dd/d15/db1/d104/fb6 [682046,56910] 0 2024-09-18T12:51:33.941 INFO:tasks.workunit.client.0.smithi081.stdout:9/947: symlink dd/d15/d1a/da7/dce/d73/d12e/l130 0 2024-09-18T12:51:33.941 INFO:tasks.workunit.client.0.smithi081.stdout:9/948: dread - dd/d15/d1a/d35/fee zero size 2024-09-18T12:51:33.941 INFO:tasks.workunit.client.0.smithi081.stdout:9/949: write dd/d15/d1a/fa8 [4083423,49050] 0 2024-09-18T12:51:33.944 INFO:tasks.workunit.client.0.smithi081.stdout:9/950: rmdir dd/d1d/d1e 39 2024-09-18T12:51:33.946 INFO:tasks.workunit.client.0.smithi081.stdout:9/951: symlink dd/d1d/d1e/l131 0 2024-09-18T12:51:33.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/952: dread dd/f74 [0,4194304] 0 2024-09-18T12:51:33.950 INFO:tasks.workunit.client.0.smithi081.stdout:9/953: mkdir dd/d1d/d1e/d2f/dc4/dcc/d132 0 2024-09-18T12:51:33.966 INFO:tasks.workunit.client.0.smithi081.stdout:9/954: dwrite dd/d1d/d1e/d24/f64 [0,4194304] 0 2024-09-18T12:51:33.967 INFO:tasks.workunit.client.0.smithi081.stdout:7/935: sync 2024-09-18T12:51:33.968 INFO:tasks.workunit.client.0.smithi081.stdout:9/955: read dd/d1d/d1e/d24/d2a/d55/d85/faa [1074194,53964] 0 2024-09-18T12:51:33.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/956: creat dd/d1d/d1e/d24/d2a/d55/d85/f133 x:0 0 0 2024-09-18T12:51:33.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/957: write dd/d15/d1a/d3d/fd4 [551826,118229] 0 2024-09-18T12:51:33.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/958: dread - dd/de/d4f/d8c/d94/f9d zero size 2024-09-18T12:51:33.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/959: creat dd/d1b/f134 x:0 0 0 2024-09-18T12:51:33.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/960: chown dd/de/d4f/d8c/d94/fdf 8352290 1 2024-09-18T12:51:33.976 INFO:tasks.workunit.client.0.smithi081.stdout:9/961: unlink dd/d31/d4a/f93 0 2024-09-18T12:51:33.977 INFO:tasks.workunit.client.0.smithi081.stdout:7/936: rename d2/d1d to d2/d14/d138 0 2024-09-18T12:51:33.977 INFO:tasks.workunit.client.0.smithi081.stdout:7/937: readlink d2/d56/dc8/le0 0 2024-09-18T12:51:33.978 INFO:tasks.workunit.client.0.smithi081.stdout:9/962: symlink dd/d1d/d1e/d2f/dc4/d116/l135 0 2024-09-18T12:51:33.979 INFO:tasks.workunit.client.0.smithi081.stdout:7/938: rename d2/d18/d3c/c91 to d2/d18/d22/d48/db9/df3/c139 0 2024-09-18T12:51:33.980 INFO:tasks.workunit.client.0.smithi081.stdout:9/963: rmdir dd/d15/db1/d104 39 2024-09-18T12:51:33.980 INFO:tasks.workunit.client.0.smithi081.stdout:9/964: chown f8 54075014 1 2024-09-18T12:51:33.980 INFO:tasks.workunit.client.0.smithi081.stdout:7/939: dread d2/d56/d73/d7c/d86/da6/ff9 [0,4194304] 0 2024-09-18T12:51:33.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/965: dread dd/d15/d1a/da7/dce/fa6 [0,4194304] 0 2024-09-18T12:51:33.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/966: fsync dd/d1d/d1e/d24/f64 0 2024-09-18T12:51:33.990 INFO:tasks.workunit.client.0.smithi081.stdout:9/967: rename dd/d15/db1/d104 to dd/d1d/d136 0 2024-09-18T12:51:34.002 INFO:tasks.workunit.client.0.smithi081.stdout:7/940: dwrite d2/d18/d3c/f7a [0,4194304] 0 2024-09-18T12:51:34.009 INFO:tasks.workunit.client.0.smithi081.stdout:9/968: dwrite dd/d15/d1a/da7/f11d [0,4194304] 0 2024-09-18T12:51:34.009 INFO:tasks.workunit.client.0.smithi081.stdout:9/969: readlink dd/l25 0 2024-09-18T12:51:34.012 INFO:tasks.workunit.client.0.smithi081.stdout:9/970: creat dd/d15/d1a/da7/dce/f137 x:0 0 0 2024-09-18T12:51:34.016 INFO:tasks.workunit.client.0.smithi081.stdout:9/971: rename dd/d15/d1a/d8d/ldc to dd/d15/d1a/da7/dce/ddd/l138 0 2024-09-18T12:51:34.017 INFO:tasks.workunit.client.0.smithi081.stdout:9/972: fsync dd/d31/fc0 0 2024-09-18T12:51:34.021 INFO:tasks.workunit.client.0.smithi081.stdout:9/973: unlink dd/d1d/d1e/d24/lb9 0 2024-09-18T12:51:34.023 INFO:tasks.workunit.client.0.smithi081.stdout:9/974: unlink dd/d15/d1a/dc6/c124 0 2024-09-18T12:51:34.025 INFO:tasks.workunit.client.0.smithi081.stdout:9/975: mkdir dd/d1d/d139 0 2024-09-18T12:51:34.028 INFO:tasks.workunit.client.0.smithi081.stdout:9/976: creat dd/d15/f13a x:0 0 0 2024-09-18T12:51:34.028 INFO:tasks.workunit.client.0.smithi081.stdout:9/977: chown dd/d15/d1a/d35/ddb/fe8 27845 1 2024-09-18T12:51:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:34 smithi136 ceph-mon[35363]: pgmap v6: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:34 smithi136 ceph-mon[35363]: mgrmap e24: smithi136.vdkrdt(active, since 6s) 2024-09-18T12:51:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:34 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:34 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:34 smithi081 ceph-mon[27646]: pgmap v6: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-18T12:51:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:34 smithi081 ceph-mon[27646]: mgrmap e24: smithi136.vdkrdt(active, since 6s) 2024-09-18T12:51:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:34 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:34 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:9/978: sync 2024-09-18T12:51:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:7/941: sync 2024-09-18T12:51:34.510 INFO:tasks.workunit.client.0.smithi081.stdout:7/942: mknod d2/d56/d73/d7c/d86/da6/def/c13a 0 2024-09-18T12:51:34.511 INFO:tasks.workunit.client.0.smithi081.stdout:9/979: creat dd/d1d/d1e/d24/d107/f13b x:0 0 0 2024-09-18T12:51:34.511 INFO:tasks.workunit.client.0.smithi081.stdout:7/943: creat d2/d14/d138/d4e/f13b x:0 0 0 2024-09-18T12:51:34.513 INFO:tasks.workunit.client.0.smithi081.stdout:9/980: mkdir dd/d1d/d1e/d24/d13c 0 2024-09-18T12:51:34.514 INFO:tasks.workunit.client.0.smithi081.stdout:9/981: getdents dd/d15/d1a/d35 0 2024-09-18T12:51:34.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/982: unlink dd/de/f9b 0 2024-09-18T12:51:34.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/983: write dd/d1d/f122 [9994,52953] 0 2024-09-18T12:51:34.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/984: dread - dd/de/d4f/d8c/d94/f9d zero size 2024-09-18T12:51:34.517 INFO:tasks.workunit.client.0.smithi081.stdout:9/985: creat dd/d15/db1/de5/f13d x:0 0 0 2024-09-18T12:51:34.518 INFO:tasks.workunit.client.0.smithi081.stdout:9/986: truncate f0 3999707 0 2024-09-18T12:51:34.519 INFO:tasks.workunit.client.0.smithi081.stdout:7/944: dread d2/d14/d21/d62/da7/f7d [4194304,4194304] 0 2024-09-18T12:51:34.521 INFO:tasks.workunit.client.0.smithi081.stdout:9/987: creat dd/d1d/d1e/d77/dfa/d9e/df2/f13e x:0 0 0 2024-09-18T12:51:34.522 INFO:tasks.workunit.client.0.smithi081.stdout:7/945: dread d2/d14/d21/f72 [0,4194304] 0 2024-09-18T12:51:34.523 INFO:tasks.workunit.client.0.smithi081.stdout:9/988: unlink dd/d15/d1a/d8d/c106 0 2024-09-18T12:51:34.527 INFO:tasks.workunit.client.0.smithi081.stdout:9/989: rename dd/d1d/d1e/l131 to dd/de/d59/l13f 0 2024-09-18T12:51:34.527 INFO:tasks.workunit.client.0.smithi081.stdout:9/990: getdents dd/d15/db1/de2 0 2024-09-18T12:51:34.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/946: rmdir d2/dfe 39 2024-09-18T12:51:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:9/991: dwrite dd/d15/d1a/dc6/f110 [0,4194304] 0 2024-09-18T12:51:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:9/992: write dd/d15/d1a/f99 [108290,130961] 0 2024-09-18T12:51:34.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/993: rmdir dd/d31/dd5 39 2024-09-18T12:51:34.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/994: creat dd/d15/d1a/dc6/f140 x:0 0 0 2024-09-18T12:51:34.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/995: dread - dd/d15/d1a/dc6/f140 zero size 2024-09-18T12:51:34.551 INFO:tasks.workunit.client.0.smithi081.stdout:7/947: dwrite d2/d42/f117 [0,4194304] 0 2024-09-18T12:51:34.553 INFO:tasks.workunit.client.0.smithi081.stdout:7/948: dread d2/d56/d73/d7c/fdf [0,4194304] 0 2024-09-18T12:51:34.553 INFO:tasks.workunit.client.0.smithi081.stdout:7/949: dread - d2/d14/d138/f101 zero size 2024-09-18T12:51:34.554 INFO:tasks.workunit.client.0.smithi081.stdout:9/996: link dd/d1d/d1e/d24/d2a/d55/d85/l6f dd/d15/d1a/d8d/dbc/l141 0 2024-09-18T12:51:34.554 INFO:tasks.workunit.client.0.smithi081.stdout:9/997: fdatasync dd/de/d4f/d8c/d94/f9d 0 2024-09-18T12:51:34.557 INFO:tasks.workunit.client.0.smithi081.stdout:7/950: rename d2/d18/d60/daa/lb8 to d2/d56/dc8/l13c 0 2024-09-18T12:51:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:9/998: rename dd/d15/d1a/l79 to dd/d1d/d1e/d2f/dc4/dcc/d132/l142 0 2024-09-18T12:51:34.561 INFO:tasks.workunit.client.0.smithi081.stdout:7/951: write d2/d14/d138/d4e/d84/fb1 [3286133,22496] 0 2024-09-18T12:51:34.561 INFO:tasks.workunit.client.0.smithi081.stdout:7/952: chown d2/d14/d138/l5b 64029603 1 2024-09-18T12:51:34.561 INFO:tasks.workunit.client.0.smithi081.stdout:9/999: dread dd/de/d4f/d8c/d94/fdf [0,4194304] 0 2024-09-18T12:51:34.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/953: mknod d2/d18/d60/d85/dee/d133/c13d 0 2024-09-18T12:51:34.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/954: truncate d2/d42/fa3 716946 0 2024-09-18T12:51:34.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/955: dread - d2/d18/d22/f128 zero size 2024-09-18T12:51:34.940 INFO:tasks.workunit.client.0.smithi081.stdout:7/956: sync 2024-09-18T12:51:34.941 INFO:tasks.workunit.client.0.smithi081.stdout:7/957: rename d2/d18/f1f to d2/d18/d22/f13e 0 2024-09-18T12:51:34.942 INFO:tasks.workunit.client.0.smithi081.stdout:7/958: creat d2/d14/d138/d4e/d115/f13f x:0 0 0 2024-09-18T12:51:34.943 INFO:tasks.workunit.client.0.smithi081.stdout:7/959: truncate d2/f3a 203385 0 2024-09-18T12:51:34.964 INFO:tasks.workunit.client.0.smithi081.stdout:7/960: dwrite d2/d14/d21/f10e [0,4194304] 0 2024-09-18T12:51:35.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:35 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:35.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:35 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:35.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:35 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:35.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:35 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:36.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:36 smithi081 ceph-mon[27646]: pgmap v7: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 109 MiB/s wr, 256 op/s 2024-09-18T12:51:36.448 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:36 smithi136 ceph-mon[35363]: pgmap v7: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 109 MiB/s wr, 256 op/s 2024-09-18T12:51:37.035 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:51:37.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-18T12:51:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:37 smithi136 ceph-mon[35363]: Standby manager daemon smithi081.pfnvgp started 2024-09-18T12:51:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:37 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/crt"}]: dispatch 2024-09-18T12:51:37.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:37 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:37.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:37 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/key"}]: dispatch 2024-09-18T12:51:37.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:37 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:37 smithi081 ceph-mon[27646]: Standby manager daemon smithi081.pfnvgp started 2024-09-18T12:51:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:37 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/crt"}]: dispatch 2024-09-18T12:51:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:37 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:37 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/key"}]: dispatch 2024-09-18T12:51:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:37 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/2' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:37.838 INFO:tasks.workunit.client.0.smithi081.stdout:7/961: sync 2024-09-18T12:51:37.838 INFO:tasks.workunit.client.0.smithi081.stdout:7/962: write d2/d56/d73/d90/f132 [465105,67183] 0 2024-09-18T12:51:37.839 INFO:tasks.workunit.client.0.smithi081.stdout:7/963: symlink d2/d56/d73/d7c/d86/da6/l140 0 2024-09-18T12:51:37.848 INFO:tasks.workunit.client.0.smithi081.stdout:7/964: write d2/d14/d21/d62/f11c [186310,10451] 0 2024-09-18T12:51:37.854 INFO:tasks.workunit.client.0.smithi081.stdout:7/965: write d2/d18/d60/fad [545689,25643] 0 2024-09-18T12:51:37.855 INFO:tasks.workunit.client.0.smithi081.stdout:7/966: truncate d2/d18/d3c/fd1 3617358 0 2024-09-18T12:51:37.856 INFO:tasks.workunit.client.0.smithi081.stdout:7/967: write d2/d14/d21/f26 [1689041,121316] 0 2024-09-18T12:51:37.856 INFO:tasks.workunit.client.0.smithi081.stdout:7/968: chown d2/d56/d73/d7c/dd7 202443151 1 2024-09-18T12:51:37.857 INFO:tasks.workunit.client.0.smithi081.stdout:7/969: getdents d2/d14/d21/d62/da7 0 2024-09-18T12:51:37.858 INFO:tasks.workunit.client.0.smithi081.stdout:7/970: chown d2/f6 3131154 1 2024-09-18T12:51:37.858 INFO:tasks.workunit.client.0.smithi081.stdout:7/971: stat d2/d18/d22/f2a 0 2024-09-18T12:51:37.859 INFO:tasks.workunit.client.0.smithi081.stdout:7/972: link d2/f12f d2/d18/f141 0 2024-09-18T12:51:37.859 INFO:tasks.workunit.client.0.smithi081.stdout:7/973: fsync d2/d42/f41 0 2024-09-18T12:51:37.864 INFO:tasks.workunit.client.0.smithi081.stdout:7/974: write d2/d7f/f129 [5650737,124968] 0 2024-09-18T12:51:37.864 INFO:tasks.workunit.client.0.smithi081.stdout:7/975: creat d2/d14/d21/d62/f142 x:0 0 0 2024-09-18T12:51:37.864 INFO:tasks.workunit.client.0.smithi081.stdout:7/976: creat d2/d14/d21/d62/f143 x:0 0 0 2024-09-18T12:51:37.869 INFO:tasks.workunit.client.0.smithi081.stdout:7/977: getdents d2/d18/d22/d48/df1 0 2024-09-18T12:51:37.870 INFO:tasks.workunit.client.0.smithi081.stdout:7/978: fsync d2/d18/f141 0 2024-09-18T12:51:37.874 INFO:tasks.workunit.client.0.smithi081.stdout:7/979: mkdir d2/d14/d21/d144 0 2024-09-18T12:51:37.883 INFO:tasks.workunit.client.0.smithi081.stdout:7/980: dread d2/d14/d21/fbb [4194304,4194304] 0 2024-09-18T12:51:37.883 INFO:tasks.workunit.client.0.smithi081.stdout:7/981: chown d2/d56/c79 409175399 1 2024-09-18T12:51:37.884 INFO:tasks.workunit.client.0.smithi081.stdout:7/982: mkdir d2/d18/d3c/d145 0 2024-09-18T12:51:37.886 INFO:tasks.workunit.client.0.smithi081.stdout:7/983: rename d2/d14/d138/d4e/d84/l92 to d2/d18/d22/l146 0 2024-09-18T12:51:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: pgmap v8: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 69 MiB/s rd, 84 MiB/s wr, 199 op/s 2024-09-18T12:51:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: mgrmap e25: smithi136.vdkrdt(active, since 10s), standbys: smithi081.pfnvgp 2024-09-18T12:51:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:38 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: pgmap v8: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 69 MiB/s rd, 84 MiB/s wr, 199 op/s 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: mgrmap e25: smithi136.vdkrdt(active, since 10s), standbys: smithi081.pfnvgp 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:38.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:38 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:39.554 INFO:tasks.workunit.client.0.smithi081.stdout:7/984: sync 2024-09-18T12:51:39.555 INFO:tasks.workunit.client.0.smithi081.stdout:7/985: symlink d2/d18/d3c/d145/l147 0 2024-09-18T12:51:39.557 INFO:tasks.workunit.client.0.smithi081.stdout:7/986: mkdir d2/d18/d22/d48/db9/df3/d148 0 2024-09-18T12:51:39.557 INFO:tasks.workunit.client.0.smithi081.stdout:7/987: chown d2/d7f/dff 1 1 2024-09-18T12:51:39.559 INFO:tasks.workunit.client.0.smithi081.stdout:7/988: creat d2/d14/d138/d4e/d115/f149 x:0 0 0 2024-09-18T12:51:39.560 INFO:tasks.workunit.client.0.smithi081.stdout:7/989: truncate d2/d42/f117 3669964 0 2024-09-18T12:51:39.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/990: creat d2/d14/d138/f14a x:0 0 0 2024-09-18T12:51:39.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/991: write d2/d18/f141 [1329307,62080] 0 2024-09-18T12:51:39.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/992: mknod d2/d18/d22/d48/db9/df3/c14b 0 2024-09-18T12:51:39.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/993: chown d2/d14/d21/d62/da7/c4d 4 1 2024-09-18T12:51:39.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/994: read - d2/d18/fab zero size 2024-09-18T12:51:39.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:39 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi136 to 2240M 2024-09-18T12:51:39.581 INFO:tasks.workunit.client.0.smithi081.stdout:7/995: dwrite d2/d14/d21/d49/f81 [0,4194304] 0 2024-09-18T12:51:39.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/996: rename d2/dfe/f10f to d2/d18/d60/daa/f14c 0 2024-09-18T12:51:39.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/997: fsync d2/d14/f2f 0 2024-09-18T12:51:39.587 INFO:tasks.workunit.client.0.smithi081.stdout:7/998: mkdir d2/d14/d21/d62/d14d 0 2024-09-18T12:51:39.587 INFO:tasks.workunit.client.0.smithi081.stdout:7/999: dread - d2/d14/f11f zero size 2024-09-18T12:51:39.591 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf -- ./tmp.rQwyjbFSGc 2024-09-18T12:51:39.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:39 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi136 to 2240M 2024-09-18T12:51:40.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:40 smithi081 ceph-mon[27646]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 84 MiB/s wr, 263 op/s 2024-09-18T12:51:40.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:40 smithi136 ceph-mon[35363]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 84 MiB/s wr, 263 op/s 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 77 MiB/s wr, 240 op/s 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:42.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:41 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 77 MiB/s wr, 240 op/s 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:41 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Adjusting osd_memory_target on smithi081 to 1216M 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:43.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Reconfiguring ceph-exporter.smithi081 (dependencies changed)... 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:43.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:43.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:43 smithi081 ceph-mon[27646]: Deploying daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Adjusting osd_memory_target on smithi081 to 1216M 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Reconfiguring ceph-exporter.smithi081 (dependencies changed)... 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:43.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:43 smithi136 ceph-mon[35363]: Deploying daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:51:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:44 smithi136 ceph-mon[35363]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 77 MiB/s wr, 240 op/s 2024-09-18T12:51:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:44 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:44 smithi081 ceph-mon[27646]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 77 MiB/s wr, 240 op/s 2024-09-18T12:51:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:44 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:46.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:46 smithi136 ceph-mon[35363]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 78 MiB/s wr, 366 op/s 2024-09-18T12:51:46.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:46 smithi081 ceph-mon[27646]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 78 MiB/s wr, 366 op/s 2024-09-18T12:51:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:48 smithi136 ceph-mon[35363]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 217 op/s 2024-09-18T12:51:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:48 smithi081 ceph-mon[27646]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 217 op/s 2024-09-18T12:51:49.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:49 smithi081 ceph-mon[27646]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 322 op/s 2024-09-18T12:51:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:49 smithi136 ceph-mon[35363]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 322 op/s 2024-09-18T12:51:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:51 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:51 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:51 smithi136 ceph-mon[35363]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:51:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:51 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:51 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:51.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:51 smithi081 ceph-mon[27646]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:51:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:52 smithi081 ceph-mon[27646]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:51:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:52 smithi081 ceph-mon[27646]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-09-18T12:51:52.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:52 smithi136 ceph-mon[35363]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:51:52.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:52 smithi136 ceph-mon[35363]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-09-18T12:51:54.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:54 smithi081 ceph-mon[27646]: pgmap v16: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 -- 172.21.15.81:0/471174590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c0fef60 msgr2=0x7f364c0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 --2- 172.21.15.81:0/471174590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c0fef60 0x7f364c0ff380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3648009910 tx=0x7f3648009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 -- 172.21.15.81:0/471174590 shutdown_connections 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 --2- 172.21.15.81:0/471174590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c101f40 0x7f364c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 --2- 172.21.15.81:0/471174590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c0fef60 0x7f364c0ff380 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 -- 172.21.15.81:0/471174590 >> 172.21.15.81:0/471174590 conn(0x7f364c0fa8c0 msgr2=0x7f364c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 -- 172.21.15.81:0/471174590 shutdown_connections 2024-09-18T12:51:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.597+0000 7f36542cc700 1 -- 172.21.15.81:0/471174590 wait complete. 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 Processor -- start 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 -- start start 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 0x7f364c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c197030 con 0x7f364c101f40 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f36542cc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c197170 con 0x7f364c0fef60 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f3652068700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f3652068700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47378/0 (socket says 172.21.15.81:47378) 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.598+0000 7f3652068700 1 -- 172.21.15.81:0/3849733554 learned_addr learned my addr 172.21.15.81:0/3849733554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3651867700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 0x7f364c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3652068700 1 -- 172.21.15.81:0/3849733554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 msgr2=0x7f364c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3652068700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 0x7f364c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3652068700 1 -- 172.21.15.81:0/3849733554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480095f0 con 0x7f364c0fef60 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3651867700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 0x7f364c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f3652068700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3648000c00 tx=0x7f364800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f364801d070 con 0x7f364c0fef60 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3648005dc0 con 0x7f364c0fef60 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36480226a0 con 0x7f364c0fef60 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c0ffd30 con 0x7f364c0fef60 2024-09-18T12:51:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.599+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c100220 con 0x7f364c0fef60 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.601+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c109800 con 0x7f364c0fef60 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.601+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7f3648003910 con 0x7f364c0fef60 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.602+0000 7f36437fe700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 0x7f3638076080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.602+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f36480961e0 con 0x7f364c0fef60 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.602+0000 7f3651867700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 0x7f3638076080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.602+0000 7f3651867700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 0x7f3638076080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f363c009be0 tx=0x7f363c009260 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.607+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f36480596e0 con 0x7f364c0fef60 2024-09-18T12:51:54.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:54 smithi136 ceph-mon[35363]: pgmap v16: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-09-18T12:51:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.935+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f364c106890 con 0x7f3638073bc0 2024-09-18T12:51:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.936+0000 7f36437fe700 1 -- 172.21.15.81:0/3849733554 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f364c106890 con 0x7f3638073bc0 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 msgr2=0x7f3638076080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 0x7f3638076080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f363c009be0 tx=0x7f363c009260 comp rx=0 tx=0).stop 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 msgr2=0x7f364c1964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3648000c00 tx=0x7f364800f740 comp rx=0 tx=0).stop 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 shutdown_connections 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f3638073bc0 0x7f3638076080 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0fef60 0x7f364c1964d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 --2- 172.21.15.81:0/3849733554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c101f40 0x7f364c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 >> 172.21.15.81:0/3849733554 conn(0x7f364c0fa8c0 msgr2=0x7f364c105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 shutdown_connections 2024-09-18T12:51:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:54.940+0000 7f36542cc700 1 -- 172.21.15.81:0/3849733554 wait complete. 2024-09-18T12:51:54.952 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:51:55.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.063+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/279302829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 msgr2=0x7f2fbc103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/279302829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc103b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009910 tx=0x7f2fac009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:55.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/279302829 shutdown_connections 2024-09-18T12:51:55.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/279302829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 0x7f2fbc1064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/279302829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc103b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/279302829 >> 172.21.15.81:0/279302829 conn(0x7f2fbc0fb190 msgr2=0x7f2fbc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:55.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/279302829 shutdown_connections 2024-09-18T12:51:55.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.064+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/279302829 wait complete. 2024-09-18T12:51:55.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 Processor -- start 2024-09-18T12:51:55.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 -- start start 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 0x7f2fbc1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc196fc0 con 0x7f2fbc1017a0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fc1e8e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc197100 con 0x7f2fbc1040d0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49968/0 (socket says 172.21.15.81:49968) 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/2831462905 learned_addr learned my addr 172.21.15.81:0/2831462905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbaffd700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 0x7f2fbc1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 msgr2=0x7f2fbc1969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.065+0000 7f2fbb7fe700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 0x7f2fbc1969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/2831462905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0095f0 con 0x7f2fbc1017a0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fbb7fe700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006010 tx=0x7f2fac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fac01d070 con 0x7f2fbc1017a0 2024-09-18T12:51:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fac00f460 con 0x7f2fbc1017a0 2024-09-18T12:51:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fac017630 con 0x7f2fbc1017a0 2024-09-18T12:51:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc19bb50 con 0x7f2fbc1017a0 2024-09-18T12:51:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.066+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc19bff0 con 0x7f2fbc1017a0 2024-09-18T12:51:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.067+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc190610 con 0x7f2fbc1017a0 2024-09-18T12:51:55.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.068+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7f2fac00f5d0 con 0x7f2fbc1017a0 2024-09-18T12:51:55.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.068+0000 7f2fb8ff9700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 0x7f2fa4076030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.068+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2fac096100 con 0x7f2fbc1017a0 2024-09-18T12:51:55.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.068+0000 7f2fbaffd700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 0x7f2fa4076030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.069+0000 7f2fbaffd700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 0x7f2fa4076030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0005950 tx=0x7f2fb00058e0 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:55.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.074+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f2fac059620 con 0x7f2fbc1017a0 2024-09-18T12:51:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.440+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fbc0611d0 con 0x7f2fa4073b70 2024-09-18T12:51:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.442+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/2831462905 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2fbc0611d0 con 0x7f2fa4073b70 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 msgr2=0x7f2fa4076030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 0x7f2fa4076030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0005950 tx=0x7f2fb00058e0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 msgr2=0x7f2fbc196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006010 tx=0x7f2fac00be20 comp rx=0 tx=0).stop 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 shutdown_connections 2024-09-18T12:51:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fbc1017a0 0x7f2fbc196460 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f2fa4073b70 0x7f2fa4076030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 --2- 172.21.15.81:0/2831462905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fbc1040d0 0x7f2fbc1969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 >> 172.21.15.81:0/2831462905 conn(0x7f2fbc0fb190 msgr2=0x7f2fbc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 shutdown_connections 2024-09-18T12:51:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.444+0000 7f2fc1e8e700 1 -- 172.21.15.81:0/2831462905 wait complete. 2024-09-18T12:51:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 -- 172.21.15.81:0/2972595865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 msgr2=0x7f4724096510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 --2- 172.21.15.81:0/2972595865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f4724096510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f471c009910 tx=0x7f471c009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 -- 172.21.15.81:0/2972595865 shutdown_connections 2024-09-18T12:51:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 --2- 172.21.15.81:0/2972595865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 0x7f4724095140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 --2- 172.21.15.81:0/2972595865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f4724096510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.590+0000 7f472b59e700 1 -- 172.21.15.81:0/2972595865 >> 172.21.15.81:0/2972595865 conn(0x7f472408f770 msgr2=0x7f4724091bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.591+0000 7f472b59e700 1 -- 172.21.15.81:0/2972595865 shutdown_connections 2024-09-18T12:51:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.591+0000 7f472b59e700 1 -- 172.21.15.81:0/2972595865 wait complete. 2024-09-18T12:51:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.591+0000 7f472b59e700 1 Processor -- start 2024-09-18T12:51:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.591+0000 7f472b59e700 1 -- start start 2024-09-18T12:51:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f472b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 0x7f472412c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f472b59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f472b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724129190 con 0x7f4724094cc0 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f472b59e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724129300 con 0x7f47240960f0 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:41740/0 (socket says 172.21.15.81:41740) 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 -- 172.21.15.81:0/2232762899 learned_addr learned my addr 172.21.15.81:0/2232762899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f472a59c700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 0x7f472412c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 -- 172.21.15.81:0/2232762899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 msgr2=0x7f472412c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 0x7f472412c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 -- 172.21.15.81:0/2232762899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0095f0 con 0x7f47240960f0 2024-09-18T12:51:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.592+0000 7f4729d9b700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4720009a20 tx=0x7f4720009de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.593+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4720012070 con 0x7f47240960f0 2024-09-18T12:51:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.593+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47241295e0 con 0x7f47240960f0 2024-09-18T12:51:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.593+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4720016410 con 0x7f47240960f0 2024-09-18T12:51:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.593+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47200155e0 con 0x7f47240960f0 2024-09-18T12:51:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.593+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4724129ae0 con 0x7f47240960f0 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.594+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472409c570 con 0x7f47240960f0 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.595+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7f472000cac0 con 0x7f47240960f0 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.595+0000 7f471b7fe700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 0x7f4714076030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.595+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4720094330 con 0x7f47240960f0 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.596+0000 7f472a59c700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 0x7f4714076030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.596+0000 7f472a59c700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 0x7f4714076030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f471c0059d0 tx=0x7f471c005940 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.601+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f4720057900 con 0x7f47240960f0 2024-09-18T12:51:55.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.916+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4724137d80 con 0x7f4714073b70 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.926+0000 7f471b7fe700 1 -- 172.21.15.81:0/2232762899 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4724137d80 con 0x7f4714073b70 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 15s ago 9m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 starting - - - - 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (8m) 22s ago 8m 7499k - 18.2.1 5be31c24972a 3e64e25cf9ce 2024-09-18T12:51:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (9m) 15s ago 9m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (8m) 22s ago 8m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (7m) 15s ago 9m 84.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (3m) 15s ago 3m 176M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (3m) 15s ago 3m 134M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (3m) 22s ago 3m 17.5M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (3m) 22s ago 3m 13.4M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:51:55.929 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:9283,8765,8443 running (10m) 15s ago 10m 204M - 18.2.1 5be31c24972a 74312fdbdf66 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (45s) 22s ago 8m 493M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1a0b20067729 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (10m) 15s ago 10m 54.5M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (8m) 22s ago 8m 41.9M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (9m) 15s ago 9m 15.9M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (8m) 22s ago 8m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 15s ago 6m 245M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (6m) 15s ago 6m 269M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:51:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (6m) 15s ago 5m 206M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:51:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (5m) 22s ago 5m 281M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:51:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (5m) 22s ago 5m 214M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:51:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (4m) 22s ago 4m 270M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:51:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 15s ago 8m 64.3M - 2.43.0 a07b618ecd1d d62b63231122 2024-09-18T12:51:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 msgr2=0x7f4714076030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 0x7f4714076030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f471c0059d0 tx=0x7f471c005940 comp rx=0 tx=0).stop 2024-09-18T12:51:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 msgr2=0x7f472412cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4720009a20 tx=0x7f4720009de0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 shutdown_connections 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724094cc0 0x7f472412c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f4714073b70 0x7f4714076030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 --2- 172.21.15.81:0/2232762899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47240960f0 0x7f472412cbe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.929+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 >> 172.21.15.81:0/2232762899 conn(0x7f472408f770 msgr2=0x7f4724098f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.930+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 shutdown_connections 2024-09-18T12:51:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:55.930+0000 7f472b59e700 1 -- 172.21.15.81:0/2232762899 wait complete. 2024-09-18T12:51:56.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 -- 172.21.15.81:0/4122002104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 msgr2=0x7f5d70100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/4122002104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70100030 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009910 tx=0x7f5d6c009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 -- 172.21.15.81:0/4122002104 shutdown_connections 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/4122002104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d70101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/4122002104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70100030 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 -- 172.21.15.81:0/4122002104 >> 172.21.15.81:0/4122002104 conn(0x7f5d700fb190 msgr2=0x7f5d700fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 -- 172.21.15.81:0/4122002104 shutdown_connections 2024-09-18T12:51:56.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.069+0000 7f5d77ed6700 1 -- 172.21.15.81:0/4122002104 wait complete. 2024-09-18T12:51:56.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 Processor -- start 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 -- start start 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d701021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70102730 con 0x7f5d700ffc10 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d77ed6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70102870 con 0x7f5d70100e10 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d75c72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d75c72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39264/0 (socket says 172.21.15.81:39264) 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d75c72700 1 -- 172.21.15.81:0/1773517373 learned_addr learned my addr 172.21.15.81:0/1773517373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.070+0000 7f5d75471700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d701021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d75471700 1 -- 172.21.15.81:0/1773517373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 msgr2=0x7f5d70103ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d75471700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d75471700 1 -- 172.21.15.81:0/1773517373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0095f0 con 0x7f5d70100e10 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d75c72700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d75471700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d701021f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000e970 tx=0x7f5d6000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6000c9d0 con 0x7f5d70100e10 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.071+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d60010430 con 0x7f5d70100e10 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.072+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d60018650 con 0x7f5d70100e10 2024-09-18T12:51:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.072+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70102b50 con 0x7f5d70100e10 2024-09-18T12:51:56.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.072+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7019e530 con 0x7f5d70100e10 2024-09-18T12:51:56.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.073+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70108700 con 0x7f5d70100e10 2024-09-18T12:51:56.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.074+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7f5d600105a0 con 0x7f5d70100e10 2024-09-18T12:51:56.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.075+0000 7f5d66ffd700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 0x7f5d5c076060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.075+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5d60014070 con 0x7f5d70100e10 2024-09-18T12:51:56.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.075+0000 7f5d75c72700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 0x7f5d5c076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.075+0000 7f5d75c72700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 0x7f5d5c076060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b6f0 tx=0x7f5d6c005a90 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:56.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.080+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f5d600554a0 con 0x7f5d70100e10 2024-09-18T12:51:56.456 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:56 smithi081 ceph-mon[27646]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:56.456 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:56 smithi081 ceph-mon[27646]: pgmap v17: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-18T12:51:56.456 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:56 smithi081 ceph-mon[27646]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:51:56.456 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:56 smithi081 ceph-mon[27646]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:56.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.593+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d7019eae0 con 0x7f5d70100e10 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.593+0000 7f5d66ffd700 1 -- 172.21.15.81:0/1773517373 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f5d60058300 con 0x7f5d70100e10 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:51:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:51:56.596 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:51:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 msgr2=0x7f5d5c076060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 0x7f5d5c076060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b6f0 tx=0x7f5d6c005a90 comp rx=0 tx=0).stop 2024-09-18T12:51:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 msgr2=0x7f5d701021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d701021f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000e970 tx=0x7f5d6000ec80 comp rx=0 tx=0).stop 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 shutdown_connections 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700ffc10 0x7f5d70103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f5d5c073ba0 0x7f5d5c076060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 --2- 172.21.15.81:0/1773517373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d70100e10 0x7f5d701021f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 >> 172.21.15.81:0/1773517373 conn(0x7f5d700fb190 msgr2=0x7f5d70068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 shutdown_connections 2024-09-18T12:51:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.596+0000 7f5d77ed6700 1 -- 172.21.15.81:0/1773517373 wait complete. 2024-09-18T12:51:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 -- 172.21.15.81:0/1308751595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 msgr2=0x7f7f841004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/1308751595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f841004e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009910 tx=0x7f7f80009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 -- 172.21.15.81:0/1308751595 shutdown_connections 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/1308751595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/1308751595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f841004e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.765+0000 7f7f8bb20700 1 -- 172.21.15.81:0/1308751595 >> 172.21.15.81:0/1308751595 conn(0x7f7f840fa8c0 msgr2=0x7f7f840fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.766+0000 7f7f8bb20700 1 -- 172.21.15.81:0/1308751595 shutdown_connections 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.766+0000 7f7f8bb20700 1 -- 172.21.15.81:0/1308751595 wait complete. 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.766+0000 7f7f8bb20700 1 Processor -- start 2024-09-18T12:51:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.766+0000 7f7f8bb20700 1 -- start start 2024-09-18T12:51:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f8bb20700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f8bb20700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f8bb20700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84197060 con 0x7f7f841000c0 2024-09-18T12:51:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f8bb20700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841971a0 con 0x7f7f84100de0 2024-09-18T12:51:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39282/0 (socket says 172.21.15.81:39282) 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 -- 172.21.15.81:0/2746972616 learned_addr learned my addr 172.21.15.81:0/2746972616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f890bb700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 -- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 msgr2=0x7f7f84196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f898bc700 1 -- 172.21.15.81:0/2746972616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800095f0 con 0x7f7f841000c0 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.767+0000 7f7f890bb700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f898bc700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f8000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f8001d070 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f80005dc0 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8419bbf0 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f80022470 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.768+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8419c0e0 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.769+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f84108730 con 0x7f7f841000c0 2024-09-18T12:51:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.770+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7f7f80003810 con 0x7f7f841000c0 2024-09-18T12:51:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.771+0000 7f7f7affd700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 0x7f7f70076030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.771+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7f800960d0 con 0x7f7f841000c0 2024-09-18T12:51:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.771+0000 7f7f890bb700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 0x7f7f70076030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.771+0000 7f7f890bb700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 0x7f7f70076030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ffdf0 tx=0x7f7f74009260 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:56.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:56.776+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f7f80059670 con 0x7f7f841000c0 2024-09-18T12:51:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:56 smithi136 ceph-mon[35363]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:56 smithi136 ceph-mon[35363]: pgmap v17: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-18T12:51:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:56 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:51:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:56 smithi136 ceph-mon[35363]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:57.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.095+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f8419cc70 con 0x7f7f841000c0 2024-09-18T12:51:57.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.096+0000 7f7f7affd700 1 -- 172.21.15.81:0/2746972616 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f7f8005c790 con 0x7f7f841000c0 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:51:57.098 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:51:57.099 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:51:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:57.102 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:51:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:51:57.102 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:57.102 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:51:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 msgr2=0x7f7f70076030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 0x7f7f70076030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ffdf0 tx=0x7f7f74009260 comp rx=0 tx=0).stop 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 msgr2=0x7f7f84196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f8000f690 comp rx=0 tx=0).stop 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 shutdown_connections 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f841000c0 0x7f7f84196500 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f7f70073b70 0x7f7f70076030 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 --2- 172.21.15.81:0/2746972616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f84100de0 0x7f7f84196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.103+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 >> 172.21.15.81:0/2746972616 conn(0x7f7f840fa8c0 msgr2=0x7f7f840fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.104+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 shutdown_connections 2024-09-18T12:51:57.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.104+0000 7f7f8bb20700 1 -- 172.21.15.81:0/2746972616 wait complete. 2024-09-18T12:51:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 -- 172.21.15.81:0/1502709864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 msgr2=0x7fa134103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 --2- 172.21.15.81:0/1502709864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134103c30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa124009910 tx=0x7fa124009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 -- 172.21.15.81:0/1502709864 shutdown_connections 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 --2- 172.21.15.81:0/1502709864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 0x7fa134106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 --2- 172.21.15.81:0/1502709864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134103c30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.258+0000 7fa13a30e700 1 -- 172.21.15.81:0/1502709864 >> 172.21.15.81:0/1502709864 conn(0x7fa1340fb190 msgr2=0x7fa1340fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.259+0000 7fa13a30e700 1 -- 172.21.15.81:0/1502709864 shutdown_connections 2024-09-18T12:51:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.259+0000 7fa13a30e700 1 -- 172.21.15.81:0/1502709864 wait complete. 2024-09-18T12:51:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.259+0000 7fa13a30e700 1 Processor -- start 2024-09-18T12:51:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.259+0000 7fa13a30e700 1 -- start start 2024-09-18T12:51:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa13a30e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa13a30e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 0x7fa134196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa13a30e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134197060 con 0x7fa134101840 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa13a30e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341971a0 con 0x7fa134104170 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39294/0 (socket says 172.21.15.81:39294) 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 -- 172.21.15.81:0/2427741814 learned_addr learned my addr 172.21.15.81:0/2427741814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa1337fe700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 0x7fa134196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 -- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 msgr2=0x7fa134196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 0x7fa134196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 -- 172.21.15.81:0/2427741814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240095f0 con 0x7fa134101840 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.260+0000 7fa133fff700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa124006010 tx=0x7fa12400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.261+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12401d070 con 0x7fa134101840 2024-09-18T12:51:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.261+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13419bbf0 con 0x7fa134101840 2024-09-18T12:51:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.261+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa12400f460 con 0x7fa134101840 2024-09-18T12:51:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.261+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa124021640 con 0x7fa134101840 2024-09-18T12:51:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.261+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13419c0e0 con 0x7fa134101840 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.262+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1341906a0 con 0x7fa134101840 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.262+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7fa12400fab0 con 0x7fa134101840 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.263+0000 7fa1317fa700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 0x7fa11c076080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.263+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa124095f30 con 0x7fa134101840 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.263+0000 7fa1337fe700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 0x7fa11c076080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.264+0000 7fa1337fe700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 0x7fa11c076080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa128009a10 tx=0x7fa128009190 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.268+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fa1240cc4a0 con 0x7fa134101840 2024-09-18T12:51:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1773517373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:57.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:57.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:57.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:57.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:57 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2746972616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:51:57.502 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1773517373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:57.503 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:57 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2746972616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:51:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.694+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1340611d0 con 0x7fa11c073bc0 2024-09-18T12:51:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.696+0000 7fa1317fa700 1 -- 172.21.15.81:0/2427741814 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa1340611d0 con 0x7fa11c073bc0 2024-09-18T12:51:57.697 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:51:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:51:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:51:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:51:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T12:51:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "1/23 daemons upgraded", 2024-09-18T12:51:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-18T12:51:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:51:57.698 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.698+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 msgr2=0x7fa11c076080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.698+0000 7fa13a30e700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 0x7fa11c076080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa128009a10 tx=0x7fa128009190 comp rx=0 tx=0).stop 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.698+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 msgr2=0x7fa134196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.698+0000 7fa13a30e700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa124006010 tx=0x7fa12400bd70 comp rx=0 tx=0).stop 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 shutdown_connections 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa134101840 0x7fa134196500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa11c073bc0 0x7fa11c076080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 --2- 172.21.15.81:0/2427741814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa134104170 0x7fa134196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 >> 172.21.15.81:0/2427741814 conn(0x7fa1340fb190 msgr2=0x7fa1340fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 shutdown_connections 2024-09-18T12:51:57.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.699+0000 7fa13a30e700 1 -- 172.21.15.81:0/2427741814 wait complete. 2024-09-18T12:51:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 -- 172.21.15.81:0/2995168116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401040d0 msgr2=0x7fa1401064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 --2- 172.21.15.81:0/2995168116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401040d0 0x7fa1401064c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa134009910 tx=0x7fa134009c20 comp rx=0 tx=0).stop 2024-09-18T12:51:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 -- 172.21.15.81:0/2995168116 shutdown_connections 2024-09-18T12:51:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 --2- 172.21.15.81:0/2995168116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401040d0 0x7fa1401064c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 --2- 172.21.15.81:0/2995168116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401017a0 0x7fa140103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 -- 172.21.15.81:0/2995168116 >> 172.21.15.81:0/2995168116 conn(0x7fa1400fb190 msgr2=0x7fa1400fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 -- 172.21.15.81:0/2995168116 shutdown_connections 2024-09-18T12:51:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.869+0000 7fa146975700 1 -- 172.21.15.81:0/2995168116 wait complete. 2024-09-18T12:51:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.870+0000 7fa146975700 1 Processor -- start 2024-09-18T12:51:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.870+0000 7fa146975700 1 -- start start 2024-09-18T12:51:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.870+0000 7fa146975700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa146975700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 0x7fa140198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa146975700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140199150 con 0x7fa1401017a0 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa146975700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140199290 con 0x7fa1401040d0 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39302/0 (socket says 172.21.15.81:39302) 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 -- 172.21.15.81:0/3832911980 learned_addr learned my addr 172.21.15.81:0/3832911980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13f7fe700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 0x7fa140198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 -- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 msgr2=0x7fa140198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 0x7fa140198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 -- 172.21.15.81:0/3832911980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340095f0 con 0x7fa1401017a0 2024-09-18T12:51:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13f7fe700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 0x7fa140198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.871+0000 7fa13ffff700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c930 tx=0x7fa13000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.872+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa130007ad0 con 0x7fa1401017a0 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.872+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa130007c30 con 0x7fa1401017a0 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.872+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14019dd50 con 0x7fa1401017a0 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.872+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14019e1c0 con 0x7fa1401017a0 2024-09-18T12:51:57.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.873+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa130018630 con 0x7fa1401017a0 2024-09-18T12:51:57.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.873+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c005320 con 0x7fa1401017a0 2024-09-18T12:51:57.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.875+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 96843+0+0 (secure 0 0 0) 0x7fa13000f450 con 0x7fa1401017a0 2024-09-18T12:51:57.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.875+0000 7fa13d7fa700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 0x7fa128076060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.875+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa130095160 con 0x7fa1401017a0 2024-09-18T12:51:57.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.876+0000 7fa13f7fe700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 0x7fa128076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.876+0000 7fa13f7fe700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 0x7fa128076060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa13400b5c0 tx=0x7fa134005960 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:57.884+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fa1300586e0 con 0x7fa1401017a0 2024-09-18T12:51:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.445+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa12c005190 con 0x7fa1401017a0 2024-09-18T12:51:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.446+0000 7fa13d7fa700 1 -- 172.21.15.81:0/3832911980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa130063e60 con 0x7fa1401017a0 2024-09-18T12:51:58.447 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:51:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 msgr2=0x7fa128076060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 0x7fa128076060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa13400b5c0 tx=0x7fa134005960 comp rx=0 tx=0).stop 2024-09-18T12:51:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 msgr2=0x7fa140198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c930 tx=0x7fa13000ccf0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 shutdown_connections 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1401017a0 0x7fa140198680 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fa128073ba0 0x7fa128076060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 --2- 172.21.15.81:0/3832911980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1401040d0 0x7fa140198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 >> 172.21.15.81:0/3832911980 conn(0x7fa1400fb190 msgr2=0x7fa1400fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 shutdown_connections 2024-09-18T12:51:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:51:58.448+0000 7fa146975700 1 -- 172.21.15.81:0/3832911980 wait complete. 2024-09-18T12:51:58.523 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:58 smithi136 ceph-mon[35363]: Reconfiguring ceph-exporter.smithi136 (dependencies changed)... 2024-09-18T12:51:58.523 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:58 smithi136 ceph-mon[35363]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:51:58.523 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:58 smithi136 ceph-mon[35363]: pgmap v18: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-09-18T12:51:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:58 smithi081 ceph-mon[27646]: Reconfiguring ceph-exporter.smithi136 (dependencies changed)... 2024-09-18T12:51:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:58 smithi081 ceph-mon[27646]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:51:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:58 smithi081 ceph-mon[27646]: pgmap v18: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-09-18T12:51:59.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:59 smithi136 ceph-mon[35363]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:59 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3832911980' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:51:59.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:51:59 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:59.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:59 smithi081 ceph-mon[27646]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:59 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3832911980' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:51:59.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:51:59 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:00.116 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:52:00.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T12:52:00.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:00 smithi081 ceph-mon[27646]: pgmap v19: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2024-09-18T12:52:00.626 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:00 smithi136 ceph-mon[35363]: pgmap v19: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: Upgrade: Need to upgrade myself (mgr.smithi136.vdkrdt) 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: Upgrade: Need to upgrade myself (mgr.smithi136.vdkrdt) 2024-09-18T12:52:02.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:01 smithi136 ceph-mon[35363]: pgmap v20: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.9 MiB/s wr, 222 op/s 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: Upgrade: Need to upgrade myself (mgr.smithi136.vdkrdt) 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: Upgrade: Need to upgrade myself (mgr.smithi136.vdkrdt) 2024-09-18T12:52:02.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:01 smithi081 ceph-mon[27646]: pgmap v20: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.9 MiB/s wr, 222 op/s 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: Upgrade: Updating mgr.smithi081.pfnvgp 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:52:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:03.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:03 smithi136 ceph-mon[35363]: Deploying daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:52:03.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: Upgrade: Updating mgr.smithi081.pfnvgp 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:03.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:03 smithi081 ceph-mon[27646]: Deploying daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:52:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:04 smithi136 ceph-mon[35363]: pgmap v21: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.9 MiB/s wr, 222 op/s 2024-09-18T12:52:04.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:04 smithi081 ceph-mon[27646]: pgmap v21: 65 pgs: 65 active+clean; 614 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.9 MiB/s wr, 222 op/s 2024-09-18T12:52:06.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:06 smithi136 ceph-mon[35363]: pgmap v22: 65 pgs: 65 active+clean; 421 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 286 op/s 2024-09-18T12:52:06.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:06 smithi081 ceph-mon[27646]: pgmap v22: 65 pgs: 65 active+clean; 421 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 286 op/s 2024-09-18T12:52:08.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:08 smithi136 ceph-mon[35363]: pgmap v23: 65 pgs: 65 active+clean; 421 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 159 op/s 2024-09-18T12:52:08.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:08 smithi081 ceph-mon[27646]: pgmap v23: 65 pgs: 65 active+clean; 421 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 159 op/s 2024-09-18T12:52:10.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:09 smithi081 ceph-mon[27646]: pgmap v24: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 298 op/s 2024-09-18T12:52:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:09 smithi136 ceph-mon[35363]: pgmap v24: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 298 op/s 2024-09-18T12:52:11.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:11 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.506 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:11 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:11 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:11.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:11 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.507 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:11 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:11 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:11 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:11 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:11 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:11.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:11 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:12.562 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:12 smithi136 ceph-mon[35363]: pgmap v25: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.8 MiB/s wr, 203 op/s 2024-09-18T12:52:12.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:12 smithi081 ceph-mon[27646]: pgmap v25: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.8 MiB/s wr, 203 op/s 2024-09-18T12:52:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:14 smithi081 ceph-mon[27646]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.8 MiB/s wr, 203 op/s 2024-09-18T12:52:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:14 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:14 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:14 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:14.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:14 smithi136 ceph-mon[35363]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.8 MiB/s wr, 203 op/s 2024-09-18T12:52:14.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:14 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:14.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:14 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:14.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:14 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: pgmap v27: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 352 op/s 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: Standby manager daemon smithi081.pfnvgp restarted 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: Standby manager daemon smithi081.pfnvgp started 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/crt"}]: dispatch 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/key"}]: dispatch 2024-09-18T12:52:16.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: pgmap v27: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 352 op/s 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: Standby manager daemon smithi081.pfnvgp restarted 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: Standby manager daemon smithi081.pfnvgp started 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/crt"}]: dispatch 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.pfnvgp/key"}]: dispatch 2024-09-18T12:52:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:17 smithi136 ceph-mon[35363]: mgrmap e26: smithi136.vdkrdt(active, since 49s), standbys: smithi081.pfnvgp 2024-09-18T12:52:17.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:17 smithi081 ceph-mon[27646]: mgrmap e26: smithi136.vdkrdt(active, since 49s), standbys: smithi081.pfnvgp 2024-09-18T12:52:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:18 smithi081 ceph-mon[27646]: pgmap v28: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-18T12:52:18.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:18 smithi136 ceph-mon[35363]: pgmap v28: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-18T12:52:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:19 smithi081 ceph-mon[27646]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-09-18T12:52:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:19 smithi136 ceph-mon[35363]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-09-18T12:52:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:22 smithi136 ceph-mon[35363]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-09-18T12:52:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:22 smithi081 ceph-mon[27646]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-09-18T12:52:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:24 smithi136 ceph-mon[35363]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-09-18T12:52:24.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:24 smithi081 ceph-mon[27646]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-09-18T12:52:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:26 smithi136 ceph-mon[35363]: pgmap v32: 65 pgs: 65 active+clean; 331 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 354 op/s 2024-09-18T12:52:26.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:26 smithi081 ceph-mon[27646]: pgmap v32: 65 pgs: 65 active+clean; 331 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 354 op/s 2024-09-18T12:52:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:28 smithi136 ceph-mon[35363]: pgmap v33: 65 pgs: 65 active+clean; 331 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 205 op/s 2024-09-18T12:52:28.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:28 smithi081 ceph-mon[27646]: pgmap v33: 65 pgs: 65 active+clean; 331 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 205 op/s 2024-09-18T12:52:28.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 -- 172.21.15.81:0/3378327857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 msgr2=0x7fc49810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 --2- 172.21.15.81:0/3378327857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc49810a1c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b0a0 tx=0x7fc49000b3b0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 -- 172.21.15.81:0/3378327857 shutdown_connections 2024-09-18T12:52:28.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 --2- 172.21.15.81:0/3378327857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc49810a700 0x7fc49810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 --2- 172.21.15.81:0/3378327857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc49810a1c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.613+0000 7fc49fd51700 1 -- 172.21.15.81:0/3378327857 >> 172.21.15.81:0/3378327857 conn(0x7fc49806da40 msgr2=0x7fc49806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:28.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.617+0000 7fc49fd51700 1 -- 172.21.15.81:0/3378327857 shutdown_connections 2024-09-18T12:52:28.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.620+0000 7fc49fd51700 1 -- 172.21.15.81:0/3378327857 wait complete. 2024-09-18T12:52:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.620+0000 7fc49fd51700 1 Processor -- start 2024-09-18T12:52:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49fd51700 1 -- start start 2024-09-18T12:52:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49fd51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49fd51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc49810a700 0x7fc4981170e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49fd51700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498117700 con 0x7fc498107d90 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49fd51700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4981b30f0 con 0x7fc49810a700 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49daed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49daed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44286/0 (socket says 172.21.15.81:44286) 2024-09-18T12:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.623+0000 7fc49daed700 1 -- 172.21.15.81:0/1148605913 learned_addr learned my addr 172.21.15.81:0/1148605913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.624+0000 7fc49daed700 1 -- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc49810a700 msgr2=0x7fc4981170e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T12:52:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.624+0000 7fc49daed700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc49810a700 0x7fc4981170e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.624+0000 7fc49daed700 1 -- 172.21.15.81:0/1148605913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490009d00 con 0x7fc498107d90 2024-09-18T12:52:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.625+0000 7fc49daed700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b070 tx=0x7fc4900093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.626+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49000e040 con 0x7fc498107d90 2024-09-18T12:52:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.626+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc490003de0 con 0x7fc498107d90 2024-09-18T12:52:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.626+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49001d8a0 con 0x7fc498107d90 2024-09-18T12:52:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.626+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4981b3290 con 0x7fc498107d90 2024-09-18T12:52:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.626+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4981b3670 con 0x7fc498107d90 2024-09-18T12:52:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.629+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c005320 con 0x7fc498107d90 2024-09-18T12:52:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.629+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7fc490019070 con 0x7fc498107d90 2024-09-18T12:52:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.630+0000 7fc48effd700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 0x7fc48407d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.630+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc49009f530 con 0x7fc498107d90 2024-09-18T12:52:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.631+0000 7fc49d2ec700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 0x7fc48407d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.634+0000 7fc49d2ec700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 0x7fc48407d6d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc498117b00 tx=0x7fc494005c10 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:28.640+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fc490062a30 con 0x7fc498107d90 2024-09-18T12:52:29.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.039+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc47c000bf0 con 0x7fc48407b210 2024-09-18T12:52:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.041+0000 7fc48effd700 1 -- 172.21.15.81:0/1148605913 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc47c000bf0 con 0x7fc48407b210 2024-09-18T12:52:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 msgr2=0x7fc48407d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 0x7fc48407d6d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc498117b00 tx=0x7fc494005c10 comp rx=0 tx=0).stop 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 msgr2=0x7fc498116ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b070 tx=0x7fc4900093b0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 shutdown_connections 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc498107d90 0x7fc498116ba0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc48407b210 0x7fc48407d6d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 --2- 172.21.15.81:0/1148605913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc49810a700 0x7fc4981170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 >> 172.21.15.81:0/1148605913 conn(0x7fc49806da40 msgr2=0x7fc49806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 shutdown_connections 2024-09-18T12:52:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.043+0000 7fc49fd51700 1 -- 172.21.15.81:0/1148605913 wait complete. 2024-09-18T12:52:29.059 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:52:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2499997235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4101eb0 msgr2=0x7f9cd4102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2499997235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4102310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009910 tx=0x7f9cd0009c20 comp rx=0 tx=0).stop 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2499997235 shutdown_connections 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2499997235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4102310 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2499997235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2499997235 >> 172.21.15.81:0/2499997235 conn(0x7f9cd40fc230 msgr2=0x7f9cd40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2499997235 shutdown_connections 2024-09-18T12:52:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.196+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2499997235 wait complete. 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 Processor -- start 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 -- start start 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4197040 con 0x7f9cd4100cb0 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cdc05c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4197180 con 0x7f9cd4101eb0 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cd9df8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cd9df8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44300/0 (socket says 172.21.15.81:44300) 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.197+0000 7f9cd9df8700 1 -- 172.21.15.81:0/2467849649 learned_addr learned my addr 172.21.15.81:0/2467849649 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.198+0000 7f9cd95f7700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.198+0000 7f9cd9df8700 1 -- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4101eb0 msgr2=0x7f9cd4196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.198+0000 7f9cd9df8700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.198+0000 7f9cd9df8700 1 -- 172.21.15.81:0/2467849649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00095f0 con 0x7f9cd4100cb0 2024-09-18T12:52:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.198+0000 7f9cd9df8700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e8f0 tx=0x7f9cc800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.199+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc8009790 con 0x7f9cd4100cb0 2024-09-18T12:52:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.199+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cc80044d0 con 0x7f9cd4100cb0 2024-09-18T12:52:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.199+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd4073020 con 0x7f9cd4100cb0 2024-09-18T12:52:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.199+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4073570 con 0x7f9cd4100cb0 2024-09-18T12:52:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.200+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc8003da0 con 0x7f9cd4100cb0 2024-09-18T12:52:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.201+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8005320 con 0x7f9cd4100cb0 2024-09-18T12:52:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.202+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7f9cc800cba0 con 0x7f9cd4100cb0 2024-09-18T12:52:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.203+0000 7f9cc6ffd700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 0x7f9cc007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.203+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9cc8014070 con 0x7f9cd4100cb0 2024-09-18T12:52:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.204+0000 7f9cd95f7700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 0x7f9cc007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.205+0000 7f9cd95f7700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 0x7f9cc007d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009fd0 tx=0x7f9cd000b5a0 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.212+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f9cc8061740 con 0x7f9cd4100cb0 2024-09-18T12:52:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:29 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:29.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:29 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.643+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cb8000bf0 con 0x7f9cc007b0b0 2024-09-18T12:52:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.644+0000 7f9cc6ffd700 1 -- 172.21.15.81:0/2467849649 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f9cb8000bf0 con 0x7f9cc007b0b0 2024-09-18T12:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 msgr2=0x7f9cc007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 0x7f9cc007d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009fd0 tx=0x7f9cd000b5a0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 msgr2=0x7f9cd41964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e8f0 tx=0x7f9cc800ecb0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 shutdown_connections 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cd4100cb0 0x7f9cd41964e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f9cc007b0b0 0x7f9cc007d570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 --2- 172.21.15.81:0/2467849649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cd4101eb0 0x7f9cd4196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 >> 172.21.15.81:0/2467849649 conn(0x7f9cd40fc230 msgr2=0x7f9cd41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 shutdown_connections 2024-09-18T12:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.648+0000 7f9cdc05c700 1 -- 172.21.15.81:0/2467849649 wait complete. 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 -- 172.21.15.81:0/2517205579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 msgr2=0x7fefa0103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 --2- 172.21.15.81:0/2517205579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0103b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009910 tx=0x7fef9c009c20 comp rx=0 tx=0).stop 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 -- 172.21.15.81:0/2517205579 shutdown_connections 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 --2- 172.21.15.81:0/2517205579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 --2- 172.21.15.81:0/2517205579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0103b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 -- 172.21.15.81:0/2517205579 >> 172.21.15.81:0/2517205579 conn(0x7fefa00fb190 msgr2=0x7fefa00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 -- 172.21.15.81:0/2517205579 shutdown_connections 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.790+0000 7fefa84e3700 1 -- 172.21.15.81:0/2517205579 wait complete. 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 Processor -- start 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 -- start start 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0196fc0 con 0x7fefa01017a0 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa84e3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0197100 con 0x7fefa01040d0 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa627f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa627f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44326/0 (socket says 172.21.15.81:44326) 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa627f700 1 -- 172.21.15.81:0/3235372223 learned_addr learned my addr 172.21.15.81:0/3235372223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.791+0000 7fefa5a7e700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa627f700 1 -- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 msgr2=0x7fefa01969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa627f700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa627f700 1 -- 172.21.15.81:0/3235372223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0095f0 con 0x7fefa01017a0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa5a7e700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa627f700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000c00 tx=0x7fef9c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c01d070 con 0x7fefa01017a0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa019bb50 con 0x7fefa01017a0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef9c005dc0 con 0x7fefa01017a0 2024-09-18T12:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa019c040 con 0x7fefa01017a0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.792+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c0226a0 con 0x7fefa01017a0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.793+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84005320 con 0x7fefa01017a0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.795+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7fef9c00fba0 con 0x7fefa01017a0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.795+0000 7fef977fe700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 0x7fef8c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.796+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fef9c09f1d0 con 0x7fefa01017a0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.796+0000 7fefa5a7e700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 0x7fef8c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.796+0000 7fefa5a7e700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 0x7fef8c07d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef90009cb0 tx=0x7fef90009260 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:29.801+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fef9c062770 con 0x7fefa01017a0 2024-09-18T12:52:30.061 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:30 smithi081 ceph-mon[27646]: pgmap v34: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.5 MiB/s wr, 424 op/s 2024-09-18T12:52:30.061 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:30 smithi081 ceph-mon[27646]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.192+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fef84000bf0 con 0x7fef8c07b0b0 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.201+0000 7fef977fe700 1 -- 172.21.15.81:0/3235372223 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fef84000bf0 con 0x7fef8c07b0b0 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 49s ago 9m 25.1M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 starting - - - - 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (30s) 17s ago 9m 7059k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (10m) 49s ago 10m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (9m) 17s ago 9m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (7m) 49s ago 9m 84.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:52:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (3m) 49s ago 3m 176M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (3m) 49s ago 3m 134M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (3m) 17s ago 3m 17.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (3m) 17s ago 3m 13.8M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 starting - - - - 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (80s) 17s ago 9m 509M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1a0b20067729 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (11m) 49s ago 11m 54.5M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (8m) 17s ago 8m 40.7M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (10m) 49s ago 10m 15.9M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (9m) 17s ago 9m 15.3M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (7m) 49s ago 7m 245M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 49s ago 7m 269M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:52:30.204 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (6m) 49s ago 6m 206M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:52:30.205 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (6m) 17s ago 6m 255M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:52:30.205 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (5m) 17s ago 5m 215M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:52:30.205 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (5m) 17s ago 5m 207M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:52:30.205 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 starting - - - - 2024-09-18T12:52:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.205+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 msgr2=0x7fef8c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.205+0000 7fefa84e3700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 0x7fef8c07d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef90009cb0 tx=0x7fef90009260 comp rx=0 tx=0).stop 2024-09-18T12:52:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.205+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 msgr2=0x7fefa0196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.205+0000 7fefa84e3700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000c00 tx=0x7fef9c00f740 comp rx=0 tx=0).stop 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 shutdown_connections 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefa01017a0 0x7fefa0196460 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fef8c07b0b0 0x7fef8c07d570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 --2- 172.21.15.81:0/3235372223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefa01040d0 0x7fefa01969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 >> 172.21.15.81:0/3235372223 conn(0x7fefa00fb190 msgr2=0x7fefa00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 shutdown_connections 2024-09-18T12:52:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.206+0000 7fefa84e3700 1 -- 172.21.15.81:0/3235372223 wait complete. 2024-09-18T12:52:30.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:30 smithi136 ceph-mon[35363]: pgmap v34: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.5 MiB/s wr, 424 op/s 2024-09-18T12:52:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:30 smithi136 ceph-mon[35363]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 -- 172.21.15.81:0/3630906989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 msgr2=0x7f0f8c0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3630906989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c0ff740 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00b0a0 tx=0x7f0f7c00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 -- 172.21.15.81:0/3630906989 shutdown_connections 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3630906989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 0x7f0f8c100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3630906989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c0ff740 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 -- 172.21.15.81:0/3630906989 >> 172.21.15.81:0/3630906989 conn(0x7f0f8c0fa8c0 msgr2=0x7f0f8c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.373+0000 7f0f927b2700 1 -- 172.21.15.81:0/3630906989 shutdown_connections 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.374+0000 7f0f927b2700 1 -- 172.21.15.81:0/3630906989 wait complete. 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.374+0000 7f0f927b2700 1 Processor -- start 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.374+0000 7f0f927b2700 1 -- start start 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f927b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f927b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 0x7f0f8c071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:30.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f927b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0683f0 con 0x7f0f8c100520 2024-09-18T12:52:30.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f927b2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c072470 con 0x7f0f8c0ff320 2024-09-18T12:52:30.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:30.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:36332/0 (socket says 172.21.15.81:36332) 2024-09-18T12:52:30.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f8bfff700 1 -- 172.21.15.81:0/3948275259 learned_addr learned my addr 172.21.15.81:0/3948275259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.375+0000 7f0f837fe700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 0x7f0f8c071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f8bfff700 1 -- 172.21.15.81:0/3948275259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 msgr2=0x7f0f8c071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f8bfff700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 0x7f0f8c071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f8bfff700 1 -- 172.21.15.81:0/3948275259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009d00 con 0x7f0f8c0ff320 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f8bfff700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009fd0 tx=0x7f0f7c003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7c00e040 con 0x7f0f8c0ff320 2024-09-18T12:52:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.376+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c0726f0 con 0x7f0f8c0ff320 2024-09-18T12:52:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.377+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c18d570 con 0x7f0f8c0ff320 2024-09-18T12:52:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.377+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f7c007e90 con 0x7f0f8c0ff320 2024-09-18T12:52:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.377+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7c0128c0 con 0x7f0f8c0ff320 2024-09-18T12:52:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.378+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c005320 con 0x7f0f8c0ff320 2024-09-18T12:52:30.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.380+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7f0f7c019070 con 0x7f0f8c0ff320 2024-09-18T12:52:30.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.380+0000 7f0f89ffb700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 0x7f0f7807d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:30.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.380+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0f7c09efd0 con 0x7f0f8c0ff320 2024-09-18T12:52:30.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.381+0000 7f0f837fe700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 0x7f0f7807d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.382+0000 7f0f837fe700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 0x7f0f7807d600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009a10 tx=0x7f0f74009190 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:30.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.385+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f0f7c062550 con 0x7f0f8c0ff320 2024-09-18T12:52:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.974+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f6c005cc0 con 0x7f0f8c0ff320 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.974+0000 7f0f89ffb700 1 -- 172.21.15.81:0/3948275259 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f0f7c065670 con 0x7f0f8c0ff320 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:52:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:52:30.977 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:52:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 msgr2=0x7f0f7807d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 0x7f0f7807d600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009a10 tx=0x7f0f74009190 comp rx=0 tx=0).stop 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 msgr2=0x7f0f8c067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009fd0 tx=0x7f0f7c003c30 comp rx=0 tx=0).stop 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 shutdown_connections 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f0f7807b140 0x7f0f7807d600 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f8c0ff320 0x7f0f8c067cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 --2- 172.21.15.81:0/3948275259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f8c100520 0x7f0f8c071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 >> 172.21.15.81:0/3948275259 conn(0x7f0f8c0fa8c0 msgr2=0x7f0f8c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 shutdown_connections 2024-09-18T12:52:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:30.978+0000 7f0f927b2700 1 -- 172.21.15.81:0/3948275259 wait complete. 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 -- 172.21.15.81:0/4061952016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 msgr2=0x7f94041002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 --2- 172.21.15.81:0/4061952016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94041002d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009910 tx=0x7f93f8009c20 comp rx=0 tx=0).stop 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 -- 172.21.15.81:0/4061952016 shutdown_connections 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 --2- 172.21.15.81:0/4061952016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94041002d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 --2- 172.21.15.81:0/4061952016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f9404101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 -- 172.21.15.81:0/4061952016 >> 172.21.15.81:0/4061952016 conn(0x7f94040fa8c0 msgr2=0x7f94040fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 -- 172.21.15.81:0/4061952016 shutdown_connections 2024-09-18T12:52:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.126+0000 7f9409386700 1 -- 172.21.15.81:0/4061952016 wait complete. 2024-09-18T12:52:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.127+0000 7f9409386700 1 Processor -- start 2024-09-18T12:52:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.127+0000 7f9409386700 1 -- start start 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9409386700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94040ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9409386700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9409386700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940419b810 con 0x7f94040ffe70 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9409386700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940419b950 con 0x7f9404101130 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9402ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94040ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f9402ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94040ff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44362/0 (socket says 172.21.15.81:44362) 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:36344/0 (socket says 172.21.15.81:36344) 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 -- 172.21.15.81:0/158060882 learned_addr learned my addr 172.21.15.81:0/158060882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 -- 172.21.15.81:0/158060882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 msgr2=0x7f94040ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94040ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.128+0000 7f94027fc700 1 -- 172.21.15.81:0/158060882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80095f0 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.129+0000 7f94027fc700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93f800f690 tx=0x7f93f800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.129+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f801d070 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.129+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f93f8005dc0 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.129+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404195010 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.129+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94041954a0 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.130+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f801d070 con 0x7f9404101130 2024-09-18T12:52:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.131+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404108710 con 0x7f9404101130 2024-09-18T12:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.132+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7f93f8003910 con 0x7f9404101130 2024-09-18T12:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.133+0000 7f93ebfff700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 0x7f93ec07d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.133+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f93f809eca0 con 0x7f9404101130 2024-09-18T12:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.133+0000 7f9402ffd700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 0x7f93ec07d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.134+0000 7f9402ffd700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 0x7f93ec07d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9404068b90 tx=0x7f93f4009260 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.137+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f93f80a3070 con 0x7f9404101130 2024-09-18T12:52:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.572+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9404195ba0 con 0x7f9404101130 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.572+0000 7f93ebfff700 1 -- 172.21.15.81:0/158060882 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f93f80621c0 con 0x7f9404101130 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:52:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:52:31.575 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:52:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:52:31.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:52:31.578 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 msgr2=0x7f93ec07d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 0x7f93ec07d5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9404068b90 tx=0x7f93f4009260 comp rx=0 tx=0).stop 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 msgr2=0x7f940419b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93f800f690 tx=0x7f93f800f6c0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 shutdown_connections 2024-09-18T12:52:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94040ffe70 0x7f94040ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7f93ec07b110 0x7f93ec07d5d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 --2- 172.21.15.81:0/158060882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9404101130 0x7f940419b240 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.578+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 >> 172.21.15.81:0/158060882 conn(0x7f94040fa8c0 msgr2=0x7f94041040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.579+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 shutdown_connections 2024-09-18T12:52:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.579+0000 7f9409386700 1 -- 172.21.15.81:0/158060882 wait complete. 2024-09-18T12:52:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:52:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.752+0000 7fd7c120d700 1 -- 172.21.15.81:0/4181686764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 msgr2=0x7fd7bc0fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.752+0000 7fd7c120d700 1 --2- 172.21.15.81:0/4181686764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc0fffd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009910 tx=0x7fd7ac009c20 comp rx=0 tx=0).stop 2024-09-18T12:52:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.752+0000 7fd7c120d700 1 -- 172.21.15.81:0/4181686764 shutdown_connections 2024-09-18T12:52:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.752+0000 7fd7c120d700 1 --2- 172.21.15.81:0/4181686764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 0x7fd7bc101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.752+0000 7fd7c120d700 1 --2- 172.21.15.81:0/4181686764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc0fffd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.754 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3948275259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:31.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:31 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.753+0000 7fd7c120d700 1 -- 172.21.15.81:0/4181686764 >> 172.21.15.81:0/4181686764 conn(0x7fd7bc0fb150 msgr2=0x7fd7bc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.753+0000 7fd7c120d700 1 -- 172.21.15.81:0/4181686764 shutdown_connections 2024-09-18T12:52:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.753+0000 7fd7c120d700 1 -- 172.21.15.81:0/4181686764 wait complete. 2024-09-18T12:52:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.754+0000 7fd7c120d700 1 Processor -- start 2024-09-18T12:52:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.755+0000 7fd7c120d700 1 -- start start 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.755+0000 7fd7c120d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.755+0000 7fd7c120d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 0x7fd7bc194780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7c120d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc194da0 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7c120d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc194ee0 con 0x7fd7bc100db0 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44392/0 (socket says 172.21.15.81:44392) 2024-09-18T12:52:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 -- 172.21.15.81:0/3969075268 learned_addr learned my addr 172.21.15.81:0/3969075268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7ba59c700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 0x7fd7bc194780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 -- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 msgr2=0x7fd7bc194780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 0x7fd7bc194780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.756+0000 7fd7bad9d700 1 -- 172.21.15.81:0/3969075268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0095f0 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7bad9d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000c00 tx=0x7fd7ac00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac01d070 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd7ac005dc0 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac022470 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc199930 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.757+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc199e20 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.758+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc107750 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.760+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7fd7ac003810 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.761+0000 7fd7a3fff700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 0x7fd7a407f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.761+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd7ac09f2e0 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.761+0000 7fd7ba59c700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 0x7fd7a407f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.761+0000 7fd7ba59c700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 0x7fd7a407f7c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009c60 tx=0x7fd7b0009260 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:31.770+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fd7ac0627e0 con 0x7fd7bc0ffbb0 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3948275259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:31.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:31 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.130+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 --> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7bc19a4f0 con 0x7fd7a407d300 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.132+0000 7fd7a3fff700 1 -- 172.21.15.81:0/3969075268 <== mgr.14700 v2:172.21.15.136:6828/434262887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd7bc19a4f0 con 0x7fd7a407d300 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-09-18T12:52:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:52:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "2/23 daemons upgraded", 2024-09-18T12:52:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:52:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:52:32.134 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:52:32.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 msgr2=0x7fd7a407f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 0x7fd7a407f7c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009c60 tx=0x7fd7b0009260 comp rx=0 tx=0).stop 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 msgr2=0x7fd7bc194240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000c00 tx=0x7fd7ac00f690 comp rx=0 tx=0).stop 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 shutdown_connections 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc0ffbb0 0x7fd7bc194240 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fd7a407d300 0x7fd7a407f7c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 --2- 172.21.15.81:0/3969075268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7bc100db0 0x7fd7bc194780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.135+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 >> 172.21.15.81:0/3969075268 conn(0x7fd7bc0fb150 msgr2=0x7fd7bc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.136+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 shutdown_connections 2024-09-18T12:52:32.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.136+0000 7fd7c120d700 1 -- 172.21.15.81:0/3969075268 wait complete. 2024-09-18T12:52:32.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 -- 172.21.15.81:0/1218993827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 msgr2=0x7fc2d01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/1218993827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01010d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009910 tx=0x7fc2cc009c20 comp rx=0 tx=0).stop 2024-09-18T12:52:32.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 -- 172.21.15.81:0/1218993827 shutdown_connections 2024-09-18T12:52:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/1218993827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 0x7fc2d0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/1218993827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01010d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 -- 172.21.15.81:0/1218993827 >> 172.21.15.81:0/1218993827 conn(0x7fc2d00fc230 msgr2=0x7fc2d00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 -- 172.21.15.81:0/1218993827 shutdown_connections 2024-09-18T12:52:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.270+0000 7fc2d77f4700 1 -- 172.21.15.81:0/1218993827 wait complete. 2024-09-18T12:52:32.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 Processor -- start 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 -- start start 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 0x7fc2d0196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0197020 con 0x7fc2d0100cb0 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d77f4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0197160 con 0x7fc2d0101eb0 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44408/0 (socket says 172.21.15.81:44408) 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 -- 172.21.15.81:0/2394131471 learned_addr learned my addr 172.21.15.81:0/2394131471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:52:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d4d8f700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 0x7fc2d0196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 -- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 msgr2=0x7fc2d0196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 0x7fc2d0196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 -- 172.21.15.81:0/2394131471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0095f0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.271+0000 7fc2d5590700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00bd70 tx=0x7fc2cc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.272+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc01d070 con 0x7fc2d0100cb0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.272+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2cc00f460 con 0x7fc2d0100cb0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.272+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d019bbb0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.272+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc021640 con 0x7fc2d0100cb0 2024-09-18T12:52:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.272+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d019c0a0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.273+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d0109810 con 0x7fc2d0100cb0 2024-09-18T12:52:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.274+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 103277+0+0 (secure 0 0 0) 0x7fc2cc00fa90 con 0x7fc2d0100cb0 2024-09-18T12:52:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.275+0000 7fc2c67fc700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 0x7fc2bc07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.275+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc2cc09f0b0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.276+0000 7fc2d4d8f700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 0x7fc2bc07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.276+0000 7fc2d4d8f700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 0x7fc2bc07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0005950 tx=0x7fc2c00058e0 comp rx=0 tx=0).ready entity=mgr.14700 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.281+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fc2cc0625d0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.782+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc2d019ca60 con 0x7fc2d0100cb0 2024-09-18T12:52:32.784 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:32 smithi081 ceph-mon[27646]: pgmap v35: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 313 op/s 2024-09-18T12:52:32.785 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:32 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/158060882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:52:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.783+0000 7fc2c67fc700 1 -- 172.21.15.81:0/2394131471 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc2cc0656f0 con 0x7fc2d0100cb0 2024-09-18T12:52:32.785 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 msgr2=0x7fc2bc07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 0x7fc2bc07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0005950 tx=0x7fc2c00058e0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 msgr2=0x7fc2d01964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00bd70 tx=0x7fc2cc00be50 comp rx=0 tx=0).stop 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 shutdown_connections 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2d0100cb0 0x7fc2d01964c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:6828/434262887,v1:172.21.15.136:6829/434262887] conn(0x7fc2bc07b0b0 0x7fc2bc07d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 --2- 172.21.15.81:0/2394131471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d0101eb0 0x7fc2d0196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 >> 172.21.15.81:0/2394131471 conn(0x7fc2d00fc230 msgr2=0x7fc2d01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.785+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 shutdown_connections 2024-09-18T12:52:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:52:32.786+0000 7fc2d77f4700 1 -- 172.21.15.81:0/2394131471 wait complete. 2024-09-18T12:52:32.813 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:32 smithi136 ceph-mon[35363]: pgmap v35: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 313 op/s 2024-09-18T12:52:32.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:32 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/158060882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:52:33.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:33 smithi136 ceph-mon[35363]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:33.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:33 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/2394131471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:52:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:33 smithi081 ceph-mon[27646]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:33.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:33 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/2394131471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:52:34.682 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:34 smithi081 ceph-mon[27646]: pgmap v36: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 313 op/s 2024-09-18T12:52:34.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:34 smithi136 ceph-mon[35363]: pgmap v36: 65 pgs: 65 active+clean; 336 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 313 op/s 2024-09-18T12:52:36.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:36 smithi081 ceph-mon[27646]: pgmap v37: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 2.9 MiB/s wr, 539 op/s 2024-09-18T12:52:36.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:36 smithi136 ceph-mon[35363]: pgmap v37: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 2.9 MiB/s wr, 539 op/s 2024-09-18T12:52:38.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:38 smithi136 ceph-mon[35363]: pgmap v38: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-18T12:52:38.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:38 smithi081 ceph-mon[27646]: pgmap v38: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-18T12:52:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:39 smithi081 ceph-mon[27646]: pgmap v39: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 64 KiB/s rd, 2.8 MiB/s wr, 645 op/s 2024-09-18T12:52:40.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:39 smithi136 ceph-mon[35363]: pgmap v39: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 64 KiB/s rd, 2.8 MiB/s wr, 645 op/s 2024-09-18T12:52:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:42 smithi136 ceph-mon[35363]: pgmap v40: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 425 op/s 2024-09-18T12:52:42.314 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:42 smithi081 ceph-mon[27646]: pgmap v40: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 425 op/s 2024-09-18T12:52:43.171 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-18T12:52:43.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-18T12:52:43.466 DEBUG:teuthology.parallel:result is None 2024-09-18T12:52:44.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:44.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:44.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: osdmap e49: 6 total, 6 up, 6 in 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd='[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]': finished 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: mgrmap e27: smithi081.pfnvgp(active, starting, since 0.00731608s) 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:52:44.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:52:44.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:52:44.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:44 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:52:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 172.21.15.136:0/4121244088' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: osdmap e49: 6 total, 6 up, 6 in 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14700 ' entity='mgr.smithi136.vdkrdt' cmd='[{"prefix": "mgr fail", "who": "smithi136.vdkrdt"}]': finished 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: mgrmap e27: smithi081.pfnvgp(active, starting, since 0.00731608s) 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"}]: dispatch 2024-09-18T12:52:44.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:52:44.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:52:44.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:44 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"}]: dispatch 2024-09-18T12:52:45.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:45 smithi136 ceph-mon[35363]: mgrmap e28: smithi081.pfnvgp(active, since 1.01081s) 2024-09-18T12:52:45.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:45 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:45.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:45 smithi136 ceph-mon[35363]: pgmap v3: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:45.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:45 smithi081 ceph-mon[27646]: mgrmap e28: smithi081.pfnvgp(active, since 1.01081s) 2024-09-18T12:52:45.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:45 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:45.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:45 smithi081 ceph-mon[27646]: pgmap v3: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:46.756 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:46 smithi136 ceph-mon[35363]: [18/Sep/2024:12:52:45] ENGINE Bus STARTING 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:46 smithi136 ceph-mon[35363]: [18/Sep/2024:12:52:45] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:46 smithi136 ceph-mon[35363]: [18/Sep/2024:12:52:45] ENGINE Error in HTTPServer.serve 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Traceback (most recent call last): 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._run(expiration_interval) 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:52:46.757 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s = self.context.wrap_socket( 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: return self.sslsocket_class._create( 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self.do_handshake() 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._sslobj.do_handshake() 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:46 smithi136 ceph-mon[35363]: [18/Sep/2024:12:52:45] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:52:46.758 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:46 smithi136 ceph-mon[35363]: [18/Sep/2024:12:52:45] ENGINE Bus STARTED 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:46 smithi081 ceph-mon[27646]: [18/Sep/2024:12:52:45] ENGINE Bus STARTING 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:46 smithi081 ceph-mon[27646]: [18/Sep/2024:12:52:45] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:46 smithi081 ceph-mon[27646]: [18/Sep/2024:12:52:45] ENGINE Error in HTTPServer.serve 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Traceback (most recent call last): 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._run(expiration_interval) 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:52:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s = self.context.wrap_socket( 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: return self.sslsocket_class._create( 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self.do_handshake() 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._sslobj.do_handshake() 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:46 smithi081 ceph-mon[27646]: [18/Sep/2024:12:52:45] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:52:46.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:46 smithi081 ceph-mon[27646]: [18/Sep/2024:12:52:45] ENGINE Bus STARTED 2024-09-18T12:52:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:47 smithi136 ceph-mon[35363]: mgrmap e29: smithi081.pfnvgp(active, since 3s) 2024-09-18T12:52:47.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:47 smithi081 ceph-mon[27646]: mgrmap e29: smithi081.pfnvgp(active, since 3s) 2024-09-18T12:52:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:48 smithi136 ceph-mon[35363]: pgmap v5: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:48 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:48 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:48 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:48 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:48 smithi081 ceph-mon[27646]: pgmap v5: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:48 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:48 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:48 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:48.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:48 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: mgrmap e30: smithi081.pfnvgp(active, since 5s) 2024-09-18T12:52:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:52:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:52:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:52:49.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:49 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: mgrmap e30: smithi081.pfnvgp(active, since 5s) 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:52:49.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:49 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/1165952384' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:50 smithi081 ceph-mon[27646]: pgmap v6: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 22 op/s 2024-09-18T12:52:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:50 smithi081 ceph-mon[27646]: mgrmap e31: smithi081.pfnvgp(active, since 6s), standbys: smithi136.vdkrdt 2024-09-18T12:52:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:50 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:50 smithi136 ceph-mon[35363]: pgmap v6: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 22 op/s 2024-09-18T12:52:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:50 smithi136 ceph-mon[35363]: mgrmap e31: smithi081.pfnvgp(active, since 6s), standbys: smithi136.vdkrdt 2024-09-18T12:52:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:50 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"}]: dispatch 2024-09-18T12:52:53.092 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:52 smithi081 ceph-mon[27646]: pgmap v7: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.1 MiB/s wr, 239 op/s 2024-09-18T12:52:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:52 smithi136 ceph-mon[35363]: pgmap v7: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.1 MiB/s wr, 239 op/s 2024-09-18T12:52:54.868 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:54 smithi081 ceph-mon[27646]: pgmap v8: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 839 KiB/s wr, 186 op/s 2024-09-18T12:52:55.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:54 smithi136 ceph-mon[35363]: pgmap v8: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 839 KiB/s wr, 186 op/s 2024-09-18T12:52:56.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:56 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:56 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:56 smithi081 ceph-mon[27646]: pgmap v9: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 298 op/s 2024-09-18T12:52:56.507 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:56 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.507 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:56 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:56 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:56 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:56 smithi136 ceph-mon[35363]: pgmap v9: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 298 op/s 2024-09-18T12:52:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:56 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:56.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:56 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:52:57.145 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-18T12:52:57.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T12:52:57.481 DEBUG:teuthology.parallel:result is None 2024-09-18T12:52:57.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:52:57.520 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:52:57.520 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:52:57.553 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:52:57.553 DEBUG:teuthology.parallel:result is None 2024-09-18T12:52:58.800 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:58 smithi081 ceph-mon[27646]: pgmap v10: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 273 op/s 2024-09-18T12:52:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:58 smithi136 ceph-mon[35363]: pgmap v10: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 273 op/s 2024-09-18T12:53:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:59 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:59 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:59 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:59 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:52:59 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:59 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:59 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:59 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:59 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:52:59 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 282 op/s 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:01.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:01.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:00 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.162 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 282 op/s 2024-09-18T12:53:01.162 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:53:01.162 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:53:01.162 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:01.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:00 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:02.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:01 smithi081 ceph-mon[27646]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:02.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:01 smithi081 ceph-mon[27646]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:02.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:01 smithi081 ceph-mon[27646]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:53:02.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:01 smithi081 ceph-mon[27646]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:53:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:01 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:01 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:01 smithi136 ceph-mon[35363]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-09-18T12:53:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:01 smithi136 ceph-mon[35363]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-09-18T12:53:02.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 -- 172.21.15.81:0/180860498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c100520 msgr2=0x7fb98c100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 --2- 172.21.15.81:0/180860498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c100520 0x7fb98c100980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb980009910 tx=0x7fb980009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 -- 172.21.15.81:0/180860498 shutdown_connections 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 --2- 172.21.15.81:0/180860498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c100520 0x7fb98c100980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 --2- 172.21.15.81:0/180860498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c0ff320 0x7fb98c0ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.907+0000 7fb99341f700 1 -- 172.21.15.81:0/180860498 >> 172.21.15.81:0/180860498 conn(0x7fb98c0fa8c0 msgr2=0x7fb98c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 -- 172.21.15.81:0/180860498 shutdown_connections 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 -- 172.21.15.81:0/180860498 wait complete. 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 Processor -- start 2024-09-18T12:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 -- start start 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c100520 0x7fb98c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c19b710 con 0x7fb98c0ff320 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb99341f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c19b880 con 0x7fb98c100520 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb9911bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb9911bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38610/0 (socket says 172.21.15.81:38610) 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.908+0000 7fb9911bb700 1 -- 172.21.15.81:0/2283196590 learned_addr learned my addr 172.21.15.81:0/2283196590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb9909ba700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c100520 0x7fb98c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb9911bb700 1 -- 172.21.15.81:0/2283196590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c100520 msgr2=0x7fb98c19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb9911bb700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c100520 0x7fb98c19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb9911bb700 1 -- 172.21.15.81:0/2283196590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800095f0 con 0x7fb98c0ff320 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb9911bb700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c910 tx=0x7fb98800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9880041f0 con 0x7fb98c0ff320 2024-09-18T12:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb98800ce60 con 0x7fb98c0ff320 2024-09-18T12:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c19bb60 con 0x7fb98c0ff320 2024-09-18T12:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb988003d20 con 0x7fb98c0ff320 2024-09-18T12:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.909+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c19c080 con 0x7fb98c0ff320 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.910+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c107e80 con 0x7fb98c0ff320 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.911+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7fb988007900 con 0x7fb98c0ff320 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.911+0000 7fb97e7fc700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 0x7fb97807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.912+0000 7fb9909ba700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 0x7fb97807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.912+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb98809db40 con 0x7fb98c0ff320 2024-09-18T12:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.912+0000 7fb9909ba700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 0x7fb97807d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb98000b5c0 tx=0x7fb9800052a0 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:02.916+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fb988060f90 con 0x7fb98c0ff320 2024-09-18T12:53:03.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:02 smithi081 ceph-mon[27646]: pgmap v12: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.4 MiB/s wr, 359 op/s 2024-09-18T12:53:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.149+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 --> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb98c104860 con 0x7fb97807b0b0 2024-09-18T12:53:03.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.150+0000 7fb97e7fc700 1 -- 172.21.15.81:0/2283196590 <== mgr.14778 v2:172.21.15.81:6800/1484526618 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb98c104860 con 0x7fb97807b0b0 2024-09-18T12:53:03.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 msgr2=0x7fb97807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 0x7fb97807d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb98000b5c0 tx=0x7fb9800052a0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 msgr2=0x7fb98c1022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c910 tx=0x7fb98800cc20 comp rx=0 tx=0).stop 2024-09-18T12:53:03.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 shutdown_connections 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb97807b0b0 0x7fb97807d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb98c0ff320 0x7fb98c1022c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 --2- 172.21.15.81:0/2283196590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb98c100520 0x7fb98c19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 >> 172.21.15.81:0/2283196590 conn(0x7fb98c0fa8c0 msgr2=0x7fb98c0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 shutdown_connections 2024-09-18T12:53:03.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.153+0000 7fb99341f700 1 -- 172.21.15.81:0/2283196590 wait complete. 2024-09-18T12:53:03.165 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:53:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 -- 172.21.15.81:0/4171219227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 msgr2=0x7fb92c102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 --2- 172.21.15.81:0/4171219227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c102310 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009910 tx=0x7fb91c009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 -- 172.21.15.81:0/4171219227 shutdown_connections 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 --2- 172.21.15.81:0/4171219227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c102310 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 --2- 172.21.15.81:0/4171219227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 0x7fb92c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 -- 172.21.15.81:0/4171219227 >> 172.21.15.81:0/4171219227 conn(0x7fb92c0fc230 msgr2=0x7fb92c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 -- 172.21.15.81:0/4171219227 shutdown_connections 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 -- 172.21.15.81:0/4171219227 wait complete. 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.259+0000 7fb930d43700 1 Processor -- start 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 -- start start 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 0x7fb92c1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c196fb0 con 0x7fb92c101eb0 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c1970f0 con 0x7fb92c100cb0 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38638/0 (socket says 172.21.15.81:38638) 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 -- 172.21.15.81:0/3547200398 learned_addr learned my addr 172.21.15.81:0/3547200398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb92a59c700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 0x7fb92c1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 -- 172.21.15.81:0/3547200398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 msgr2=0x7fb92c1964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 0x7fb92c1964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 -- 172.21.15.81:0/3547200398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0095f0 con 0x7fb92c101eb0 2024-09-18T12:53:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb929d9b700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00bd70 tx=0x7fb91c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c01d070 con 0x7fb92c101eb0 2024-09-18T12:53:03.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c19bb50 con 0x7fb92c101eb0 2024-09-18T12:53:03.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb91c005940 con 0x7fb92c101eb0 2024-09-18T12:53:03.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.260+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c021430 con 0x7fb92c101eb0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.261+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c19c010 con 0x7fb92c101eb0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.261+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c109810 con 0x7fb92c101eb0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.262+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7fb91c00f860 con 0x7fb92c101eb0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.263+0000 7fb91b7fe700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 0x7fb91407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.263+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb91c09f300 con 0x7fb92c101eb0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.263+0000 7fb92a59c700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 0x7fb91407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.263+0000 7fb92a59c700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 0x7fb91407d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb92c101d10 tx=0x7fb92000a3b0 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.267+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7fb91c0626d0 con 0x7fb92c101eb0 2024-09-18T12:53:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:02 smithi136 ceph-mon[35363]: pgmap v12: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.4 MiB/s wr, 359 op/s 2024-09-18T12:53:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.497+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 --> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb92c106800 con 0x7fb91407b0b0 2024-09-18T12:53:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.498+0000 7fb91b7fe700 1 -- 172.21.15.81:0/3547200398 <== mgr.14778 v2:172.21.15.81:6800/1484526618 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb92c106800 con 0x7fb91407b0b0 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 msgr2=0x7fb91407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 0x7fb91407d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb92c101d10 tx=0x7fb92000a3b0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 msgr2=0x7fb92c196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00bd70 tx=0x7fb91c00bda0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 shutdown_connections 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c100cb0 0x7fb92c1964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7fb91407b0b0 0x7fb91407d570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 --2- 172.21.15.81:0/3547200398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb92c101eb0 0x7fb92c196a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.500+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 >> 172.21.15.81:0/3547200398 conn(0x7fb92c0fc230 msgr2=0x7fb92c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.501+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 shutdown_connections 2024-09-18T12:53:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.501+0000 7fb930d43700 1 -- 172.21.15.81:0/3547200398 wait complete. 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.606+0000 7f6cdc870700 1 -- 172.21.15.81:0/2287697957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8100cb0 msgr2=0x7f6cd81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.606+0000 7f6cdc870700 1 --2- 172.21.15.81:0/2287697957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81010d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009910 tx=0x7f6cc8009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 -- 172.21.15.81:0/2287697957 shutdown_connections 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 --2- 172.21.15.81:0/2287697957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 --2- 172.21.15.81:0/2287697957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81010d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 -- 172.21.15.81:0/2287697957 >> 172.21.15.81:0/2287697957 conn(0x7f6cd80fc230 msgr2=0x7f6cd80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 -- 172.21.15.81:0/2287697957 shutdown_connections 2024-09-18T12:53:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 -- 172.21.15.81:0/2287697957 wait complete. 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 Processor -- start 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 -- start start 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.607+0000 7f6cdc870700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cdc870700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8199250 con 0x7f6cd8101eb0 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cdc870700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8199390 con 0x7f6cd8100cb0 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38666/0 (socket says 172.21.15.81:38666) 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 -- 172.21.15.81:0/3642260573 learned_addr learned my addr 172.21.15.81:0/3642260573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd659c700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 -- 172.21.15.81:0/3642260573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8100cb0 msgr2=0x7f6cd81986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 -- 172.21.15.81:0/3642260573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80095f0 con 0x7f6cd8101eb0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cd5d9b700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00d8d0 tx=0x7f6ccc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc0098a0 con 0x7f6cd8101eb0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ccc010460 con 0x7f6cd8101eb0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd819de40 con 0x7f6cd8101eb0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc00f5f0 con 0x7f6cd8101eb0 2024-09-18T12:53:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.608+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd819e360 con 0x7f6cd8101eb0 2024-09-18T12:53:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.609+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd8105f90 con 0x7f6cd8101eb0 2024-09-18T12:53:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.610+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7f6ccc009a00 con 0x7f6cd8101eb0 2024-09-18T12:53:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.610+0000 7f6cc77fe700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 0x7f6cc007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.611+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f6ccc09ddd0 con 0x7f6cd8101eb0 2024-09-18T12:53:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.611+0000 7f6cd659c700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 0x7f6cc007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.611+0000 7f6cd659c700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 0x7f6cc007d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc800b540 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.615+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f6ccc0611a0 con 0x7f6cd8101eb0 2024-09-18T12:53:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.834+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 --> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd80611d0 con 0x7f6cc007b0b0 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.845+0000 7f6cc77fe700 1 -- 172.21.15.81:0/3642260573 <== mgr.14778 v2:172.21.15.81:6800/1484526618 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f6cd80611d0 con 0x7f6cc007b0b0 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (8m) 8s ago 10m 25.2M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (74s) 8s ago 10m 7444k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (63s) 16s ago 9m 7147k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (10m) 8s ago 10m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:53:03.846 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (9m) 16s ago 9m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (8m) 8s ago 10m 85.5M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (4m) 8s ago 4m 148M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (4m) 8s ago 4m 141M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (4m) 16s ago 4m 18.3M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (4m) 16s ago 4m 14.2M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (58s) 8s ago 11m 489M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (113s) 16s ago 9m 127M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1a0b20067729 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (12m) 8s ago 12m 55.7M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (9m) 16s ago 9m 45.2M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (10m) 8s ago 10m 16.1M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (9m) 16s ago 9m 14.6M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 8s ago 8m 239M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 8s ago 7m 241M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:53:03.847 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 8s ago 7m 186M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:53:03.848 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (6m) 16s ago 6m 279M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:53:03.848 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (6m) 16s ago 6m 235M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:53:03.848 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (5m) 16s ago 5m 221M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:53:03.848 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (67s) 8s ago 10m 55.8M - 2.43.0 a07b618ecd1d c9b08c5e73e9 2024-09-18T12:53:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 msgr2=0x7f6cc007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 0x7f6cc007d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc800b540 comp rx=0 tx=0).stop 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 msgr2=0x7f6cd8198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00d8d0 tx=0x7f6ccc00dbe0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 shutdown_connections 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cd8100cb0 0x7f6cd81986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f6cc007b0b0 0x7f6cc007d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 --2- 172.21.15.81:0/3642260573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd8101eb0 0x7f6cd8198c30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 >> 172.21.15.81:0/3642260573 conn(0x7f6cd80fc230 msgr2=0x7f6cd81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 shutdown_connections 2024-09-18T12:53:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.847+0000 7f6cdc870700 1 -- 172.21.15.81:0/3642260573 wait complete. 2024-09-18T12:53:03.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 -- 172.21.15.81:0/615319818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4101ea0 msgr2=0x7f96b4102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 --2- 172.21.15.81:0/615319818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4101ea0 0x7f96b4102300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009910 tx=0x7f96a8009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:03.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 -- 172.21.15.81:0/615319818 shutdown_connections 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 --2- 172.21.15.81:0/615319818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4101ea0 0x7f96b4102300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 --2- 172.21.15.81:0/615319818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4100ca0 0x7f96b41010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 -- 172.21.15.81:0/615319818 >> 172.21.15.81:0/615319818 conn(0x7f96b40fc260 msgr2=0x7f96b40fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 -- 172.21.15.81:0/615319818 shutdown_connections 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.950+0000 7f96b99ec700 1 -- 172.21.15.81:0/615319818 wait complete. 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 Processor -- start 2024-09-18T12:53:03.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 -- start start 2024-09-18T12:53:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4101ea0 0x7f96b4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4197040 con 0x7f96b4100ca0 2024-09-18T12:53:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.951+0000 7f96b99ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4197180 con 0x7f96b4101ea0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38680/0 (socket says 172.21.15.81:38680) 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 -- 172.21.15.81:0/1764519809 learned_addr learned my addr 172.21.15.81:0/1764519809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b27fc700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4101ea0 0x7f96b4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 -- 172.21.15.81:0/1764519809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4101ea0 msgr2=0x7f96b4196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4101ea0 0x7f96b4196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 -- 172.21.15.81:0/1764519809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80095f0 con 0x7f96b4100ca0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b2ffd700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c8f0 tx=0x7f96a400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a40078e0 con 0x7f96b4100ca0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f96a400f450 con 0x7f96b4100ca0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b419bc30 con 0x7f96b4100ca0 2024-09-18T12:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a4018610 con 0x7f96b4100ca0 2024-09-18T12:53:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.952+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b419c180 con 0x7f96b4100ca0 2024-09-18T12:53:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.953+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b4109800 con 0x7f96b4100ca0 2024-09-18T12:53:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.954+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7f96a400f5c0 con 0x7f96b4100ca0 2024-09-18T12:53:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.955+0000 7f96b89ea700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 0x7f969c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.955+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f96a409de40 con 0x7f96b4100ca0 2024-09-18T12:53:03.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.955+0000 7f96b27fc700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 0x7f969c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.956+0000 7f96b27fc700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 0x7f969c07d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006010 tx=0x7f96a800b540 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:03.960+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f96a4061210 con 0x7f96b4100ca0 2024-09-18T12:53:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.286+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96b419c790 con 0x7f96b4100ca0 2024-09-18T12:53:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.286+0000 7f96b89ea700 1 -- 172.21.15.81:0/1764519809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f96a4064330 con 0x7f96b4100ca0 2024-09-18T12:53:04.288 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:04.289 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 msgr2=0x7f969c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 0x7f969c07d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006010 tx=0x7f96a800b540 comp rx=0 tx=0).stop 2024-09-18T12:53:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 msgr2=0x7f96b41964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c8f0 tx=0x7f96a400cc00 comp rx=0 tx=0).stop 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 shutdown_connections 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f969c07b0b0 0x7f969c07d570 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96b4100ca0 0x7f96b41964e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 --2- 172.21.15.81:0/1764519809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b4101ea0 0x7f96b4196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 >> 172.21.15.81:0/1764519809 conn(0x7f96b40fc260 msgr2=0x7f96b41050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 shutdown_connections 2024-09-18T12:53:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.289+0000 7f96b99ec700 1 -- 172.21.15.81:0/1764519809 wait complete. 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 -- 172.21.15.81:0/1142638895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 msgr2=0x7f84ec102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1142638895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec102310 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009910 tx=0x7f84d4009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 -- 172.21.15.81:0/1142638895 shutdown_connections 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1142638895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec102310 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1142638895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 0x7f84ec1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 -- 172.21.15.81:0/1142638895 >> 172.21.15.81:0/1142638895 conn(0x7f84ec0fc230 msgr2=0x7f84ec0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 -- 172.21.15.81:0/1142638895 shutdown_connections 2024-09-18T12:53:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.398+0000 7f84f11a0700 1 -- 172.21.15.81:0/1142638895 wait complete. 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 Processor -- start 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 -- start start 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 0x7f84ec1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec197050 con 0x7f84ec101eb0 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84f11a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec197190 con 0x7f84ec100cb0 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38710/0 (socket says 172.21.15.81:38710) 2024-09-18T12:53:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84e259c700 1 -- 172.21.15.81:0/1879949729 learned_addr learned my addr 172.21.15.81:0/1879949729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.399+0000 7f84ead9d700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 0x7f84ec1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e259c700 1 -- 172.21.15.81:0/1879949729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 msgr2=0x7f84ec1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e259c700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 0x7f84ec1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e259c700 1 -- 172.21.15.81:0/1879949729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40095f0 con 0x7f84ec101eb0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e259c700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84d4006010 tx=0x7f84d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d401d070 con 0x7f84ec101eb0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec19bbe0 con 0x7f84ec101eb0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84d400f460 con 0x7f84ec101eb0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d4021640 con 0x7f84ec101eb0 2024-09-18T12:53:04.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.400+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec19c0d0 con 0x7f84ec101eb0 2024-09-18T12:53:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.401+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec109810 con 0x7f84ec101eb0 2024-09-18T12:53:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.402+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7f84d400fab0 con 0x7f84ec101eb0 2024-09-18T12:53:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.402+0000 7f84e8d99700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 0x7f84d807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.402+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f84d409f2a0 con 0x7f84ec101eb0 2024-09-18T12:53:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.402+0000 7f84ead9d700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 0x7f84d807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.403+0000 7f84ead9d700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 0x7f84d807d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84ec101d10 tx=0x7f84dc00a380 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.407+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f84d4062670 con 0x7f84ec101eb0 2024-09-18T12:53:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.664+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f84ec19c6e0 con 0x7f84ec101eb0 2024-09-18T12:53:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.664+0000 7f84e8d99700 1 -- 172.21.15.81:0/1879949729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f84d4065790 con 0x7f84ec101eb0 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:53:04.666 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:53:04.667 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:04.669 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:53:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:04.669 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:04.669 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 msgr2=0x7f84d807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 0x7f84d807d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84ec101d10 tx=0x7f84dc00a380 comp rx=0 tx=0).stop 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 msgr2=0x7f84ec196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84d4006010 tx=0x7f84d400bd70 comp rx=0 tx=0).stop 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 shutdown_connections 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84ec100cb0 0x7f84ec1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f84d807b0b0 0x7f84d807d570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 --2- 172.21.15.81:0/1879949729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec101eb0 0x7f84ec196a30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.666+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 >> 172.21.15.81:0/1879949729 conn(0x7f84ec0fc230 msgr2=0x7f84ec1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.667+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 shutdown_connections 2024-09-18T12:53:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.667+0000 7f84f11a0700 1 -- 172.21.15.81:0/1879949729 wait complete. 2024-09-18T12:53:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:53:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 -- 172.21.15.81:0/2924240920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0100ca0 msgr2=0x7f83a01010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 --2- 172.21.15.81:0/2924240920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0100ca0 0x7f83a01010c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f839c00b0a0 tx=0x7f839c00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 -- 172.21.15.81:0/2924240920 shutdown_connections 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 --2- 172.21.15.81:0/2924240920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83a0101ea0 0x7f83a0102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 --2- 172.21.15.81:0/2924240920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0100ca0 0x7f83a01010c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 -- 172.21.15.81:0/2924240920 >> 172.21.15.81:0/2924240920 conn(0x7f83a00fc260 msgr2=0x7f83a00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 -- 172.21.15.81:0/2924240920 shutdown_connections 2024-09-18T12:53:04.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.771+0000 7f83a7789700 1 -- 172.21.15.81:0/2924240920 wait complete. 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 Processor -- start 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 -- start start 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83a0100ca0 0x7f83a0074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00736c0 con 0x7f83a0101ea0 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a7789700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0073800 con 0x7f83a0100ca0 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38726/0 (socket says 172.21.15.81:38726) 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 -- 172.21.15.81:0/2249235660 learned_addr learned my addr 172.21.15.81:0/2249235660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 -- 172.21.15.81:0/2249235660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83a0100ca0 msgr2=0x7f83a0074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83a0100ca0 0x7f83a0074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 -- 172.21.15.81:0/2249235660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009d00 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.772+0000 7f83a4d24700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f839000d8d0 tx=0x7f839000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.773+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8390009940 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.773+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8390010460 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.773+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a0073ae0 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.773+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f839000f5f0 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.773+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a019e530 con 0x7f83a0101ea0 2024-09-18T12:53:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.774+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0109800 con 0x7f83a0101ea0 2024-09-18T12:53:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.774+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7f83900105d0 con 0x7f83a0101ea0 2024-09-18T12:53:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.775+0000 7f83967fc700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 0x7f838c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.775+0000 7f83a5525700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 0x7f838c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.775+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f839009de70 con 0x7f83a0101ea0 2024-09-18T12:53:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.775+0000 7f83a5525700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 0x7f838c07d570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f839c0077b0 tx=0x7f839c006000 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:04.780+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f83900612c0 con 0x7f83a0101ea0 2024-09-18T12:53:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.048+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 --> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a01067f0 con 0x7f838c07b0b0 2024-09-18T12:53:05.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.049+0000 7f83967fc700 1 -- 172.21.15.81:0/2249235660 <== mgr.14778 v2:172.21.15.81:6800/1484526618 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f83a01067f0 con 0x7f838c07b0b0 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "2/23 daemons upgraded", 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:53:05.051 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 msgr2=0x7f838c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 0x7f838c07d570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f839c0077b0 tx=0x7f839c006000 comp rx=0 tx=0).stop 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 msgr2=0x7f83a0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f839000d8d0 tx=0x7f839000dc90 comp rx=0 tx=0).stop 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 shutdown_connections 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83a0100ca0 0x7f83a0074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f838c07b0b0 0x7f838c07d570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 --2- 172.21.15.81:0/2249235660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a0101ea0 0x7f83a0073180 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.052+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 >> 172.21.15.81:0/2249235660 conn(0x7f83a00fc260 msgr2=0x7f83a01050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.053+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 shutdown_connections 2024-09-18T12:53:05.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.053+0000 7f83a7789700 1 -- 172.21.15.81:0/2249235660 wait complete. 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: pgmap v13: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 852 KiB/s wr, 229 op/s 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1764519809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:05.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:04 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/1879949729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:53:05.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 -- 172.21.15.81:0/4021881900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 msgr2=0x7f1370102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 --2- 172.21.15.81:0/4021881900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370102300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1364009910 tx=0x7f1364009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 -- 172.21.15.81:0/4021881900 shutdown_connections 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 --2- 172.21.15.81:0/4021881900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370102300 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 --2- 172.21.15.81:0/4021881900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 0x7f13701010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 -- 172.21.15.81:0/4021881900 >> 172.21.15.81:0/4021881900 conn(0x7f13700fc260 msgr2=0x7f13700fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 -- 172.21.15.81:0/4021881900 shutdown_connections 2024-09-18T12:53:05.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.163+0000 7f137629c700 1 -- 172.21.15.81:0/4021881900 wait complete. 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 Processor -- start 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 -- start start 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 0x7f1370196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370197080 con 0x7f1370101ea0 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f137629c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13701971c0 con 0x7f1370100ca0 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.164+0000 7f136f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38744/0 (socket says 172.21.15.81:38744) 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 -- 172.21.15.81:0/3367713631 learned_addr learned my addr 172.21.15.81:0/3367713631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136ffff700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 0x7f1370196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 -- 172.21.15.81:0/3367713631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 msgr2=0x7f1370196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 0x7f1370196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 -- 172.21.15.81:0/3367713631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640095f0 con 0x7f1370101ea0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136f7fe700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1364006010 tx=0x7f136400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136401d070 con 0x7f1370101ea0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137019bc10 con 0x7f1370101ea0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f136400f460 con 0x7f1370101ea0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1364021640 con 0x7f1370101ea0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.165+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137019c100 con 0x7f1370101ea0 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.166+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13701098a0 con 0x7f1370101ea0 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.167+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 103275+0+0 (secure 0 0 0) 0x7f136400fab0 con 0x7f1370101ea0 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.168+0000 7f136d7fa700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 0x7f135807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.168+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f136409f320 con 0x7f1370101ea0 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.168+0000 7f136ffff700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 0x7f135807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.168+0000 7f136ffff700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 0x7f135807d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1370101d00 tx=0x7f1360009190 comp rx=0 tx=0).ready entity=mgr.14778 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.173+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193678 (secure 0 0 0) 0x7f13640626f0 con 0x7f1370101ea0 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: pgmap v13: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 852 KiB/s wr, 229 op/s 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1764519809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:04 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1879949729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:53:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.499+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1370109a90 con 0x7f1370101ea0 2024-09-18T12:53:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.500+0000 7f136d7fa700 1 -- 172.21.15.81:0/3367713631 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1364065810 con 0x7f1370101ea0 2024-09-18T12:53:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:53:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 msgr2=0x7f135807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 0x7f135807d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1370101d00 tx=0x7f1360009190 comp rx=0 tx=0).stop 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 msgr2=0x7f1370196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1364006010 tx=0x7f136400bd70 comp rx=0 tx=0).stop 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 shutdown_connections 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1370100ca0 0x7f1370196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:6800/1484526618,v1:172.21.15.81:6801/1484526618] conn(0x7f135807b0b0 0x7f135807d570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 --2- 172.21.15.81:0/3367713631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370101ea0 0x7f1370196a60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 >> 172.21.15.81:0/3367713631 conn(0x7f13700fc260 msgr2=0x7f13701050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 shutdown_connections 2024-09-18T12:53:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:05.502+0000 7f137629c700 1 -- 172.21.15.81:0/3367713631 wait complete. 2024-09-18T12:53:06.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:05 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3367713631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:53:06.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:05 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:06.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:05 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:06.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:05 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:06.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:05 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:06.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:05 smithi081 ceph-mon[27646]: from='client.? 172.21.15.81:0/3367713631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:53:06.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:05 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:06.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:05 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:06.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:05 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:06.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:05 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:06 smithi136 ceph-mon[35363]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:06 smithi136 ceph-mon[35363]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 853 KiB/s wr, 230 op/s 2024-09-18T12:53:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:06 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:06 smithi081 ceph-mon[27646]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:06 smithi081 ceph-mon[27646]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 853 KiB/s wr, 230 op/s 2024-09-18T12:53:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:06 smithi081 ceph-mon[27646]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:07 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:53:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:07 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:53:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:07 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:07 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:53:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:07 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:53:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:07 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:08 smithi136 ceph-mon[35363]: Upgrade: Updating mgr.smithi136.vdkrdt 2024-09-18T12:53:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:08 smithi136 ceph-mon[35363]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:53:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:08 smithi136 ceph-mon[35363]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 96 op/s 2024-09-18T12:53:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:08 smithi081 ceph-mon[27646]: Upgrade: Updating mgr.smithi136.vdkrdt 2024-09-18T12:53:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:08 smithi081 ceph-mon[27646]: Deploying daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:53:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:08 smithi081 ceph-mon[27646]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 96 op/s 2024-09-18T12:53:11.211 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:10 smithi081 ceph-mon[27646]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 96 op/s 2024-09-18T12:53:11.211 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:10 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:11.212 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:10 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:11.212 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:10 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:11.252 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:10 smithi136 ceph-mon[35363]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 96 op/s 2024-09-18T12:53:11.252 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:10 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:11.252 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:10 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:11.252 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:10 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:12.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:11 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:12.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:11 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:11 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:12.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:11 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:13.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:12 smithi081 ceph-mon[27646]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 87 op/s 2024-09-18T12:53:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:12 smithi136 ceph-mon[35363]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 324 KiB/s wr, 87 op/s 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:14 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-18T12:53:14.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:14.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:14.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:14 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: pgmap v19: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-18T12:53:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:53:16.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:53:16.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:53:16.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:16.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:53:16.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:16 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: pgmap v19: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:53:16.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:16.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:53:16.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:16 smithi081 ceph-mon[27646]: from='mgr.? 172.21.15.136:0/3246598001' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: mgrmap e32: smithi081.pfnvgp(active, since 33s), standbys: smithi136.vdkrdt 2024-09-18T12:53:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.pfnvgp"}]: dispatch 2024-09-18T12:53:17.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.pfnvgp"}]': finished 2024-09-18T12:53:17.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi136.vdkrdt"}]: dispatch 2024-09-18T12:53:17.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi136.vdkrdt"}]': finished 2024-09-18T12:53:17.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:17 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: mgrmap e32: smithi081.pfnvgp(active, since 33s), standbys: smithi136.vdkrdt 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.pfnvgp"}]: dispatch 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.pfnvgp"}]': finished 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi136.vdkrdt"}]: dispatch 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi136.vdkrdt"}]': finished 2024-09-18T12:53:17.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:17 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:18.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:18 smithi081 ceph-mon[27646]: pgmap v20: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:18.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:18 smithi081 ceph-mon[27646]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:19.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:18 smithi136 ceph-mon[35363]: pgmap v20: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:19.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:18 smithi136 ceph-mon[35363]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: Upgrade: Updating mon.smithi081 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: Deploying daemon mon.smithi081 on smithi081 2024-09-18T12:53:20.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 ceph-mon[27646]: pgmap v21: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: Upgrade: Updating mon.smithi081 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: Deploying daemon mon.smithi081 on smithi081 2024-09-18T12:53:20.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:20 smithi136 ceph-mon[35363]: pgmap v21: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:21.360 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:20 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:53:22.335 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:22 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[27642]: 2024-09-18T12:53:22.016+0000 7f4a3df5f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:53:22.336 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:22 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[27642]: 2024-09-18T12:53:22.016+0000 7f4a3df5f700 -1 mon.smithi081@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T12:53:22.336 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:22 smithi081 podman[92362]: 2024-09-18 12:53:22.190332978 +0000 UTC m=+1.112436049 container died 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, GIT_CLEAN=True, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T12:53:24.773 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:24 smithi081 podman[92362]: 2024-09-18 12:53:24.567576592 +0000 UTC m=+3.489679654 container cleanup 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-18T12:53:24.773 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:24 smithi081 bash[92362]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081 2024-09-18T12:53:25.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:24 smithi081 podman[92374]: 2024-09-18 12:53:24.977528767 +0000 UTC m=+2.780864303 container remove 1c0090382c9378ed467689cdf333ed35b4ff281459a0ebc93266cdeafccd2e2c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T12:53:25.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service: Deactivated successfully. 2024-09-18T12:53:25.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 systemd[1]: Stopped Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:53:25.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service: Consumed 12.614s CPU time. 2024-09-18T12:53:25.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 systemd[1]: Starting Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:53:25.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 podman[92525]: 2024-09-18 12:53:25.487262505 +0000 UTC m=+0.015594336 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:53:25.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 podman[92525]: 2024-09-18 12:53:25.595412813 +0000 UTC m=+0.123744638 container create e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-18T12:53:25.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 podman[92525]: 2024-09-18 12:53:25.823388391 +0000 UTC m=+0.351720221 container init e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-18T12:53:25.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 podman[92525]: 2024-09-18 12:53:25.827174504 +0000 UTC m=+0.355506330 container start e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:53:26.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:53:26.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:53:26.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: pidfile_write: ignore empty --pid-file 2024-09-18T12:53:26.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: load: jerasure load: lrc 2024-09-18T12:53:26.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:53:26.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Git sha 0 2024-09-18T12:53:26.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:53:26.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: DB SUMMARY 2024-09-18T12:53:26.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: DB Session ID: O9ZF61C9B877K1H8KW6I 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1517 Bytes 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi081/store.db dir, Total Num: 1, files: 000032.sst 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi081/store.db: 000030.log size: 3236977 ; 2024-09-18T12:53:26.110 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:53:26.111 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:53:26.111 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:53:26.111 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:53:26.111 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:53:26.111 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:53:26.112 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.env: 0x55bfb3128120 2024-09-18T12:53:26.112 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:53:26.112 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.info_log: 0x55bfb4b778e0 2024-09-18T12:53:26.112 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:53:26.112 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.statistics: (nil) 2024-09-18T12:53:26.113 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.use_fsync: 0 2024-09-18T12:53:26.113 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:53:26.113 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:53:26.113 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:53:26.114 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:53:26.114 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:53:26.114 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:53:26.114 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:53:26.114 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.db_log_dir: 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.wal_dir: 2024-09-18T12:53:26.115 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:53:26.116 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:53:26.116 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:53:26.116 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:53:26.116 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:53:26.116 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:53:26.117 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:53:26.117 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:53:26.117 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.write_buffer_manager: 0x55bfb4b7bb80 2024-09-18T12:53:26.117 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:53:26.117 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:53:26.118 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:53:26.118 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:53:26.118 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:53:26.118 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:53:26.118 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:53:26.119 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:53:26.119 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.unordered_write: 0 2024-09-18T12:53:26.119 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:53:26.119 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:53:26.120 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:53:26.120 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:53:26.120 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.row_cache: None 2024-09-18T12:53:26.121 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.wal_filter: None 2024-09-18T12:53:26.121 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:53:26.121 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:53:26.121 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:53:26.121 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:53:26.122 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.wal_compression: 0 2024-09-18T12:53:26.122 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:53:26.122 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:53:26.123 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:53:26.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:53:26.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:53:26.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:53:26.127 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:53:26.127 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:53:26.128 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:53:26.128 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:53:26.128 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:53:26.128 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:53:26.128 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:53:26.129 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:53:26.129 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:53:26.129 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:53:26.129 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:53:26.129 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:53:26.130 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_open_files: -1 2024-09-18T12:53:26.130 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:53:26.130 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Compression algorithms supported: 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kZSTD supported: 0 2024-09-18T12:53:26.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:53:26.132 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:53:26.132 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:53:26.132 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:53:26.132 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:53:26.132 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:53:26.133 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:53:26.133 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:53:26.133 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:53:26.133 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000015 2024-09-18T12:53:26.133 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.merge_operator: 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_filter: None 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:53:26.134 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:53:26.135 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:53:26.135 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bfb4b77540) 2024-09-18T12:53:26.135 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:53:26.135 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:53:26.135 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:53:26.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:53:26.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_type: 0 2024-09-18T12:53:26.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_index_type: 0 2024-09-18T12:53:26.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_shortening: 1 2024-09-18T12:53:26.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: checksum: 4 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: no_block_cache: 0 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache: 0x55bfb4b6b610 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_options: 2024-09-18T12:53:26.137 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: capacity : 536870912 2024-09-18T12:53:26.138 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_shard_bits : 4 2024-09-18T12:53:26.138 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: strict_capacity_limit : 0 2024-09-18T12:53:26.138 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:53:26.138 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_compressed: (nil) 2024-09-18T12:53:26.138 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: persistent_cache: (nil) 2024-09-18T12:53:26.139 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size: 4096 2024-09-18T12:53:26.139 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size_deviation: 10 2024-09-18T12:53:26.139 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_restart_interval: 16 2024-09-18T12:53:26.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_block_restart_interval: 1 2024-09-18T12:53:26.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_block_size: 4096 2024-09-18T12:53:26.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: partition_filters: 0 2024-09-18T12:53:26.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: use_delta_encoding: 1 2024-09-18T12:53:26.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: filter_policy: bloomfilter 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: whole_key_filtering: 1 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: verify_compression: 0 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: format_version: 5 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_index_compression: 1 2024-09-18T12:53:26.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_align: 0 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_auto_readahead_size: 262144 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: prepopulate_block_cache: 0 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:53:26.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression: NoCompression 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.num_levels: 7 2024-09-18T12:53:26.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:53:26.144 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:53:26.144 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:53:26.144 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:53:26.144 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:53:26.144 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:53:26.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:53:26.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:26.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:53:26.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:53:26.145 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:26.146 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:26.146 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:53:26.146 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:53:26.146 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:53:26.146 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:53:26.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:53:26.148 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:53:26.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:53:26.150 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:53:26.151 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.ttl: 2592000 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:53:26.152 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:53:26.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12122, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 86123a14-373b-48b6-8ac1-b54956fa44c4 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664005853736, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-18T12:53:26.154 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664005862756, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2928876, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12123, "largest_seqno": 13636, "table_properties": {"data_size": 2921872, "index_size": 4359, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 14180, "raw_average_key_size": 22, "raw_value_size": 2908402, "raw_average_value_size": 4646, "num_data_blocks": 199, "num_entries": 626, "num_filter_entries": 626, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664005, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "86123a14-373b-48b6-8ac1-b54956fa44c4", "db_session_id": "O9ZF61C9B877K1H8KW6I", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664005862883, "job": 1, "event": "recovery_finished"} 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi081/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bfb4b9ae00 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: DB pointer 0x55bfb4c9c000 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:53:26.155 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** DB Stats ** 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.156 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L0 1/0 2.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 676.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L6 1/0 4.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Sum 2/0 7.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 676.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 676.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:26.157 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 676.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-18T12:53:26.158 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:53:26.159 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:53:26.159 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:53:26.159 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:53:26.159 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative compaction: 0.00 GB write, 243.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:26.159 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval compaction: 0.00 GB write, 243.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:26.160 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:53:26.160 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache BinnedLRUCache@0x55bfb4b6b610#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-18T12:53:26.160 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-18T12:53:26.160 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.160 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:53:26.161 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: starting mon.smithi081 rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi081 fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:26.161 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???) e2 preinit fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:26.161 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).mds e20 new map 2024-09-18T12:53:26.161 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).mds e20 print_map 2024-09-18T12:53:26.161 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: e20 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: legacy client fscid: 1 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: fs_name cephfs 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: epoch 20 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:26.162 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: tableserver 0 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: root 0 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: session_timeout 60 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: session_autoclose 300 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_file_size 1099511627776 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_xattr_size 65536 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: required_client_features {} 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: last_failure 0 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: last_failure_osd_epoch 47 2024-09-18T12:53:26.163 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_mds 2 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: in 0,1 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: up {0=14544,1=14556} 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: failed 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: damaged 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: stopped 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_pools [3] 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_pool 2 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: inline_data disabled 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: balancer 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: bal_rank_mask -1 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: standby_count_wanted 1 2024-09-18T12:53:26.164 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: qdb_cluster leader: 0 members: 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Standby daemons: 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:26.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:26.166 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:25 smithi081 ceph-mon[92545]: mon.smithi081@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-18T12:53:26.166 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:26 smithi081 bash[92525]: e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 2024-09-18T12:53:26.166 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:26 smithi081 systemd[1]: Started Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:53:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:53:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:53:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: pgmap v24: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: pgmap v25: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: mon.smithi081 calling monitor election 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: monmap epoch 2 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: last_changed 2024-09-18T12:43:33.397025+0000 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: created 2024-09-18T12:40:54.860777+0000 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: min_mon_release 18 (reef) 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: election_strategy: 1 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-09-18T12:53:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.smithi136 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: osdmap e49: 6 total, 6 up, 6 in 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: mgrmap e32: smithi081.pfnvgp(active, since 45s), standbys: smithi136.vdkrdt 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: overall HEALTH_OK 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: from='mgr.14778 ' entity='' 2024-09-18T12:53:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:28 smithi081 ceph-mon[92545]: mgrmap e33: smithi081.pfnvgp(active, since 45s), standbys: smithi136.vdkrdt 2024-09-18T12:53:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-09-18T12:53:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "mon metadata", "id": "smithi136"}]: dispatch 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: from='mgr.14778 172.21.15.81:0/607462380' entity='mgr.smithi081.pfnvgp' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: pgmap v24: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: pgmap v25: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: mon.smithi081 calling monitor election 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: monmap epoch 2 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: last_changed 2024-09-18T12:43:33.397025+0000 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: created 2024-09-18T12:40:54.860777+0000 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: min_mon_release 18 (reef) 2024-09-18T12:53:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: election_strategy: 1 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.smithi136 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: osdmap e49: 6 total, 6 up, 6 in 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: mgrmap e32: smithi081.pfnvgp(active, since 45s), standbys: smithi136.vdkrdt 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: overall HEALTH_OK 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: from='mgr.14778 ' entity='' 2024-09-18T12:53:29.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:28 smithi136 ceph-mon[35363]: mgrmap e33: smithi081.pfnvgp(active, since 45s), standbys: smithi136.vdkrdt 2024-09-18T12:53:34.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:53:34.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:53:34.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:53:34.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: mgrmap e34: smithi081.pfnvgp(active, starting, since 0.00573343s), standbys: smithi136.vdkrdt 2024-09-18T12:53:34.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi081"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi136"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:53:34.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata"} : dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata"} : dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata"} : dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:53:34.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:33 smithi081 ceph-mon[92545]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:34.274 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: Active manager daemon smithi081.pfnvgp restarted 2024-09-18T12:53:34.274 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: Activating manager daemon smithi081.pfnvgp 2024-09-18T12:53:34.274 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:53:34.274 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: mgrmap e34: smithi081.pfnvgp(active, starting, since 0.00573343s), standbys: smithi136.vdkrdt 2024-09-18T12:53:34.274 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi081"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi136"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr metadata", "who": "smithi081.pfnvgp", "id": "smithi081.pfnvgp"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr metadata", "who": "smithi136.vdkrdt", "id": "smithi136.vdkrdt"} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:53:34.275 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata"} : dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata"} : dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata"} : dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: Manager daemon smithi081.pfnvgp is now available 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt restarted 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: Standby manager daemon smithi136.vdkrdt started 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/crt"}]: dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi136.vdkrdt/key"}]: dispatch 2024-09-18T12:53:34.276 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:33 smithi136 ceph-mon[35363]: from='mgr.? 172.21.15.136:0/1705429542' entity='mgr.smithi136.vdkrdt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"} : dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"} : dispatch 2024-09-18T12:53:35.224 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:34 smithi081 ceph-mon[92545]: mgrmap e35: smithi081.pfnvgp(active, since 1.01059s), standbys: smithi136.vdkrdt 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/mirror_snapshot_schedule"} : dispatch 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.pfnvgp/trash_purge_schedule"} : dispatch 2024-09-18T12:53:35.242 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:34 smithi136 ceph-mon[35363]: mgrmap e35: smithi081.pfnvgp(active, since 1.01059s), standbys: smithi136.vdkrdt 2024-09-18T12:53:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 -- 172.21.15.81:0/792493324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc0ffc10 msgr2=0x7f3fdc100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/792493324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc100030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009910 tx=0x7f3fcc009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 -- 172.21.15.81:0/792493324 shutdown_connections 2024-09-18T12:53:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/792493324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc100e10 0x7f3fdc101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/792493324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc100030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.628+0000 7f3fe0e12700 1 -- 172.21.15.81:0/792493324 >> 172.21.15.81:0/792493324 conn(0x7f3fdc0fb190 msgr2=0x7f3fdc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.629+0000 7f3fe0e12700 1 -- 172.21.15.81:0/792493324 shutdown_connections 2024-09-18T12:53:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.629+0000 7f3fe0e12700 1 -- 172.21.15.81:0/792493324 wait complete. 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.629+0000 7f3fe0e12700 1 Processor -- start 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.629+0000 7f3fe0e12700 1 -- start start 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fe0e12700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fe0e12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fe0e12700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc197030 con 0x7f3fdc100e10 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fe0e12700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc197170 con 0x7f3fdc0ffc10 2024-09-18T12:53:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fda59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51400/0 (socket says 172.21.15.81:51400) 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 -- 172.21.15.81:0/1499939429 learned_addr learned my addr 172.21.15.81:0/1499939429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 -- 172.21.15.81:0/1499939429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc0ffc10 msgr2=0x7f3fdc1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 -- 172.21.15.81:0/1499939429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0095f0 con 0x7f3fdc100e10 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fd9d9b700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000d900 tx=0x7f3fd000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd00041f0 con 0x7f3fdc100e10 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.630+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc102090 con 0x7f3fdc100e10 2024-09-18T12:53:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.631+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc1025e0 con 0x7f3fdc100e10 2024-09-18T12:53:35.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.631+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fd0004ce0 con 0x7f3fdc100e10 2024-09-18T12:53:35.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.631+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd000b750 con 0x7f3fdc100e10 2024-09-18T12:53:35.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.632+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc005320 con 0x7f3fdc100e10 2024-09-18T12:53:35.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.632+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 35) v1 ==== 103072+0+0 (secure 0 0 0) 0x7f3fd000b8b0 con 0x7f3fdc100e10 2024-09-18T12:53:35.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.633+0000 7f3fcb7fe700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 0x7f3fc407d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:35.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.633+0000 7f3fda59c700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 0x7f3fc407d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:35.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.633+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3fd009db50 con 0x7f3fdc100e10 2024-09-18T12:53:35.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.633+0000 7f3fda59c700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 0x7f3fc407d4d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc006010 tx=0x7f3fcc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:35.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.640+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3fd0060f40 con 0x7f3fdc100e10 2024-09-18T12:53:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.884+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fbc000bf0 con 0x7f3fc407b010 2024-09-18T12:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.885+0000 7f3fcb7fe700 1 -- 172.21.15.81:0/1499939429 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3fbc000bf0 con 0x7f3fc407b010 2024-09-18T12:53:35.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 msgr2=0x7f3fc407d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:35.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 0x7f3fc407d4d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc006010 tx=0x7f3fcc00b560 comp rx=0 tx=0).stop 2024-09-18T12:53:35.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 msgr2=0x7f3fdc196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:35.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000d900 tx=0x7f3fd000dc10 comp rx=0 tx=0).stop 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 shutdown_connections 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3fc407b010 0x7f3fc407d4d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fdc0ffc10 0x7f3fdc1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 --2- 172.21.15.81:0/1499939429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fdc100e10 0x7f3fdc196a10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 >> 172.21.15.81:0/1499939429 conn(0x7f3fdc0fb190 msgr2=0x7f3fdc068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 shutdown_connections 2024-09-18T12:53:35.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:35.888+0000 7f3fe0e12700 1 -- 172.21.15.81:0/1499939429 wait complete. 2024-09-18T12:53:35.900 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.005+0000 7f459261d700 1 -- 172.21.15.81:0/2273910252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c0ff590 msgr2=0x7f458c1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.005+0000 7f459261d700 1 --2- 172.21.15.81:0/2273910252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c0ff590 0x7f458c1019c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f457c009910 tx=0x7f457c009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- 172.21.15.81:0/2273910252 shutdown_connections 2024-09-18T12:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 --2- 172.21.15.81:0/2273910252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c101f00 0x7f458c104390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 --2- 172.21.15.81:0/2273910252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c0ff590 0x7f458c1019c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- 172.21.15.81:0/2273910252 >> 172.21.15.81:0/2273910252 conn(0x7f458c0fb190 msgr2=0x7f458c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- 172.21.15.81:0/2273910252 shutdown_connections 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- 172.21.15.81:0/2273910252 wait complete. 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 Processor -- start 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- start start 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 0x7f458c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c19d660 con 0x7f458c101f00 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.006+0000 7f459261d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c19d7a0 con 0x7f458c0ff590 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51422/0 (socket says 172.21.15.81:51422) 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 -- 172.21.15.81:0/581902291 learned_addr learned my addr 172.21.15.81:0/581902291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458bfff700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 0x7f458c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 -- 172.21.15.81:0/581902291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 msgr2=0x7f458c19cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 0x7f458c19cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 -- 172.21.15.81:0/581902291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0095f0 con 0x7f458c101f00 2024-09-18T12:53:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458bfff700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 0x7f458c19cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f458b7fe700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f458000b4b0 tx=0x7f458000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4580011800 con 0x7f458c101f00 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c1a2250 con 0x7f458c101f00 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4580011e10 con 0x7f458c101f00 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f458000f2e0 con 0x7f458c101f00 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.007+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c1a27a0 con 0x7f458c101f00 2024-09-18T12:53:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.008+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c196c80 con 0x7f458c101f00 2024-09-18T12:53:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.009+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f4580010380 con 0x7f458c101f00 2024-09-18T12:53:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.009+0000 7f45897fa700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 0x7f457407d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.009+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f458009deb0 con 0x7f458c101f00 2024-09-18T12:53:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.009+0000 7f458bfff700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 0x7f457407d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.010+0000 7f458bfff700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 0x7f457407d850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f457c006010 tx=0x7f457c00b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.014+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4580060e80 con 0x7f458c101f00 2024-09-18T12:53:36.090 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:35 smithi136 ceph-mon[35363]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:36.090 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:35 smithi136 ceph-mon[35363]: pgmap v3: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.250+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f458c0611d0 con 0x7f457407b390 2024-09-18T12:53:36.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:35 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:36.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:35 smithi081 ceph-mon[92545]: pgmap v3: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.252+0000 7f45897fa700 1 -- 172.21.15.81:0/581902291 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f458c0611d0 con 0x7f457407b390 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 msgr2=0x7f457407d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 0x7f457407d850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f457c006010 tx=0x7f457c00b580 comp rx=0 tx=0).stop 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 msgr2=0x7f458c19d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f458000b4b0 tx=0x7f458000b870 comp rx=0 tx=0).stop 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 shutdown_connections 2024-09-18T12:53:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f457407b390 0x7f457407d850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f458c0ff590 0x7f458c19cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 --2- 172.21.15.81:0/581902291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101f00 0x7f458c19d040 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 >> 172.21.15.81:0/581902291 conn(0x7f458c0fb190 msgr2=0x7f458c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 shutdown_connections 2024-09-18T12:53:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.254+0000 7f459261d700 1 -- 172.21.15.81:0/581902291 wait complete. 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 -- 172.21.15.81:0/828421280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140101f40 msgr2=0x7f61401023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 --2- 172.21.15.81:0/828421280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140101f40 0x7f61401023a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6134009910 tx=0x7f6134009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 -- 172.21.15.81:0/828421280 shutdown_connections 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 --2- 172.21.15.81:0/828421280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6140101f40 0x7f61401023a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 --2- 172.21.15.81:0/828421280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61400fef60 0x7f61400ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 -- 172.21.15.81:0/828421280 >> 172.21.15.81:0/828421280 conn(0x7f61400fa8c0 msgr2=0x7f61400fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 -- 172.21.15.81:0/828421280 shutdown_connections 2024-09-18T12:53:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.364+0000 7f61469c4700 1 -- 172.21.15.81:0/828421280 wait complete. 2024-09-18T12:53:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 Processor -- start 2024-09-18T12:53:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 -- start start 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 0x7f6140196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140197040 con 0x7f61400fef60 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.365+0000 7f61469c4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140197180 con 0x7f6140101f40 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51450/0 (socket says 172.21.15.81:51450) 2024-09-18T12:53:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 -- 172.21.15.81:0/879599061 learned_addr learned my addr 172.21.15.81:0/879599061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613f7fe700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 0x7f6140196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 -- 172.21.15.81:0/879599061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 msgr2=0x7f6140196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 0x7f6140196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 -- 172.21.15.81:0/879599061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340095f0 con 0x7f61400fef60 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613f7fe700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 0x7f6140196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613ffff700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f613000e8f0 tx=0x7f613000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6130009790 con 0x7f61400fef60 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f613000c810 con 0x7f61400fef60 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6130003d20 con 0x7f61400fef60 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614019bc30 con 0x7f61400fef60 2024-09-18T12:53:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.366+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614019c180 con 0x7f61400fef60 2024-09-18T12:53:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.367+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140109800 con 0x7f61400fef60 2024-09-18T12:53:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.368+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f61300041f0 con 0x7f61400fef60 2024-09-18T12:53:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.369+0000 7f613d7fa700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 0x7f612807d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.369+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6130014070 con 0x7f61400fef60 2024-09-18T12:53:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.369+0000 7f613f7fe700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 0x7f612807d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.369+0000 7f613f7fe700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 0x7f612807d850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f613400b6f0 tx=0x7f6134005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.374+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f61300616a0 con 0x7f61400fef60 2024-09-18T12:53:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.622+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6140106890 con 0x7f612807b390 2024-09-18T12:53:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.632+0000 7f613d7fa700 1 -- 172.21.15.81:0/879599061 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f6140106890 con 0x7f612807b390 2024-09-18T12:53:36.633 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (9m) 21s ago 11m 25.2M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (106s) 21s ago 11m 7478k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (96s) 23s ago 10m 7180k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (11m) 21s ago 11m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (10m) 23s ago 10m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (8m) 21s ago 10m 85.9M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (4m) 21s ago 4m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (4m) 21s ago 4m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:53:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (4m) 23s ago 4m 18.6M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (4m) 23s ago 4m 14.5M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (90s) 21s ago 12m 507M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (26s) 23s ago 10m 83.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (12m) 21s ago 12m 57.1M 2048M 18.2.1 5be31c24972a 1c0090382c93 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (10m) 23s ago 10m 45.7M 2048M 18.2.1 5be31c24972a 7b91f02cc444 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (11m) 21s ago 11m 15.7M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (10m) 23s ago 10m 15.1M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 21s ago 8m 253M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (8m) 21s ago 8m 243M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 21s ago 7m 191M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (7m) 23s ago 7m 284M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (6m) 23s ago 6m 242M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (6m) 23s ago 6m 222M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:53:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (31s) 21s ago 10m 45.6M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:53:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 msgr2=0x7f612807d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 0x7f612807d850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f613400b6f0 tx=0x7f6134005a90 comp rx=0 tx=0).stop 2024-09-18T12:53:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 msgr2=0x7f61401964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f613000e8f0 tx=0x7f613000ec00 comp rx=0 tx=0).stop 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 shutdown_connections 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f612807b390 0x7f612807d850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61400fef60 0x7f61401964e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 --2- 172.21.15.81:0/879599061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6140101f40 0x7f6140196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 >> 172.21.15.81:0/879599061 conn(0x7f61400fa8c0 msgr2=0x7f6140105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 shutdown_connections 2024-09-18T12:53:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.634+0000 7f61469c4700 1 -- 172.21.15.81:0/879599061 wait complete. 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 -- 172.21.15.81:0/2472474627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 msgr2=0x7f6a141023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 --2- 172.21.15.81:0/2472474627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a141023a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009910 tx=0x7f6a04009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 -- 172.21.15.81:0/2472474627 shutdown_connections 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 --2- 172.21.15.81:0/2472474627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a141023a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 --2- 172.21.15.81:0/2472474627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a140ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 -- 172.21.15.81:0/2472474627 >> 172.21.15.81:0/2472474627 conn(0x7f6a140fa8c0 msgr2=0x7f6a140fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 -- 172.21.15.81:0/2472474627 shutdown_connections 2024-09-18T12:53:36.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.747+0000 7f6a19c79700 1 -- 172.21.15.81:0/2472474627 wait complete. 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 Processor -- start 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 -- start start 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a141964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14197040 con 0x7f6a14101f40 2024-09-18T12:53:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a19c79700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14197180 con 0x7f6a140fef60 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a12ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a12ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51466/0 (socket says 172.21.15.81:51466) 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.748+0000 7f6a12ffd700 1 -- 172.21.15.81:0/184932143 learned_addr learned my addr 172.21.15.81:0/184932143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a137fe700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a141964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a12ffd700 1 -- 172.21.15.81:0/184932143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 msgr2=0x7f6a141964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a12ffd700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a141964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a12ffd700 1 -- 172.21.15.81:0/184932143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040095f0 con 0x7f6a14101f40 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a137fe700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a141964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a12ffd700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b5c0 tx=0x7f6a0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a0401d070 con 0x7f6a14101f40 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1419bbd0 con 0x7f6a14101f40 2024-09-18T12:53:36.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1419c0c0 con 0x7f6a14101f40 2024-09-18T12:53:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a04022470 con 0x7f6a14101f40 2024-09-18T12:53:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.749+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a0400f690 con 0x7f6a14101f40 2024-09-18T12:53:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.750+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00005320 con 0x7f6a14101f40 2024-09-18T12:53:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.751+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f6a04004b70 con 0x7f6a14101f40 2024-09-18T12:53:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.751+0000 7f6a10ff9700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 0x7f69fc07d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.751+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6a0409f900 con 0x7f6a14101f40 2024-09-18T12:53:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.751+0000 7f6a137fe700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 0x7f69fc07d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.752+0000 7f6a137fe700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 0x7f69fc07d850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a14068380 tx=0x7f6a08005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:36.756+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6a04062a00 con 0x7f6a14101f40 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.063+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a00005cc0 con 0x7f6a14101f40 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.064+0000 7f6a10ff9700 1 -- 172.21.15.81:0/184932143 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7f6a04065b20 con 0x7f6a14101f40 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:53:37.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:53:37.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 11, 2024-09-18T12:53:37.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:53:37.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:53:37.067 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:53:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 msgr2=0x7f69fc07d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 0x7f69fc07d850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a14068380 tx=0x7f6a08005f90 comp rx=0 tx=0).stop 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 msgr2=0x7f6a14196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b5c0 tx=0x7f6a0400be20 comp rx=0 tx=0).stop 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 shutdown_connections 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f69fc07b390 0x7f69fc07d850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a140fef60 0x7f6a141964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 --2- 172.21.15.81:0/184932143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a14101f40 0x7f6a14196a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 >> 172.21.15.81:0/184932143 conn(0x7f6a140fa8c0 msgr2=0x7f6a14105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 shutdown_connections 2024-09-18T12:53:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.066+0000 7f6a19c79700 1 -- 172.21.15.81:0/184932143 wait complete. 2024-09-18T12:53:37.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: [18/Sep/2024:12:53:35] ENGINE Bus STARTING 2024-09-18T12:53:37.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: [18/Sep/2024:12:53:35] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: [18/Sep/2024:12:53:35] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: [18/Sep/2024:12:53:35] ENGINE Bus STARTED 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: [18/Sep/2024:12:53:35] ENGINE Error in HTTPServer.serve 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Traceback (most recent call last): 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._run(expiration_interval) 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:53:37.104 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: s = self.context.wrap_socket( 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: return self.sslsocket_class._create( 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self.do_handshake() 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: self._sslobj.do_handshake() 2024-09-18T12:53:37.105 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:53:37.106 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: pgmap v4: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:37.106 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:37.106 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:36 smithi136 ceph-mon[35363]: mgrmap e36: smithi081.pfnvgp(active, since 2s), standbys: smithi136.vdkrdt 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.181+0000 7f4650156700 1 -- 172.21.15.81:0/667902855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 msgr2=0x7f4648101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.181+0000 7f4650156700 1 --2- 172.21.15.81:0/667902855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f4648101270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4638009910 tx=0x7f4638009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 -- 172.21.15.81:0/667902855 shutdown_connections 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 --2- 172.21.15.81:0/667902855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f4648101270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 --2- 172.21.15.81:0/667902855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 -- 172.21.15.81:0/667902855 >> 172.21.15.81:0/667902855 conn(0x7f46480fb190 msgr2=0x7f46480fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 -- 172.21.15.81:0/667902855 shutdown_connections 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: [18/Sep/2024:12:53:35] ENGINE Bus STARTING 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: [18/Sep/2024:12:53:35] ENGINE Serving on http://172.21.15.81:8765 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: [18/Sep/2024:12:53:35] ENGINE Serving on https://172.21.15.81:7150 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: [18/Sep/2024:12:53:35] ENGINE Bus STARTED 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: [18/Sep/2024:12:53:35] ENGINE Error in HTTPServer.serve 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Traceback (most recent call last): 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:53:37.184 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._run(expiration_interval) 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: s = self.context.wrap_socket( 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: return self.sslsocket_class._create( 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self.do_handshake() 2024-09-18T12:53:37.185 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:53:37.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: self._sslobj.do_handshake() 2024-09-18T12:53:37.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:53:37.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: pgmap v4: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:37.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:37.186 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:36 smithi081 ceph-mon[92545]: mgrmap e36: smithi081.pfnvgp(active, since 2s), standbys: smithi136.vdkrdt 2024-09-18T12:53:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.182+0000 7f4650156700 1 -- 172.21.15.81:0/667902855 wait complete. 2024-09-18T12:53:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 Processor -- start 2024-09-18T12:53:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 -- start start 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f46481969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4648196fe0 con 0x7f4648100e10 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f4650156700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4648197120 con 0x7f46480ffc10 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f464def2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f464d6f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f46481969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f464def2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:49700/0 (socket says 172.21.15.81:49700) 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.183+0000 7f464def2700 1 -- 172.21.15.81:0/3464272802 learned_addr learned my addr 172.21.15.81:0/3464272802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f464d6f1700 1 -- 172.21.15.81:0/3464272802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 msgr2=0x7f4648196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f464d6f1700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f464d6f1700 1 -- 172.21.15.81:0/3464272802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380095f0 con 0x7f4648100e10 2024-09-18T12:53:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f464d6f1700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f46481969c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4638009910 tx=0x7f463800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463801d070 con 0x7f4648100e10 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464819bb70 con 0x7f4648100e10 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4648102390 con 0x7f4648100e10 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f463800f460 con 0x7f4648100e10 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.184+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4638017630 con 0x7f4648100e10 2024-09-18T12:53:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.185+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c005320 con 0x7f4648100e10 2024-09-18T12:53:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.187+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f4638003a60 con 0x7f4648100e10 2024-09-18T12:53:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.187+0000 7f463effd700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 0x7f463407d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.187+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f463809f4e0 con 0x7f4648100e10 2024-09-18T12:53:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.187+0000 7f464def2700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 0x7f463407d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.188+0000 7f464def2700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 0x7f463407d860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f464400bd70 tx=0x7f464400b4a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.195+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f46380624a0 con 0x7f4648100e10 2024-09-18T12:53:37.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.464+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f462c005cc0 con 0x7f4648100e10 2024-09-18T12:53:37.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.465+0000 7f463effd700 1 -- 172.21.15.81:0/3464272802 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7f46380655c0 con 0x7f4648100e10 2024-09-18T12:53:37.466 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:53:37.466 INFO:teuthology.orchestra.run.smithi081.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:53:37.466 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:53:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:53:37.468 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:53:37.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:53:37.470 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:37.470 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 msgr2=0x7f463407d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 0x7f463407d860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f464400bd70 tx=0x7f464400b4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 msgr2=0x7f46481969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f46481969c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4638009910 tx=0x7f463800bd70 comp rx=0 tx=0).stop 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 shutdown_connections 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f463407b3a0 0x7f463407d860 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46480ffc10 0x7f4648196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 --2- 172.21.15.81:0/3464272802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4648100e10 0x7f46481969c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 >> 172.21.15.81:0/3464272802 conn(0x7f46480fb190 msgr2=0x7f4648068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.467+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 shutdown_connections 2024-09-18T12:53:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.468+0000 7f4650156700 1 -- 172.21.15.81:0/3464272802 wait complete. 2024-09-18T12:53:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:53:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- 172.21.15.81:0/367475141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 msgr2=0x7fabc4073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 --2- 172.21.15.81:0/367475141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4073220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009910 tx=0x7fabb4009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- 172.21.15.81:0/367475141 shutdown_connections 2024-09-18T12:53:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 --2- 172.21.15.81:0/367475141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 0x7fabc4073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 --2- 172.21.15.81:0/367475141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4073220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- 172.21.15.81:0/367475141 >> 172.21.15.81:0/367475141 conn(0x7fabc40fc230 msgr2=0x7fabc40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- 172.21.15.81:0/367475141 shutdown_connections 2024-09-18T12:53:37.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- 172.21.15.81:0/367475141 wait complete. 2024-09-18T12:53:37.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 Processor -- start 2024-09-18T12:53:37.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.576+0000 7fabca6cf700 1 -- start start 2024-09-18T12:53:37.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabca6cf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 0x7fabc41986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabca6cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabca6cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4199250 con 0x7fabc4074dc0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabca6cf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4199390 con 0x7fabc40737f0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51486/0 (socket says 172.21.15.81:51486) 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 -- 172.21.15.81:0/1054631540 learned_addr learned my addr 172.21.15.81:0/1054631540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc3fff700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 0x7fabc41986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 -- 172.21.15.81:0/1054631540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 msgr2=0x7fabc41986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 0x7fabc41986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 -- 172.21.15.81:0/1054631540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40095f0 con 0x7fabc4074dc0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.577+0000 7fabc37fe700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d900 tx=0x7fabb800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.578+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb80041f0 con 0x7fabc4074dc0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.578+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabb8004350 con 0x7fabc4074dc0 2024-09-18T12:53:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.578+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb8003d20 con 0x7fabc4074dc0 2024-09-18T12:53:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.578+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc419de40 con 0x7fabc4074dc0 2024-09-18T12:53:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.578+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc419e360 con 0x7fabc4074dc0 2024-09-18T12:53:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.579+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc410ba20 con 0x7fabc4074dc0 2024-09-18T12:53:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.579+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7fabb8009730 con 0x7fabc4074dc0 2024-09-18T12:53:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.580+0000 7fabc17fa700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 0x7fabac07d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.580+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fabb809e1d0 con 0x7fabc4074dc0 2024-09-18T12:53:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.580+0000 7fabc3fff700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 0x7fabac07d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.580+0000 7fabc3fff700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 0x7fabac07d850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006010 tx=0x7fabb400b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.584+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fabb8061220 con 0x7fabc4074dc0 2024-09-18T12:53:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.822+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc419eab0 con 0x7fabac07b390 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.824+0000 7fabc17fa700 1 -- 172.21.15.81:0/1054631540 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fabc419eab0 con 0x7fabac07b390 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:53:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-09-18T12:53:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:53:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "2/23 daemons upgraded", 2024-09-18T12:53:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-18T12:53:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:53:37.826 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:53:37.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.826+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 msgr2=0x7fabac07d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.826+0000 7fabca6cf700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 0x7fabac07d850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006010 tx=0x7fabb400b560 comp rx=0 tx=0).stop 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.826+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 msgr2=0x7fabc4198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.826+0000 7fabca6cf700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d900 tx=0x7fabb800dc10 comp rx=0 tx=0).stop 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 shutdown_connections 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fabac07b390 0x7fabac07d850 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabc40737f0 0x7fabc41986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 --2- 172.21.15.81:0/1054631540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4074dc0 0x7fabc4198c30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 >> 172.21.15.81:0/1054631540 conn(0x7fabc40fc230 msgr2=0x7fabc4106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 shutdown_connections 2024-09-18T12:53:37.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.827+0000 7fabca6cf700 1 -- 172.21.15.81:0/1054631540 wait complete. 2024-09-18T12:53:37.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 -- 172.21.15.81:0/3125785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec48102280 msgr2=0x7fec481026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 --2- 172.21.15.81:0/3125785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec48102280 0x7fec481026a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fec38009910 tx=0x7fec38009c20 comp rx=0 tx=0).stop 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 -- 172.21.15.81:0/3125785154 shutdown_connections 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 --2- 172.21.15.81:0/3125785154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec480fed00 0x7fec480ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 --2- 172.21.15.81:0/3125785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec48102280 0x7fec481026a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.938+0000 7fec4de08700 1 -- 172.21.15.81:0/3125785154 >> 172.21.15.81:0/3125785154 conn(0x7fec480fa8c0 msgr2=0x7fec480fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.939+0000 7fec4de08700 1 -- 172.21.15.81:0/3125785154 shutdown_connections 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.939+0000 7fec4de08700 1 -- 172.21.15.81:0/3125785154 wait complete. 2024-09-18T12:53:37.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.939+0000 7fec4de08700 1 Processor -- start 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.939+0000 7fec4de08700 1 -- start start 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec4de08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec4de08700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec48102280 0x7fec48196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec4de08700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec481970a0 con 0x7fec480fed00 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec4de08700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec481971e0 con 0x7fec48102280 2024-09-18T12:53:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51490/0 (socket says 172.21.15.81:51490) 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 -- 172.21.15.81:0/1861846048 learned_addr learned my addr 172.21.15.81:0/1861846048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec46ffd700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec48102280 0x7fec48196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 -- 172.21.15.81:0/1861846048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec48102280 msgr2=0x7fec48196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec48102280 0x7fec48196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 -- 172.21.15.81:0/1861846048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380095f0 con 0x7fec480fed00 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.940+0000 7fec477fe700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec38005b40 tx=0x7fec3800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.941+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3801d070 con 0x7fec480fed00 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.941+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4819bc30 con 0x7fec480fed00 2024-09-18T12:53:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.941+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4819c120 con 0x7fec480fed00 2024-09-18T12:53:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.941+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec38005dc0 con 0x7fec480fed00 2024-09-18T12:53:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.941+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec38003e80 con 0x7fec480fed00 2024-09-18T12:53:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.942+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec34005320 con 0x7fec480fed00 2024-09-18T12:53:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.943+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7fec38003680 con 0x7fec480fed00 2024-09-18T12:53:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.943+0000 7fec44ff9700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 0x7fec3007d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.943+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fec3809f830 con 0x7fec480fed00 2024-09-18T12:53:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.943+0000 7fec46ffd700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 0x7fec3007d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.944+0000 7fec46ffd700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 0x7fec3007d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009c60 tx=0x7fec3c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:37.950+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fec38062880 con 0x7fec480fed00 2024-09-18T12:53:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/184932143' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3464272802' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:53:38.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.271+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fec34005190 con 0x7fec480fed00 2024-09-18T12:53:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.271+0000 7fec44ff9700 1 -- 172.21.15.81:0/1861846048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fec380659a0 con 0x7fec480fed00 2024-09-18T12:53:38.273 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:53:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 msgr2=0x7fec3007d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 0x7fec3007d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009c60 tx=0x7fec3c009260 comp rx=0 tx=0).stop 2024-09-18T12:53:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 msgr2=0x7fec48196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec38005b40 tx=0x7fec3800f690 comp rx=0 tx=0).stop 2024-09-18T12:53:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 shutdown_connections 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.273+0000 7fec4de08700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fec3007b390 0x7fec3007d850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.274+0000 7fec4de08700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec480fed00 0x7fec48196540 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.274+0000 7fec4de08700 1 --2- 172.21.15.81:0/1861846048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec48102280 0x7fec48196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.274+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 >> 172.21.15.81:0/1861846048 conn(0x7fec480fa8c0 msgr2=0x7fec48105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.274+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 shutdown_connections 2024-09-18T12:53:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:53:38.274+0000 7fec4de08700 1 -- 172.21.15.81:0/1861846048 wait complete. 2024-09-18T12:53:38.296 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.296 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.296 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/184932143' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:38.296 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.296 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.297 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/3464272802' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:53:38.297 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:38.297 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:37 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:39.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:38 smithi081 ceph-mon[92545]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:38 smithi081 ceph-mon[92545]: pgmap v5: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:39.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:38 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1861846048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:53:39.093 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:38 smithi081 ceph-mon[92545]: mgrmap e37: smithi081.pfnvgp(active, since 4s), standbys: smithi136.vdkrdt 2024-09-18T12:53:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:38 smithi136 ceph-mon[35363]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:38 smithi136 ceph-mon[35363]: pgmap v5: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:38 smithi136 ceph-mon[35363]: from='client.? 172.21.15.81:0/1861846048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:53:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:38 smithi136 ceph-mon[35363]: mgrmap e37: smithi081.pfnvgp(active, since 4s), standbys: smithi136.vdkrdt 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:40 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:40 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:40 smithi136 ceph-mon[35363]: pgmap v6: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:40 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:40 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:40 smithi081 ceph-mon[92545]: pgmap v6: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:40.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "quorum_status"} : dispatch 2024-09-18T12:53:42.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:42 smithi081 ceph-mon[92545]: pgmap v7: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-18T12:53:42.415 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:42.416 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: Updating smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "quorum_status"} : dispatch 2024-09-18T12:53:42.417 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:42 smithi136 ceph-mon[35363]: pgmap v7: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-18T12:53:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: Upgrade: Updating mon.smithi136 2024-09-18T12:53:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:53:44.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:53:44.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:44.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: Deploying daemon mon.smithi136 on smithi136 2024-09-18T12:53:44.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 ceph-mon[35363]: pgmap v8: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-18T12:53:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: Upgrade: Updating mon.smithi136 2024-09-18T12:53:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:53:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:53:44.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:44.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: Deploying daemon mon.smithi136 on smithi136 2024-09-18T12:53:44.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:44 smithi081 ceph-mon[92545]: pgmap v8: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-18T12:53:45.045 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:44 smithi136 systemd[1]: Stopping Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:53:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136[35346]: 2024-09-18T12:53:45.042+0000 7f28f8522700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi136 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:53:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136[35346]: 2024-09-18T12:53:45.042+0000 7f28f8522700 -1 mon.smithi136@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T12:53:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 podman[80017]: 2024-09-18 12:53:45.074578439 +0000 UTC m=+0.148389714 container died 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-18T12:53:45.720 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 podman[80017]: 2024-09-18 12:53:45.451937659 +0000 UTC m=+0.525748933 container cleanup 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-09-18T12:53:45.720 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 bash[80017]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136 2024-09-18T12:53:46.062 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 podman[80028]: 2024-09-18 12:53:45.719621743 +0000 UTC m=+0.647309168 container remove 7b91f02cc444960fb27fca8cdbbe34b085e7cb16e576dca9c5ee33cf517689d1 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1) 2024-09-18T12:53:46.062 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi136.service: Deactivated successfully. 2024-09-18T12:53:46.062 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 systemd[1]: Stopped Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:53:46.062 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:45 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi136.service: Consumed 6.935s CPU time. 2024-09-18T12:53:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 systemd[1]: Starting Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:53:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 podman[80160]: 2024-09-18 12:53:46.174349237 +0000 UTC m=+0.015690127 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:53:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 podman[80160]: 2024-09-18 12:53:46.287356229 +0000 UTC m=+0.128697184 container create 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0) 2024-09-18T12:53:46.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 podman[80160]: 2024-09-18 12:53:46.53980017 +0000 UTC m=+0.381141068 container init 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 podman[80160]: 2024-09-18 12:53:46.542928933 +0000 UTC m=+0.384269836 container start 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: pidfile_write: ignore empty --pid-file 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: load: jerasure load: lrc 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Git sha 0 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:53:46.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: DB SUMMARY 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: DB Session ID: 37S06JN43KL7MAI8UL4M 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi136/store.db dir, Total Num: 1, files: 000027.sst 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi136/store.db: 000025.log size: 7647932 ; 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:53:46.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.env: 0x55c059e1c120 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.info_log: 0x55c05a9558e0 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.statistics: (nil) 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.use_fsync: 0 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:53:46.817 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.db_log_dir: 2024-09-18T12:53:46.818 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.wal_dir: 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.write_buffer_manager: 0x55c05a959b80 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:53:46.819 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.unordered_write: 0 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:53:46.820 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:53:46.821 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.row_cache: None 2024-09-18T12:53:46.821 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.wal_filter: None 2024-09-18T12:53:46.822 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:53:46.822 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:53:46.822 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:53:46.822 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.wal_compression: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:53:46.823 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:53:46.824 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_open_files: -1 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Compression algorithms supported: 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kZSTD supported: 0 2024-09-18T12:53:46.825 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi136/store.db/MANIFEST-000010 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:53:46.826 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.merge_operator: 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_filter: None 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c05a955540) 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:53:46.827 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_type: 0 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: data_block_index_type: 0 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_shortening: 1 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: checksum: 4 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: no_block_cache: 0 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache: 0x55c05a949610 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_options: 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: capacity : 536870912 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: num_shard_bits : 4 2024-09-18T12:53:46.828 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: strict_capacity_limit : 0 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_cache_compressed: (nil) 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: persistent_cache: (nil) 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_size: 4096 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_size_deviation: 10 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_restart_interval: 16 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: index_block_restart_interval: 1 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: metadata_block_size: 4096 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: partition_filters: 0 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: use_delta_encoding: 1 2024-09-18T12:53:46.829 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: filter_policy: bloomfilter 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: whole_key_filtering: 1 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: verify_compression: 0 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: format_version: 5 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: enable_index_compression: 1 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: block_align: 0 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: max_auto_readahead_size: 262144 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: prepopulate_block_cache: 0 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:53:46.830 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression: NoCompression 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.num_levels: 7 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:53:46.831 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:53:46.832 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:53:46.833 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:53:46.834 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:53:46.835 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:53:46.836 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.ttl: 2592000 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:53:46.837 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:53:46.838 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi136/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12192, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e4245e8d-0dde-4f27-98ac-e6b6f7811bf2 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664026569785, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664026585772, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4577374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12197, "largest_seqno": 14331, "table_properties": {"data_size": 4568479, "index_size": 5737, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2117, "raw_key_size": 19001, "raw_average_key_size": 22, "raw_value_size": 4550803, "raw_average_value_size": 5496, "num_data_blocks": 260, "num_entries": 828, "num_filter_entries": 828, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664026, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e4245e8d-0dde-4f27-98ac-e6b6f7811bf2", "db_session_id": "37S06JN43KL7MAI8UL4M", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664026585896, "job": 1, "event": "recovery_finished"} 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:46.839 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi136/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c05a978e00 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: DB pointer 0x55c05aa7a000 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** DB Stats ** 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:53:46.840 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: L0 1/0 4.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.8 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: L6 1/0 4.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Sum 2/0 9.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.8 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.8 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-18T12:53:46.841 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 734.8 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:53:46.842 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Cumulative compaction: 0.00 GB write, 233.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Interval compaction: 0.00 GB write, 233.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Block cache BinnedLRUCache@0x55c05a949610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: starting mon.smithi136 rank 1 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi136 fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:46.843 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???) e2 preinit fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).mds e20 new map 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).mds e20 print_map 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: e20 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: legacy client fscid: 1 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:53:46.844 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: fs_name cephfs 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: epoch 20 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: tableserver 0 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: root 0 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: session_timeout 60 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: session_autoclose 300 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: max_file_size 1099511627776 2024-09-18T12:53:46.845 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: max_xattr_size 65536 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: required_client_features {} 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: last_failure 0 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: last_failure_osd_epoch 47 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: max_mds 2 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: in 0,1 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: up {0=14544,1=14556} 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: failed 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: damaged 2024-09-18T12:53:46.846 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: stopped 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: data_pools [3] 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: metadata_pool 2 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: inline_data disabled 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: balancer 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: bal_rank_mask -1 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: standby_count_wanted 1 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: qdb_cluster leader: 0 members: 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: [mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: [mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.847 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: Standby daemons: 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: [mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout: [mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 ceph-mon[80179]: mon.smithi136@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 bash[80160]: 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 2024-09-18T12:53:46.848 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:46 smithi136 systemd[1]: Started Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:53:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: overall HEALTH_OK 2024-09-18T12:53:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: mon.smithi081 calling monitor election 2024-09-18T12:53:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: mon.smithi136 calling monitor election 2024-09-18T12:53:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi081"} : dispatch 2024-09-18T12:53:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi136"} : dispatch 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: monmap epoch 3 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: last_changed 2024-09-18T12:53:47.295033+0000 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: created 2024-09-18T12:40:54.860777+0000 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: min_mon_release 19 (squid) 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: election_strategy: 1 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.smithi136 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: mgrmap e37: smithi081.pfnvgp(active, since 13s), standbys: smithi136.vdkrdt 2024-09-18T12:53:48.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: overall HEALTH_OK 2024-09-18T12:53:48.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:48.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:48.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:48.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:48 smithi136 ceph-mon[80179]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:48.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: overall HEALTH_OK 2024-09-18T12:53:48.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: mon.smithi081 calling monitor election 2024-09-18T12:53:48.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: mon.smithi136 calling monitor election 2024-09-18T12:53:48.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi081"} : dispatch 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: mon.smithi081 is new leader, mons smithi081,smithi136 in quorum (ranks 0,1) 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mon metadata", "id": "smithi136"} : dispatch 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: monmap epoch 3 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: fsid 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: last_changed 2024-09-18T12:53:47.295033+0000 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: created 2024-09-18T12:40:54.860777+0000 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: min_mon_release 19 (squid) 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: election_strategy: 1 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.smithi136 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:53:48.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: mgrmap e37: smithi081.pfnvgp(active, since 13s), standbys: smithi136.vdkrdt 2024-09-18T12:53:48.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: overall HEALTH_OK 2024-09-18T12:53:48.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:48.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:48.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:48.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:48 smithi081 ceph-mon[92545]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:49.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:49.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:51.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:50 smithi136 ceph-mon[80179]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:51.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.103 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:50 smithi081 ceph-mon[92545]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:52 smithi081 ceph-mon[92545]: pgmap v12: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:52.981 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:52 smithi136 ceph-mon[80179]: pgmap v12: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:53:55.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: Reconfiguring mon.smithi081 (monmap changed)... 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: Reconfiguring daemon mon.smithi081 on smithi081 2024-09-18T12:53:55.007 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:54 smithi081 ceph-mon[92545]: pgmap v13: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: Reconfiguring mon.smithi081 (monmap changed)... 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: Reconfiguring daemon mon.smithi081 on smithi081 2024-09-18T12:53:55.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:54 smithi136 ceph-mon[80179]: pgmap v13: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: Reconfiguring mgr.smithi081.pfnvgp (monmap changed)... 2024-09-18T12:53:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-18T12:53:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr services"} : dispatch 2024-09-18T12:53:56.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:56.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: Reconfiguring daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:53:56.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:56 smithi136 ceph-mon[80179]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:56.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:56.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:56.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: Reconfiguring mgr.smithi081.pfnvgp (monmap changed)... 2024-09-18T12:53:56.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi081.pfnvgp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-18T12:53:56.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr services"} : dispatch 2024-09-18T12:53:56.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:56.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: Reconfiguring daemon mgr.smithi081.pfnvgp on smithi081 2024-09-18T12:53:56.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:56 smithi081 ceph-mon[92545]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: Reconfiguring ceph-exporter.smithi081 (monmap changed)... 2024-09-18T12:53:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: Unable to update caps for client.ceph-exporter.smithi081 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi081"} : dispatch 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:58.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:57 smithi136 ceph-mon[80179]: Reconfiguring daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:53:58.072 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: Reconfiguring ceph-exporter.smithi081 (monmap changed)... 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: Unable to update caps for client.ceph-exporter.smithi081 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi081"} : dispatch 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:58.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:57 smithi081 ceph-mon[92545]: Reconfiguring daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:53:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:58 smithi136 ceph-mon[80179]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:58 smithi081 ceph-mon[92545]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:53:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: Reconfiguring crash.smithi081 (monmap changed)... 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: Reconfiguring daemon crash.smithi081 on smithi081 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:00.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:53:59 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:00.105 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: Reconfiguring crash.smithi081 (monmap changed)... 2024-09-18T12:54:00.105 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: Reconfiguring daemon crash.smithi081 on smithi081 2024-09-18T12:54:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:00.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:53:59 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:00.982 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:00 smithi081 ceph-mon[92545]: Reconfiguring osd.0 (monmap changed)... 2024-09-18T12:54:00.982 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:00 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.0 on smithi081 2024-09-18T12:54:00.982 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:00 smithi081 ceph-mon[92545]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:00 smithi136 ceph-mon[80179]: Reconfiguring osd.0 (monmap changed)... 2024-09-18T12:54:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:00 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.0 on smithi081 2024-09-18T12:54:01.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:00 smithi136 ceph-mon[80179]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: Reconfiguring osd.1 (monmap changed)... 2024-09-18T12:54:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:54:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:02.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.1 on smithi081 2024-09-18T12:54:02.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:02 smithi081 ceph-mon[92545]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: Reconfiguring osd.1 (monmap changed)... 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.1 on smithi081 2024-09-18T12:54:02.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:02 smithi136 ceph-mon[80179]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: Reconfiguring osd.2 (monmap changed)... 2024-09-18T12:54:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:54:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:03.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:03 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.2 on smithi081 2024-09-18T12:54:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: Reconfiguring osd.2 (monmap changed)... 2024-09-18T12:54:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:54:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:03 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.2 on smithi081 2024-09-18T12:54:04.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:04.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:04.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:04.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:04.743 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:04.744 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: Reconfiguring mds.cephfs.smithi081.irimad (monmap changed)... 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: Reconfiguring daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:05.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: Reconfiguring mds.cephfs.smithi081.irimad (monmap changed)... 2024-09-18T12:54:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: Reconfiguring daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:54:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:06.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:06.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:06.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:06.965 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:06 smithi136 ceph-mon[80179]: Reconfiguring mds.cephfs.smithi081.hmnvyn (monmap changed)... 2024-09-18T12:54:06.965 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:06 smithi136 ceph-mon[80179]: Reconfiguring daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:54:06.966 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:06 smithi136 ceph-mon[80179]: pgmap v19: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:06.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:06 smithi081 ceph-mon[92545]: Reconfiguring mds.cephfs.smithi081.hmnvyn (monmap changed)... 2024-09-18T12:54:06.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:06 smithi081 ceph-mon[92545]: Reconfiguring daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:54:06.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:06 smithi081 ceph-mon[92545]: pgmap v19: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: Reconfiguring ceph-exporter.smithi136 (monmap changed)... 2024-09-18T12:54:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: Unable to update caps for client.ceph-exporter.smithi136 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi136"} : dispatch 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: Reconfiguring daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:54:08.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:08 smithi136 ceph-mon[80179]: pgmap v20: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: Reconfiguring ceph-exporter.smithi136 (monmap changed)... 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: Unable to update caps for client.ceph-exporter.smithi136 2024-09-18T12:54:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi136"} : dispatch 2024-09-18T12:54:08.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:08.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: Reconfiguring daemon ceph-exporter.smithi136 on smithi136 2024-09-18T12:54:08.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:08 smithi081 ceph-mon[92545]: pgmap v20: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 -- 172.21.15.81:0/4184992613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 msgr2=0x7fe414073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/4184992613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe414073c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe404009910 tx=0x7fe404009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 -- 172.21.15.81:0/4184992613 shutdown_connections 2024-09-18T12:54:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/4184992613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe414073c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/4184992613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 0x7fe414073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 -- 172.21.15.81:0/4184992613 >> 172.21.15.81:0/4184992613 conn(0x7fe4140fc230 msgr2=0x7fe4140fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 -- 172.21.15.81:0/4184992613 shutdown_connections 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.392+0000 7fe41bb4b700 1 -- 172.21.15.81:0/4184992613 wait complete. 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 Processor -- start 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 -- start start 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 0x7fe41419d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419d670 con 0x7fe4140737f0 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe41bb4b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419d7b0 con 0x7fe414074dc0 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60512/0 (socket says 172.21.15.81:60512) 2024-09-18T12:54:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 -- 172.21.15.81:0/945884401 learned_addr learned my addr 172.21.15.81:0/945884401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4190e6700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 0x7fe41419d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 -- 172.21.15.81:0/945884401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 msgr2=0x7fe41419d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 0x7fe41419d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.393+0000 7fe4198e7700 1 -- 172.21.15.81:0/945884401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040095f0 con 0x7fe4140737f0 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe4198e7700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e90 tx=0x7fe41000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41000dda0 con 0x7fe4140737f0 2024-09-18T12:54:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe41000f040 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4141a2260 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe410012610 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.394+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4141a27b0 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.395+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41410fe40 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.395+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fe4100128d0 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.396+0000 7fe40affd700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 0x7fe40007d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.396+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe41009ddf0 con 0x7fe4140737f0 2024-09-18T12:54:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.396+0000 7fe4190e6700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 0x7fe40007d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.397+0000 7fe4190e6700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 0x7fe40007d8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe404005950 tx=0x7fe4040058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.401+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe410060ce0 con 0x7fe4140737f0 2024-09-18T12:54:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.632+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe414103cb0 con 0x7fe40007b420 2024-09-18T12:54:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.633+0000 7fe40affd700 1 -- 172.21.15.81:0/945884401 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe414103cb0 con 0x7fe40007b420 2024-09-18T12:54:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 msgr2=0x7fe40007d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 0x7fe40007d8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe404005950 tx=0x7fe4040058e0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 msgr2=0x7fe41419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e90 tx=0x7fe41000d3b0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 shutdown_connections 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe40007b420 0x7fe40007d8e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4140737f0 0x7fe41419cb10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 --2- 172.21.15.81:0/945884401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe414074dc0 0x7fe41419d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 >> 172.21.15.81:0/945884401 conn(0x7fe4140fc230 msgr2=0x7fe414102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 shutdown_connections 2024-09-18T12:54:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.635+0000 7fe41bb4b700 1 -- 172.21.15.81:0/945884401 wait complete. 2024-09-18T12:54:08.648 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- 172.21.15.81:0/3458321293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 msgr2=0x7f6d481015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/3458321293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d481015d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009910 tx=0x7f6d38009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- 172.21.15.81:0/3458321293 shutdown_connections 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/3458321293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 0x7f6d48100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/3458321293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d481015d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- 172.21.15.81:0/3458321293 >> 172.21.15.81:0/3458321293 conn(0x7f6d480fa8c0 msgr2=0x7f6d480fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- 172.21.15.81:0/3458321293 shutdown_connections 2024-09-18T12:54:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- 172.21.15.81:0/3458321293 wait complete. 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 Processor -- start 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.742+0000 7f6d4d82f700 1 -- start start 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4d82f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 0x7f6d481953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4d82f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4d82f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48195f40 con 0x7f6d481011b0 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4d82f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48196080 con 0x7f6d480ffe10 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60528/0 (socket says 172.21.15.81:60528) 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 -- 172.21.15.81:0/1110526243 learned_addr learned my addr 172.21.15.81:0/1110526243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d46ffd700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 0x7f6d481953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 -- 172.21.15.81:0/1110526243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 msgr2=0x7f6d481953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 0x7f6d481953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 -- 172.21.15.81:0/1110526243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380095f0 con 0x7f6d481011b0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d467fc700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d900 tx=0x7f6d3c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c0041f0 con 0x7f6d481011b0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d3c004ce0 con 0x7f6d481011b0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c00b750 con 0x7f6d481011b0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.743+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4819ab30 con 0x7f6d481011b0 2024-09-18T12:54:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.744+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480fefe0 con 0x7f6d481011b0 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.745+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48108710 con 0x7f6d481011b0 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.745+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f6d3c004e50 con 0x7f6d481011b0 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.746+0000 7f6d4c82d700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 0x7f6d3007d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.746+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6d3c09e3a0 con 0x7f6d481011b0 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.746+0000 7f6d46ffd700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 0x7f6d3007d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.746+0000 7f6d46ffd700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 0x7f6d3007d8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d38006010 tx=0x7f6d3800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.750+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6d3c061290 con 0x7f6d481011b0 2024-09-18T12:54:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.983+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d480ffbe0 con 0x7f6d3007b420 2024-09-18T12:54:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.984+0000 7f6d4c82d700 1 -- 172.21.15.81:0/1110526243 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6d480ffbe0 con 0x7f6d3007b420 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 msgr2=0x7f6d3007d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 0x7f6d3007d8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d38006010 tx=0x7f6d3800b560 comp rx=0 tx=0).stop 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 msgr2=0x7f6d48195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d900 tx=0x7f6d3c00dc10 comp rx=0 tx=0).stop 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 shutdown_connections 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6d3007b420 0x7f6d3007d8e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d480ffe10 0x7f6d481953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 --2- 172.21.15.81:0/1110526243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d481011b0 0x7f6d48195920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.986+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 >> 172.21.15.81:0/1110526243 conn(0x7f6d480fa8c0 msgr2=0x7f6d48104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.988+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 shutdown_connections 2024-09-18T12:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:08.988+0000 7f6d4d82f700 1 -- 172.21.15.81:0/1110526243 wait complete. 2024-09-18T12:54:09.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/3531796428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 msgr2=0x7f5e78102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/3531796428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78102310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009910 tx=0x7f5e6c009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/3531796428 shutdown_connections 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/3531796428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78102310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/3531796428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 0x7f5e781010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/3531796428 >> 172.21.15.81:0/3531796428 conn(0x7f5e780fc230 msgr2=0x7f5e780fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/3531796428 shutdown_connections 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/3531796428 wait complete. 2024-09-18T12:54:09.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.092+0000 7f5e7dbe7700 1 Processor -- start 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e7dbe7700 1 -- start start 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e7dbe7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 0x7f5e78074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e7dbe7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e7dbe7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780736c0 con 0x7f5e78101eb0 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e7dbe7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78073800 con 0x7f5e78100cb0 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60536/0 (socket says 172.21.15.81:60536) 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 -- 172.21.15.81:0/1324933464 learned_addr learned my addr 172.21.15.81:0/1324933464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e777fe700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 0x7f5e78074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 -- 172.21.15.81:0/1324933464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 msgr2=0x7f5e78074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 0x7f5e78074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 -- 172.21.15.81:0/1324933464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0095f0 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e76ffd700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b5c0 tx=0x7f5e6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.093+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c01d070 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.094+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e78073a80 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.094+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e6c022470 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.094+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c00f690 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.094+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e78073f70 con 0x7f5e78101eb0 2024-09-18T12:54:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.094+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e78109810 con 0x7f5e78101eb0 2024-09-18T12:54:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.095+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f5e6c0225e0 con 0x7f5e78101eb0 2024-09-18T12:54:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.096+0000 7f5e74ff9700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 0x7f5e6007d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.096+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f5e6c09fc50 con 0x7f5e78101eb0 2024-09-18T12:54:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.096+0000 7f5e777fe700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 0x7f5e6007d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.096+0000 7f5e777fe700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 0x7f5e6007d8e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e78101d10 tx=0x7f5e6800a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.100+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5e6c062b40 con 0x7f5e78101eb0 2024-09-18T12:54:09.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.317+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e78106800 con 0x7f5e6007b420 2024-09-18T12:54:09.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.327+0000 7f5e74ff9700 1 -- 172.21.15.81:0/1324933464 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5e78106800 con 0x7f5e6007b420 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (9m) 29s ago 11m 25.2M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (2m) 29s ago 11m 7512k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (2m) 19s ago 10m 7235k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (11m) 29s ago 11m 6660k - 18.2.1 5be31c24972a b659395580c3 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (10m) 19s ago 10m 6669k - 18.2.1 5be31c24972a 0d4e21ade1a4 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (9m) 29s ago 11m 85.9M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (5m) 29s ago 5m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (5m) 29s ago 5m 133M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (5m) 19s ago 5m 19.4M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (5m) 19s ago 5m 15.3M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:54:09.329 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (2m) 29s ago 13m 487M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (59s) 19s ago 10m 452M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (43s) 29s ago 13m 29.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (23s) 19s ago 10m 25.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (11m) 29s ago 11m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (10m) 19s ago 10m 14.9M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (9m) 29s ago 9m 253M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (8m) 29s ago 8m 243M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (8m) 29s ago 8m 191M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (7m) 19s ago 7m 285M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (7m) 19s ago 7m 243M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (6m) 19s ago 6m 222M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:54:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (64s) 29s ago 11m 55.3M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:54:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.329+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 msgr2=0x7f5e6007d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.329+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 0x7f5e6007d8e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e78101d10 tx=0x7f5e6800a380 comp rx=0 tx=0).stop 2024-09-18T12:54:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.329+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 msgr2=0x7f5e78073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.329+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b5c0 tx=0x7f5e6c00bd70 comp rx=0 tx=0).stop 2024-09-18T12:54:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 shutdown_connections 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e6007b420 0x7f5e6007d8e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e78100cb0 0x7f5e78074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 --2- 172.21.15.81:0/1324933464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e78101eb0 0x7f5e78073180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 >> 172.21.15.81:0/1324933464 conn(0x7f5e780fc230 msgr2=0x7f5e781050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 shutdown_connections 2024-09-18T12:54:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.330+0000 7f5e7dbe7700 1 -- 172.21.15.81:0/1324933464 wait complete. 2024-09-18T12:54:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.431+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/2020585860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc0ffe20 msgr2=0x7f3bbc1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.431+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/2020585860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1002a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009910 tx=0x7f3bb0009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/2020585860 shutdown_connections 2024-09-18T12:54:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/2020585860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1002a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/2020585860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/2020585860 >> 172.21.15.81:0/2020585860 conn(0x7f3bbc0fa8b0 msgr2=0x7f3bbc0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/2020585860 shutdown_connections 2024-09-18T12:54:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/2020585860 wait complete. 2024-09-18T12:54:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 Processor -- start 2024-09-18T12:54:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.432+0000 7f3bc0b5a700 1 -- start start 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc196f70 con 0x7f3bbc1011c0 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1970b0 con 0x7f3bbc0ffe20 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60552/0 (socket says 172.21.15.81:60552) 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 -- 172.21.15.81:0/407063666 learned_addr learned my addr 172.21.15.81:0/407063666 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bba59c700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 -- 172.21.15.81:0/407063666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc0ffe20 msgr2=0x7f3bbc1964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 -- 172.21.15.81:0/407063666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00095f0 con 0x7f3bbc1011c0 2024-09-18T12:54:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bb9d9b700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000bd70 tx=0x7f3bb000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb001d070 con 0x7f3bbc1011c0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3bb0005940 con 0x7f3bbc1011c0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc19bb10 con 0x7f3bbc1011c0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb0021430 con 0x7f3bbc1011c0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.433+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc19bfd0 con 0x7f3bbc1011c0 2024-09-18T12:54:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.434+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc108720 con 0x7f3bbc1011c0 2024-09-18T12:54:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.435+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f3bb000f860 con 0x7f3bbc1011c0 2024-09-18T12:54:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.435+0000 7f3bab7fe700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 0x7f3ba407d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.436+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3bb009f780 con 0x7f3bbc1011c0 2024-09-18T12:54:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.436+0000 7f3bba59c700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 0x7f3ba407d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.436+0000 7f3bba59c700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 0x7f3ba407d8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc068c10 tx=0x7f3bac00a3b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.440+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3bb0062670 con 0x7f3bbc1011c0 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: Reconfiguring crash.smithi136 (monmap changed)... 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: Reconfiguring daemon crash.smithi136 on smithi136 2024-09-18T12:54:09.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:09 smithi081 ceph-mon[92545]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:09.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.738+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bbc1088e0 con 0x7f3bbc1011c0 2024-09-18T12:54:09.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.739+0000 7f3bab7fe700 1 -- 172.21.15.81:0/407063666 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f3bb0065790 con 0x7f3bbc1011c0 2024-09-18T12:54:09.740 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:54:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:54:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-09-18T12:54:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:54:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:54:09.742 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 msgr2=0x7f3ba407d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 0x7f3ba407d8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc068c10 tx=0x7f3bac00a3b0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 msgr2=0x7f3bbc1969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000bd70 tx=0x7f3bb000bda0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 shutdown_connections 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3ba407b430 0x7f3ba407d8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bbc0ffe20 0x7f3bbc1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 --2- 172.21.15.81:0/407063666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bbc1011c0 0x7f3bbc1969e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 >> 172.21.15.81:0/407063666 conn(0x7f3bbc0fa8b0 msgr2=0x7f3bbc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 shutdown_connections 2024-09-18T12:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.741+0000 7f3bc0b5a700 1 -- 172.21.15.81:0/407063666 wait complete. 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: Reconfiguring crash.smithi136 (monmap changed)... 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: Reconfiguring daemon crash.smithi136 on smithi136 2024-09-18T12:54:09.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:09 smithi136 ceph-mon[80179]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:09.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 -- 172.21.15.81:0/3461391444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c0ffc10 msgr2=0x7f7b8c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 --2- 172.21.15.81:0/3461391444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c100030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009910 tx=0x7f7b7c009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 -- 172.21.15.81:0/3461391444 shutdown_connections 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 --2- 172.21.15.81:0/3461391444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c100e10 0x7f7b8c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 --2- 172.21.15.81:0/3461391444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c100030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 -- 172.21.15.81:0/3461391444 >> 172.21.15.81:0/3461391444 conn(0x7f7b8c0fb190 msgr2=0x7f7b8c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 -- 172.21.15.81:0/3461391444 shutdown_connections 2024-09-18T12:54:09.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.845+0000 7f7b927aa700 1 -- 172.21.15.81:0/3461391444 wait complete. 2024-09-18T12:54:09.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 Processor -- start 2024-09-18T12:54:09.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 -- start start 2024-09-18T12:54:09.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c197050 con 0x7f7b8c100e10 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b927aa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c197190 con 0x7f7b8c0ffc10 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60556/0 (socket says 172.21.15.81:60556) 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 -- 172.21.15.81:0/1498349698 learned_addr learned my addr 172.21.15.81:0/1498349698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b8bfff700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 -- 172.21.15.81:0/1498349698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c0ffc10 msgr2=0x7f7b8c1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 -- 172.21.15.81:0/1498349698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0095f0 con 0x7f7b8c100e10 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.846+0000 7f7b83fff700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400e920 tx=0x7f7b7400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.847+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b7400c9d0 con 0x7f7b8c100e10 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.847+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b74010430 con 0x7f7b8c100e10 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.847+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c19bc40 con 0x7f7b8c100e10 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.847+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b74018650 con 0x7f7b8c100e10 2024-09-18T12:54:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.847+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c19c190 con 0x7f7b8c100e10 2024-09-18T12:54:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.848+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c108700 con 0x7f7b8c100e10 2024-09-18T12:54:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.848+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f7b740105a0 con 0x7f7b8c100e10 2024-09-18T12:54:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.849+0000 7f7b89ffb700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 0x7f7b7807d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.849+0000 7f7b8bfff700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 0x7f7b7807d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.849+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f7b74014070 con 0x7f7b8c100e10 2024-09-18T12:54:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.849+0000 7f7b8bfff700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 0x7f7b7807d8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009fd0 tx=0x7f7b7c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:09.853+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f7b74061670 con 0x7f7b8c100e10 2024-09-18T12:54:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.110+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b8c1088f0 con 0x7f7b8c100e10 2024-09-18T12:54:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.110+0000 7f7b89ffb700 1 -- 172.21.15.81:0/1498349698 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7f7b74064790 con 0x7f7b8c100e10 2024-09-18T12:54:10.112 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:54:10.112 INFO:teuthology.orchestra.run.smithi081.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:54:10.112 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:54:10.112 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:54:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:54:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:54:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:54:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:10.117 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 msgr2=0x7f7b7807d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 0x7f7b7807d8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009fd0 tx=0x7f7b7c005a90 comp rx=0 tx=0).stop 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 msgr2=0x7f7b8c196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400e920 tx=0x7f7b7400ec30 comp rx=0 tx=0).stop 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 shutdown_connections 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7b7807b420 0x7f7b7807d8e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b8c0ffc10 0x7f7b8c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 --2- 172.21.15.81:0/1498349698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b8c100e10 0x7f7b8c196a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.113+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 >> 172.21.15.81:0/1498349698 conn(0x7f7b8c0fb190 msgr2=0x7f7b8c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.114+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 shutdown_connections 2024-09-18T12:54:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.114+0000 7f7b927aa700 1 -- 172.21.15.81:0/1498349698 wait complete. 2024-09-18T12:54:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:54:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 -- 172.21.15.81:0/3358929274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c0ffc10 msgr2=0x7f112c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 --2- 172.21.15.81:0/3358929274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c0ffc10 0x7f112c100030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f111c009910 tx=0x7f111c009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 -- 172.21.15.81:0/3358929274 shutdown_connections 2024-09-18T12:54:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 --2- 172.21.15.81:0/3358929274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c100e10 0x7f112c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 --2- 172.21.15.81:0/3358929274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c0ffc10 0x7f112c100030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 -- 172.21.15.81:0/3358929274 >> 172.21.15.81:0/3358929274 conn(0x7f112c0fb190 msgr2=0x7f112c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 -- 172.21.15.81:0/3358929274 shutdown_connections 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 -- 172.21.15.81:0/3358929274 wait complete. 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.219+0000 7f1130976700 1 Processor -- start 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1130976700 1 -- start start 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1130976700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 0x7f112c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1130976700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1130976700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c196fa0 con 0x7f112c100e10 2024-09-18T12:54:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1130976700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c1970e0 con 0x7f112c0ffc10 2024-09-18T12:54:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60578/0 (socket says 172.21.15.81:60578) 2024-09-18T12:54:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 -- 172.21.15.81:0/95097198 learned_addr learned my addr 172.21.15.81:0/95097198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f112a59c700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 0x7f112c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 -- 172.21.15.81:0/95097198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 msgr2=0x7f112c1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 0x7f112c1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 -- 172.21.15.81:0/95097198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0095f0 con 0x7f112c100e10 2024-09-18T12:54:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f112a59c700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 0x7f112c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:10.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.220+0000 7f1121d9b700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f111400c930 tx=0x7f111400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.221+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1114007ad0 con 0x7f112c100e10 2024-09-18T12:54:10.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.221+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c19bba0 con 0x7f112c100e10 2024-09-18T12:54:10.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.221+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1114007c30 con 0x7f112c100e10 2024-09-18T12:54:10.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.221+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1114018630 con 0x7f112c100e10 2024-09-18T12:54:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.221+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c19c0c0 con 0x7f112c100e10 2024-09-18T12:54:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.222+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c108700 con 0x7f112c100e10 2024-09-18T12:54:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.222+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f111400f450 con 0x7f112c100e10 2024-09-18T12:54:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.223+0000 7f1123fff700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 0x7f111807d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.223+0000 7f112a59c700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 0x7f111807d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.223+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f111409e6b0 con 0x7f112c100e10 2024-09-18T12:54:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.223+0000 7f112a59c700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 0x7f111807d8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f111c006010 tx=0x7f111c005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.227+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f11140615a0 con 0x7f112c100e10 2024-09-18T12:54:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.456+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f112c19c730 con 0x7f111807b430 2024-09-18T12:54:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.458+0000 7f1123fff700 1 -- 172.21.15.81:0/95097198 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f112c19c730 con 0x7f111807b430 2024-09-18T12:54:10.460 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:54:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:54:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "4/23 daemons upgraded", 2024-09-18T12:54:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mon daemons", 2024-09-18T12:54:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:54:10.462 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:54:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 msgr2=0x7f111807d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 0x7f111807d8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f111c006010 tx=0x7f111c005ab0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 msgr2=0x7f112c196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f111400c930 tx=0x7f111400ccf0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 shutdown_connections 2024-09-18T12:54:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111807b430 0x7f111807d8f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112c0ffc10 0x7f112c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.460+0000 7f1130976700 1 --2- 172.21.15.81:0/95097198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f112c100e10 0x7f112c196a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.461+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 >> 172.21.15.81:0/95097198 conn(0x7f112c0fb190 msgr2=0x7f112c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.461+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 shutdown_connections 2024-09-18T12:54:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.461+0000 7f1130976700 1 -- 172.21.15.81:0/95097198 wait complete. 2024-09-18T12:54:10.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- 172.21.15.81:0/2202830160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8100cb0 msgr2=0x7f6bb81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 --2- 172.21.15.81:0/2202830160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81010d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009910 tx=0x7f6bac009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- 172.21.15.81:0/2202830160 shutdown_connections 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 --2- 172.21.15.81:0/2202830160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 --2- 172.21.15.81:0/2202830160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81010d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- 172.21.15.81:0/2202830160 >> 172.21.15.81:0/2202830160 conn(0x7f6bb80fc230 msgr2=0x7f6bb80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- 172.21.15.81:0/2202830160 shutdown_connections 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- 172.21.15.81:0/2202830160 wait complete. 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 Processor -- start 2024-09-18T12:54:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- start start 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8197020 con 0x7f6bb8101eb0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.565+0000 7f6bbea81700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8197160 con 0x7f6bb8100cb0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60590/0 (socket says 172.21.15.81:60590) 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 -- 172.21.15.81:0/1118668541 learned_addr learned my addr 172.21.15.81:0/1118668541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bbc81d700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 -- 172.21.15.81:0/1118668541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8100cb0 msgr2=0x7f6bb81964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 -- 172.21.15.81:0/1118668541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0095f0 con 0x7f6bb8101eb0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb7fff700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d8d0 tx=0x7f6ba400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba40098a0 con 0x7f6bb8101eb0 2024-09-18T12:54:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ba4010460 con 0x7f6bb8101eb0 2024-09-18T12:54:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba400f5f0 con 0x7f6bb8101eb0 2024-09-18T12:54:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb819bc10 con 0x7f6bb8101eb0 2024-09-18T12:54:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.566+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb819c160 con 0x7f6bb8101eb0 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.567+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8109810 con 0x7f6bb8101eb0 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.568+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f6ba4009a00 con 0x7f6bb8101eb0 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.569+0000 7f6bb5ffb700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 0x7f6ba807d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.569+0000 7f6bbc81d700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 0x7f6ba807d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.569+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6ba409e300 con 0x7f6bb8101eb0 2024-09-18T12:54:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.569+0000 7f6bbc81d700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 0x7f6ba807d8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006010 tx=0x7f6bac00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.573+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6ba4061210 con 0x7f6bb8101eb0 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/407063666' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: pgmap v21: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: Reconfiguring mgr.smithi136.vdkrdt (monmap changed)... 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr services"} : dispatch 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: Reconfiguring daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:54:10.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:10 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1498349698' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/407063666' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: pgmap v21: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:10.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: Reconfiguring mgr.smithi136.vdkrdt (monmap changed)... 2024-09-18T12:54:10.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi136.vdkrdt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-18T12:54:10.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mgr services"} : dispatch 2024-09-18T12:54:10.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:10.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: Reconfiguring daemon mgr.smithi136.vdkrdt on smithi136 2024-09-18T12:54:10.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:10 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1498349698' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.866+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6bb8109a00 con 0x7f6bb8101eb0 2024-09-18T12:54:10.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.867+0000 7f6bb5ffb700 1 -- 172.21.15.81:0/1118668541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6ba4064330 con 0x7f6bb8101eb0 2024-09-18T12:54:10.868 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:54:10.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 msgr2=0x7f6ba807d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 0x7f6ba807d8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006010 tx=0x7f6bac00b540 comp rx=0 tx=0).stop 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 msgr2=0x7f6bb8196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d8d0 tx=0x7f6ba400dbe0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 shutdown_connections 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6ba807b430 0x7f6ba807d8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb8100cb0 0x7f6bb81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 --2- 172.21.15.81:0/1118668541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb8101eb0 0x7f6bb8196a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 >> 172.21.15.81:0/1118668541 conn(0x7f6bb80fc230 msgr2=0x7f6bb81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 shutdown_connections 2024-09-18T12:54:10.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:10.870+0000 7f6bbea81700 1 -- 172.21.15.81:0/1118668541 wait complete. 2024-09-18T12:54:11.795 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1118668541' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:54:11.796 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:11 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1118668541' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-18T12:54:11.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:11 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:12 smithi136 ceph-mon[80179]: Reconfiguring mon.smithi136 (monmap changed)... 2024-09-18T12:54:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:12 smithi136 ceph-mon[80179]: Reconfiguring daemon mon.smithi136 on smithi136 2024-09-18T12:54:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:12 smithi136 ceph-mon[80179]: pgmap v22: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:12 smithi081 ceph-mon[92545]: Reconfiguring mon.smithi136 (monmap changed)... 2024-09-18T12:54:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:12 smithi081 ceph-mon[92545]: Reconfiguring daemon mon.smithi136 on smithi136 2024-09-18T12:54:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:12 smithi081 ceph-mon[92545]: pgmap v22: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: Reconfiguring osd.3 (monmap changed)... 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:13.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:13 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.3 on smithi136 2024-09-18T12:54:14.001 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:14.002 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:14.002 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: Reconfiguring osd.3 (monmap changed)... 2024-09-18T12:54:14.002 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:54:14.002 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:14.002 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:13 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.3 on smithi136 2024-09-18T12:54:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:14 smithi136 ceph-mon[80179]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:54:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:15.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:14 smithi081 ceph-mon[92545]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:15.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:54:15.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: Reconfiguring osd.4 (monmap changed)... 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.4 on smithi136 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:54:15.944 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: Reconfiguring osd.4 (monmap changed)... 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.4 on smithi136 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:54:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:17.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:16 smithi136 ceph-mon[80179]: Reconfiguring osd.5 (monmap changed)... 2024-09-18T12:54:17.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:16 smithi136 ceph-mon[80179]: Reconfiguring daemon osd.5 on smithi136 2024-09-18T12:54:17.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:16 smithi136 ceph-mon[80179]: pgmap v24: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:17.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:16 smithi081 ceph-mon[92545]: Reconfiguring osd.5 (monmap changed)... 2024-09-18T12:54:17.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:16 smithi081 ceph-mon[92545]: Reconfiguring daemon osd.5 on smithi136 2024-09-18T12:54:17.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:16 smithi081 ceph-mon[92545]: pgmap v24: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: Reconfiguring mds.cephfs.smithi136.tfcykk (monmap changed)... 2024-09-18T12:54:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:18.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:18.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:17 smithi081 ceph-mon[92545]: Reconfiguring daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:54:18.163 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:18.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:18.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: Reconfiguring mds.cephfs.smithi136.tfcykk (monmap changed)... 2024-09-18T12:54:18.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:18.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:18.164 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:17 smithi136 ceph-mon[80179]: Reconfiguring daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:54:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:18 smithi081 ceph-mon[92545]: pgmap v25: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:19.138 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:18 smithi136 ceph-mon[80179]: pgmap v25: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:19.138 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:19.138 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:19.138 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:54:19.138 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: Reconfiguring mds.cephfs.smithi136.lwvlbo (monmap changed)... 2024-09-18T12:54:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: Reconfiguring daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:54:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]': finished 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi136"} : dispatch 2024-09-18T12:54:20.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi136"}]': finished 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: Reconfiguring mds.cephfs.smithi136.lwvlbo (monmap changed)... 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: Reconfiguring daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"} : dispatch 2024-09-18T12:54:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]': finished 2024-09-18T12:54:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi136"} : dispatch 2024-09-18T12:54:20.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi136"}]': finished 2024-09-18T12:54:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:20 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all mon 2024-09-18T12:54:21.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:20 smithi081 ceph-mon[92545]: pgmap v26: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:20 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all mon 2024-09-18T12:54:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:20 smithi136 ceph-mon[80179]: pgmap v26: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:22.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:21 smithi081 ceph-mon[92545]: Upgrade: Updating crash.smithi081 (1/2) 2024-09-18T12:54:22.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:22.287 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:22.288 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:22.288 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:21 smithi081 ceph-mon[92545]: Deploying daemon crash.smithi081 on smithi081 2024-09-18T12:54:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:21 smithi136 ceph-mon[80179]: Upgrade: Updating crash.smithi081 (1/2) 2024-09-18T12:54:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:21 smithi136 ceph-mon[80179]: Deploying daemon crash.smithi081 on smithi081 2024-09-18T12:54:23.092 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:22 smithi081 ceph-mon[92545]: pgmap v27: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:22 smithi136 ceph-mon[80179]: pgmap v27: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:25.152 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:24 smithi136 ceph-mon[80179]: pgmap v28: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:25.152 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:24 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:25.153 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:24 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:24 smithi081 ceph-mon[92545]: pgmap v28: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:24 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:24 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:27.057 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: Upgrade: Updating crash.smithi136 (2/2) 2024-09-18T12:54:27.058 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:27.058 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:27.058 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:27.058 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: Deploying daemon crash.smithi136 on smithi136 2024-09-18T12:54:27.058 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:26 smithi136 ceph-mon[80179]: pgmap v29: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: Upgrade: Updating crash.smithi136 (2/2) 2024-09-18T12:54:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi136", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:54:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: Deploying daemon crash.smithi136 on smithi136 2024-09-18T12:54:27.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:26 smithi081 ceph-mon[92545]: pgmap v29: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:28 smithi081 ceph-mon[92545]: pgmap v30: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:28 smithi136 ceph-mon[80179]: pgmap v30: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:30 smithi081 ceph-mon[92545]: pgmap v31: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:30.449 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:30.449 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:30.449 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:30.449 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:30 smithi136 ceph-mon[80179]: pgmap v31: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:32 smithi081 ceph-mon[92545]: pgmap v32: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.183 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:32 smithi136 ceph-mon[80179]: pgmap v32: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:33.183 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.183 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.183 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:33.183 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.256 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: pgmap v33: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:35.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:35.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: pgmap v33: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:37.033 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:37.033 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:37.033 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:36 smithi136 ceph-mon[80179]: pgmap v34: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:37.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:37.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:37.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:36 smithi081 ceph-mon[92545]: pgmap v34: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: pgmap v35: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:39.095 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"} : dispatch 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]': finished 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi136"} : dispatch 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi136"}]': finished 2024-09-18T12:54:39.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: pgmap v35: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]': finished 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi136"} : dispatch 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi136"}]': finished 2024-09-18T12:54:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all crash 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: Upgrade: osd.0 is safe to restart 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:40.205 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all crash 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: Upgrade: osd.0 is safe to restart 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 -- 172.21.15.81:0/12456304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104070 msgr2=0x7f11e0106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 --2- 172.21.15.81:0/12456304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104070 0x7f11e0106460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009910 tx=0x7f11c8009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 -- 172.21.15.81:0/12456304 shutdown_connections 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 --2- 172.21.15.81:0/12456304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104070 0x7f11e0106460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 --2- 172.21.15.81:0/12456304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0101740 0x7f11e0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 -- 172.21.15.81:0/12456304 >> 172.21.15.81:0/12456304 conn(0x7f11e00fb150 msgr2=0x7f11e00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 -- 172.21.15.81:0/12456304 shutdown_connections 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.981+0000 7f11e529e700 1 -- 172.21.15.81:0/12456304 wait complete. 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 Processor -- start 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 -- start start 2024-09-18T12:54:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0104070 0x7f11e01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0196fc0 con 0x7f11e0101740 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11e529e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0197100 con 0x7f11e0104070 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35328/0 (socket says 172.21.15.81:35328) 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 -- 172.21.15.81:0/1711182376 learned_addr learned my addr 172.21.15.81:0/1711182376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11de7fc700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0104070 0x7f11e01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 -- 172.21.15.81:0/1711182376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0104070 msgr2=0x7f11e01969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0104070 0x7f11e01969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.982+0000 7f11deffd700 1 -- 172.21.15.81:0/1711182376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80095f0 con 0x7f11e0101740 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11deffd700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11d80060b0 tx=0x7f11d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d800dda0 con 0x7f11e0101740 2024-09-18T12:54:40.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11d800f040 con 0x7f11e0101740 2024-09-18T12:54:40.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e019bbb0 con 0x7f11e0101740 2024-09-18T12:54:40.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d8014790 con 0x7f11e0101740 2024-09-18T12:54:40.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.983+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e019c100 con 0x7f11e0101740 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.984+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0190620 con 0x7f11e0101740 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.984+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f11d80148f0 con 0x7f11e0101740 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.985+0000 7f11d7fff700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 0x7f11cc07d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.985+0000 7f11de7fc700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 0x7f11cc07d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.985+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f11d809df30 con 0x7f11e0101740 2024-09-18T12:54:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.986+0000 7f11de7fc700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 0x7f11cc07d8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11c800b5c0 tx=0x7f11c8005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:40.990+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f11d80d51f0 con 0x7f11e0101740 2024-09-18T12:54:41.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.230+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11e00611d0 con 0x7f11cc07b430 2024-09-18T12:54:41.232 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:40 smithi081 ceph-mon[92545]: Upgrade: Updating osd.0 2024-09-18T12:54:41.232 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:40 smithi081 ceph-mon[92545]: Deploying daemon osd.0 on smithi081 2024-09-18T12:54:41.232 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:40 smithi081 ceph-mon[92545]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.232+0000 7f11d7fff700 1 -- 172.21.15.81:0/1711182376 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f11e00611d0 con 0x7f11cc07b430 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 msgr2=0x7f11cc07d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 0x7f11cc07d8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11c800b5c0 tx=0x7f11c8005960 comp rx=0 tx=0).stop 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 msgr2=0x7f11e0196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11d80060b0 tx=0x7f11d800d3b0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 shutdown_connections 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f11cc07b430 0x7f11cc07d8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0101740 0x7f11e0196460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 --2- 172.21.15.81:0/1711182376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11e0104070 0x7f11e01969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 >> 172.21.15.81:0/1711182376 conn(0x7f11e00fb150 msgr2=0x7f11e00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 shutdown_connections 2024-09-18T12:54:41.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.234+0000 7f11e529e700 1 -- 172.21.15.81:0/1711182376 wait complete. 2024-09-18T12:54:41.246 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:54:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:40 smithi136 ceph-mon[80179]: Upgrade: Updating osd.0 2024-09-18T12:54:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:40 smithi136 ceph-mon[80179]: Deploying daemon osd.0 on smithi081 2024-09-18T12:54:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:40 smithi136 ceph-mon[80179]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 -- 172.21.15.81:0/2899965707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240100dc0 msgr2=0x7fd240101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 --2- 172.21.15.81:0/2899965707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240100dc0 0x7fd240101220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd234009910 tx=0x7fd234009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 -- 172.21.15.81:0/2899965707 shutdown_connections 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 --2- 172.21.15.81:0/2899965707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240100dc0 0x7fd240101220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 --2- 172.21.15.81:0/2899965707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2400ffbc0 0x7fd2400fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 -- 172.21.15.81:0/2899965707 >> 172.21.15.81:0/2899965707 conn(0x7fd2400fb160 msgr2=0x7fd2400fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 -- 172.21.15.81:0/2899965707 shutdown_connections 2024-09-18T12:54:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.341+0000 7fd2476ec700 1 -- 172.21.15.81:0/2899965707 wait complete. 2024-09-18T12:54:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 Processor -- start 2024-09-18T12:54:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 -- start start 2024-09-18T12:54:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 0x7fd24019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24019bb70 con 0x7fd2400ffbc0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd2476ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24019bce0 con 0x7fd240100dc0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd245488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd245488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35340/0 (socket says 172.21.15.81:35340) 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.342+0000 7fd245488700 1 -- 172.21.15.81:0/1892087028 learned_addr learned my addr 172.21.15.81:0/1892087028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd244c87700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 0x7fd24019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd245488700 1 -- 172.21.15.81:0/1892087028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 msgr2=0x7fd24019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd245488700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 0x7fd24019b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd245488700 1 -- 172.21.15.81:0/1892087028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340095f0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd244c87700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 0x7fd24019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd245488700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b9c0 tx=0x7fd23800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23800c980 con 0x7fd2400ffbc0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd238014440 con 0x7fd2400ffbc0 2024-09-18T12:54:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd238012550 con 0x7fd2400ffbc0 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24019bfc0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.343+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24019c4b0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.344+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24018f5d0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.345+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fd2380145b0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.345+0000 7fd23e7fc700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 0x7fd22807d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.345+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd238006e40 con 0x7fd2400ffbc0 2024-09-18T12:54:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.345+0000 7fd244c87700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 0x7fd22807d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.346+0000 7fd244c87700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 0x7fd22807d8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd234006010 tx=0x7fd23400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.349+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fd238060ad0 con 0x7fd2400ffbc0 2024-09-18T12:54:41.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.589+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2400611d0 con 0x7fd22807b420 2024-09-18T12:54:41.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.591+0000 7fd23e7fc700 1 -- 172.21.15.81:0/1892087028 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd2400611d0 con 0x7fd22807b420 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 msgr2=0x7fd22807d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 0x7fd22807d8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd234006010 tx=0x7fd23400b540 comp rx=0 tx=0).stop 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 msgr2=0x7fd240069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b9c0 tx=0x7fd23800bd80 comp rx=0 tx=0).stop 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 shutdown_connections 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd22807b420 0x7fd22807d8e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2400ffbc0 0x7fd240069990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 --2- 172.21.15.81:0/1892087028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd240100dc0 0x7fd24019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 >> 172.21.15.81:0/1892087028 conn(0x7fd2400fb160 msgr2=0x7fd2401040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 shutdown_connections 2024-09-18T12:54:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.593+0000 7fd2476ec700 1 -- 172.21.15.81:0/1892087028 wait complete. 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 -- 172.21.15.81:0/1771588280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c100e10 msgr2=0x7fcf7c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1771588280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c100e10 0x7fcf7c101270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009910 tx=0x7fcf6c009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 -- 172.21.15.81:0/1771588280 shutdown_connections 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1771588280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c100e10 0x7fcf7c101270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1771588280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 -- 172.21.15.81:0/1771588280 >> 172.21.15.81:0/1771588280 conn(0x7fcf7c0fb190 msgr2=0x7fcf7c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 -- 172.21.15.81:0/1771588280 shutdown_connections 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.701+0000 7fcf842c5700 1 -- 172.21.15.81:0/1771588280 wait complete. 2024-09-18T12:54:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 Processor -- start 2024-09-18T12:54:41.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 -- start start 2024-09-18T12:54:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c100e10 0x7fcf7c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c196f50 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf842c5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c197090 con 0x7fcf7c100e10 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf82061700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf82061700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35368/0 (socket says 172.21.15.81:35368) 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf82061700 1 -- 172.21.15.81:0/1754724966 learned_addr learned my addr 172.21.15.81:0/1754724966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf81860700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c100e10 0x7fcf7c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf82061700 1 -- 172.21.15.81:0/1754724966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c100e10 msgr2=0x7fcf7c1969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.702+0000 7fcf82061700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c100e10 0x7fcf7c1969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf82061700 1 -- 172.21.15.81:0/1754724966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0095f0 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf82061700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c910 tx=0x7fcf7800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf780041f0 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf78007db0 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf78003d60 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c19bb50 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.703+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c19c070 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.704+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c108700 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.705+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fcf7800f450 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.705+0000 7fcf737fe700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 0x7fcf6807d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.705+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fcf7809e180 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.705+0000 7fcf81860700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 0x7fcf6807d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.706+0000 7fcf81860700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 0x7fcf6807d8e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c006010 tx=0x7fcf6c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.710+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fcf78061070 con 0x7fcf7c0ffc10 2024-09-18T12:54:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.937+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf7c068c90 con 0x7fcf6807b420 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.946+0000 7fcf737fe700 1 -- 172.21.15.81:0/1754724966 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcf7c068c90 con 0x7fcf6807b420 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (10m) 7s ago 12m 25.2M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (2m) 7s ago 12m 7596k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (2m) 9s ago 11m 7285k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (17s) 7s ago 12m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (13s) 9s ago 11m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:54:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (10m) 7s ago 11m 83.4M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (5m) 7s ago 5m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (5m) 7s ago 5m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (5m) 9s ago 5m 19.7M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (5m) 9s ago 5m 15.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (2m) 7s ago 13m 506M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (91s) 9s ago 11m 453M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (76s) 7s ago 13m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (55s) 9s ago 11m 35.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (12m) 7s ago 12m 16.1M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (11m) 9s ago 11m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (9m) 7s ago 9m 254M 1216M 18.2.1 5be31c24972a 7c1f01e9bd33 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (9m) 7s ago 9m 244M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:54:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (8m) 7s ago 8m 192M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:54:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (8m) 9s ago 8m 285M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:54:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (7m) 9s ago 7m 243M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:54:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (7m) 9s ago 7m 223M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:54:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (96s) 7s ago 11m 60.4M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:54:41.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 msgr2=0x7fcf6807d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 0x7fcf6807d8e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c006010 tx=0x7fcf6c00b540 comp rx=0 tx=0).stop 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 msgr2=0x7fcf7c196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c910 tx=0x7fcf7800ccd0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 shutdown_connections 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf6807b420 0x7fcf6807d8e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c0ffc10 0x7fcf7c196480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 --2- 172.21.15.81:0/1754724966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c100e10 0x7fcf7c1969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 >> 172.21.15.81:0/1754724966 conn(0x7fcf7c0fb190 msgr2=0x7fcf7c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 shutdown_connections 2024-09-18T12:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:41.949+0000 7fcf842c5700 1 -- 172.21.15.81:0/1754724966 wait complete. 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 -- 172.21.15.81:0/599346566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8640ffbb0 msgr2=0x7fb8640fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 --2- 172.21.15.81:0/599346566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8640ffbb0 0x7fb8640fffd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb854009910 tx=0x7fb854009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 -- 172.21.15.81:0/599346566 shutdown_connections 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 --2- 172.21.15.81:0/599346566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb864100db0 0x7fb864101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 --2- 172.21.15.81:0/599346566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8640ffbb0 0x7fb8640fffd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 -- 172.21.15.81:0/599346566 >> 172.21.15.81:0/599346566 conn(0x7fb8640fb150 msgr2=0x7fb8640fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 -- 172.21.15.81:0/599346566 shutdown_connections 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.053+0000 7fb8691fc700 1 -- 172.21.15.81:0/599346566 wait complete. 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 Processor -- start 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 -- start start 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8640ffbb0 0x7fb864069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86419b890 con 0x7fb864100db0 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.054+0000 7fb8691fc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86419b9d0 con 0x7fb8640ffbb0 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35400/0 (socket says 172.21.15.81:35400) 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 -- 172.21.15.81:0/1187265381 learned_addr learned my addr 172.21.15.81:0/1187265381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb862d9d700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8640ffbb0 0x7fb864069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 -- 172.21.15.81:0/1187265381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8640ffbb0 msgr2=0x7fb864069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8640ffbb0 0x7fb864069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 -- 172.21.15.81:0/1187265381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540095f0 con 0x7fb864100db0 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb86259c700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b4b0 tx=0x7fb85800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb858011800 con 0x7fb864100db0 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86419bcb0 con 0x7fb864100db0 2024-09-18T12:54:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb858011e10 con 0x7fb864100db0 2024-09-18T12:54:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85800f2e0 con 0x7fb864100db0 2024-09-18T12:54:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.055+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86419c200 con 0x7fb864100db0 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.056+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864108790 con 0x7fb864100db0 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.057+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fb858010380 con 0x7fb864100db0 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.057+0000 7fb84bfff700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 0x7fb84c07d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.057+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fb85809df60 con 0x7fb864100db0 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.057+0000 7fb862d9d700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 0x7fb84c07d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.058+0000 7fb862d9d700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 0x7fb84c07d8e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb854006010 tx=0x7fb85400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.062+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fb8580d51f0 con 0x7fb864100db0 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.368+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8641089b0 con 0x7fb864100db0 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.369+0000 7fb84bfff700 1 -- 172.21.15.81:0/1187265381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7fb858060e50 con 0x7fb864100db0 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:42.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-09-18T12:54:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:54:42.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:54:42.372 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:54:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 msgr2=0x7fb84c07d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 0x7fb84c07d8e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb854006010 tx=0x7fb85400b540 comp rx=0 tx=0).stop 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 msgr2=0x7fb86419b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b4b0 tx=0x7fb85800b870 comp rx=0 tx=0).stop 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 shutdown_connections 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb84c07b420 0x7fb84c07d8e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8640ffbb0 0x7fb864069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 --2- 172.21.15.81:0/1187265381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864100db0 0x7fb86419b2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 >> 172.21.15.81:0/1187265381 conn(0x7fb8640fb150 msgr2=0x7fb864103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 shutdown_connections 2024-09-18T12:54:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.372+0000 7fb8691fc700 1 -- 172.21.15.81:0/1187265381 wait complete. 2024-09-18T12:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- 172.21.15.81:0/324256684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe968100db0 msgr2=0x7fe968101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 --2- 172.21.15.81:0/324256684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe968100db0 0x7fe968101210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe958009910 tx=0x7fe958009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- 172.21.15.81:0/324256684 shutdown_connections 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 --2- 172.21.15.81:0/324256684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe968100db0 0x7fe968101210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 --2- 172.21.15.81:0/324256684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9680ffbb0 0x7fe9680fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- 172.21.15.81:0/324256684 >> 172.21.15.81:0/324256684 conn(0x7fe9680fb150 msgr2=0x7fe9680fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- 172.21.15.81:0/324256684 shutdown_connections 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- 172.21.15.81:0/324256684 wait complete. 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 Processor -- start 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.484+0000 7fe970088700 1 -- start start 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe970088700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe970088700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 0x7fe96819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe970088700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96819b800 con 0x7fe9680ffbb0 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe970088700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96819b940 con 0x7fe968100db0 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35420/0 (socket says 172.21.15.81:35420) 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 -- 172.21.15.81:0/3329689091 learned_addr learned my addr 172.21.15.81:0/3329689091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96d623700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 0x7fe96819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 -- 172.21.15.81:0/3329689091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 msgr2=0x7fe96819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 0x7fe96819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 -- 172.21.15.81:0/3329689091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580095f0 con 0x7fe9680ffbb0 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96d623700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 0x7fe96819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:54:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe96de24700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c8f0 tx=0x7fe96400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9640041f0 con 0x7fe9680ffbb0 2024-09-18T12:54:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe964007d30 con 0x7fe9680ffbb0 2024-09-18T12:54:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.485+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96819bc20 con 0x7fe9680ffbb0 2024-09-18T12:54:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.486+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe964003dc0 con 0x7fe9680ffbb0 2024-09-18T12:54:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.486+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96819c170 con 0x7fe9680ffbb0 2024-09-18T12:54:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.487+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe968108730 con 0x7fe9680ffbb0 2024-09-18T12:54:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.488+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fe964007880 con 0x7fe9680ffbb0 2024-09-18T12:54:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.488+0000 7fe95effd700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 0x7fe95407d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.488+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe96409e4a0 con 0x7fe9680ffbb0 2024-09-18T12:54:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.488+0000 7fe96d623700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 0x7fe95407d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.489+0000 7fe96d623700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 0x7fe95407d8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe958006010 tx=0x7fe95800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.493+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe964061390 con 0x7fe9680ffbb0 2024-09-18T12:54:42.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.763+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe96819c7e0 con 0x7fe9680ffbb0 2024-09-18T12:54:42.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.764+0000 7fe95effd700 1 -- 172.21.15.81:0/3329689091 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7fe964004550 con 0x7fe9680ffbb0 2024-09-18T12:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 msgr2=0x7fe95407d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 0x7fe95407d8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe958006010 tx=0x7fe95800b540 comp rx=0 tx=0).stop 2024-09-18T12:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 msgr2=0x7fe968069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c8f0 tx=0x7fe96400ccb0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 shutdown_connections 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe95407b420 0x7fe95407d8e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9680ffbb0 0x7fe968069970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 --2- 172.21.15.81:0/3329689091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe968100db0 0x7fe96819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 >> 172.21.15.81:0/3329689091 conn(0x7fe9680fb150 msgr2=0x7fe968103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.766+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 shutdown_connections 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.767+0000 7fe970088700 1 -- 172.21.15.81:0/3329689091 wait complete. 2024-09-18T12:54:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.881+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1704690336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14101750 msgr2=0x7f1e14103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.881+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1704690336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14101750 0x7f1e14103b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009910 tx=0x7f1e04009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1704690336 shutdown_connections 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1704690336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14104080 0x7f1e14106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1704690336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14101750 0x7f1e14103b40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1704690336 >> 172.21.15.81:0/1704690336 conn(0x7f1e140fb160 msgr2=0x7f1e140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1704690336 shutdown_connections 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1704690336 wait complete. 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 Processor -- start 2024-09-18T12:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.882+0000 7f1e1a58b700 1 -- start start 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e1a58b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14101750 0x7f1e141967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e1a58b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e1a58b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14197340 con 0x7f1e14104080 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e1a58b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14197480 con 0x7f1e14101750 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35430/0 (socket says 172.21.15.81:35430) 2024-09-18T12:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 -- 172.21.15.81:0/1761868879 learned_addr learned my addr 172.21.15.81:0/1761868879 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e13fff700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14101750 0x7f1e141967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 -- 172.21.15.81:0/1761868879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14101750 msgr2=0x7f1e141967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14101750 0x7f1e141967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 -- 172.21.15.81:0/1761868879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040095f0 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e137fe700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d8d0 tx=0x7f1e0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.883+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e08009940 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.884+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e08010460 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.884+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1419bf30 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.884+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0800f5f0 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.884+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1419c450 con 0x7f1e14104080 2024-09-18T12:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.885+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e14190630 con 0x7f1e14104080 2024-09-18T12:54:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.885+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f1e080105d0 con 0x7f1e14104080 2024-09-18T12:54:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.886+0000 7f1e117fa700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 0x7f1dfc07d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.886+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1e0809e490 con 0x7f1e14104080 2024-09-18T12:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.886+0000 7f1e13fff700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 0x7f1dfc07d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.886+0000 7f1e13fff700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 0x7f1dfc07d8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005b40 tx=0x7f1e04005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:42.890+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1e08061380 con 0x7f1e14104080 2024-09-18T12:54:43.068 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:42 smithi081 systemd[1]: Stopping Ceph osd.0 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:54:43.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: pgmap v37: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:43.068 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1187265381' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:43.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:42 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3329689091' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:43.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.134+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e1402d070 con 0x7f1dfc07b430 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.135+0000 7f1e117fa700 1 -- 172.21.15.81:0/1761868879 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e1402d070 con 0x7f1dfc07b430 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:54:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:54:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "6/23 daemons upgraded", 2024-09-18T12:54:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:54:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:54:43.138 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:54:43.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 msgr2=0x7f1dfc07d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 0x7f1dfc07d8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005b40 tx=0x7f1e04005a90 comp rx=0 tx=0).stop 2024-09-18T12:54:43.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 msgr2=0x7f1e14196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d8d0 tx=0x7f1e0800dc90 comp rx=0 tx=0).stop 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 shutdown_connections 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1dfc07b430 0x7f1dfc07d8f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e14101750 0x7f1e141967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 --2- 172.21.15.81:0/1761868879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e14104080 0x7f1e14196d20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 >> 172.21.15.81:0/1761868879 conn(0x7f1e140fb160 msgr2=0x7f1e140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 shutdown_connections 2024-09-18T12:54:43.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.138+0000 7f1e1a58b700 1 -- 172.21.15.81:0/1761868879 wait complete. 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.241+0000 7f0e0b140700 1 -- 172.21.15.81:0/695492208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e040ffbb0 msgr2=0x7f0e040fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.241+0000 7f0e0b140700 1 --2- 172.21.15.81:0/695492208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e040ffbb0 0x7f0e040fffd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009910 tx=0x7f0df8009c20 comp rx=0 tx=0).stop 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- 172.21.15.81:0/695492208 shutdown_connections 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 --2- 172.21.15.81:0/695492208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e04100db0 0x7f0e04101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 --2- 172.21.15.81:0/695492208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e040ffbb0 0x7f0e040fffd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- 172.21.15.81:0/695492208 >> 172.21.15.81:0/695492208 conn(0x7f0e040fb150 msgr2=0x7f0e040fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- 172.21.15.81:0/695492208 shutdown_connections 2024-09-18T12:54:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- 172.21.15.81:0/695492208 wait complete. 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 Processor -- start 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- start start 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e040ffbb0 0x7f0e04069a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0419b7c0 con 0x7f0e04100db0 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e0b140700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0419b930 con 0x7f0e040ffbb0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e03fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.242+0000 7f0e03fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35442/0 (socket says 172.21.15.81:35442) 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e03fff700 1 -- 172.21.15.81:0/3296557910 learned_addr learned my addr 172.21.15.81:0/3296557910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e08edc700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e040ffbb0 0x7f0e04069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e03fff700 1 -- 172.21.15.81:0/3296557910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e040ffbb0 msgr2=0x7f0e04069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e03fff700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e040ffbb0 0x7f0e04069a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e03fff700 1 -- 172.21.15.81:0/3296557910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80095f0 con 0x7f0e04100db0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e03fff700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d8d0 tx=0x7f0df000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df00098a0 con 0x7f0e04100db0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0df0010460 con 0x7f0e04100db0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df000f5f0 con 0x7f0e04100db0 2024-09-18T12:54:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0419bc10 con 0x7f0e04100db0 2024-09-18T12:54:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.243+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0419c160 con 0x7f0e04100db0 2024-09-18T12:54:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.244+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04108710 con 0x7f0e04100db0 2024-09-18T12:54:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.245+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f0df0009a00 con 0x7f0e04100db0 2024-09-18T12:54:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.245+0000 7f0e01ffb700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 0x7f0df407d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.246+0000 7f0e08edc700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 0x7f0df407d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.246+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f0df009e2a0 con 0x7f0e04100db0 2024-09-18T12:54:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.246+0000 7f0e08edc700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 0x7f0df407d8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.250+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0df0061210 con 0x7f0e04100db0 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: pgmap v37: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1187265381' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:42 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3329689091' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:43.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:43 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[49309]: 2024-09-18T12:54:43.065+0000 7eff1522c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:54:43.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:43 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[49309]: 2024-09-18T12:54:43.066+0000 7eff1522c700 -1 osd.0 50 *** Got signal Terminated *** 2024-09-18T12:54:43.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:43 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[49309]: 2024-09-18T12:54:43.066+0000 7eff1522c700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:54:43.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.551+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0e04108900 con 0x7f0e04100db0 2024-09-18T12:54:43.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.552+0000 7f0e01ffb700 1 -- 172.21.15.81:0/3296557910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0df0064330 con 0x7f0e04100db0 2024-09-18T12:54:43.553 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 msgr2=0x7f0df407d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 0x7f0df407d8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df800b560 comp rx=0 tx=0).stop 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 msgr2=0x7f0e0419b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d8d0 tx=0x7f0df000dbe0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 shutdown_connections 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0df407b420 0x7f0df407d8e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e040ffbb0 0x7f0e04069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 --2- 172.21.15.81:0/3296557910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e04100db0 0x7f0e0419b1f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 >> 172.21.15.81:0/3296557910 conn(0x7f0e040fb150 msgr2=0x7f0e04103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 shutdown_connections 2024-09-18T12:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:54:43.554+0000 7f0e0b140700 1 -- 172.21.15.81:0/3296557910 wait complete. 2024-09-18T12:54:44.291 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:43 smithi081 ceph-mon[92545]: osd.0 marked itself down and dead 2024-09-18T12:54:44.291 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:43 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3296557910' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:43 smithi136 ceph-mon[80179]: osd.0 marked itself down and dead 2024-09-18T12:54:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:43 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3296557910' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:44.576 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:44 smithi081 podman[99867]: 2024-09-18 12:54:44.29022196 +0000 UTC m=+1.337027438 container died 7c1f01e9bd33dabb84d892af33db55221b8b9c81e50303fda5434fc98e07cf9b (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, ceph=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-09-18T12:54:44.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:44 smithi081 podman[99867]: 2024-09-18 12:54:44.674776502 +0000 UTC m=+1.721581970 container cleanup 7c1f01e9bd33dabb84d892af33db55221b8b9c81e50303fda5434fc98e07cf9b (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-09-18T12:54:44.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:44 smithi081 bash[99867]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0 2024-09-18T12:54:45.298 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:44 smithi081 ceph-mon[92545]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:45.298 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:44 smithi081 ceph-mon[92545]: pgmap v38: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:45.298 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:44 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:45.298 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:44 smithi081 ceph-mon[92545]: osdmap e51: 6 total, 5 up, 6 in 2024-09-18T12:54:45.298 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:44 smithi081 podman[99910]: 2024-09-18 12:54:44.968536257 +0000 UTC m=+0.675376211 container remove 7c1f01e9bd33dabb84d892af33db55221b8b9c81e50303fda5434fc98e07cf9b (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-09-18T12:54:45.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:44 smithi136 ceph-mon[80179]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:44 smithi136 ceph-mon[80179]: pgmap v38: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:44 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:44 smithi136 ceph-mon[80179]: osdmap e51: 6 total, 5 up, 6 in 2024-09-18T12:54:45.564 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.200396176 +0000 UTC m=+0.016186592 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:45.564 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.327911343 +0000 UTC m=+0.143701782 container create 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:45.564 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.563849759 +0000 UTC m=+0.379640162 container init 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:45.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.567416647 +0000 UTC m=+0.383207061 container start 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-18T12:54:45.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.655497928 +0000 UTC m=+0.471288329 container attach 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-18T12:54:45.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:45 smithi081 podman[100001]: 2024-09-18 12:54:45.758401585 +0000 UTC m=+0.574191995 container died 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:45 smithi136 ceph-mon[80179]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T12:54:46.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:45 smithi081 ceph-mon[92545]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T12:54:46.842 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 podman[100024]: 2024-09-18 12:54:46.409589479 +0000 UTC m=+0.640668578 container remove 7cbb5972fd67380f91d0496b1e6dbaf485b409efa6c3434c60c379d9ebf7ced9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T12:54:46.842 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-18T12:54:46.842 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 systemd[1]: Stopped Ceph osd.0 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:54:46.842 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.0.service: Consumed 56.610s CPU time. 2024-09-18T12:54:46.843 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 systemd[1]: Starting Ceph osd.0 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:54:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:46 smithi081 ceph-mon[92545]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:46 smithi081 ceph-mon[92545]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-18T12:54:47.107 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 podman[100127]: 2024-09-18 12:54:46.744429859 +0000 UTC m=+0.016088163 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:47.107 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:46 smithi081 podman[100127]: 2024-09-18 12:54:46.869155771 +0000 UTC m=+0.140814064 container create 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:46 smithi136 ceph-mon[80179]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:46 smithi136 ceph-mon[80179]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-18T12:54:47.417 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 podman[100127]: 2024-09-18 12:54:47.158358646 +0000 UTC m=+0.430016950 container init 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T12:54:47.417 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 podman[100127]: 2024-09-18 12:54:47.161928091 +0000 UTC m=+0.433586394 container start 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-18T12:54:47.417 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 podman[100127]: 2024-09-18 12:54:47.263701537 +0000 UTC m=+0.535359840 container attach 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True) 2024-09-18T12:54:47.417 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:47.418 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 bash[100127]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:47.418 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:47.418 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:47 smithi081 bash[100127]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:48 smithi081 ceph-mon[92545]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:48 smithi136 ceph-mon[80179]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:49.923 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:50.277 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:50.277 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:50.277 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:50 smithi081 ceph-mon[92545]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:50.277 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate[100142]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 bash[100127]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:54:50.278 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:49 smithi081 podman[100127]: 2024-09-18 12:54:49.958343573 +0000 UTC m=+3.230001881 container died 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-18T12:54:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:50 smithi136 ceph-mon[80179]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:50.811 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:50 smithi081 podman[100299]: 2024-09-18 12:54:50.551040414 +0000 UTC m=+0.581895725 container remove 7e778556eca1041c70230eb173f3aa64daee46b9e077e920f38e2bc9f7dda2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:50.811 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:50 smithi081 podman[100358]: 2024-09-18 12:54:50.67129578 +0000 UTC m=+0.016538771 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:50.811 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:50 smithi081 podman[100358]: 2024-09-18 12:54:50.810731254 +0000 UTC m=+0.155974293 container create abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:51.081 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:51 smithi081 podman[100358]: 2024-09-18 12:54:51.054517708 +0000 UTC m=+0.399760694 container init abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T12:54:51.081 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:51 smithi081 podman[100358]: 2024-09-18 12:54:51.058354588 +0000 UTC m=+0.403597562 container start abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-18T12:54:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:51 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 72/369 objects degraded (19.512%), 19 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:51 smithi081 ceph-mon[92545]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-18T12:54:51.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:51 smithi081 ceph-osd[100377]: -- 172.21.15.81:0/1323686499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcc4a941e0 con 0x55fcc3c33c00 2024-09-18T12:54:51.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:51 smithi081 bash[100358]: abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 2024-09-18T12:54:51.357 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:51 smithi081 systemd[1]: Started Ceph osd.0 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:54:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:51 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 72/369 objects degraded (19.512%), 19 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:51.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:51 smithi136 ceph-mon[80179]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-18T12:54:52.562 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:52.562 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:52.562 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:52.562 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:52 smithi081 ceph-mon[92545]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:52 smithi136 ceph-mon[80179]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:52.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:52 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T12:54:52.700+0000 7f4af79ea640 -1 Falling back to public interface 2024-09-18T12:54:55.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:54 smithi081 ceph-mon[92545]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:54 smithi136 ceph-mon[80179]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:57.195 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:56 smithi081 ceph-mon[92545]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:57.196 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.196 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.196 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.196 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.217 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:56 smithi136 ceph-mon[80179]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:57.217 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.217 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.217 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:57.217 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:54:58.245 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:57 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T12:54:57.988+0000 7f4af79ea640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-18T12:54:58.553 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:58 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T12:54:58.439+0000 7f4af79ea640 -1 osd.0 50 log_to_monitors true 2024-09-18T12:54:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:58 smithi081 ceph-mon[92545]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:58 smithi081 ceph-mon[92545]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:54:59.107 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 12:54:58 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T12:54:58.962+0000 7f4aef794640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:54:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:58 smithi136 ceph-mon[80179]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:54:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:58 smithi136 ceph-mon[80179]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:55:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:59 smithi081 ceph-mon[92545]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:55:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:59 smithi081 ceph-mon[92545]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:55:00.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:54:59 smithi081 ceph-mon[92545]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:55:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:59 smithi136 ceph-mon[80179]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:55:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:59 smithi136 ceph-mon[80179]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:55:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:54:59 smithi136 ceph-mon[80179]: from='osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:55:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903] boot 2024-09-18T12:55:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: osdmap e54: 6 total, 6 up, 6 in 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:55:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: osd.0 [v2:172.21.15.81:6802/2781623903,v1:172.21.15.81:6803/2781623903] boot 2024-09-18T12:55:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: osdmap e54: 6 total, 6 up, 6 in 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:01.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:55:02.263 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:01 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:55:02.264 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:01 smithi136 ceph-mon[80179]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:55:02.264 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:01 smithi136 ceph-mon[80179]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T12:55:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:01 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:55:02.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:01 smithi081 ceph-mon[92545]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:55:02.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:01 smithi081 ceph-mon[92545]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T12:55:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:02 smithi136 ceph-mon[80179]: pgmap v52: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:02 smithi081 ceph-mon[92545]: pgmap v52: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:04 smithi136 ceph-mon[80179]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:04 smithi081 ceph-mon[92545]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 72/369 objects degraded (19.512%) 2024-09-18T12:55:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:06.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:06 smithi136 ceph-mon[80179]: pgmap v54: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 589 B/s wr, 0 op/s 2024-09-18T12:55:06.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:06 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 72/369 objects degraded (19.512%), 19 pgs degraded) 2024-09-18T12:55:06.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:06 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:55:06.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:06 smithi136 ceph-mon[80179]: mgrmap e38: smithi081.pfnvgp(active, since 92s), standbys: smithi136.vdkrdt 2024-09-18T12:55:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:06 smithi081 ceph-mon[92545]: pgmap v54: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 589 B/s wr, 0 op/s 2024-09-18T12:55:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:06 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 72/369 objects degraded (19.512%), 19 pgs degraded) 2024-09-18T12:55:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:06 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:55:06.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:06 smithi081 ceph-mon[92545]: mgrmap e38: smithi081.pfnvgp(active, since 92s), standbys: smithi136.vdkrdt 2024-09-18T12:55:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:08 smithi081 ceph-mon[92545]: pgmap v55: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:08 smithi136 ceph-mon[80179]: pgmap v55: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:10 smithi136 ceph-mon[80179]: pgmap v56: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 618 B/s wr, 0 op/s 2024-09-18T12:55:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:10 smithi081 ceph-mon[92545]: pgmap v56: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 618 B/s wr, 0 op/s 2024-09-18T12:55:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:12 smithi136 ceph-mon[80179]: pgmap v57: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 561 B/s wr, 0 op/s 2024-09-18T12:55:13.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:12 smithi081 ceph-mon[92545]: pgmap v57: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 561 B/s wr, 0 op/s 2024-09-18T12:55:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 -- 172.21.15.81:0/3739140002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5810100dc0 msgr2=0x7f5810101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 --2- 172.21.15.81:0/3739140002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5810100dc0 0x7f5810101220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5800009910 tx=0x7f5800009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 -- 172.21.15.81:0/3739140002 shutdown_connections 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 --2- 172.21.15.81:0/3739140002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5810100dc0 0x7f5810101220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 --2- 172.21.15.81:0/3739140002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58100ffbc0 0x7f58100fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 -- 172.21.15.81:0/3739140002 >> 172.21.15.81:0/3739140002 conn(0x7f58100fb160 msgr2=0x7f58100fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 -- 172.21.15.81:0/3739140002 shutdown_connections 2024-09-18T12:55:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.673+0000 7f58182cd700 1 -- 172.21.15.81:0/3739140002 wait complete. 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 Processor -- start 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 -- start start 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5810100dc0 0x7f581019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581019baf0 con 0x7f58100ffbc0 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f58182cd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581019bc30 con 0x7f5810100dc0 2024-09-18T12:55:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49226/0 (socket says 172.21.15.81:49226) 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 -- 172.21.15.81:0/1652845256 learned_addr learned my addr 172.21.15.81:0/1652845256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5815868700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5810100dc0 0x7f581019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 -- 172.21.15.81:0/1652845256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5810100dc0 msgr2=0x7f581019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5810100dc0 0x7f581019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.674+0000 7f5816069700 1 -- 172.21.15.81:0/1652845256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000095f0 con 0x7f58100ffbc0 2024-09-18T12:55:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f5816069700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f580c00d900 tx=0x7f580c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580c0041f0 con 0x7f58100ffbc0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f580c004350 con 0x7f58100ffbc0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580c003d20 con 0x7f58100ffbc0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581019bf10 con 0x7f58100ffbc0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.675+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581019c3e0 con 0x7f58100ffbc0 2024-09-18T12:55:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.676+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581018f530 con 0x7f58100ffbc0 2024-09-18T12:55:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.677+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f580c009730 con 0x7f58100ffbc0 2024-09-18T12:55:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.677+0000 7f58077fe700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 0x7f57fc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.677+0000 7f5815868700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 0x7f57fc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.677+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f580c09e0d0 con 0x7f58100ffbc0 2024-09-18T12:55:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.678+0000 7f5815868700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 0x7f57fc07d7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5810069ef0 tx=0x7f580000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.682+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f580c0611e0 con 0x7f58100ffbc0 2024-09-18T12:55:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.913+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58100611d0 con 0x7f57fc07b310 2024-09-18T12:55:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.915+0000 7f58077fe700 1 -- 172.21.15.81:0/1652845256 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f58100611d0 con 0x7f57fc07b310 2024-09-18T12:55:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 msgr2=0x7f57fc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 0x7f57fc07d7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5810069ef0 tx=0x7f580000b560 comp rx=0 tx=0).stop 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 msgr2=0x7f5810069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f580c00d900 tx=0x7f580c00dc10 comp rx=0 tx=0).stop 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 shutdown_connections 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f57fc07b310 0x7f57fc07d7d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100ffbc0 0x7f5810069970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 --2- 172.21.15.81:0/1652845256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5810100dc0 0x7f581019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 >> 172.21.15.81:0/1652845256 conn(0x7f58100fb160 msgr2=0x7f5810104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 shutdown_connections 2024-09-18T12:55:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:13.917+0000 7f58182cd700 1 -- 172.21.15.81:0/1652845256 wait complete. 2024-09-18T12:55:13.929 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 -- 172.21.15.81:0/3141233572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 msgr2=0x7fcb84100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/3141233572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb84100030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009910 tx=0x7fcb74009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 -- 172.21.15.81:0/3141233572 shutdown_connections 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/3141233572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 0x7fcb84101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/3141233572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb84100030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 -- 172.21.15.81:0/3141233572 >> 172.21.15.81:0/3141233572 conn(0x7fcb840fb190 msgr2=0x7fcb840fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 -- 172.21.15.81:0/3141233572 shutdown_connections 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.023+0000 7fcb8bf67700 1 -- 172.21.15.81:0/3141233572 wait complete. 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 Processor -- start 2024-09-18T12:55:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 -- start start 2024-09-18T12:55:14.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 0x7fcb84195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84195f30 con 0x7fcb840ffc10 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb8bf67700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84196070 con 0x7fcb84100e10 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49248/0 (socket says 172.21.15.81:49248) 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 -- 172.21.15.81:0/1990363604 learned_addr learned my addr 172.21.15.81:0/1990363604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89502700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 0x7fcb84195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 -- 172.21.15.81:0/1990363604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 msgr2=0x7fcb84195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 0x7fcb84195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 -- 172.21.15.81:0/1990363604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740095f0 con 0x7fcb840ffc10 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.024+0000 7fcb89d03700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400bda0 tx=0x7fcb7400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.025+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7401d070 con 0x7fcb840ffc10 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.025+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb7400f460 con 0x7fcb840ffc10 2024-09-18T12:55:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.025+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8419aac0 con 0x7fcb840ffc10 2024-09-18T12:55:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.025+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb74021640 con 0x7fcb840ffc10 2024-09-18T12:55:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.025+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8419afb0 con 0x7fcb840ffc10 2024-09-18T12:55:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.026+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb84108700 con 0x7fcb840ffc10 2024-09-18T12:55:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.026+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fcb7400fa00 con 0x7fcb840ffc10 2024-09-18T12:55:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.027+0000 7fcb82ffd700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 0x7fcb6c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.027+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fcb7409f570 con 0x7fcb840ffc10 2024-09-18T12:55:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.027+0000 7fcb89502700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 0x7fcb6c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.027+0000 7fcb89502700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 0x7fcb6c07d7d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb78005950 tx=0x7fcb780058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.031+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fcb74062680 con 0x7fcb840ffc10 2024-09-18T12:55:14.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.273+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb8419b620 con 0x7fcb6c07b310 2024-09-18T12:55:14.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.275+0000 7fcb82ffd700 1 -- 172.21.15.81:0/1990363604 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcb8419b620 con 0x7fcb6c07b310 2024-09-18T12:55:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 msgr2=0x7fcb6c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 0x7fcb6c07d7d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb78005950 tx=0x7fcb780058e0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 msgr2=0x7fcb841953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400bda0 tx=0x7fcb7400be80 comp rx=0 tx=0).stop 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 shutdown_connections 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcb6c07b310 0x7fcb6c07d7d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb840ffc10 0x7fcb841953d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 --2- 172.21.15.81:0/1990363604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb84100e10 0x7fcb84195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 >> 172.21.15.81:0/1990363604 conn(0x7fcb840fb190 msgr2=0x7fcb84104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 shutdown_connections 2024-09-18T12:55:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.277+0000 7fcb8bf67700 1 -- 172.21.15.81:0/1990363604 wait complete. 2024-09-18T12:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.380+0000 7f5aaf50d700 1 -- 172.21.15.81:0/4238496984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa80ffdd0 msgr2=0x7f5aa8100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.380+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/4238496984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa8100250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009910 tx=0x7f5a98009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- 172.21.15.81:0/4238496984 shutdown_connections 2024-09-18T12:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/4238496984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa8100250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/4238496984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa8101170 0x7f5aa8101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- 172.21.15.81:0/4238496984 >> 172.21.15.81:0/4238496984 conn(0x7f5aa80fa8c0 msgr2=0x7f5aa80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- 172.21.15.81:0/4238496984 shutdown_connections 2024-09-18T12:55:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- 172.21.15.81:0/4238496984 wait complete. 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 Processor -- start 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- start start 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa81954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8196020 con 0x7f5aa8101170 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.381+0000 7f5aaf50d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8196160 con 0x7f5aa80ffdd0 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49262/0 (socket says 172.21.15.81:49262) 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 -- 172.21.15.81:0/2519329070 learned_addr learned my addr 172.21.15.81:0/2519329070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aad2a9700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa81954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 -- 172.21.15.81:0/2519329070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa80ffdd0 msgr2=0x7f5aa81954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa81954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 -- 172.21.15.81:0/2519329070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980095f0 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aacaa8700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800bda0 tx=0x7f5a9800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a9801d070 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a98022470 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa819abb0 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a9800f670 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.382+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa819b0a0 con 0x7f5aa8101170 2024-09-18T12:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.383+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa81087d0 con 0x7f5aa8101170 2024-09-18T12:55:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.384+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5a98004af0 con 0x7f5aa8101170 2024-09-18T12:55:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.385+0000 7f5a9e7fc700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 0x7f5a9407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.385+0000 7f5aad2a9700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 0x7f5a9407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.385+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f5a9809f8d0 con 0x7f5aa8101170 2024-09-18T12:55:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.385+0000 7f5aad2a9700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 0x7f5a9407d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80688e0 tx=0x7f5aa4009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.389+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5a98062a90 con 0x7f5aa8101170 2024-09-18T12:55:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.608+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5aa8105730 con 0x7f5a9407b310 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.618+0000 7f5a9e7fc700 1 -- 172.21.15.81:0/2519329070 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f5aa8105730 con 0x7f5a9407b310 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (10m) 18s ago 12m 24.7M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (3m) 18s ago 13m 7620k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (3m) 42s ago 11m 7285k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (50s) 18s ago 12m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:55:14.619 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (45s) 42s ago 11m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (10m) 18s ago 12m 83.5M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (6m) 18s ago 6m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (6m) 18s ago 6m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (6m) 42s ago 6m 19.7M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (6m) 42s ago 6m 15.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (3m) 18s ago 14m 509M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (2m) 42s ago 11m 453M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (109s) 18s ago 14m 44.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (88s) 42s ago 11m 35.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (12m) 18s ago 12m 16.3M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (11m) 42s ago 11m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (23s) 18s ago 10m 11.9M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:55:14.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (9m) 18s ago 9m 244M 1216M 18.2.1 5be31c24972a 678074f4e17d 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (9m) 18s ago 9m 192M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (8m) 42s ago 8m 285M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (8m) 42s ago 8m 243M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (8m) 42s ago 8m 223M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 18s ago 12m 67.2M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:55:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 msgr2=0x7f5a9407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 0x7f5a9407d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80688e0 tx=0x7f5aa4009190 comp rx=0 tx=0).stop 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 msgr2=0x7f5aa8195a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800bda0 tx=0x7f5a9800bdd0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 shutdown_connections 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5a9407b310 0x7f5a9407d7d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa80ffdd0 0x7f5aa81954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 --2- 172.21.15.81:0/2519329070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aa8101170 0x7f5aa8195a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 >> 172.21.15.81:0/2519329070 conn(0x7f5aa80fa8c0 msgr2=0x7f5aa8104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 shutdown_connections 2024-09-18T12:55:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.620+0000 7f5aaf50d700 1 -- 172.21.15.81:0/2519329070 wait complete. 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- 172.21.15.81:0/3543239181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37500ffbc0 msgr2=0x7f37500fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 --2- 172.21.15.81:0/3543239181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37500ffbc0 0x7f37500fffe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f374c009910 tx=0x7f374c009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- 172.21.15.81:0/3543239181 shutdown_connections 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 --2- 172.21.15.81:0/3543239181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3750100dc0 0x7f3750101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 --2- 172.21.15.81:0/3543239181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37500ffbc0 0x7f37500fffe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- 172.21.15.81:0/3543239181 >> 172.21.15.81:0/3543239181 conn(0x7f37500fb160 msgr2=0x7f37500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- 172.21.15.81:0/3543239181 shutdown_connections 2024-09-18T12:55:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- 172.21.15.81:0/3543239181 wait complete. 2024-09-18T12:55:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 Processor -- start 2024-09-18T12:55:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.723+0000 7f37581e2700 1 -- start start 2024-09-18T12:55:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37500ffbc0 0x7f3750103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37501026e0 con 0x7f3750100dc0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3750102820 con 0x7f37500ffbc0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49276/0 (socket says 172.21.15.81:49276) 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 -- 172.21.15.81:0/1373296082 learned_addr learned my addr 172.21.15.81:0/1373296082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f3755f7e700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37500ffbc0 0x7f3750103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 -- 172.21.15.81:0/1373296082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37500ffbc0 msgr2=0x7f3750103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37500ffbc0 0x7f3750103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 -- 172.21.15.81:0/1373296082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0095f0 con 0x7f3750100dc0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f375577d700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f374000e920 tx=0x7f374000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f374000c9d0 con 0x7f3750100dc0 2024-09-18T12:55:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3740010430 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3750102b00 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3740018650 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.724+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375019e850 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.725+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3750068af0 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.726+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f37400105a0 con 0x7f3750100dc0 2024-09-18T12:55:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.726+0000 7f3746ffd700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 0x7f373c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.727+0000 7f3755f7e700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 0x7f373c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.727+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3740014070 con 0x7f3750100dc0 2024-09-18T12:55:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.727+0000 7f3755f7e700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 0x7f373c07d7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f374c00b6f0 tx=0x7f374c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:14.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:14.731+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3740061550 con 0x7f3750100dc0 2024-09-18T12:55:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.033+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f375019ed50 con 0x7f3750100dc0 2024-09-18T12:55:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.033+0000 7f3746ffd700 1 -- 172.21.15.81:0/1373296082 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f3740064670 con 0x7f3750100dc0 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 9, 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:55:15.036 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 msgr2=0x7f373c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 0x7f373c07d7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f374c00b6f0 tx=0x7f374c005940 comp rx=0 tx=0).stop 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 msgr2=0x7f37501021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f374000e920 tx=0x7f374000ec30 comp rx=0 tx=0).stop 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 shutdown_connections 2024-09-18T12:55:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f373c07b310 0x7f373c07d7d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37500ffbc0 0x7f3750103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 --2- 172.21.15.81:0/1373296082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3750100dc0 0x7f37501021a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 >> 172.21.15.81:0/1373296082 conn(0x7f37500fb160 msgr2=0x7f3750068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 shutdown_connections 2024-09-18T12:55:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.036+0000 7f37581e2700 1 -- 172.21.15.81:0/1373296082 wait complete. 2024-09-18T12:55:15.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 -- 172.21.15.81:0/1925444279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e0100dc0 msgr2=0x7f58e0101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 --2- 172.21.15.81:0/1925444279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e0100dc0 0x7f58e0101220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009910 tx=0x7f58d0009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 -- 172.21.15.81:0/1925444279 shutdown_connections 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 --2- 172.21.15.81:0/1925444279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e0100dc0 0x7f58e0101220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 --2- 172.21.15.81:0/1925444279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e00ffbc0 0x7f58e00fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 -- 172.21.15.81:0/1925444279 >> 172.21.15.81:0/1925444279 conn(0x7f58e00fb160 msgr2=0x7f58e00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 -- 172.21.15.81:0/1925444279 shutdown_connections 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.138+0000 7f58e485f700 1 -- 172.21.15.81:0/1925444279 wait complete. 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 Processor -- start 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 -- start start 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e0100dc0 0x7f58e019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e019bad0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58e485f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e019bc40 con 0x7f58e0100dc0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49298/0 (socket says 172.21.15.81:49298) 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 -- 172.21.15.81:0/1005663627 learned_addr learned my addr 172.21.15.81:0/1005663627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58ddd9b700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e0100dc0 0x7f58e019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 -- 172.21.15.81:0/1005663627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e0100dc0 msgr2=0x7f58e019b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e0100dc0 0x7f58e019b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.139+0000 7f58de59c700 1 -- 172.21.15.81:0/1005663627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00095f0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58de59c700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c8f0 tx=0x7f58c800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c80078e0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58c800f450 con 0x7f58e00ffbc0 2024-09-18T12:55:15.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e019bf20 con 0x7f58e00ffbc0 2024-09-18T12:55:15.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c8018610 con 0x7f58e00ffbc0 2024-09-18T12:55:15.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.140+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e019c3c0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.141+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e018f530 con 0x7f58e00ffbc0 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.142+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f58c800f5c0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.142+0000 7f58d77fe700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 0x7f58cc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.142+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f58c809e040 con 0x7f58e00ffbc0 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.142+0000 7f58ddd9b700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 0x7f58cc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.143+0000 7f58ddd9b700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 0x7f58cc07d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58d0006010 tx=0x7f58d00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.146+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f58c80611d0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:14 smithi136 ceph-mon[80179]: pgmap v58: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:14 smithi136 ceph-mon[80179]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:14 smithi081 ceph-mon[92545]: pgmap v58: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:14 smithi081 ceph-mon[92545]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.405+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f58e00619a0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.405+0000 7f58d77fe700 1 -- 172.21.15.81:0/1005663627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7f58c80642f0 con 0x7f58e00ffbc0 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:e20 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:55:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:51:55.319596+0000 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:55:15.408 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:55:15.409 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:15.410 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:55:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:15.411 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:15.411 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 msgr2=0x7f58cc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 0x7f58cc07d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58d0006010 tx=0x7f58d00058e0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 msgr2=0x7f58e0069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c8f0 tx=0x7f58c800cc00 comp rx=0 tx=0).stop 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 shutdown_connections 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f58cc07b310 0x7f58cc07d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58e00ffbc0 0x7f58e0069990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 --2- 172.21.15.81:0/1005663627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58e0100dc0 0x7f58e019b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 >> 172.21.15.81:0/1005663627 conn(0x7f58e00fb160 msgr2=0x7f58e0104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 shutdown_connections 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.408+0000 7f58e485f700 1 -- 172.21.15.81:0/1005663627 wait complete. 2024-09-18T12:55:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T12:55:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- 172.21.15.81:0/267992472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41040f0 msgr2=0x7f6ca41064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 --2- 172.21.15.81:0/267992472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41040f0 0x7f6ca41064e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009910 tx=0x7f6c94009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- 172.21.15.81:0/267992472 shutdown_connections 2024-09-18T12:55:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 --2- 172.21.15.81:0/267992472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41040f0 0x7f6ca41064e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 --2- 172.21.15.81:0/267992472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41017c0 0x7f6ca4103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- 172.21.15.81:0/267992472 >> 172.21.15.81:0/267992472 conn(0x7f6ca40fb150 msgr2=0x7f6ca40fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- 172.21.15.81:0/267992472 shutdown_connections 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- 172.21.15.81:0/267992472 wait complete. 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 Processor -- start 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.523+0000 7f6cab924700 1 -- start start 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6cab924700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6cab924700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 0x7f6ca4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6cab924700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4196f20 con 0x7f6ca41017c0 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6cab924700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4197060 con 0x7f6ca41040f0 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32948/0 (socket says 172.21.15.81:32948) 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 -- 172.21.15.81:0/3377839119 learned_addr learned my addr 172.21.15.81:0/3377839119 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca8ebf700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 0x7f6ca4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 -- 172.21.15.81:0/3377839119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 msgr2=0x7f6ca4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 0x7f6ca4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 -- 172.21.15.81:0/3377839119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940095f0 con 0x7f6ca41017c0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca8ebf700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 0x7f6ca4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6ca96c0700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c930 tx=0x7f6ca000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca0007ad0 con 0x7f6ca41017c0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ca0007c30 con 0x7f6ca41017c0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca0018630 con 0x7f6ca41017c0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.524+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca419bb20 con 0x7f6ca41017c0 2024-09-18T12:55:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.525+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca419c040 con 0x7f6ca41017c0 2024-09-18T12:55:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.525+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca4190620 con 0x7f6ca41017c0 2024-09-18T12:55:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.526+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f6ca000f450 con 0x7f6ca41017c0 2024-09-18T12:55:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.527+0000 7f6c9a7fc700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 0x7f6c9007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.527+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6ca009e390 con 0x7f6ca41017c0 2024-09-18T12:55:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.527+0000 7f6ca8ebf700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 0x7f6c9007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.527+0000 7f6ca8ebf700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 0x7f6c9007d7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400b5c0 tx=0x7f6c94005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.531+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6ca0061520 con 0x7f6ca41017c0 2024-09-18T12:55:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.770+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ca40611d0 con 0x7f6c9007b310 2024-09-18T12:55:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.771+0000 7f6c9a7fc700 1 -- 172.21.15.81:0/3377839119 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ca40611d0 con 0x7f6c9007b310 2024-09-18T12:55:15.772 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "7/23 daemons upgraded", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:55:15.773 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:55:15.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.773+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 msgr2=0x7f6c9007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.773+0000 7f6cab924700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 0x7f6c9007d7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400b5c0 tx=0x7f6c94005960 comp rx=0 tx=0).stop 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 msgr2=0x7f6ca4196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c930 tx=0x7f6ca000ccf0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 shutdown_connections 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6c9007b310 0x7f6c9007d7d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca41017c0 0x7f6ca4196450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 --2- 172.21.15.81:0/3377839119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ca41040f0 0x7f6ca4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 >> 172.21.15.81:0/3377839119 conn(0x7f6ca40fb150 msgr2=0x7f6ca40fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 shutdown_connections 2024-09-18T12:55:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.774+0000 7f6cab924700 1 -- 172.21.15.81:0/3377839119 wait complete. 2024-09-18T12:55:15.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.877+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/62151850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 msgr2=0x7f8cd41026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.877+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/62151850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd41026a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009910 tx=0x7f8cd0009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/62151850 shutdown_connections 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/62151850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 0x7f8cd40ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/62151850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd41026a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/62151850 >> 172.21.15.81:0/62151850 conn(0x7f8cd40fa8c0 msgr2=0x7f8cd40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/62151850 shutdown_connections 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/62151850 wait complete. 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 Processor -- start 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- start start 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 0x7f8cd4196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41970b0 con 0x7f8cd4102280 2024-09-18T12:55:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cdc4ee700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41971f0 con 0x7f8cd40fed00 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.878+0000 7f8cd9a89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32966/0 (socket says 172.21.15.81:32966) 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 -- 172.21.15.81:0/2336922106 learned_addr learned my addr 172.21.15.81:0/2336922106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cda28a700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 0x7f8cd4196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 -- 172.21.15.81:0/2336922106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 msgr2=0x7f8cd4196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 0x7f8cd4196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 -- 172.21.15.81:0/2336922106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00095f0 con 0x7f8cd4102280 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cd9a89700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400d8d0 tx=0x7f8cc400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc40098a0 con 0x7f8cd4102280 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8cc4010460 con 0x7f8cd4102280 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd419bca0 con 0x7f8cd4102280 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc400f5f0 con 0x7f8cd4102280 2024-09-18T12:55:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.879+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd419c1f0 con 0x7f8cd4102280 2024-09-18T12:55:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.880+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4109810 con 0x7f8cd4102280 2024-09-18T12:55:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.881+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8cc4009a00 con 0x7f8cd4102280 2024-09-18T12:55:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.881+0000 7f8ccb7fe700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 0x7f8cc007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.881+0000 7f8cda28a700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 0x7f8cc007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.881+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f8cc409e160 con 0x7f8cd4102280 2024-09-18T12:55:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.882+0000 7f8cda28a700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 0x7f8cc007d7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0006010 tx=0x7f8cd000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:15.886+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f8cc40611d0 con 0x7f8cd4102280 2024-09-18T12:55:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:15 smithi081 ceph-mon[92545]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:15 smithi081 ceph-mon[92545]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1373296082' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:55:16.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1005663627' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.200+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8cd4109a00 con 0x7f8cd4102280 2024-09-18T12:55:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.200+0000 7f8ccb7fe700 1 -- 172.21.15.81:0/2336922106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8cc40642f0 con 0x7f8cd4102280 2024-09-18T12:55:16.201 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 msgr2=0x7f8cc007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 0x7f8cc007d7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0006010 tx=0x7f8cd000b540 comp rx=0 tx=0).stop 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 msgr2=0x7f8cd4196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400d8d0 tx=0x7f8cc400dbe0 comp rx=0 tx=0).stop 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 shutdown_connections 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8cc007b310 0x7f8cc007d7d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd40fed00 0x7f8cd4196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 --2- 172.21.15.81:0/2336922106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd4102280 0x7f8cd4196a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 >> 172.21.15.81:0/2336922106 conn(0x7f8cd40fa8c0 msgr2=0x7f8cd4105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 shutdown_connections 2024-09-18T12:55:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:16.202+0000 7f8cdc4ee700 1 -- 172.21.15.81:0/2336922106 wait complete. 2024-09-18T12:55:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:15 smithi136 ceph-mon[80179]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:15 smithi136 ceph-mon[80179]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1373296082' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:55:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1005663627' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:17.256 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: Upgrade: osd.1 is safe to restart 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: pgmap v59: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2336922106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:55:17.257 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: Upgrade: osd.1 is safe to restart 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: pgmap v59: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2336922106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:17.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:55:17.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:18.211 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:17 smithi081 ceph-mon[92545]: Upgrade: Updating osd.1 2024-09-18T12:55:18.212 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:17 smithi081 ceph-mon[92545]: Deploying daemon osd.1 on smithi081 2024-09-18T12:55:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:17 smithi136 ceph-mon[80179]: Upgrade: Updating osd.1 2024-09-18T12:55:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:17 smithi136 ceph-mon[80179]: Deploying daemon osd.1 on smithi081 2024-09-18T12:55:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:18 smithi081 ceph-mon[92545]: pgmap v60: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:55:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:18 smithi136 ceph-mon[80179]: pgmap v60: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:55:19.898 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:19 smithi081 systemd[1]: Stopping Ceph osd.1 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:55:20.155 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:19 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:55:19.896+0000 7f8c6f93e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:55:20.155 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:19 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:55:19.896+0000 7f8c6f93e700 -1 osd.1 55 *** Got signal Terminated *** 2024-09-18T12:55:20.155 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:19 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[56526]: 2024-09-18T12:55:19.896+0000 7f8c6f93e700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:55:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:20 smithi136 ceph-mon[80179]: pgmap v61: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:55:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:20 smithi136 ceph-mon[80179]: osd.1 marked itself down and dead 2024-09-18T12:55:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:20 smithi081 ceph-mon[92545]: pgmap v61: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T12:55:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:20 smithi081 ceph-mon[92545]: osd.1 marked itself down and dead 2024-09-18T12:55:20.967 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:20 smithi081 podman[105478]: 2024-09-18 12:55:20.673680342 +0000 UTC m=+0.899691464 container died 678074f4e17d701fa8787946aaeaa16056c0ee966a43950d9e6befc2de240c5c (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS) 2024-09-18T12:55:21.316 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:21 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:21.316 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:21 smithi081 ceph-mon[92545]: osdmap e56: 6 total, 5 up, 6 in 2024-09-18T12:55:21.317 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105478]: 2024-09-18 12:55:21.081065741 +0000 UTC m=+1.307076901 container cleanup 678074f4e17d701fa8787946aaeaa16056c0ee966a43950d9e6befc2de240c5c (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-18T12:55:21.317 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 bash[105478]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1 2024-09-18T12:55:21.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:21 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:21.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:21 smithi136 ceph-mon[80179]: osdmap e56: 6 total, 5 up, 6 in 2024-09-18T12:55:21.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105495]: 2024-09-18 12:55:21.315784639 +0000 UTC m=+0.638164835 container remove 678074f4e17d701fa8787946aaeaa16056c0ee966a43950d9e6befc2de240c5c (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, RELEASE=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-09-18T12:55:21.978 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105584]: 2024-09-18 12:55:21.535728467 +0000 UTC m=+0.015964261 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:21.979 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105584]: 2024-09-18 12:55:21.65883874 +0000 UTC m=+0.139074521 container create 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2) 2024-09-18T12:55:21.979 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105584]: 2024-09-18 12:55:21.878142731 +0000 UTC m=+0.358378518 container init 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-18T12:55:21.979 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105584]: 2024-09-18 12:55:21.881862178 +0000 UTC m=+0.362097961 container start 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:55:21.979 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:21 smithi081 podman[105584]: 2024-09-18 12:55:21.978000467 +0000 UTC m=+0.458236249 container attach 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-18T12:55:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:22 smithi081 ceph-mon[92545]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T12:55:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:22 smithi081 ceph-mon[92545]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:22.358 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 podman[105584]: 2024-09-18 12:55:22.069651236 +0000 UTC m=+0.549887028 container died 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_BRANCH=HEAD) 2024-09-18T12:55:22.447 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:22 smithi136 ceph-mon[80179]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T12:55:22.447 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:22 smithi136 ceph-mon[80179]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:22.955 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 podman[105608]: 2024-09-18 12:55:22.698449131 +0000 UTC m=+0.621727189 container remove 9da8d092f27f88e923636a57a1ea34725cf8dab0571cd5a14173d7dbe493c826 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-18T12:55:22.955 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-18T12:55:22.956 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 systemd[1]: Stopped Ceph osd.1 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:55:22.956 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 1.789s CPU time. 2024-09-18T12:55:23.272 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:22 smithi081 systemd[1]: Starting Ceph osd.1 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:55:23.272 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 podman[105704]: 2024-09-18 12:55:23.157812467 +0000 UTC m=+0.106580549 container create 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:55:23.273 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 podman[105704]: 2024-09-18 12:55:23.067147786 +0000 UTC m=+0.015915874 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:23.544 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 podman[105704]: 2024-09-18 12:55:23.410855764 +0000 UTC m=+0.359623839 container init 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:55:23.544 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 podman[105704]: 2024-09-18 12:55:23.41541156 +0000 UTC m=+0.364179637 container start 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:55:23.545 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 podman[105704]: 2024-09-18 12:55:23.510899329 +0000 UTC m=+0.459667406 container attach 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:55:23.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:23.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 bash[105704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:23.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:23.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:23 smithi081 bash[105704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:25.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:24 smithi081 ceph-mon[92545]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:24 smithi136 ceph-mon[80179]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:26.202 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:25 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:25 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:25 smithi081 bash[105704]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:25 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:25 smithi081 bash[105704]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:55:26.202 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 bash[105704]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:55:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:25 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:55:26.524 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 bash[105704]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 bash[105704]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 bash[105704]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate[105718]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 bash[105704]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:55:26.525 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 podman[105704]: 2024-09-18 12:55:26.231218269 +0000 UTC m=+3.179986353 container died 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:55:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-mon[92545]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:26 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 57/369 objects degraded (15.447%), 16 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:27.107 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:26 smithi081 podman[105901]: 2024-09-18 12:55:26.831595187 +0000 UTC m=+0.593804868 container remove 3d9f095173aee470cfe85305cb051c6d293738186ee9ad15c8c709283e09088d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T12:55:27.108 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 podman[105960]: 2024-09-18 12:55:26.947660365 +0000 UTC m=+0.016388491 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:27.108 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 podman[105960]: 2024-09-18 12:55:27.049068325 +0000 UTC m=+0.117796449 container create 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T12:55:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:26 smithi136 ceph-mon[80179]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:26 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 57/369 objects degraded (15.447%), 16 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:27.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 podman[105960]: 2024-09-18 12:55:27.276916649 +0000 UTC m=+0.345644773 container init 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-18T12:55:27.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 podman[105960]: 2024-09-18 12:55:27.280067867 +0000 UTC m=+0.348795992 container start 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T12:55:27.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 ceph-osd[105978]: -- 172.21.15.81:0/3008157232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55daac5ae1e0 con 0x55daac53e000 2024-09-18T12:55:27.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 bash[105960]: 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 2024-09-18T12:55:27.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:27 smithi081 systemd[1]: Started Ceph osd.1 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:55:28.717 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:28.717 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:28.717 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:28.717 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:28 smithi081 ceph-mon[92545]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:28.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:28.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:28.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:28.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:28 smithi136 ceph-mon[80179]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:29.107 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:28 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T12:55:28.923+0000 7f2a617a7640 -1 Falling back to public interface 2024-09-18T12:55:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:30 smithi136 ceph-mon[80179]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:31.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:30 smithi081 ceph-mon[92545]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:32 smithi136 ceph-mon[80179]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:33.332 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:32 smithi081 ceph-mon[92545]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:33.332 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:33.332 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:34.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:34.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:34.535 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T12:55:34.283+0000 7f2a617a7640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-18T12:55:34.821 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T12:55:34.743+0000 7f2a617a7640 -1 osd.1 55 log_to_monitors true 2024-09-18T12:55:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-mon[92545]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:34 smithi081 ceph-mon[92545]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:55:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:34 smithi136 ceph-mon[80179]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:34 smithi136 ceph-mon[80179]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:55:36.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:36 smithi136 ceph-mon[80179]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:55:36.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:36 smithi136 ceph-mon[80179]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:55:36.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:36 smithi136 ceph-mon[80179]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:55:36.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:36 smithi136 ceph-mon[80179]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:36.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:36 smithi136 ceph-mon[80179]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' 2024-09-18T12:55:36.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T12:55:36.143+0000 7f2a55549640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:55:36.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-mon[92545]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:55:36.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-mon[92545]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:55:36.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-mon[92545]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:55:36.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-mon[92545]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:36.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:36 smithi081 ceph-mon[92545]: from='osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932]' entity='osd.1' 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:37.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932] boot 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: osdmap e59: 6 total, 6 up, 6 in 2024-09-18T12:55:37.216 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:55:37.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:37.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:37.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: osd.1 [v2:172.21.15.81:6810/3025791932,v1:172.21.15.81:6811/3025791932] boot 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: osdmap e59: 6 total, 6 up, 6 in 2024-09-18T12:55:37.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:55:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:38 smithi136 ceph-mon[80179]: pgmap v74: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:38 smithi136 ceph-mon[80179]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T12:55:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:38 smithi081 ceph-mon[92545]: pgmap v74: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-18T12:55:38.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:38 smithi081 ceph-mon[92545]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T12:55:40.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:40 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:55:40.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:40 smithi081 ceph-mon[92545]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24/369 objects degraded (6.504%) 2024-09-18T12:55:40.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:40 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:55:40.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:40 smithi136 ceph-mon[80179]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24/369 objects degraded (6.504%) 2024-09-18T12:55:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:41 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 24/369 objects degraded (6.504%), 7 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:41.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:41 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 24/369 objects degraded (6.504%), 7 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:42 smithi081 ceph-mon[92545]: pgmap v77: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:42.629 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:42 smithi136 ceph-mon[80179]: pgmap v77: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:43.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:43 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/369 objects degraded (6.504%), 7 pgs degraded) 2024-09-18T12:55:43.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:43 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:55:43.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:43 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/369 objects degraded (6.504%), 7 pgs degraded) 2024-09-18T12:55:43.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:43 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:55:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:44 smithi081 ceph-mon[92545]: pgmap v78: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:44 smithi136 ceph-mon[80179]: pgmap v78: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/568051056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4100cb0 msgr2=0x7f6ec41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/568051056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4100cb0 0x7f6ec41010d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009910 tx=0x7f6ec0009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/568051056 shutdown_connections 2024-09-18T12:55:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/568051056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/568051056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4100cb0 0x7f6ec41010d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/568051056 >> 172.21.15.81:0/568051056 conn(0x7f6ec40fc230 msgr2=0x7f6ec40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/568051056 shutdown_connections 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.319+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/568051056 wait complete. 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 Processor -- start 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 -- start start 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 0x7f6ec4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41992b0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ecc6aa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41993f0 con 0x7f6ec4100cb0 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53718/0 (socket says 172.21.15.81:53718) 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 -- 172.21.15.81:0/3084867877 learned_addr learned my addr 172.21.15.81:0/3084867877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6eca446700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 0x7f6ec4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 -- 172.21.15.81:0/3084867877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 msgr2=0x7f6ec4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 0x7f6ec4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6ec9c45700 1 -- 172.21.15.81:0/3084867877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00095f0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.320+0000 7f6eca446700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 0x7f6ec4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ec9c45700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b4b0 tx=0x7f6eb400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb4011800 con 0x7f6ec4101eb0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6eb4011e10 con 0x7f6ec4101eb0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb400f2e0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec419dea0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.321+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec419e3c0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.322+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec4105f90 con 0x7f6ec4101eb0 2024-09-18T12:55:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.323+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f6eb4010380 con 0x7f6ec4101eb0 2024-09-18T12:55:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.323+0000 7f6ebb7fe700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 0x7f6eb007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.323+0000 7f6eca446700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 0x7f6eb007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.323+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6eb409dc60 con 0x7f6ec4101eb0 2024-09-18T12:55:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.324+0000 7f6eca446700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 0x7f6eb007d7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006010 tx=0x7f6ec0005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.328+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6eb4060df0 con 0x7f6ec4101eb0 2024-09-18T12:55:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.562+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ec40611d0 con 0x7f6eb007b310 2024-09-18T12:55:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.563+0000 7f6ebb7fe700 1 -- 172.21.15.81:0/3084867877 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ec40611d0 con 0x7f6eb007b310 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 msgr2=0x7f6eb007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 0x7f6eb007d7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006010 tx=0x7f6ec0005920 comp rx=0 tx=0).stop 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 msgr2=0x7f6ec4198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b4b0 tx=0x7f6eb400b870 comp rx=0 tx=0).stop 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 shutdown_connections 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f6eb007b310 0x7f6eb007d7d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ec4100cb0 0x7f6ec4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 --2- 172.21.15.81:0/3084867877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec4101eb0 0x7f6ec4198c90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 >> 172.21.15.81:0/3084867877 conn(0x7f6ec40fc230 msgr2=0x7f6ec41030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 shutdown_connections 2024-09-18T12:55:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.566+0000 7f6ecc6aa700 1 -- 172.21.15.81:0/3084867877 wait complete. 2024-09-18T12:55:46.577 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:55:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 -- 172.21.15.81:0/3403762790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c100e10 msgr2=0x7f962c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 --2- 172.21.15.81:0/3403762790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c100e10 0x7f962c101270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f961c009910 tx=0x7f961c009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 -- 172.21.15.81:0/3403762790 shutdown_connections 2024-09-18T12:55:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 --2- 172.21.15.81:0/3403762790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c100e10 0x7f962c101270 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 --2- 172.21.15.81:0/3403762790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962c0ffc10 0x7f962c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 -- 172.21.15.81:0/3403762790 >> 172.21.15.81:0/3403762790 conn(0x7f962c0fb190 msgr2=0x7f962c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 -- 172.21.15.81:0/3403762790 shutdown_connections 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.671+0000 7f96333c1700 1 -- 172.21.15.81:0/3403762790 wait complete. 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 Processor -- start 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 -- start start 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962c100e10 0x7f962c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c196fe0 con 0x7f962c0ffc10 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f96333c1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c197120 con 0x7f962c100e10 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53728/0 (socket says 172.21.15.81:53728) 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 -- 172.21.15.81:0/599868185 learned_addr learned my addr 172.21.15.81:0/599868185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 -- 172.21.15.81:0/599868185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962c100e10 msgr2=0x7f962c1969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962c100e10 0x7f962c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 -- 172.21.15.81:0/599868185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0095f0 con 0x7f962c0ffc10 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.672+0000 7f963115d700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f962800d900 tx=0x7f962800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.673+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96280041f0 con 0x7f962c0ffc10 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.673+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9628004350 con 0x7f962c0ffc10 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.673+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c19bbd0 con 0x7f962c0ffc10 2024-09-18T12:55:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.673+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9628003da0 con 0x7f962c0ffc10 2024-09-18T12:55:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.673+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c19c120 con 0x7f962c0ffc10 2024-09-18T12:55:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.674+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c108700 con 0x7f962c0ffc10 2024-09-18T12:55:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.674+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9628009730 con 0x7f962c0ffc10 2024-09-18T12:55:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.675+0000 7f96227fc700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 0x7f961807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.675+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f962809e360 con 0x7f962c0ffc10 2024-09-18T12:55:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.675+0000 7f963095c700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 0x7f961807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.675+0000 7f963095c700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 0x7f961807d7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f961c00b5c0 tx=0x7f961c005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.679+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9628061470 con 0x7f962c0ffc10 2024-09-18T12:55:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.910+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f962c068c90 con 0x7f961807b310 2024-09-18T12:55:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.911+0000 7f96227fc700 1 -- 172.21.15.81:0/599868185 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f962c068c90 con 0x7f961807b310 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 msgr2=0x7f961807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 0x7f961807d7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f961c00b5c0 tx=0x7f961c005960 comp rx=0 tx=0).stop 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 msgr2=0x7f962c196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f962800d900 tx=0x7f962800dcc0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 shutdown_connections 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f961807b310 0x7f961807d7d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962c0ffc10 0x7f962c196480 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 --2- 172.21.15.81:0/599868185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962c100e10 0x7f962c1969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 >> 172.21.15.81:0/599868185 conn(0x7f962c0fb190 msgr2=0x7f962c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.913+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 shutdown_connections 2024-09-18T12:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:46.914+0000 7f96333c1700 1 -- 172.21.15.81:0/599868185 wait complete. 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 -- 172.21.15.81:0/1040746535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 msgr2=0x7f14e8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 --2- 172.21.15.81:0/1040746535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8100030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009910 tx=0x7f14d8009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 -- 172.21.15.81:0/1040746535 shutdown_connections 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 --2- 172.21.15.81:0/1040746535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14e8100e10 0x7f14e8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 --2- 172.21.15.81:0/1040746535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8100030 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 -- 172.21.15.81:0/1040746535 >> 172.21.15.81:0/1040746535 conn(0x7f14e80fb190 msgr2=0x7f14e80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 -- 172.21.15.81:0/1040746535 shutdown_connections 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.022+0000 7f14edc13700 1 -- 172.21.15.81:0/1040746535 wait complete. 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 Processor -- start 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 -- start start 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14e8100e10 0x7f14e8106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8106750 con 0x7f14e80ffc10 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14edc13700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8106890 con 0x7f14e8100e10 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53736/0 (socket says 172.21.15.81:53736) 2024-09-18T12:55:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 -- 172.21.15.81:0/2084272714 learned_addr learned my addr 172.21.15.81:0/2084272714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 -- 172.21.15.81:0/2084272714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14e8100e10 msgr2=0x7f14e8106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14e8100e10 0x7f14e8106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 -- 172.21.15.81:0/2084272714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80095f0 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.023+0000 7f14e77fe700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bda0 tx=0x7f14d800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.024+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d801d070 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.024+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f14d8004c50 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.024+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d800f690 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.024+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8106b10 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.024+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8106fb0 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.025+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8109880 con 0x7f14e80ffc10 2024-09-18T12:55:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.025+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f14d80229b0 con 0x7f14e80ffc10 2024-09-18T12:55:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.026+0000 7f14e57fa700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 0x7f14d407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.026+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f14d809f920 con 0x7f14e80ffc10 2024-09-18T12:55:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.026+0000 7f14dffff700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 0x7f14d407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.026+0000 7f14dffff700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 0x7f14d407d7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14d00097b0 tx=0x7f14d0006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.030+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f14d8062ae0 con 0x7f14e80ffc10 2024-09-18T12:55:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.248+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14e8105760 con 0x7f14d407b310 2024-09-18T12:55:47.250 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:46 smithi081 ceph-mon[92545]: pgmap v79: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.258+0000 7f14e57fa700 1 -- 172.21.15.81:0/2084272714 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f14e8105760 con 0x7f14d407b310 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (11m) 14s ago 13m 24.8M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (3m) 14s ago 13m 7956k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (3m) 75s ago 12m 7285k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (83s) 14s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (78s) 75s ago 12m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (11m) 14s ago 13m 85.9M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (6m) 14s ago 6m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (7m) 14s ago 7m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:55:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (6m) 75s ago 6m 19.7M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (7m) 75s ago 7m 15.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (3m) 14s ago 14m 513M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (2m) 75s ago 12m 453M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (2m) 14s ago 14m 46.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (2m) 75s ago 12m 35.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (13m) 14s ago 13m 15.9M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (12m) 75s ago 12m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (56s) 14s ago 10m 93.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (20s) 14s ago 10m 12.2M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (9m) 14s ago 9m 192M 1216M 18.2.1 5be31c24972a 6cba6a3cd915 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (9m) 75s ago 9m 285M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (9m) 75s ago 9m 243M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:55:47.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (8m) 75s ago 8m 223M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:55:47.262 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 14s ago 12m 67.4M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:55:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.260+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 msgr2=0x7f14d407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.260+0000 7f14edc13700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 0x7f14d407d7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14d00097b0 tx=0x7f14d0006d20 comp rx=0 tx=0).stop 2024-09-18T12:55:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 msgr2=0x7f14e8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bda0 tx=0x7f14d800be80 comp rx=0 tx=0).stop 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 shutdown_connections 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f14d407b310 0x7f14d407d7d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ffc10 0x7f14e8107bc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 --2- 172.21.15.81:0/2084272714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14e8100e10 0x7f14e8106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 >> 172.21.15.81:0/2084272714 conn(0x7f14e80fb190 msgr2=0x7f14e8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 shutdown_connections 2024-09-18T12:55:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.261+0000 7f14edc13700 1 -- 172.21.15.81:0/2084272714 wait complete. 2024-09-18T12:55:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:46 smithi136 ceph-mon[80179]: pgmap v79: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 -- 172.21.15.81:0/3549187498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00ff610 msgr2=0x7f55f00ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 --2- 172.21.15.81:0/3549187498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00ff610 0x7f55f00ffa30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f55e800b0a0 tx=0x7f55e800b3b0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 -- 172.21.15.81:0/3549187498 shutdown_connections 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 --2- 172.21.15.81:0/3549187498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00fff70 0x7f55f01003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 --2- 172.21.15.81:0/3549187498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00ff610 0x7f55f00ffa30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 -- 172.21.15.81:0/3549187498 >> 172.21.15.81:0/3549187498 conn(0x7f55f00fb190 msgr2=0x7f55f00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 -- 172.21.15.81:0/3549187498 shutdown_connections 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.363+0000 7f55f6045700 1 -- 172.21.15.81:0/3549187498 wait complete. 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 Processor -- start 2024-09-18T12:55:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 -- start start 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00ff610 0x7f55f01986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0199230 con 0x7f55f00fff70 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55f6045700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0199370 con 0x7f55f00ff610 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55eeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55eeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53758/0 (socket says 172.21.15.81:53758) 2024-09-18T12:55:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55eeffd700 1 -- 172.21.15.81:0/1433738674 learned_addr learned my addr 172.21.15.81:0/1433738674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55eeffd700 1 -- 172.21.15.81:0/1433738674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00ff610 msgr2=0x7f55f01986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55ef7fe700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00ff610 0x7f55f01986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.364+0000 7f55eeffd700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00ff610 0x7f55f01986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55eeffd700 1 -- 172.21.15.81:0/1433738674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009d00 con 0x7f55f00fff70 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55eeffd700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55d800d8d0 tx=0x7f55d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55d8009940 con 0x7f55f00fff70 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55d8010460 con 0x7f55f00fff70 2024-09-18T12:55:47.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f019de20 con 0x7f55f00fff70 2024-09-18T12:55:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55d800f5f0 con 0x7f55f00fff70 2024-09-18T12:55:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.365+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f019e340 con 0x7f55f00fff70 2024-09-18T12:55:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.366+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f010b9f0 con 0x7f55f00fff70 2024-09-18T12:55:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.366+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f55d80105d0 con 0x7f55f00fff70 2024-09-18T12:55:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.367+0000 7f55ecff9700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 0x7f55dc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.367+0000 7f55ef7fe700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 0x7f55dc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.367+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f55d809e190 con 0x7f55f00fff70 2024-09-18T12:55:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.367+0000 7f55ef7fe700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 0x7f55dc07d7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55e8015040 tx=0x7f55e8000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.371+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f55d8061320 con 0x7f55f00fff70 2024-09-18T12:55:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.668+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55f010bbb0 con 0x7f55f00fff70 2024-09-18T12:55:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.668+0000 7f55ecff9700 1 -- 172.21.15.81:0/1433738674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f55d8064440 con 0x7f55f00fff70 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-09-18T12:55:47.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 8, 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:55:47.671 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:55:47.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 msgr2=0x7f55dc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 0x7f55dc07d7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55e8015040 tx=0x7f55e8000f40 comp rx=0 tx=0).stop 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 msgr2=0x7f55f0198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55d800d8d0 tx=0x7f55d800dc90 comp rx=0 tx=0).stop 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 shutdown_connections 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f55dc07b310 0x7f55dc07d7d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f00ff610 0x7f55f01986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 --2- 172.21.15.81:0/1433738674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f00fff70 0x7f55f0198c10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 >> 172.21.15.81:0/1433738674 conn(0x7f55f00fb190 msgr2=0x7f55f0107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 shutdown_connections 2024-09-18T12:55:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.671+0000 7f55f6045700 1 -- 172.21.15.81:0/1433738674 wait complete. 2024-09-18T12:55:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 -- 172.21.15.81:0/3495611511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238104130 msgr2=0x7f7238106520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 --2- 172.21.15.81:0/3495611511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238104130 0x7f7238106520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7220009910 tx=0x7f7220009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 -- 172.21.15.81:0/3495611511 shutdown_connections 2024-09-18T12:55:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 --2- 172.21.15.81:0/3495611511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238104130 0x7f7238106520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 --2- 172.21.15.81:0/3495611511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238101800 0x7f7238103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 -- 172.21.15.81:0/3495611511 >> 172.21.15.81:0/3495611511 conn(0x7f72380fb190 msgr2=0x7f72380fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 -- 172.21.15.81:0/3495611511 shutdown_connections 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.775+0000 7f723d962700 1 -- 172.21.15.81:0/3495611511 wait complete. 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 Processor -- start 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 -- start start 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238104130 0x7f7238196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238196fb0 con 0x7f7238101800 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f723d962700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381970f0 con 0x7f7238104130 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f7236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f7236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53786/0 (socket says 172.21.15.81:53786) 2024-09-18T12:55:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f7236ffd700 1 -- 172.21.15.81:0/3230223447 learned_addr learned my addr 172.21.15.81:0/3230223447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.776+0000 7f72367fc700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238104130 0x7f7238196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f7236ffd700 1 -- 172.21.15.81:0/3230223447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238104130 msgr2=0x7f7238196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f7236ffd700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238104130 0x7f7238196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f7236ffd700 1 -- 172.21.15.81:0/3230223447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200095f0 con 0x7f7238101800 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f7236ffd700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f722800d8d0 tx=0x7f722800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7228009940 con 0x7f7238101800 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7228010460 con 0x7f7238101800 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723819bba0 con 0x7f7238101800 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722800f5f0 con 0x7f7238101800 2024-09-18T12:55:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.777+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723819c0f0 con 0x7f7238101800 2024-09-18T12:55:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.778+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238190610 con 0x7f7238101800 2024-09-18T12:55:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.779+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f72280105d0 con 0x7f7238101800 2024-09-18T12:55:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.779+0000 7f723c960700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 0x7f722407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.779+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f722809e210 con 0x7f7238101800 2024-09-18T12:55:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.779+0000 7f72367fc700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 0x7f722407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.780+0000 7f72367fc700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 0x7f722407d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7220005b40 tx=0x7f7220005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:47.783+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f7228061320 con 0x7f7238101800 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.037+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7238061ab0 con 0x7f7238101800 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.037+0000 7f723c960700 1 -- 172.21.15.81:0/3230223447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f7228064440 con 0x7f7238101800 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stdout:e22 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:55:39:334155+0000 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:55:48.039 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 22 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:55:39.283936+0000 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:55:48.040 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:55:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14556,14544 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:55:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 msgr2=0x7f722407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 0x7f722407d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7220005b40 tx=0x7f7220005a90 comp rx=0 tx=0).stop 2024-09-18T12:55:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 msgr2=0x7f7238196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f722800d8d0 tx=0x7f722800dc90 comp rx=0 tx=0).stop 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 shutdown_connections 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f722407b310 0x7f722407d7d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7238101800 0x7f7238196450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 --2- 172.21.15.81:0/3230223447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7238104130 0x7f7238196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 >> 172.21.15.81:0/3230223447 conn(0x7f72380fb190 msgr2=0x7f72380fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 shutdown_connections 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.040+0000 7f723d962700 1 -- 172.21.15.81:0/3230223447 wait complete. 2024-09-18T12:55:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-18T12:55:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- 172.21.15.81:0/4077625954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 msgr2=0x7f2ca41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 --2- 172.21.15.81:0/4077625954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca41023a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009910 tx=0x7f2c94009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- 172.21.15.81:0/4077625954 shutdown_connections 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 --2- 172.21.15.81:0/4077625954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca41023a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 --2- 172.21.15.81:0/4077625954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 0x7f2ca40ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- 172.21.15.81:0/4077625954 >> 172.21.15.81:0/4077625954 conn(0x7f2ca40fa8c0 msgr2=0x7f2ca40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- 172.21.15.81:0/4077625954 shutdown_connections 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- 172.21.15.81:0/4077625954 wait complete. 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 Processor -- start 2024-09-18T12:55:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.151+0000 7f2cac007700 1 -- start start 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 0x7f2ca4196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41970d0 con 0x7f2ca4101f40 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4197210 con 0x7f2ca40fef60 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53808/0 (socket says 172.21.15.81:53808) 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 -- 172.21.15.81:0/1590380109 learned_addr learned my addr 172.21.15.81:0/1590380109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 -- 172.21.15.81:0/1590380109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 msgr2=0x7f2ca4196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca9da3700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 0x7f2ca4196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 0x7f2ca4196570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 -- 172.21.15.81:0/1590380109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940095f0 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2ca95a2700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006010 tx=0x7f2c9400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9401d070 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c9400f460 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca419bc60 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c94021640 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.152+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca419c150 con 0x7f2ca4101f40 2024-09-18T12:55:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.153+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca41098a0 con 0x7f2ca4101f40 2024-09-18T12:55:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.154+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2c9400fab0 con 0x7f2ca4101f40 2024-09-18T12:55:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.154+0000 7f2c9affd700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 0x7f2c9007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.155+0000 7f2ca9da3700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 0x7f2c9007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.155+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f2c9409f710 con 0x7f2ca4101f40 2024-09-18T12:55:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.155+0000 7f2ca9da3700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 0x7f2c9007d7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4068c10 tx=0x7f2ca00072f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.159+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f2c94062820 con 0x7f2ca4101f40 2024-09-18T12:55:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:47 smithi136 ceph-mon[80179]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:47 smithi136 ceph-mon[80179]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:47 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1433738674' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:47 smithi081 ceph-mon[92545]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:47 smithi081 ceph-mon[92545]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:47 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1433738674' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:48.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.389+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ca4106890 con 0x7f2c9007b310 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.391+0000 7f2c9affd700 1 -- 172.21.15.81:0/1590380109 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2ca4106890 con 0x7f2c9007b310 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:55:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "8/23 daemons upgraded", 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:55:48.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 msgr2=0x7f2c9007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 0x7f2c9007d7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4068c10 tx=0x7f2ca00072f0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 msgr2=0x7f2ca4196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006010 tx=0x7f2c9400be20 comp rx=0 tx=0).stop 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 shutdown_connections 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c9007b310 0x7f2c9007d7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ca40fef60 0x7f2ca4196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 --2- 172.21.15.81:0/1590380109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4101f40 0x7f2ca4196ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 >> 172.21.15.81:0/1590380109 conn(0x7f2ca40fa8c0 msgr2=0x7f2ca4105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 shutdown_connections 2024-09-18T12:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.393+0000 7f2cac007700 1 -- 172.21.15.81:0/1590380109 wait complete. 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 -- 172.21.15.81:0/3560208915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258101ea0 msgr2=0x7f6258102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 --2- 172.21.15.81:0/3560208915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258101ea0 0x7f6258102300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6254009910 tx=0x7f6254009c20 comp rx=0 tx=0).stop 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 -- 172.21.15.81:0/3560208915 shutdown_connections 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 --2- 172.21.15.81:0/3560208915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258101ea0 0x7f6258102300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 --2- 172.21.15.81:0/3560208915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258100ca0 0x7f62581010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 -- 172.21.15.81:0/3560208915 >> 172.21.15.81:0/3560208915 conn(0x7f62580fc260 msgr2=0x7f62580fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 -- 172.21.15.81:0/3560208915 shutdown_connections 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.497+0000 7f6260426700 1 -- 172.21.15.81:0/3560208915 wait complete. 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 Processor -- start 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 -- start start 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 0x7f6258196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258197040 con 0x7f6258100ca0 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f6260426700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258197180 con 0x7f6258101ea0 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53816/0 (socket says 172.21.15.81:53816) 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 -- 172.21.15.81:0/2647720204 learned_addr learned my addr 172.21.15.81:0/2647720204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625d9c1700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 0x7f6258196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 -- 172.21.15.81:0/2647720204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 msgr2=0x7f6258196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 0x7f6258196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 -- 172.21.15.81:0/2647720204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540095f0 con 0x7f6258100ca0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625d9c1700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 0x7f6258196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.498+0000 7f625e1c2700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f624800d900 tx=0x7f624800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62480041f0 con 0x7f6258100ca0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6248004350 con 0x7f6258100ca0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625819bc30 con 0x7f6258100ca0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6248003da0 con 0x7f6258100ca0 2024-09-18T12:55:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625819c180 con 0x7f6258100ca0 2024-09-18T12:55:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.499+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6258109800 con 0x7f6258100ca0 2024-09-18T12:55:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.500+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f6248009730 con 0x7f6258100ca0 2024-09-18T12:55:48.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.501+0000 7f624f7fe700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 0x7f624407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:48.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.501+0000 7f625d9c1700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 0x7f624407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:48.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.501+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f624809e300 con 0x7f6258100ca0 2024-09-18T12:55:48.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.501+0000 7f625d9c1700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 0x7f624407d7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6254005b40 tx=0x7f6254005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.505+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f6248061490 con 0x7f6258100ca0 2024-09-18T12:55:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.800+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f62581099f0 con 0x7f6258100ca0 2024-09-18T12:55:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.801+0000 7f624f7fe700 1 -- 172.21.15.81:0/2647720204 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f62480645b0 con 0x7f6258100ca0 2024-09-18T12:55:48.802 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:55:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 msgr2=0x7f624407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 0x7f624407d7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6254005b40 tx=0x7f6254005a90 comp rx=0 tx=0).stop 2024-09-18T12:55:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 msgr2=0x7f62581964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f624800d900 tx=0x7f624800dcc0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 shutdown_connections 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f624407b310 0x7f624407d7d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6258100ca0 0x7f62581964e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 --2- 172.21.15.81:0/2647720204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6258101ea0 0x7f6258196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 >> 172.21.15.81:0/2647720204 conn(0x7f62580fc260 msgr2=0x7f62581050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 shutdown_connections 2024-09-18T12:55:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:55:48.803+0000 7f6260426700 1 -- 172.21.15.81:0/2647720204 wait complete. 2024-09-18T12:55:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:48 smithi081 ceph-mon[92545]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:48 smithi081 ceph-mon[92545]: pgmap v80: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:48 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3230223447' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:48 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2647720204' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:48 smithi136 ceph-mon[80179]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:48 smithi136 ceph-mon[80179]: pgmap v80: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:48 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3230223447' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:48 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2647720204' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:49 smithi136 ceph-mon[80179]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:50.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:49 smithi081 ceph-mon[92545]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:50 smithi136 ceph-mon[80179]: pgmap v81: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:50 smithi081 ceph-mon[92545]: pgmap v81: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:51 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:51 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: Upgrade: osd.2 is safe to restart 2024-09-18T12:55:53.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: pgmap v82: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:53.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:53.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:55:53.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:53.294 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:53.294 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: Upgrade: osd.2 is safe to restart 2024-09-18T12:55:53.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: pgmap v82: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:53.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:55:53.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:55:53.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:54.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:53 smithi081 ceph-mon[92545]: Upgrade: Updating osd.2 2024-09-18T12:55:54.084 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:53 smithi081 ceph-mon[92545]: Deploying daemon osd.2 on smithi081 2024-09-18T12:55:54.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:53 smithi136 ceph-mon[80179]: Upgrade: Updating osd.2 2024-09-18T12:55:54.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:53 smithi136 ceph-mon[80179]: Deploying daemon osd.2 on smithi081 2024-09-18T12:55:55.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:54 smithi136 ceph-mon[80179]: pgmap v83: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:55.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:54 smithi081 ceph-mon[92545]: pgmap v83: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:56.013 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:55 smithi081 systemd[1]: Stopping Ceph osd.2 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:55:56.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:56 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[63993]: 2024-09-18T12:55:56.011+0000 7fada8cb4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:55:56.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:56 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[63993]: 2024-09-18T12:55:56.011+0000 7fada8cb4700 -1 osd.2 60 *** Got signal Terminated *** 2024-09-18T12:55:56.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:56 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[63993]: 2024-09-18T12:55:56.011+0000 7fada8cb4700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:55:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:56 smithi136 ceph-mon[80179]: pgmap v84: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:56 smithi136 ceph-mon[80179]: osd.2 marked itself down and dead 2024-09-18T12:55:57.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:56 smithi081 ceph-mon[92545]: pgmap v84: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:57.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:56 smithi081 ceph-mon[92545]: osd.2 marked itself down and dead 2024-09-18T12:55:57.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:57 smithi081 podman[110951]: 2024-09-18 12:55:57.351119682 +0000 UTC m=+1.476420358 container died 6cba6a3cd915d3005566d30fe8f9a2de8343da902e113d518ad9ac6912a5ded0 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_CLEAN=True) 2024-09-18T12:55:57.988 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:57 smithi081 podman[110951]: 2024-09-18 12:55:57.694655411 +0000 UTC m=+1.819956080 container cleanup 6cba6a3cd915d3005566d30fe8f9a2de8343da902e113d518ad9ac6912a5ded0 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-18T12:55:57.988 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:57 smithi081 bash[110951]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2 2024-09-18T12:55:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:57 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:57 smithi136 ceph-mon[80179]: osdmap e61: 6 total, 5 up, 6 in 2024-09-18T12:55:58.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:57 smithi136 ceph-mon[80179]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T12:55:58.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:57 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:58.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:57 smithi081 ceph-mon[92545]: osdmap e61: 6 total, 5 up, 6 in 2024-09-18T12:55:58.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:57 smithi081 ceph-mon[92545]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T12:55:58.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:57 smithi081 podman[110969]: 2024-09-18 12:55:57.996091698 +0000 UTC m=+0.644904519 container remove 6cba6a3cd915d3005566d30fe8f9a2de8343da902e113d518ad9ac6912a5ded0 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, ceph=True) 2024-09-18T12:55:58.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.264707877 +0000 UTC m=+0.015873631 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:58.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.405667116 +0000 UTC m=+0.156832870 container create a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-18T12:55:58.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.650114201 +0000 UTC m=+0.401279956 container init a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T12:55:58.989 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.653694477 +0000 UTC m=+0.404860231 container start a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-18T12:55:58.989 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.766778679 +0000 UTC m=+0.517944445 container attach a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:55:58.990 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:58 smithi081 podman[111055]: 2024-09-18 12:55:58.837239151 +0000 UTC m=+0.588404898 container died a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T12:55:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:58 smithi136 ceph-mon[80179]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:59.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:58 smithi081 ceph-mon[92545]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:59.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 podman[111078]: 2024-09-18 12:55:59.479216419 +0000 UTC m=+0.632223813 container remove a6f8d92572ad5e7a821bdf4d31cff94be416cf5719467cf28ab5e2a9bf7b9f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:55:59.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-18T12:55:59.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 systemd[1]: Stopped Ceph osd.2 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:55:59.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.2.service: Consumed 47.677s CPU time. 2024-09-18T12:55:59.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 systemd[1]: Starting Ceph osd.2 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:00.175 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:55:59 smithi081 ceph-mon[92545]: pgmap v88: 65 pgs: 11 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/369 objects degraded (8.672%) 2024-09-18T12:56:00.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 podman[111180]: 2024-09-18 12:55:59.816613961 +0000 UTC m=+0.015768366 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:00.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:55:59 smithi081 podman[111180]: 2024-09-18 12:55:59.95578782 +0000 UTC m=+0.154942208 container create 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-18T12:56:00.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 podman[111180]: 2024-09-18 12:56:00.17532827 +0000 UTC m=+0.374482657 container init 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-18T12:56:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:55:59 smithi136 ceph-mon[80179]: pgmap v88: 65 pgs: 11 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/369 objects degraded (8.672%) 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 podman[111180]: 2024-09-18 12:56:00.179075368 +0000 UTC m=+0.378229759 container start 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 podman[111180]: 2024-09-18 12:56:00.250268318 +0000 UTC m=+0.449422714 container attach 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 bash[111180]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:00.607 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:00 smithi081 bash[111180]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:00 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 32/369 objects degraded (8.672%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:00 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 32/369 objects degraded (8.672%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:02 smithi136 ceph-mon[80179]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-mon[92545]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:02.949 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:56:02.950 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:56:02.950 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:56:02.950 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:56:02.950 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:56:02.950 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:56:03.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:56:03.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:56:03.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:56:03.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:56:03.358 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:56:03.358 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:56:03.358 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate[111196]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:56:03.358 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 bash[111180]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:56:03.358 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:02 smithi081 podman[111180]: 2024-09-18 12:56:02.982221823 +0000 UTC m=+3.181376217 container died 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:03.989 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:03 smithi081 podman[111352]: 2024-09-18 12:56:03.63723726 +0000 UTC m=+0.643539588 container remove 1716b070abe57a1e684a8154c3af31b998b368b38a9bf24757b5a4ca83a86c4d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-18T12:56:03.989 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:03 smithi081 podman[111411]: 2024-09-18 12:56:03.753924776 +0000 UTC m=+0.016225112 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:03.989 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:03 smithi081 podman[111411]: 2024-09-18 12:56:03.863134981 +0000 UTC m=+0.125435305 container create 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2) 2024-09-18T12:56:04.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:04 smithi081 podman[111411]: 2024-09-18 12:56:04.099150055 +0000 UTC m=+0.361450384 container init 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T12:56:04.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:04 smithi081 podman[111411]: 2024-09-18 12:56:04.102308187 +0000 UTC m=+0.364608510 container start 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:04.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-osd[111431]: -- 172.21.15.81:0/554358595 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e09d2161e0 con 0x55e09c3b3c00 2024-09-18T12:56:04.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:04 smithi081 bash[111411]: 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 2024-09-18T12:56:04.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:04 smithi081 systemd[1]: Started Ceph osd.2 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:05.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:05.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:05.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:05.857 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:05 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T12:56:05.736+0000 7f938aec4640 -1 Falling back to public interface 2024-09-18T12:56:06.215 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:05 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 45/369 objects degraded (12.195%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:06.360 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:05 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 45/369 objects degraded (12.195%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:06 smithi136 ceph-mon[80179]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:07.355 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:06 smithi081 ceph-mon[92545]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:08 smithi081 ceph-mon[92545]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:08 smithi136 ceph-mon[80179]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:10.728 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T12:56:10.451+0000 7f938aec4640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-18T12:56:10.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-mon[92545]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:10.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.728 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:10 smithi136 ceph-mon[80179]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:10.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:11.107 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:10 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T12:56:10.809+0000 7f938aec4640 -1 osd.2 60 log_to_monitors true 2024-09-18T12:56:11.725 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:11 smithi081 ceph-mon[92545]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 12:56:11 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T12:56:11.489+0000 7f9382c6e640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:56:11.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:11 smithi136 ceph-mon[80179]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:56:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:12 smithi136 ceph-mon[80179]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:56:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:12 smithi136 ceph-mon[80179]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:56:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:12 smithi136 ceph-mon[80179]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:56:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:12 smithi136 ceph-mon[80179]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:12 smithi081 ceph-mon[92545]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:56:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:12 smithi081 ceph-mon[92545]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:56:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:12 smithi081 ceph-mon[92545]: from='osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-18T12:56:12.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:12 smithi081 ceph-mon[92545]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857] boot 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: osdmap e64: 6 total, 6 up, 6 in 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: osd.2 [v2:172.21.15.81:6818/2594345857,v1:172.21.15.81:6819/2594345857] boot 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: osdmap e64: 6 total, 6 up, 6 in 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:13.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:14.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:14 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:14.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:14 smithi136 ceph-mon[80179]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:56:14.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:14 smithi136 ceph-mon[80179]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T12:56:14.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:14 smithi136 ceph-mon[80179]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:14.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:14 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:14.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:14 smithi081 ceph-mon[92545]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:56:14.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:14 smithi081 ceph-mon[92545]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T12:56:14.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:14 smithi081 ceph-mon[92545]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:16 smithi136 ceph-mon[80179]: pgmap v99: 65 pgs: 5 active+undersized, 4 active+undersized+degraded, 56 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15/369 objects degraded (4.065%) 2024-09-18T12:56:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:16 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 15/369 objects degraded (4.065%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:16 smithi081 ceph-mon[92545]: pgmap v99: 65 pgs: 5 active+undersized, 4 active+undersized+degraded, 56 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15/369 objects degraded (4.065%) 2024-09-18T12:56:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:16 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 15/369 objects degraded (4.065%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:18 smithi136 ceph-mon[80179]: pgmap v100: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:18 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/369 objects degraded (4.065%), 4 pgs degraded) 2024-09-18T12:56:18.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:18 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:56:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:18 smithi081 ceph-mon[92545]: pgmap v100: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:18 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/369 objects degraded (4.065%), 4 pgs degraded) 2024-09-18T12:56:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:18 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:56:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 -- 172.21.15.81:0/2400987312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 msgr2=0x7f9f6c0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 --2- 172.21.15.81:0/2400987312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c0fffc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400b0a0 tx=0x7f9f6400b3b0 comp rx=0 tx=0).stop 2024-09-18T12:56:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 -- 172.21.15.81:0/2400987312 shutdown_connections 2024-09-18T12:56:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 --2- 172.21.15.81:0/2400987312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 --2- 172.21.15.81:0/2400987312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c0fffc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 -- 172.21.15.81:0/2400987312 >> 172.21.15.81:0/2400987312 conn(0x7f9f6c0fb120 msgr2=0x7f9f6c0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 -- 172.21.15.81:0/2400987312 shutdown_connections 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.921+0000 7f9f74218700 1 -- 172.21.15.81:0/2400987312 wait complete. 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 Processor -- start 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 -- start start 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c197050 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f74218700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c197190 con 0x7f9f6c100da0 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f71fb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f71fb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36870/0 (socket says 172.21.15.81:36870) 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f71fb4700 1 -- 172.21.15.81:0/2487405021 learned_addr learned my addr 172.21.15.81:0/2487405021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.922+0000 7f9f717b3700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f71fb4700 1 -- 172.21.15.81:0/2487405021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 msgr2=0x7f9f6c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f71fb4700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f71fb4700 1 -- 172.21.15.81:0/2487405021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64009d00 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f717b3700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f71fb4700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f640077b0 tx=0x7f9f64009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6400e040 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f640044f0 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c19bbe0 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6401d9e0 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.923+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c19c0d0 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.924+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c108720 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.925+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9f64004040 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.925+0000 7f9f6affd700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 0x7f9f5407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.925+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9f640a02a0 con 0x7f9f6c0ffba0 2024-09-18T12:56:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.925+0000 7f9f717b3700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 0x7f9f5407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.926+0000 7f9f717b3700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 0x7f9f5407d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000bcf0 tx=0x7f9f6000b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:18.929+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9f64063430 con 0x7f9f6c0ffba0 2024-09-18T12:56:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.163+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f6c069520 con 0x7f9f5407b310 2024-09-18T12:56:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.164+0000 7f9f6affd700 1 -- 172.21.15.81:0/2487405021 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9f6c069520 con 0x7f9f5407b310 2024-09-18T12:56:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 msgr2=0x7f9f5407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 0x7f9f5407d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000bcf0 tx=0x7f9f6000b2c0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 msgr2=0x7f9f6c1964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f640077b0 tx=0x7f9f64009810 comp rx=0 tx=0).stop 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 shutdown_connections 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9f5407b310 0x7f9f5407d7d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f6c0ffba0 0x7f9f6c1964f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 --2- 172.21.15.81:0/2487405021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f6c100da0 0x7f9f6c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 >> 172.21.15.81:0/2487405021 conn(0x7f9f6c0fb120 msgr2=0x7f9f6c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 shutdown_connections 2024-09-18T12:56:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.167+0000 7f9f74218700 1 -- 172.21.15.81:0/2487405021 wait complete. 2024-09-18T12:56:19.179 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:56:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 -- 172.21.15.81:0/301076324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 msgr2=0x7fcf44100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/301076324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44100030 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009910 tx=0x7fcf40009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 -- 172.21.15.81:0/301076324 shutdown_connections 2024-09-18T12:56:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/301076324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 0x7fcf44101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/301076324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44100030 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 -- 172.21.15.81:0/301076324 >> 172.21.15.81:0/301076324 conn(0x7fcf440fb190 msgr2=0x7fcf440fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 -- 172.21.15.81:0/301076324 shutdown_connections 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.272+0000 7fcf4aa75700 1 -- 172.21.15.81:0/301076324 wait complete. 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 Processor -- start 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 -- start start 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 0x7fcf441021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44102730 con 0x7fcf440ffc10 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf4aa75700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44102870 con 0x7fcf44100e10 2024-09-18T12:56:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36880/0 (socket says 172.21.15.81:36880) 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 -- 172.21.15.81:0/4248682639 learned_addr learned my addr 172.21.15.81:0/4248682639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 0x7fcf441021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 -- 172.21.15.81:0/4248682639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 msgr2=0x7fcf441021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 0x7fcf441021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 -- 172.21.15.81:0/4248682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400095f0 con 0x7fcf440ffc10 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.273+0000 7fcf48811700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000bda0 tx=0x7fcf4000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.274+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf4001d070 con 0x7fcf440ffc10 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.274+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf44102af0 con 0x7fcf440ffc10 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.274+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf40004c50 con 0x7fcf440ffc10 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.274+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf4000f690 con 0x7fcf440ffc10 2024-09-18T12:56:19.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.274+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44102fe0 con 0x7fcf440ffc10 2024-09-18T12:56:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.275+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44108780 con 0x7fcf440ffc10 2024-09-18T12:56:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.276+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fcf400229b0 con 0x7fcf440ffc10 2024-09-18T12:56:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.276+0000 7fcf39ffb700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 0x7fcf2c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.276+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fcf4009f9d0 con 0x7fcf440ffc10 2024-09-18T12:56:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.276+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 0x7fcf2c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.277+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 0x7fcf2c07d7d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006fd0 tx=0x7fcf34008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.280+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fcf40062b90 con 0x7fcf440ffc10 2024-09-18T12:56:19.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.511+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf4419e9b0 con 0x7fcf2c07b310 2024-09-18T12:56:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.513+0000 7fcf39ffb700 1 -- 172.21.15.81:0/4248682639 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcf4419e9b0 con 0x7fcf2c07b310 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 msgr2=0x7fcf2c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 0x7fcf2c07d7d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006fd0 tx=0x7fcf34008040 comp rx=0 tx=0).stop 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 msgr2=0x7fcf44103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000bda0 tx=0x7fcf4000be80 comp rx=0 tx=0).stop 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 shutdown_connections 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcf2c07b310 0x7fcf2c07d7d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf440ffc10 0x7fcf44103ba0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 --2- 172.21.15.81:0/4248682639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf44100e10 0x7fcf441021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.515+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 >> 172.21.15.81:0/4248682639 conn(0x7fcf440fb190 msgr2=0x7fcf44068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.516+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 shutdown_connections 2024-09-18T12:56:19.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.516+0000 7fcf4aa75700 1 -- 172.21.15.81:0/4248682639 wait complete. 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.619+0000 7faf2f6db700 1 -- 172.21.15.81:0/968274333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28101fe0 msgr2=0x7faf28102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.619+0000 7faf2f6db700 1 --2- 172.21.15.81:0/968274333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28101fe0 0x7faf28102440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf18009910 tx=0x7faf18009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.619+0000 7faf2f6db700 1 -- 172.21.15.81:0/968274333 shutdown_connections 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.619+0000 7faf2f6db700 1 --2- 172.21.15.81:0/968274333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28101fe0 0x7faf28102440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.619+0000 7faf2f6db700 1 --2- 172.21.15.81:0/968274333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf280fef60 0x7faf280ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- 172.21.15.81:0/968274333 >> 172.21.15.81:0/968274333 conn(0x7faf280fa8c0 msgr2=0x7faf280fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- 172.21.15.81:0/968274333 shutdown_connections 2024-09-18T12:56:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- 172.21.15.81:0/968274333 wait complete. 2024-09-18T12:56:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 Processor -- start 2024-09-18T12:56:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- start start 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28101fe0 0x7faf28196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28197030 con 0x7faf280fef60 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.620+0000 7faf2f6db700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28197170 con 0x7faf28101fe0 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36904/0 (socket says 172.21.15.81:36904) 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 -- 172.21.15.81:0/151201411 learned_addr learned my addr 172.21.15.81:0/151201411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2cc76700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28101fe0 0x7faf28196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 -- 172.21.15.81:0/151201411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28101fe0 msgr2=0x7faf28196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28101fe0 0x7faf28196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 -- 172.21.15.81:0/151201411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180095f0 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2d477700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d900 tx=0x7faf2400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf240041f0 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf24004350 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2819bc20 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf24003d20 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.621+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2819c170 con 0x7faf280fef60 2024-09-18T12:56:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.622+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28109800 con 0x7faf280fef60 2024-09-18T12:56:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.623+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7faf24009730 con 0x7faf280fef60 2024-09-18T12:56:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.623+0000 7faf1e7fc700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 0x7faf1407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.624+0000 7faf2cc76700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 0x7faf1407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.624+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7faf2409e0c0 con 0x7faf280fef60 2024-09-18T12:56:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.624+0000 7faf2cc76700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 0x7faf1407d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b5c0 tx=0x7faf18005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.628+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7faf240611d0 con 0x7faf280fef60 2024-09-18T12:56:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.845+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf28106930 con 0x7faf1407b310 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.856+0000 7faf1e7fc700 1 -- 172.21.15.81:0/151201411 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7faf28106930 con 0x7faf1407b310 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (11m) 10s ago 13m 25.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (4m) 10s ago 14m 8376k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (4m) 107s ago 13m 7285k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (115s) 10s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (111s) 107s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (11m) 10s ago 13m 82.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (7m) 10s ago 7m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:56:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (7m) 10s ago 7m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (7m) 107s ago 7m 19.7M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (7m) 107s ago 7m 15.6M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (4m) 10s ago 15m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (3m) 107s ago 12m 453M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (2m) 10s ago 15m 46.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (2m) 107s ago 12m 35.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (13m) 10s ago 13m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (12m) 107s ago 12m 14.8M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (89s) 10s ago 11m 93.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (52s) 10s ago 10m 102M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (16s) 10s ago 10m 14.3M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (9m) 107s ago 9m 285M 2240M 18.2.1 5be31c24972a 8f1e31a64e07 2024-09-18T12:56:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (9m) 107s ago 9m 243M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:56:19.860 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (9m) 107s ago 9m 223M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:56:19.860 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (3m) 10s ago 13m 67.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:56:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 msgr2=0x7faf1407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 0x7faf1407d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b5c0 tx=0x7faf18005ee0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 msgr2=0x7faf281964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d900 tx=0x7faf2400dc10 comp rx=0 tx=0).stop 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 shutdown_connections 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faf1407b310 0x7faf1407d7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf280fef60 0x7faf281964d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 --2- 172.21.15.81:0/151201411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28101fe0 0x7faf28196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 >> 172.21.15.81:0/151201411 conn(0x7faf280fa8c0 msgr2=0x7faf28105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 shutdown_connections 2024-09-18T12:56:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.859+0000 7faf2f6db700 1 -- 172.21.15.81:0/151201411 wait complete. 2024-09-18T12:56:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 -- 172.21.15.81:0/3487866329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43900ffe30 msgr2=0x7f4390100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 --2- 172.21.15.81:0/3487866329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43900ffe30 0x7f4390100290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4380009910 tx=0x7f4380009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 -- 172.21.15.81:0/3487866329 shutdown_connections 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 --2- 172.21.15.81:0/3487866329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43900ffe30 0x7f4390100290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 --2- 172.21.15.81:0/3487866329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4390101180 0x7f43901015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 -- 172.21.15.81:0/3487866329 >> 172.21.15.81:0/3487866329 conn(0x7f43900fa8c0 msgr2=0x7f43900fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 -- 172.21.15.81:0/3487866329 shutdown_connections 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.962+0000 7f439546f700 1 -- 172.21.15.81:0/3487866329 wait complete. 2024-09-18T12:56:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 Processor -- start 2024-09-18T12:56:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 -- start start 2024-09-18T12:56:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43900ffe30 0x7f43901964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390197010 con 0x7f4390101180 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f439546f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390197150 con 0x7f43900ffe30 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36926/0 (socket says 172.21.15.81:36926) 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 -- 172.21.15.81:0/1688012599 learned_addr learned my addr 172.21.15.81:0/1688012599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438effd700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43900ffe30 0x7f43901964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 -- 172.21.15.81:0/1688012599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43900ffe30 msgr2=0x7f43901964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43900ffe30 0x7f43901964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.963+0000 7f438e7fc700 1 -- 172.21.15.81:0/1688012599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800095f0 con 0x7f4390101180 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f438e7fc700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4380006010 tx=0x7f438000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438001d070 con 0x7f4390101180 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f438000f460 con 0x7f4390101180 2024-09-18T12:56:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439019bba0 con 0x7f4390101180 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4380021640 con 0x7f4390101180 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.964+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439019c090 con 0x7f4390101180 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.965+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4390108700 con 0x7f4390101180 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.965+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f438000fab0 con 0x7f4390101180 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.966+0000 7f4377fff700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 0x7f437807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.966+0000 7f438effd700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 0x7f437807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.966+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f438009f470 con 0x7f4390101180 2024-09-18T12:56:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.966+0000 7f438effd700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 0x7f437807d7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4390068bd0 tx=0x7f438400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:19.970+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4380062580 con 0x7f4390101180 2024-09-18T12:56:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.266+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43901088f0 con 0x7f4390101180 2024-09-18T12:56:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.267+0000 7f4377fff700 1 -- 172.21.15.81:0/1688012599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f43800656a0 con 0x7f4390101180 2024-09-18T12:56:20.268 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:56:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 7, 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 7 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 msgr2=0x7f437807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 0x7f437807d7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4390068bd0 tx=0x7f438400b410 comp rx=0 tx=0).stop 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 msgr2=0x7f43901969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4380006010 tx=0x7f438000bd70 comp rx=0 tx=0).stop 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 shutdown_connections 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f437807b310 0x7f437807d7d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43900ffe30 0x7f43901964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 --2- 172.21.15.81:0/1688012599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4390101180 0x7f43901969f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 >> 172.21.15.81:0/1688012599 conn(0x7f43900fa8c0 msgr2=0x7f43900fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 shutdown_connections 2024-09-18T12:56:20.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.269+0000 7f439546f700 1 -- 172.21.15.81:0/1688012599 wait complete. 2024-09-18T12:56:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 -- 172.21.15.81:0/4267072793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 msgr2=0x7f0360102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 --2- 172.21.15.81:0/4267072793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f0360102310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f035c009910 tx=0x7f035c009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 -- 172.21.15.81:0/4267072793 shutdown_connections 2024-09-18T12:56:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 --2- 172.21.15.81:0/4267072793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f0360102310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 --2- 172.21.15.81:0/4267072793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 0x7f03601010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 -- 172.21.15.81:0/4267072793 >> 172.21.15.81:0/4267072793 conn(0x7f03600fc230 msgr2=0x7f03600fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 -- 172.21.15.81:0/4267072793 shutdown_connections 2024-09-18T12:56:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.374+0000 7f03686b5700 1 -- 172.21.15.81:0/4267072793 wait complete. 2024-09-18T12:56:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 Processor -- start 2024-09-18T12:56:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 -- start start 2024-09-18T12:56:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 0x7f03601964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360197010 con 0x7f0360101eb0 2024-09-18T12:56:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f03686b5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360197150 con 0x7f0360100cb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.375+0000 7f0365c50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36944/0 (socket says 172.21.15.81:36944) 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 -- 172.21.15.81:0/1206894480 learned_addr learned my addr 172.21.15.81:0/1206894480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0366451700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 0x7f03601964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 -- 172.21.15.81:0/1206894480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 msgr2=0x7f03601964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 0x7f03601964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 -- 172.21.15.81:0/1206894480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0095f0 con 0x7f0360101eb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f0365c50700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f035c006010 tx=0x7f035c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035c01d070 con 0x7f0360101eb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f035c00f460 con 0x7f0360101eb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035c021640 con 0x7f0360101eb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036019bba0 con 0x7f0360101eb0 2024-09-18T12:56:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.376+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036019c090 con 0x7f0360101eb0 2024-09-18T12:56:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.377+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360109810 con 0x7f0360101eb0 2024-09-18T12:56:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.378+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f035c00fab0 con 0x7f0360101eb0 2024-09-18T12:56:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.379+0000 7f03577fe700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 0x7f034c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.379+0000 7f0366451700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 0x7f034c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.379+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f035c09f380 con 0x7f0360101eb0 2024-09-18T12:56:20.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.379+0000 7f0366451700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 0x7f034c07d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0360101d10 tx=0x7f035000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.383+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f035c062510 con 0x7f0360101eb0 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:20 smithi136 ceph-mon[80179]: pgmap v101: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:20 smithi081 ceph-mon[92545]: pgmap v101: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:20.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.635+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0360109a00 con 0x7f0360101eb0 2024-09-18T12:56:20.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.635+0000 7f03577fe700 1 -- 172.21.15.81:0/1206894480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f035c065630 con 0x7f0360101eb0 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:e22 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:55:39:334155+0000 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 22 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:56:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:55:39.283936+0000 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:56:20.638 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14556,14544 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:20.639 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:20.640 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 msgr2=0x7f034c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 0x7f034c07d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0360101d10 tx=0x7f035000b410 comp rx=0 tx=0).stop 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 msgr2=0x7f03601969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f035c006010 tx=0x7f035c00bd70 comp rx=0 tx=0).stop 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 shutdown_connections 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f034c07b310 0x7f034c07d7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0360100cb0 0x7f03601964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 --2- 172.21.15.81:0/1206894480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0360101eb0 0x7f03601969f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 >> 172.21.15.81:0/1206894480 conn(0x7f03600fc230 msgr2=0x7f03601050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 shutdown_connections 2024-09-18T12:56:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.637+0000 7f03686b5700 1 -- 172.21.15.81:0/1206894480 wait complete. 2024-09-18T12:56:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-18T12:56:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2789332044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 msgr2=0x7ff9580ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2789332044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9580ff390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff948009910 tx=0x7ff948009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2789332044 shutdown_connections 2024-09-18T12:56:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2789332044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 0x7ff9581023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2789332044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9580ff390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2789332044 >> 172.21.15.81:0/2789332044 conn(0x7ff9580fa8b0 msgr2=0x7ff9580fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2789332044 shutdown_connections 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.742+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2789332044 wait complete. 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 Processor -- start 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 -- start start 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 0x7ff958196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958196fb0 con 0x7ff9580fef70 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95fc2e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581970f0 con 0x7ff958101f50 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36966/0 (socket says 172.21.15.81:36966) 2024-09-18T12:56:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 -- 172.21.15.81:0/2801048724 learned_addr learned my addr 172.21.15.81:0/2801048724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d1c9700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 0x7ff958196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 -- 172.21.15.81:0/2801048724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 msgr2=0x7ff958196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 0x7ff958196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 -- 172.21.15.81:0/2801048724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480095f0 con 0x7ff9580fef70 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.743+0000 7ff95d9ca700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff94800bda0 tx=0x7ff94800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.744+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94801d070 con 0x7ff9580fef70 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.744+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff948004c50 con 0x7ff9580fef70 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.744+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95819bb50 con 0x7ff9580fef70 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.744+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94800f690 con 0x7ff9580fef70 2024-09-18T12:56:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.744+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95819c010 con 0x7ff9580fef70 2024-09-18T12:56:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.745+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958109810 con 0x7ff9580fef70 2024-09-18T12:56:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.745+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff948022a20 con 0x7ff9580fef70 2024-09-18T12:56:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.746+0000 7ff94effd700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 0x7ff94407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.746+0000 7ff95d1c9700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 0x7ff94407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.746+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ff94809f8a0 con 0x7ff9580fef70 2024-09-18T12:56:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.746+0000 7ff95d1c9700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 0x7ff94407d7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff954005ea0 tx=0x7ff954005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.750+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff948062a60 con 0x7ff9580fef70 2024-09-18T12:56:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.983+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9581068a0 con 0x7ff94407b310 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.984+0000 7ff94effd700 1 -- 172.21.15.81:0/2801048724 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff9581068a0 con 0x7ff94407b310 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:20.985 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "9/23 daemons upgraded", 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:56:20.986 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 msgr2=0x7ff94407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 0x7ff94407d7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff954005ea0 tx=0x7ff954005e30 comp rx=0 tx=0).stop 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 msgr2=0x7ff9581964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff94800bda0 tx=0x7ff94800be80 comp rx=0 tx=0).stop 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 shutdown_connections 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff94407b310 0x7ff94407d7d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9580fef70 0x7ff9581964e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 --2- 172.21.15.81:0/2801048724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff958101f50 0x7ff958196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 >> 172.21.15.81:0/2801048724 conn(0x7ff9580fa8b0 msgr2=0x7ff958105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.986+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 shutdown_connections 2024-09-18T12:56:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:20.987+0000 7ff95fc2e700 1 -- 172.21.15.81:0/2801048724 wait complete. 2024-09-18T12:56:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- 172.21.15.81:0/2762343093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 msgr2=0x7f5150103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 --2- 172.21.15.81:0/2762343093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f5150103b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f514000b0a0 tx=0x7f514000b3b0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- 172.21.15.81:0/2762343093 shutdown_connections 2024-09-18T12:56:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 --2- 172.21.15.81:0/2762343093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 --2- 172.21.15.81:0/2762343093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f5150103b40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- 172.21.15.81:0/2762343093 >> 172.21.15.81:0/2762343093 conn(0x7f51500fb160 msgr2=0x7f51500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- 172.21.15.81:0/2762343093 shutdown_connections 2024-09-18T12:56:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- 172.21.15.81:0/2762343093 wait complete. 2024-09-18T12:56:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 Processor -- start 2024-09-18T12:56:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.090+0000 7f5155c06700 1 -- start start 2024-09-18T12:56:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f5155c06700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f5155c06700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f5155c06700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150197350 con 0x7f5150101750 2024-09-18T12:56:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f5155c06700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150197490 con 0x7f5150104080 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36994/0 (socket says 172.21.15.81:36994) 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 -- 172.21.15.81:0/2718408719 learned_addr learned my addr 172.21.15.81:0/2718408719 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514effd700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 -- 172.21.15.81:0/2718408719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 msgr2=0x7f5150196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 -- 172.21.15.81:0/2718408719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009d00 con 0x7f5150101750 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514effd700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514f7fe700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f514000b070 tx=0x7f5140003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f514000e040 con 0x7f5150101750 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f514000ce60 con 0x7f5150101750 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515019bee0 con 0x7f5150101750 2024-09-18T12:56:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.091+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f514001daf0 con 0x7f5150101750 2024-09-18T12:56:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.092+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515019c350 con 0x7f5150101750 2024-09-18T12:56:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.092+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150190630 con 0x7f5150101750 2024-09-18T12:56:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.093+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5140004250 con 0x7f5150101750 2024-09-18T12:56:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.094+0000 7f514cff9700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 0x7f513807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:21.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.094+0000 7f514effd700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 0x7f513807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:21.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.094+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f514009fe30 con 0x7f5150101750 2024-09-18T12:56:21.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.094+0000 7f514effd700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 0x7f513807d7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5144005950 tx=0x7f5144005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:21.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.098+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5140062f40 con 0x7f5150101750 2024-09-18T12:56:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:21 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1688012599' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:21 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1206894480' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:21 smithi081 ceph-mon[92545]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.396+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5150068af0 con 0x7f5150101750 2024-09-18T12:56:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.396+0000 7f514cff9700 1 -- 172.21.15.81:0/2718408719 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5140066060 con 0x7f5150101750 2024-09-18T12:56:21.397 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 msgr2=0x7f513807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 0x7f513807d7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5144005950 tx=0x7f5144005f50 comp rx=0 tx=0).stop 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 msgr2=0x7f51501967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f514000b070 tx=0x7f5140003ce0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 shutdown_connections 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f513807b310 0x7f513807d7d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150101750 0x7f51501967f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 --2- 172.21.15.81:0/2718408719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5150104080 0x7f5150196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.398+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 >> 172.21.15.81:0/2718408719 conn(0x7f51500fb160 msgr2=0x7f51500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.399+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 shutdown_connections 2024-09-18T12:56:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:21.399+0000 7f5155c06700 1 -- 172.21.15.81:0/2718408719 wait complete. 2024-09-18T12:56:21.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:21 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1688012599' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:21.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:21 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1206894480' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:21.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:21 smithi136 ceph-mon[80179]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:22.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:22 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2718408719' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:22.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:22 smithi136 ceph-mon[80179]: pgmap v102: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:22.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:22 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2718408719' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:22.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:22 smithi081 ceph-mon[92545]: pgmap v102: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:24 smithi136 ceph-mon[80179]: pgmap v103: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:24 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:24 smithi081 ceph-mon[92545]: pgmap v103: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:24 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:26 smithi136 ceph-mon[80179]: pgmap v104: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:26 smithi081 ceph-mon[92545]: pgmap v104: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:29.055 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:28 smithi136 ceph-mon[80179]: pgmap v105: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:29.055 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:28 smithi081 ceph-mon[92545]: pgmap v105: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:29 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:29 smithi136 ceph-mon[80179]: Upgrade: osd.3 is safe to restart 2024-09-18T12:56:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:29 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:29 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:56:30.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:29 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:29 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:29 smithi081 ceph-mon[92545]: Upgrade: osd.3 is safe to restart 2024-09-18T12:56:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:29 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:29 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:56:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:29 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:31.116 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:30 smithi136 ceph-mon[80179]: Upgrade: Updating osd.3 2024-09-18T12:56:31.116 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:30 smithi136 ceph-mon[80179]: Deploying daemon osd.3 on smithi136 2024-09-18T12:56:31.116 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:30 smithi136 ceph-mon[80179]: pgmap v106: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:30 smithi081 ceph-mon[92545]: Upgrade: Updating osd.3 2024-09-18T12:56:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:30 smithi081 ceph-mon[92545]: Deploying daemon osd.3 on smithi136 2024-09-18T12:56:31.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:30 smithi081 ceph-mon[92545]: pgmap v106: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:32.912 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:32 smithi136 systemd[1]: Stopping Ceph osd.3 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:32 smithi136 ceph-mon[80179]: pgmap v107: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:32 smithi136 ceph-mon[80179]: osd.3 marked itself down and dead 2024-09-18T12:56:33.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:32 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[41355]: 2024-09-18T12:56:32.909+0000 7fa75e2a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:33.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:32 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[41355]: 2024-09-18T12:56:32.909+0000 7fa75e2a4700 -1 osd.3 65 *** Got signal Terminated *** 2024-09-18T12:56:33.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:32 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[41355]: 2024-09-18T12:56:32.909+0000 7fa75e2a4700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:56:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:32 smithi081 ceph-mon[92545]: pgmap v107: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:32 smithi081 ceph-mon[92545]: osd.3 marked itself down and dead 2024-09-18T12:56:33.604 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:33 smithi136 podman[88696]: 2024-09-18 12:56:33.35206635 +0000 UTC m=+0.544282367 container died 8f1e31a64e07c6dcdbd190cbd05648e6cc64f39356f71a312c48151fee98a051 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-18T12:56:33.887 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:33 smithi136 podman[88696]: 2024-09-18 12:56:33.702613785 +0000 UTC m=+0.894829785 container cleanup 8f1e31a64e07c6dcdbd190cbd05648e6cc64f39356f71a312c48151fee98a051 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-09-18T12:56:33.888 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:33 smithi136 bash[88696]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3 2024-09-18T12:56:34.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88721]: 2024-09-18 12:56:34.012761722 +0000 UTC m=+0.661412000 container remove 8f1e31a64e07c6dcdbd190cbd05648e6cc64f39356f71a312c48151fee98a051 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-18T12:56:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: osdmap e66: 6 total, 5 up, 6 in 2024-09-18T12:56:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]} : dispatch 2024-09-18T12:56:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 3]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2]} : dispatch 2024-09-18T12:56:34.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-18T12:56:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: osdmap e66: 6 total, 5 up, 6 in 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 3]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]} : dispatch 2024-09-18T12:56:34.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2]} : dispatch 2024-09-18T12:56:34.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-18T12:56:34.609 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.242416831 +0000 UTC m=+0.015773950 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:34.610 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.36360975 +0000 UTC m=+0.136966854 container create c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-18T12:56:34.610 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.607892794 +0000 UTC m=+0.381249909 container init c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-18T12:56:34.986 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.611445563 +0000 UTC m=+0.384802678 container start c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-18T12:56:34.986 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.691252783 +0000 UTC m=+0.464609901 container attach c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:34.986 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:34 smithi136 podman[88812]: 2024-09-18 12:56:34.808135741 +0000 UTC m=+0.581492862 container died c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 3]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2]}]': finished 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:35.244 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:34 smithi081 ceph-mon[92545]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 3]}]': finished 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]': finished 2024-09-18T12:56:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-09-18T12:56:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2]}]': finished 2024-09-18T12:56:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T12:56:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:34 smithi136 ceph-mon[80179]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:56:35.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 podman[88834]: 2024-09-18 12:56:35.503950486 +0000 UTC m=+0.685963227 container remove c2cc0a6c7de9289ae8bd69d3bf3469a8e9047b70ccadcea2dee96a2859d5b102 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:35.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-18T12:56:35.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 systemd[1]: Stopped Ceph osd.3 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:35.815 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 9.017s CPU time. 2024-09-18T12:56:35.815 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 systemd[1]: Starting Ceph osd.3 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:36.233 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 podman[88937]: 2024-09-18 12:56:35.848610684 +0000 UTC m=+0.015458203 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:36.233 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:35 smithi136 podman[88937]: 2024-09-18 12:56:35.9716113 +0000 UTC m=+0.138458811 container create 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-18T12:56:36.234 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 podman[88937]: 2024-09-18 12:56:36.232937676 +0000 UTC m=+0.399785194 container init 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-18T12:56:36.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 podman[88937]: 2024-09-18 12:56:36.236772317 +0000 UTC m=+0.403619826 container start 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:36.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 podman[88937]: 2024-09-18 12:56:36.358355951 +0000 UTC m=+0.525203469 container attach 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-18T12:56:36.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:36.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 bash[88937]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:36.565 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:36.565 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:36 smithi136 bash[88937]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:37.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-mon[80179]: pgmap v112: 65 pgs: 3 remapped+peering, 1 unknown, 10 active+undersized, 9 peering, 1 stale+active+clean, 15 active+undersized+degraded, 26 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-18T12:56:37.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-mon[80179]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:56:37.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-mon[80179]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:37.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:36 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 63/369 objects degraded (17.073%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:36 smithi081 ceph-mon[92545]: pgmap v112: 65 pgs: 3 remapped+peering, 1 unknown, 10 active+undersized, 9 peering, 1 stale+active+clean, 15 active+undersized+degraded, 26 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-18T12:56:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:36 smithi081 ceph-mon[92545]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:56:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:36 smithi081 ceph-mon[92545]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:36 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 63/369 objects degraded (17.073%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:37 smithi136 ceph-mon[80179]: osdmap e70: 6 total, 5 up, 6 in 2024-09-18T12:56:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:37 smithi081 ceph-mon[92545]: osdmap e70: 6 total, 5 up, 6 in 2024-09-18T12:56:38.994 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:38 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:38.994 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:38 smithi136 bash[88937]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:38.994 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:38 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:38.994 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:38 smithi136 bash[88937]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:38 smithi136 ceph-mon[80179]: pgmap v115: 65 pgs: 3 remapped+peering, 1 unknown, 13 active+undersized, 9 peering, 16 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66/369 objects degraded (17.886%) 2024-09-18T12:56:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:38 smithi136 ceph-mon[80179]: osdmap e71: 6 total, 5 up, 6 in 2024-09-18T12:56:39.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:39.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 bash[88937]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:39.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 bash[88937]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 bash[88937]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 bash[88937]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate[88952]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 bash[88937]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:56:39.315 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 podman[88937]: 2024-09-18 12:56:39.039797303 +0000 UTC m=+3.206644812 container died 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-18T12:56:39.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:38 smithi081 ceph-mon[92545]: pgmap v115: 65 pgs: 3 remapped+peering, 1 unknown, 13 active+undersized, 9 peering, 16 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66/369 objects degraded (17.886%) 2024-09-18T12:56:39.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:38 smithi081 ceph-mon[92545]: osdmap e71: 6 total, 5 up, 6 in 2024-09-18T12:56:39.949 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 podman[89119]: 2024-09-18 12:56:39.679357298 +0000 UTC m=+0.633125789 container remove 6ba8657a6689f6ff044c7aca9bd778475888ff49cc61ecf82d850a686d806fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T12:56:39.949 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 podman[89177]: 2024-09-18 12:56:39.787822578 +0000 UTC m=+0.015819529 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:39.949 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:39 smithi136 podman[89177]: 2024-09-18 12:56:39.948571081 +0000 UTC m=+0.176568022 container create 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-18T12:56:40.199 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:40 smithi136 ceph-mon[80179]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T12:56:40.200 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:40 smithi136 ceph-mon[80179]: pgmap v118: 65 pgs: 2 active+clean+remapped, 3 remapped+peering, 17 active+undersized, 2 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 390 op/s; 71/369 objects degraded (19.241%); 2/369 objects misplaced (0.542%); 0 B/s, 355 objects/s recovering 2024-09-18T12:56:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:40 smithi081 ceph-mon[92545]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T12:56:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:40 smithi081 ceph-mon[92545]: pgmap v118: 65 pgs: 2 active+clean+remapped, 3 remapped+peering, 17 active+undersized, 2 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 390 op/s; 71/369 objects degraded (19.241%); 2/369 objects misplaced (0.542%); 0 B/s, 355 objects/s recovering 2024-09-18T12:56:40.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:40 smithi136 podman[89177]: 2024-09-18 12:56:40.199506593 +0000 UTC m=+0.427503534 container init 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-18T12:56:40.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:40 smithi136 podman[89177]: 2024-09-18 12:56:40.202706664 +0000 UTC m=+0.430703606 container start 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-18T12:56:40.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:40 smithi136 ceph-osd[89196]: -- 172.21.15.136:0/1934961006 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f5df8b41e0 con 0x55f5df844000 2024-09-18T12:56:40.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:40 smithi136 bash[89177]: 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 2024-09-18T12:56:40.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:40 smithi136 systemd[1]: Started Ceph osd.3 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:41 smithi136 ceph-mon[80179]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:56:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:41 smithi081 ceph-mon[92545]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:56:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:41.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:41 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T12:56:41.603+0000 7f2d81af1640 -1 Falling back to public interface 2024-09-18T12:56:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:42 smithi136 ceph-mon[80179]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T12:56:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:42 smithi136 ceph-mon[80179]: pgmap v121: 65 pgs: 5 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 390 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 2.0 MiB/s, 356 objects/s recovering 2024-09-18T12:56:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:42 smithi081 ceph-mon[92545]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T12:56:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:42 smithi081 ceph-mon[92545]: pgmap v121: 65 pgs: 5 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 46 MiB/s wr, 390 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 2.0 MiB/s, 356 objects/s recovering 2024-09-18T12:56:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:43 smithi136 ceph-mon[80179]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T12:56:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:43 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:43 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:43 smithi081 ceph-mon[92545]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T12:56:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:43 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:43 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:44.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:44 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:44.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:44 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:44.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:44 smithi136 ceph-mon[80179]: pgmap v122: 65 pgs: 5 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 264 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1.4 MiB/s, 241 objects/s recovering 2024-09-18T12:56:44.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:44.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:44 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:44.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:44 smithi081 ceph-mon[92545]: pgmap v122: 65 pgs: 5 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 1 peering, 18 active+undersized+degraded, 23 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 31 MiB/s wr, 264 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1.4 MiB/s, 241 objects/s recovering 2024-09-18T12:56:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:45 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 71/369 objects degraded (19.241%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:46.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:45 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 71/369 objects degraded (19.241%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: pgmap v123: 65 pgs: 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 27 MiB/s wr, 225 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1.2 MiB/s, 310 objects/s recovering 2024-09-18T12:56:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T12:56:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:46 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:47.282 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T12:56:47.001+0000 7f2d81af1640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-18T12:56:47.283 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: pgmap v123: 65 pgs: 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 27 MiB/s wr, 225 op/s; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1.2 MiB/s, 310 objects/s recovering 2024-09-18T12:56:47.283 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T12:56:47.283 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.283 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:47.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:47.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:47.284 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:47.285 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.285 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.285 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:47.285 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:46 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:47.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T12:56:47.562+0000 7f2d81af1640 -1 osd.3 65 log_to_monitors true 2024-09-18T12:56:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-mon[80179]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:56:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-mon[80179]: from='osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:47 smithi136 ceph-mon[80179]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:47 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:47 smithi081 ceph-mon[92545]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:56:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:47 smithi081 ceph-mon[92545]: from='osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:47 smithi081 ceph-mon[92545]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:49.064 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T12:56:48.722+0000 7f2d75893640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:56:49.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: pgmap v124: 65 pgs: 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1024 KiB/s, 90 objects/s recovering 2024-09-18T12:56:49.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:56:49.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: from='osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:56:49.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T12:56:49.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:56:49.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:48 smithi136 ceph-mon[80179]: from='osd.3 ' entity='osd.3' 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: pgmap v124: 65 pgs: 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/369 objects degraded (19.241%); 10/369 objects misplaced (2.710%); 1024 KiB/s, 90 objects/s recovering 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: from='osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:56:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:48 smithi081 ceph-mon[92545]: from='osd.3 ' entity='osd.3' 2024-09-18T12:56:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:50.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929] boot 2024-09-18T12:56:50.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T12:56:50.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:56:50.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:50 smithi136 ceph-mon[80179]: pgmap v127: 65 pgs: 8 peering, 2 remapped+peering, 4 active+clean+remapped, 12 active+undersized, 15 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/369 objects degraded (16.260%); 8/369 objects misplaced (2.168%); 0 B/s, 89 objects/s recovering 2024-09-18T12:56:50.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:56:50.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:50.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:50.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: osd.3 [v2:172.21.15.136:6800/229006929,v1:172.21.15.136:6801/229006929] boot 2024-09-18T12:56:50.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T12:56:50.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:56:50.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:50 smithi081 ceph-mon[92545]: pgmap v127: 65 pgs: 8 peering, 2 remapped+peering, 4 active+clean+remapped, 12 active+undersized, 15 active+undersized+degraded, 24 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/369 objects degraded (16.260%); 8/369 objects misplaced (2.168%); 0 B/s, 89 objects/s recovering 2024-09-18T12:56:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 -- 172.21.15.81:0/3699377596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250100cb0 msgr2=0x7ff2501010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 --2- 172.21.15.81:0/3699377596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250100cb0 0x7ff2501010d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff240009910 tx=0x7ff240009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 -- 172.21.15.81:0/3699377596 shutdown_connections 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 --2- 172.21.15.81:0/3699377596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250101eb0 0x7ff250102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 --2- 172.21.15.81:0/3699377596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250100cb0 0x7ff2501010d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 -- 172.21.15.81:0/3699377596 >> 172.21.15.81:0/3699377596 conn(0x7ff2500fc230 msgr2=0x7ff2500fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 -- 172.21.15.81:0/3699377596 shutdown_connections 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.518+0000 7ff256755700 1 -- 172.21.15.81:0/3699377596 wait complete. 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 Processor -- start 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 -- start start 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 0x7ff2501964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250197020 con 0x7ff250101eb0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff256755700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250197160 con 0x7ff250100cb0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff24f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff24f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60866/0 (socket says 172.21.15.81:60866) 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff24f7fe700 1 -- 172.21.15.81:0/506851618 learned_addr learned my addr 172.21.15.81:0/506851618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.519+0000 7ff24ffff700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 0x7ff2501964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24f7fe700 1 -- 172.21.15.81:0/506851618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 msgr2=0x7ff2501964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24f7fe700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 0x7ff2501964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24f7fe700 1 -- 172.21.15.81:0/506851618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400095f0 con 0x7ff250101eb0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24ffff700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 0x7ff2501964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24f7fe700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff24400d8d0 tx=0x7ff24400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff244009940 con 0x7ff250101eb0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff244010460 con 0x7ff250101eb0 2024-09-18T12:56:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25019bc10 con 0x7ff250101eb0 2024-09-18T12:56:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24400f5f0 con 0x7ff250101eb0 2024-09-18T12:56:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.520+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25019c160 con 0x7ff250101eb0 2024-09-18T12:56:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.521+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250109810 con 0x7ff250101eb0 2024-09-18T12:56:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.522+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff2440105d0 con 0x7ff250101eb0 2024-09-18T12:56:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.522+0000 7ff24d7fa700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 0x7ff23807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.522+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff24409e2b0 con 0x7ff250101eb0 2024-09-18T12:56:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.522+0000 7ff24ffff700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 0x7ff23807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.523+0000 7ff24ffff700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 0x7ff23807d7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff240006010 tx=0x7ff240005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.527+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff244061320 con 0x7ff250101eb0 2024-09-18T12:56:51.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.772+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff250106800 con 0x7ff23807b310 2024-09-18T12:56:51.774 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:51 smithi081 ceph-mon[92545]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T12:56:51.774 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:51 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 60/369 objects degraded (16.260%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.774+0000 7ff24d7fa700 1 -- 172.21.15.81:0/506851618 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff250106800 con 0x7ff23807b310 2024-09-18T12:56:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 msgr2=0x7ff23807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 0x7ff23807d7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff240006010 tx=0x7ff240005a90 comp rx=0 tx=0).stop 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 msgr2=0x7ff250196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff24400d8d0 tx=0x7ff24400dc90 comp rx=0 tx=0).stop 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 shutdown_connections 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff23807b310 0x7ff23807d7d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff250100cb0 0x7ff2501964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 --2- 172.21.15.81:0/506851618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff250101eb0 0x7ff250196a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.776+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 >> 172.21.15.81:0/506851618 conn(0x7ff2500fc230 msgr2=0x7ff2501050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.777+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 shutdown_connections 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.777+0000 7ff256755700 1 -- 172.21.15.81:0/506851618 wait complete. 2024-09-18T12:56:51.789 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- 172.21.15.81:0/776067403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41040d0 msgr2=0x7f0df41064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 --2- 172.21.15.81:0/776067403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41040d0 0x7f0df41064c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009910 tx=0x7f0de0009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- 172.21.15.81:0/776067403 shutdown_connections 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 --2- 172.21.15.81:0/776067403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41040d0 0x7f0df41064c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 --2- 172.21.15.81:0/776067403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41017a0 0x7f0df4103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- 172.21.15.81:0/776067403 >> 172.21.15.81:0/776067403 conn(0x7f0df40fb190 msgr2=0x7f0df40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- 172.21.15.81:0/776067403 shutdown_connections 2024-09-18T12:56:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- 172.21.15.81:0/776067403 wait complete. 2024-09-18T12:56:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 Processor -- start 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- start start 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41040d0 0x7f0df4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4196fb0 con 0x7f0df41017a0 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.885+0000 7f0dfad14700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41970f0 con 0x7f0df41040d0 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60888/0 (socket says 172.21.15.81:60888) 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 -- 172.21.15.81:0/715696980 learned_addr learned my addr 172.21.15.81:0/715696980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df3fff700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41040d0 0x7f0df4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 -- 172.21.15.81:0/715696980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41040d0 msgr2=0x7f0df4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41040d0 0x7f0df4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 -- 172.21.15.81:0/715696980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00095f0 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df8ab0700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0de800d8d0 tx=0x7f0de800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de80098a0 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0de8010460 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df419bba0 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.886+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de800f5f0 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.887+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df419c0f0 con 0x7f0df41017a0 2024-09-18T12:56:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.888+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4190610 con 0x7f0df41017a0 2024-09-18T12:56:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.888+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0de8009a00 con 0x7f0df41017a0 2024-09-18T12:56:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.889+0000 7f0df1ffb700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 0x7f0de407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.889+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0de809e1e0 con 0x7f0df41017a0 2024-09-18T12:56:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.889+0000 7f0df3fff700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 0x7f0de407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.889+0000 7f0df3fff700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 0x7f0de407d7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b5c0 tx=0x7f0de0005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:51.893+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0de80611d0 con 0x7f0df41017a0 2024-09-18T12:56:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:51 smithi136 ceph-mon[80179]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T12:56:52.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:51 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 60/369 objects degraded (16.260%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:52.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.165+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0df40611d0 con 0x7f0de407b310 2024-09-18T12:56:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.166+0000 7f0df1ffb700 1 -- 172.21.15.81:0/715696980 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0df40611d0 con 0x7f0de407b310 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 msgr2=0x7f0de407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 0x7f0de407d7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b5c0 tx=0x7f0de0005ee0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 msgr2=0x7f0df4196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0de800d8d0 tx=0x7f0de800dbe0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 shutdown_connections 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0de407b310 0x7f0de407d7d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0df41017a0 0x7f0df4196450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 --2- 172.21.15.81:0/715696980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0df41040d0 0x7f0df4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 >> 172.21.15.81:0/715696980 conn(0x7f0df40fb190 msgr2=0x7f0df40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:52.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 shutdown_connections 2024-09-18T12:56:52.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.169+0000 7f0dfad14700 1 -- 172.21.15.81:0/715696980 wait complete. 2024-09-18T12:56:52.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/3859741099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 msgr2=0x7f4c680fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/3859741099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c680fffd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009910 tx=0x7f4c58009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/3859741099 shutdown_connections 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/3859741099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/3859741099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c680fffd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/3859741099 >> 172.21.15.81:0/3859741099 conn(0x7f4c680fb150 msgr2=0x7f4c680fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/3859741099 shutdown_connections 2024-09-18T12:56:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.292+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/3859741099 wait complete. 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 Processor -- start 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 -- start start 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68197020 con 0x7f4c680ffbb0 2024-09-18T12:56:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c6d7b8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68197160 con 0x7f4c68100db0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60896/0 (socket says 172.21.15.81:60896) 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c66ffd700 1 -- 172.21.15.81:0/928766665 learned_addr learned my addr 172.21.15.81:0/928766665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.293+0000 7f4c5ffff700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c66ffd700 1 -- 172.21.15.81:0/928766665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 msgr2=0x7f4c68196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c66ffd700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c66ffd700 1 -- 172.21.15.81:0/928766665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580095f0 con 0x7f4c680ffbb0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c5ffff700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c66ffd700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800bda0 tx=0x7f4c5800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c5801d070 con 0x7f4c680ffbb0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c5800f460 con 0x7f4c680ffbb0 2024-09-18T12:56:52.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6819bbb0 con 0x7f4c680ffbb0 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c58021620 con 0x7f4c680ffbb0 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.294+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6819c0a0 con 0x7f4c680ffbb0 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.295+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c68108710 con 0x7f4c680ffbb0 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.296+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4c5800f5d0 con 0x7f4c680ffbb0 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.297+0000 7f4c64ff9700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 0x7f4c5407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.297+0000 7f4c5ffff700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 0x7f4c5407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.297+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4c5809f4f0 con 0x7f4c680ffbb0 2024-09-18T12:56:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.298+0000 7f4c5ffff700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 0x7f4c5407d7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005950 tx=0x7f4c5000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.301+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4c58062560 con 0x7f4c680ffbb0 2024-09-18T12:56:52.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.536+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c68069520 con 0x7f4c5407b310 2024-09-18T12:56:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.548+0000 7f4c64ff9700 1 -- 172.21.15.81:0/928766665 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4c68069520 con 0x7f4c5407b310 2024-09-18T12:56:52.549 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (12m) 43s ago 14m 25.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:56:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (5m) 43s ago 14m 8376k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:56:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (4m) 9s ago 13m 7470k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:56:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (2m) 43s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:56:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (2m) 9s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (12m) 43s ago 14m 82.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (8m) 43s ago 8m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (8m) 43s ago 8m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (8m) 9s ago 8m 20.6M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (8m) 9s ago 8m 16.5M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:56:52.551 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (4m) 43s ago 15m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:56:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (3m) 9s ago 13m 455M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:56:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (3m) 43s ago 15m 46.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:56:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (3m) 9s ago 13m 37.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:56:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (14m) 43s ago 14m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:56:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (13m) 9s ago 13m 14.6M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:56:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (2m) 43s ago 11m 93.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:56:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (85s) 43s ago 11m 102M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:56:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (48s) 43s ago 10m 14.3M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:56:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (12s) 9s ago 10m 11.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:56:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (10m) 9s ago 10m 245M 2240M 18.2.1 5be31c24972a 2b5064fa058a 2024-09-18T12:56:52.554 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (9m) 9s ago 9m 252M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:56:52.554 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (3m) 43s ago 13m 67.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:56:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 msgr2=0x7f4c5407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 0x7f4c5407d7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005950 tx=0x7f4c5000b410 comp rx=0 tx=0).stop 2024-09-18T12:56:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 msgr2=0x7f4c681964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800bda0 tx=0x7f4c5800bdd0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 shutdown_connections 2024-09-18T12:56:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4c5407b310 0x7f4c5407d7d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c680ffbb0 0x7f4c681964c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 --2- 172.21.15.81:0/928766665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c68100db0 0x7f4c68196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 >> 172.21.15.81:0/928766665 conn(0x7f4c680fb150 msgr2=0x7f4c68068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 shutdown_connections 2024-09-18T12:56:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.550+0000 7f4c6d7b8700 1 -- 172.21.15.81:0/928766665 wait complete. 2024-09-18T12:56:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 -- 172.21.15.81:0/1904523595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 msgr2=0x7f5274100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 --2- 172.21.15.81:0/1904523595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f5274100030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5264009910 tx=0x7f5264009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 -- 172.21.15.81:0/1904523595 shutdown_connections 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 --2- 172.21.15.81:0/1904523595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 0x7f5274101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 --2- 172.21.15.81:0/1904523595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f5274100030 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 -- 172.21.15.81:0/1904523595 >> 172.21.15.81:0/1904523595 conn(0x7f52740fb190 msgr2=0x7f52740fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 -- 172.21.15.81:0/1904523595 shutdown_connections 2024-09-18T12:56:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.657+0000 7f5278e0d700 1 -- 172.21.15.81:0/1904523595 wait complete. 2024-09-18T12:56:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 Processor -- start 2024-09-18T12:56:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 -- start start 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 0x7f527419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527419b800 con 0x7f52740ffc10 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5278e0d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527419b940 con 0x7f5274100e10 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60910/0 (socket says 172.21.15.81:60910) 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 -- 172.21.15.81:0/2350176134 learned_addr learned my addr 172.21.15.81:0/2350176134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f5271d9b700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 0x7f527419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 -- 172.21.15.81:0/2350176134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 msgr2=0x7f527419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 0x7f527419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.658+0000 7f527259c700 1 -- 172.21.15.81:0/2350176134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640095f0 con 0x7f52740ffc10 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f527259c700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5264000c00 tx=0x7f526400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526401d070 con 0x7f52740ffc10 2024-09-18T12:56:52.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5264005dc0 con 0x7f52740ffc10 2024-09-18T12:56:52.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5264022470 con 0x7f52740ffc10 2024-09-18T12:56:52.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527419bbc0 con 0x7f52740ffc10 2024-09-18T12:56:52.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.659+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527419c0b0 con 0x7f52740ffc10 2024-09-18T12:56:52.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.660+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274108700 con 0x7f52740ffc10 2024-09-18T12:56:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.661+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5264003810 con 0x7f52740ffc10 2024-09-18T12:56:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.661+0000 7f52637fe700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 0x7f525c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.661+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f526409fa00 con 0x7f52740ffc10 2024-09-18T12:56:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.661+0000 7f5271d9b700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 0x7f525c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.662+0000 7f5271d9b700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 0x7f525c07d7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5274069660 tx=0x7f5268009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:52.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.665+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5264062a70 con 0x7f52740ffc10 2024-09-18T12:56:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:52 smithi081 ceph-mon[92545]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T12:56:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:52 smithi081 ceph-mon[92545]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:52.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:52 smithi081 ceph-mon[92545]: pgmap v130: 65 pgs: 15 peering, 4 remapped+peering, 1 active+clean+remapped, 8 active+undersized, 10 active+undersized+degraded, 27 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.998+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f527419c6c0 con 0x7f52740ffc10 2024-09-18T12:56:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:52.999+0000 7f52637fe700 1 -- 172.21.15.81:0/2350176134 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f5264065b90 con 0x7f52740ffc10 2024-09-18T12:56:53.000 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:56:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6, 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 8 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:56:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 msgr2=0x7f525c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 0x7f525c07d7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5274069660 tx=0x7f5268009260 comp rx=0 tx=0).stop 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 msgr2=0x7f52740690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5264000c00 tx=0x7f526400f690 comp rx=0 tx=0).stop 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 shutdown_connections 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f525c07b310 0x7f525c07d7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52740ffc10 0x7f52740690e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 --2- 172.21.15.81:0/2350176134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5274100e10 0x7f527419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 >> 172.21.15.81:0/2350176134 conn(0x7f52740fb190 msgr2=0x7f5274104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 shutdown_connections 2024-09-18T12:56:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.001+0000 7f5278e0d700 1 -- 172.21.15.81:0/2350176134 wait complete. 2024-09-18T12:56:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:52 smithi136 ceph-mon[80179]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T12:56:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:52 smithi136 ceph-mon[80179]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:52 smithi136 ceph-mon[80179]: pgmap v130: 65 pgs: 15 peering, 4 remapped+peering, 1 active+clean+remapped, 8 active+undersized, 10 active+undersized+degraded, 27 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/369 objects degraded (12.195%) 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 -- 172.21.15.81:0/1749121533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 msgr2=0x7fbad80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 --2- 172.21.15.81:0/1749121533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad80fffd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009910 tx=0x7fbac8009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 -- 172.21.15.81:0/1749121533 shutdown_connections 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 --2- 172.21.15.81:0/1749121533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 0x7fbad8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 --2- 172.21.15.81:0/1749121533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad80fffd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.106+0000 7fbade047700 1 -- 172.21.15.81:0/1749121533 >> 172.21.15.81:0/1749121533 conn(0x7fbad80fb150 msgr2=0x7fbad80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 -- 172.21.15.81:0/1749121533 shutdown_connections 2024-09-18T12:56:53.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 -- 172.21.15.81:0/1749121533 wait complete. 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 Processor -- start 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 -- start start 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 0x7fbad819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad819b7f0 con 0x7fbad80ffbb0 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbade047700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad819b960 con 0x7fbad8100db0 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbad77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbad77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60934/0 (socket says 172.21.15.81:60934) 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.107+0000 7fbad77fe700 1 -- 172.21.15.81:0/2649821904 learned_addr learned my addr 172.21.15.81:0/2649821904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbacffff700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 0x7fbad819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad77fe700 1 -- 172.21.15.81:0/2649821904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 msgr2=0x7fbad819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad77fe700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 0x7fbad819b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad77fe700 1 -- 172.21.15.81:0/2649821904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80095f0 con 0x7fbad80ffbb0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad77fe700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac800bda0 tx=0x7fbac800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac801d070 con 0x7fbad80ffbb0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad819bbe0 con 0x7fbad80ffbb0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbac8022470 con 0x7fbad80ffbb0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac800f650 con 0x7fbad80ffbb0 2024-09-18T12:56:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.108+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad819c0d0 con 0x7fbad80ffbb0 2024-09-18T12:56:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.109+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8108710 con 0x7fbad80ffbb0 2024-09-18T12:56:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.110+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fbac8004af0 con 0x7fbad80ffbb0 2024-09-18T12:56:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.110+0000 7fbad57fa700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 0x7fbac407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.110+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbac809f920 con 0x7fbad80ffbb0 2024-09-18T12:56:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.111+0000 7fbacffff700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 0x7fbac407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.111+0000 7fbacffff700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 0x7fbac407d7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbad8069ef0 tx=0x7fbac000a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.115+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fbac8062a00 con 0x7fbad80ffbb0 2024-09-18T12:56:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.369+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbad8108900 con 0x7fbad80ffbb0 2024-09-18T12:56:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.370+0000 7fbad57fa700 1 -- 172.21.15.81:0/2649821904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7fbac8065b20 con 0x7fbad80ffbb0 2024-09-18T12:56:53.371 INFO:teuthology.orchestra.run.smithi081.stdout:e22 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:55:39:334155+0000 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 22 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:55:39.283936+0000 2024-09-18T12:56:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:56:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14556,14544 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:56:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:56:53.375 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:53.375 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:56:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 msgr2=0x7fbac407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 0x7fbac407d7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbad8069ef0 tx=0x7fbac000a300 comp rx=0 tx=0).stop 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 msgr2=0x7fbad8069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac800bda0 tx=0x7fbac800bdd0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 shutdown_connections 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fbac407b310 0x7fbac407d7d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad80ffbb0 0x7fbad8069990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 --2- 172.21.15.81:0/2649821904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad8100db0 0x7fbad819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 >> 172.21.15.81:0/2649821904 conn(0x7fbad80fb150 msgr2=0x7fbad8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 shutdown_connections 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.372+0000 7fbade047700 1 -- 172.21.15.81:0/2649821904 wait complete. 2024-09-18T12:56:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-18T12:56:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 -- 172.21.15.81:0/1729511961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc0ffc10 msgr2=0x7fe1cc100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/1729511961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc100030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009910 tx=0x7fe1bc009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 -- 172.21.15.81:0/1729511961 shutdown_connections 2024-09-18T12:56:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/1729511961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc100e10 0x7fe1cc101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/1729511961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc100030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 -- 172.21.15.81:0/1729511961 >> 172.21.15.81:0/1729511961 conn(0x7fe1cc0fb190 msgr2=0x7fe1cc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 -- 172.21.15.81:0/1729511961 shutdown_connections 2024-09-18T12:56:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.481+0000 7fe1d1b81700 1 -- 172.21.15.81:0/1729511961 wait complete. 2024-09-18T12:56:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 Processor -- start 2024-09-18T12:56:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 -- start start 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc199230 con 0x7fe1cc100e10 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1d1b81700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc199370 con 0x7fe1cc0ffc10 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60964/0 (socket says 172.21.15.81:60964) 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1caffd700 1 -- 172.21.15.81:0/568552261 learned_addr learned my addr 172.21.15.81:0/568552261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.482+0000 7fe1cb7fe700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1caffd700 1 -- 172.21.15.81:0/568552261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0ffc10 msgr2=0x7fe1cc1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1caffd700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1caffd700 1 -- 172.21.15.81:0/568552261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0095f0 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1caffd700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e920 tx=0x7fe1c000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c000c9d0 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1c0010430 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc19de20 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c0018650 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.483+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc19e340 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.484+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc108700 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.485+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe1c00105a0 con 0x7fe1cc100e10 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.485+0000 7fe1c8ff9700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 0x7fe1b407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.485+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe1c0014070 con 0x7fe1cc100e10 2024-09-18T12:56:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.485+0000 7fe1cb7fe700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 0x7fe1b407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.486+0000 7fe1cb7fe700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 0x7fe1b407d7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009fd0 tx=0x7fe1bc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.490+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe1c00615b0 con 0x7fe1cc100e10 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.732+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1cc068c90 con 0x7fe1b407b310 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.733+0000 7fe1c8ff9700 1 -- 172.21.15.81:0/568552261 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe1cc068c90 con 0x7fe1b407b310 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "10/23 daemons upgraded", 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:56:53.735 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:56:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 msgr2=0x7fe1b407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 0x7fe1b407d7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009fd0 tx=0x7fe1bc005a90 comp rx=0 tx=0).stop 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 msgr2=0x7fe1cc198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e920 tx=0x7fe1c000ec30 comp rx=0 tx=0).stop 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 shutdown_connections 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1b407b310 0x7fe1b407d7d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0ffc10 0x7fe1cc1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 --2- 172.21.15.81:0/568552261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1cc100e10 0x7fe1cc198c10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 >> 172.21.15.81:0/568552261 conn(0x7fe1cc0fb190 msgr2=0x7fe1cc068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.735+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 shutdown_connections 2024-09-18T12:56:53.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.736+0000 7fe1d1b81700 1 -- 172.21.15.81:0/568552261 wait complete. 2024-09-18T12:56:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 -- 172.21.15.81:0/600774881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 msgr2=0x7f34841002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 --2- 172.21.15.81:0/600774881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f34841002d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3478009910 tx=0x7f3478009c20 comp rx=0 tx=0).stop 2024-09-18T12:56:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 -- 172.21.15.81:0/600774881 shutdown_connections 2024-09-18T12:56:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 --2- 172.21.15.81:0/600774881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f34841002d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 --2- 172.21.15.81:0/600774881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 0x7f3484101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.852+0000 7f3489904700 1 -- 172.21.15.81:0/600774881 >> 172.21.15.81:0/600774881 conn(0x7f34840fa8c0 msgr2=0x7f34840fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:53.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.853+0000 7f3489904700 1 -- 172.21.15.81:0/600774881 shutdown_connections 2024-09-18T12:56:53.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.853+0000 7f3489904700 1 -- 172.21.15.81:0/600774881 wait complete. 2024-09-18T12:56:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.853+0000 7f3489904700 1 Processor -- start 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.853+0000 7f3489904700 1 -- start start 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3489904700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3489904700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 0x7f3484102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3489904700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841027a0 con 0x7f34840ffe70 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3489904700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841028e0 con 0x7f3484101130 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60972/0 (socket says 172.21.15.81:60972) 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 -- 172.21.15.81:0/28941865 learned_addr learned my addr 172.21.15.81:0/28941865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:56:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f34827fc700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 0x7f3484102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 -- 172.21.15.81:0/28941865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 msgr2=0x7f3484102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 0x7f3484102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 -- 172.21.15.81:0/28941865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780095f0 con 0x7f34840ffe70 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.854+0000 7f3482ffd700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f347400d900 tx=0x7f347400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.855+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347400b920 con 0x7f34840ffe70 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.855+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3474010460 con 0x7f34840ffe70 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.855+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347400f590 con 0x7f34840ffe70 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.855+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484102bc0 con 0x7f34840ffe70 2024-09-18T12:56:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.855+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348419e520 con 0x7f34840ffe70 2024-09-18T12:56:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.856+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484108710 con 0x7f34840ffe70 2024-09-18T12:56:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.856+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f34740105d0 con 0x7f34840ffe70 2024-09-18T12:56:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.857+0000 7f3488902700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 0x7f346c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.857+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f347409de30 con 0x7f34840ffe70 2024-09-18T12:56:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.857+0000 7f34827fc700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 0x7f346c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.857+0000 7f34827fc700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 0x7f346c07d7d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3478006010 tx=0x7f347800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:53.861+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3474060f00 con 0x7f34840ffe70 2024-09-18T12:56:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:53 smithi136 ceph-mon[80179]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:54.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:53 smithi136 ceph-mon[80179]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:54.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:53 smithi136 ceph-mon[80179]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T12:56:54.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:53 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2350176134' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:53 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2649821904' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:53 smithi081 ceph-mon[92545]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:53 smithi081 ceph-mon[92545]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:53 smithi081 ceph-mon[92545]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T12:56:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:53 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2350176134' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:53 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2649821904' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.212+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f34841088d0 con 0x7f34840ffe70 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.212+0000 7f3488902700 1 -- 172.21.15.81:0/28941865 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+739 (secure 0 0 0) 0x7f3474064020 con 0x7f34840ffe70 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_WARN Degraded data redundancy: 45/369 objects degraded (12.195%), 10 pgs degraded 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/369 objects degraded (12.195%), 10 pgs degraded 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-18T12:56:54.214 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-18T12:56:54.215 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-18T12:56:54.215 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-18T12:56:54.215 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-18T12:56:54.215 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-18T12:56:54.215 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-18T12:56:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 msgr2=0x7f346c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 0x7f346c07d7d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3478006010 tx=0x7f347800b540 comp rx=0 tx=0).stop 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 msgr2=0x7f3484103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f347400d900 tx=0x7f347400dc10 comp rx=0 tx=0).stop 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 shutdown_connections 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f346c07b310 0x7f346c07d7d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ffe70 0x7f3484103c10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 --2- 172.21.15.81:0/28941865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3484101130 0x7f3484102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 >> 172.21.15.81:0/28941865 conn(0x7f34840fa8c0 msgr2=0x7f34840fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 shutdown_connections 2024-09-18T12:56:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:56:54.215+0000 7f3489904700 1 -- 172.21.15.81:0/28941865 wait complete. 2024-09-18T12:56:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:54 smithi136 ceph-mon[80179]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:54 smithi136 ceph-mon[80179]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T12:56:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:54 smithi136 ceph-mon[80179]: pgmap v133: 65 pgs: 15 peering, 4 remapped+peering, 3 active+undersized, 43 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:54 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/28941865' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:55.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:54 smithi081 ceph-mon[92545]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:55.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:54 smithi081 ceph-mon[92545]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T12:56:55.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:54 smithi081 ceph-mon[92545]: pgmap v133: 65 pgs: 15 peering, 4 remapped+peering, 3 active+undersized, 43 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:55.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:54 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/28941865' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:55 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/369 objects degraded (12.195%), 10 pgs degraded) 2024-09-18T12:56:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:55 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:56:56.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:55 smithi136 ceph-mon[80179]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T12:56:56.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:55 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/369 objects degraded (12.195%), 10 pgs degraded) 2024-09-18T12:56:56.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:55 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:56:56.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:55 smithi081 ceph-mon[92545]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T12:56:57.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:56 smithi136 ceph-mon[80179]: pgmap v135: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s, 1 objects/s recovering 2024-09-18T12:56:57.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:56 smithi081 ceph-mon[92545]: pgmap v135: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s, 1 objects/s recovering 2024-09-18T12:56:59.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:56:58 smithi081 ceph-mon[92545]: pgmap v136: 65 pgs: 1 remapped+peering, 64 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2024-09-18T12:56:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:56:58 smithi136 ceph-mon[80179]: pgmap v136: 65 pgs: 1 remapped+peering, 64 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2024-09-18T12:57:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:00 smithi136 ceph-mon[80179]: pgmap v137: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s, 100 objects/s recovering 2024-09-18T12:57:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:00 smithi081 ceph-mon[92545]: pgmap v137: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s, 100 objects/s recovering 2024-09-18T12:57:02.309 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:01 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:57:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:01 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:57:03.241 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:02 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:57:03.241 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:02 smithi136 ceph-mon[80179]: Upgrade: osd.4 is safe to restart 2024-09-18T12:57:03.241 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:02 smithi136 ceph-mon[80179]: pgmap v138: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s, 87 objects/s recovering 2024-09-18T12:57:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:02 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:57:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:02 smithi081 ceph-mon[92545]: Upgrade: osd.4 is safe to restart 2024-09-18T12:57:03.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:02 smithi081 ceph-mon[92545]: pgmap v138: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s, 87 objects/s recovering 2024-09-18T12:57:04.547 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: Upgrade: Updating osd.4 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: Deploying daemon osd.4 on smithi136 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: pgmap v139: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s, 71 objects/s recovering 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:04.548 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: Upgrade: Updating osd.4 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: Deploying daemon osd.4 on smithi136 2024-09-18T12:57:04.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: pgmap v139: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s, 71 objects/s recovering 2024-09-18T12:57:04.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:04.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:06.436 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:06 smithi136 systemd[1]: Stopping Ceph osd.4 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:06.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:06 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[47759]: 2024-09-18T12:57:06.434+0000 7fd26cb70700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:57:06.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:06 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[47759]: 2024-09-18T12:57:06.434+0000 7fd26cb70700 -1 osd.4 81 *** Got signal Terminated *** 2024-09-18T12:57:06.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:06 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[47759]: 2024-09-18T12:57:06.434+0000 7fd26cb70700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:57:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:06 smithi136 ceph-mon[80179]: pgmap v140: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s, 64 objects/s recovering 2024-09-18T12:57:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:06 smithi136 ceph-mon[80179]: osd.4 marked itself down and dead 2024-09-18T12:57:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:06 smithi081 ceph-mon[92545]: pgmap v140: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s, 64 objects/s recovering 2024-09-18T12:57:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:06 smithi081 ceph-mon[92545]: osd.4 marked itself down and dead 2024-09-18T12:57:07.694 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:07 smithi136 podman[93389]: 2024-09-18 12:57:07.36429931 +0000 UTC m=+1.057686871 container died 2b5064fa058ae85608dbe77528f3d33f948863098e24c5105233a7aab8ef7ec8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-18T12:57:07.984 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:07 smithi136 podman[93389]: 2024-09-18 12:57:07.79291487 +0000 UTC m=+1.486302417 container cleanup 2b5064fa058ae85608dbe77528f3d33f948863098e24c5105233a7aab8ef7ec8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True) 2024-09-18T12:57:07.984 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:07 smithi136 bash[93389]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4 2024-09-18T12:57:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:07 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:07 smithi136 ceph-mon[80179]: osdmap e82: 6 total, 5 up, 6 in 2024-09-18T12:57:08.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:07 smithi136 ceph-mon[80179]: osdmap e83: 6 total, 5 up, 6 in 2024-09-18T12:57:08.315 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:07 smithi136 podman[93408]: 2024-09-18 12:57:07.986003789 +0000 UTC m=+0.623725932 container remove 2b5064fa058ae85608dbe77528f3d33f948863098e24c5105233a7aab8ef7ec8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-18T12:57:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:07 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:07 smithi081 ceph-mon[92545]: osdmap e82: 6 total, 5 up, 6 in 2024-09-18T12:57:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:07 smithi081 ceph-mon[92545]: osdmap e83: 6 total, 5 up, 6 in 2024-09-18T12:57:08.690 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.310573632 +0000 UTC m=+0.015606619 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:08.690 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.445625875 +0000 UTC m=+0.150658861 container create d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T12:57:08.690 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.689991965 +0000 UTC m=+0.395024953 container init d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-18T12:57:08.985 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.693247175 +0000 UTC m=+0.398280163 container start d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-18T12:57:08.985 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.790074393 +0000 UTC m=+0.495107383 container attach d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-18T12:57:08.985 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:08 smithi136 podman[93498]: 2024-09-18 12:57:08.881934852 +0000 UTC m=+0.586967839 container died d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T12:57:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:08 smithi081 ceph-mon[92545]: pgmap v142: 65 pgs: 5 stale+active+clean, 60 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 71 objects/s recovering 2024-09-18T12:57:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:08 smithi136 ceph-mon[80179]: pgmap v142: 65 pgs: 5 stale+active+clean, 60 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 71 objects/s recovering 2024-09-18T12:57:09.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 podman[93521]: 2024-09-18 12:57:09.451945039 +0000 UTC m=+0.563360399 container remove d7973358cd26ee3d9b43f8f03cc75ce7e6f5fe811f9d51f53991a2d7adf30ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-18T12:57:09.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-18T12:57:09.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 systemd[1]: Stopped Ceph osd.4 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:09.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.4.service: Consumed 59.242s CPU time. 2024-09-18T12:57:09.815 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 systemd[1]: Starting Ceph osd.4 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:10.156 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 podman[93622]: 2024-09-18 12:57:09.791999424 +0000 UTC m=+0.015817235 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:10.156 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:09 smithi136 podman[93622]: 2024-09-18 12:57:09.919975719 +0000 UTC m=+0.143793527 container create 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True) 2024-09-18T12:57:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:10 smithi136 ceph-mon[80179]: pgmap v144: 65 pgs: 12 active+undersized, 1 stale+active+clean, 11 active+undersized+degraded, 41 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/369 objects degraded (12.737%) 2024-09-18T12:57:10.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 podman[93622]: 2024-09-18 12:57:10.155707579 +0000 UTC m=+0.379525387 container init 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-18T12:57:10.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 podman[93622]: 2024-09-18 12:57:10.159093638 +0000 UTC m=+0.382911449 container start 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-18T12:57:10.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 podman[93622]: 2024-09-18 12:57:10.272700223 +0000 UTC m=+0.496518047 container attach 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:57:10.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:10.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 bash[93622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:10.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:10.565 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:10 smithi136 bash[93622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:10.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:10.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:10 smithi081 ceph-mon[92545]: pgmap v144: 65 pgs: 12 active+undersized, 1 stale+active+clean, 11 active+undersized+degraded, 41 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/369 objects degraded (12.737%) 2024-09-18T12:57:11.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:11 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 47/369 objects degraded (12.737%), 11 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:11.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:11 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 47/369 objects degraded (12.737%), 11 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:12.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-mon[80179]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:12 smithi081 ceph-mon[92545]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:12.924 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:57:12.924 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:57:12.925 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:12.925 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:12.925 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:12.925 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:57:13.260 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:57:13.261 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate[93636]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:57:13.261 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 bash[93622]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:57:13.261 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:12 smithi136 podman[93622]: 2024-09-18 12:57:12.96003491 +0000 UTC m=+3.183852719 container died 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:13.909 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:13 smithi136 podman[93803]: 2024-09-18 12:57:13.568082283 +0000 UTC m=+0.599400104 container remove 779aec1b8a739df66673148871e0ae3d2d6a98734a23f14c8d61dbf1182d0f51 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD) 2024-09-18T12:57:13.909 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:13 smithi136 podman[93861]: 2024-09-18 12:57:13.688701577 +0000 UTC m=+0.016243381 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:13.909 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:13 smithi136 podman[93861]: 2024-09-18 12:57:13.811047528 +0000 UTC m=+0.138589332 container create be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:57:14.164 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:14 smithi136 podman[93861]: 2024-09-18 12:57:14.064130711 +0000 UTC m=+0.391672525 container init be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T12:57:14.165 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:14 smithi136 podman[93861]: 2024-09-18 12:57:14.067601929 +0000 UTC m=+0.395143733 container start be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T12:57:14.165 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:14 smithi136 ceph-osd[93880]: -- 172.21.15.136:0/3732463948 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55792620e1e0 con 0x55792619e000 2024-09-18T12:57:14.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:14 smithi136 bash[93861]: be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b 2024-09-18T12:57:14.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:14 smithi136 systemd[1]: Started Ceph osd.4 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:14 smithi136 ceph-mon[80179]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:15.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:14 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:14 smithi081 ceph-mon[92545]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:14 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:15.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:15 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T12:57:15.471+0000 7f522eaed640 -1 Falling back to public interface 2024-09-18T12:57:16.199 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:15 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 64/369 objects degraded (17.344%), 16 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:15 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 64/369 objects degraded (17.344%), 16 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:16 smithi136 ceph-mon[80179]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:16 smithi081 ceph-mon[92545]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:18 smithi136 ceph-mon[80179]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:18.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:18.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:18.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:18 smithi081 ceph-mon[92545]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:20.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:20 smithi136 ceph-mon[80179]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:20.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:20 smithi081 ceph-mon[92545]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:21.314 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:21 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T12:57:21.120+0000 7f522eaed640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-18T12:57:21.814 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:21 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T12:57:21.543+0000 7f522eaed640 -1 osd.4 81 log_to_monitors true 2024-09-18T12:57:22.314 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T12:57:22.053+0000 7f5226897640 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:57:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:57:22.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:22 smithi136 ceph-mon[80179]: pgmap v150: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:57:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:22 smithi081 ceph-mon[92545]: pgmap v150: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:23 smithi136 ceph-mon[80179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:57:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:23 smithi136 ceph-mon[80179]: osdmap e84: 6 total, 5 up, 6 in 2024-09-18T12:57:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:23 smithi136 ceph-mon[80179]: from='osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:23 smithi136 ceph-mon[80179]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:23 smithi081 ceph-mon[92545]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:57:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:23 smithi081 ceph-mon[92545]: osdmap e84: 6 total, 5 up, 6 in 2024-09-18T12:57:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:23 smithi081 ceph-mon[92545]: from='osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:23 smithi081 ceph-mon[92545]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:24 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:24 smithi136 ceph-mon[80179]: osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638] boot 2024-09-18T12:57:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:24 smithi136 ceph-mon[80179]: osdmap e85: 6 total, 6 up, 6 in 2024-09-18T12:57:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:24 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:57:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:24 smithi136 ceph-mon[80179]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.322+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3057841162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 msgr2=0x7faa440ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.322+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3057841162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa440ff1b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa38009910 tx=0x7faa38009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3057841162 shutdown_connections 2024-09-18T12:57:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3057841162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa440ff1b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3057841162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa441026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3057841162 >> 172.21.15.81:0/3057841162 conn(0x7faa440fa8b0 msgr2=0x7faa440fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3057841162 shutdown_connections 2024-09-18T12:57:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3057841162 wait complete. 2024-09-18T12:57:24.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:24 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:24.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:24 smithi081 ceph-mon[92545]: osd.4 [v2:172.21.15.136:6808/1982710638,v1:172.21.15.136:6809/1982710638] boot 2024-09-18T12:57:24.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:24 smithi081 ceph-mon[92545]: osdmap e85: 6 total, 6 up, 6 in 2024-09-18T12:57:24.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:24 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:57:24.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:24 smithi081 ceph-mon[92545]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/369 objects degraded (17.344%) 2024-09-18T12:57:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 Processor -- start 2024-09-18T12:57:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.323+0000 7faa4a5b4700 1 -- start start 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa4a5b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa4a5b4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa4419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa4a5b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4419d6f0 con 0x7faa440fed30 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa4a5b4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4419d830 con 0x7faa441022b0 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58168/0 (socket says 172.21.15.81:58168) 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 -- 172.21.15.81:0/3985236339 learned_addr learned my addr 172.21.15.81:0/3985236339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa437fe700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa4419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 -- 172.21.15.81:0/3985236339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 msgr2=0x7faa4419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa4419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 -- 172.21.15.81:0/3985236339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380095f0 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa437fe700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa4419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa43fff700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b480 tx=0x7faa3400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa340118c0 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa34010380 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa441a22e0 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.324+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3400f4f0 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.325+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa441a2830 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.325+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44106130 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.326+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7faa340104f0 con 0x7faa440fed30 2024-09-18T12:57:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.327+0000 7faa417fa700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 0x7faa2c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.327+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7faa3409de60 con 0x7faa440fed30 2024-09-18T12:57:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.327+0000 7faa437fe700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 0x7faa2c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.327+0000 7faa437fe700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 0x7faa2c07d7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa38006010 tx=0x7faa38005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.331+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7faa34060eb0 con 0x7faa440fed30 2024-09-18T12:57:24.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.559+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa440611d0 con 0x7faa2c07b310 2024-09-18T12:57:24.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.561+0000 7faa417fa700 1 -- 172.21.15.81:0/3985236339 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7faa440611d0 con 0x7faa2c07b310 2024-09-18T12:57:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 msgr2=0x7faa2c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 0x7faa2c07d7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa38006010 tx=0x7faa38005960 comp rx=0 tx=0).stop 2024-09-18T12:57:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 msgr2=0x7faa4419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b480 tx=0x7faa3400b840 comp rx=0 tx=0).stop 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 shutdown_connections 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faa2c07b310 0x7faa2c07d7d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa440fed30 0x7faa4419cb90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 --2- 172.21.15.81:0/3985236339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa441022b0 0x7faa4419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 >> 172.21.15.81:0/3985236339 conn(0x7faa440fa8b0 msgr2=0x7faa44103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 shutdown_connections 2024-09-18T12:57:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.563+0000 7faa4a5b4700 1 -- 172.21.15.81:0/3985236339 wait complete. 2024-09-18T12:57:24.575 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 -- 172.21.15.81:0/2476680191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c0ffbc0 msgr2=0x7f313c0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 --2- 172.21.15.81:0/2476680191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c0ffbc0 0x7f313c0fffe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f313400b0a0 tx=0x7f313400b3b0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 -- 172.21.15.81:0/2476680191 shutdown_connections 2024-09-18T12:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 --2- 172.21.15.81:0/2476680191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c100dc0 0x7f313c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 --2- 172.21.15.81:0/2476680191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c0ffbc0 0x7f313c0fffe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 -- 172.21.15.81:0/2476680191 >> 172.21.15.81:0/2476680191 conn(0x7f313c0fb160 msgr2=0x7f313c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 -- 172.21.15.81:0/2476680191 shutdown_connections 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.668+0000 7f31444a2700 1 -- 172.21.15.81:0/2476680191 wait complete. 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 Processor -- start 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 -- start start 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c0ffbc0 0x7f313c196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1973b0 con 0x7f313c100dc0 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1974f0 con 0x7f313c0ffbc0 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58182/0 (socket says 172.21.15.81:58182) 2024-09-18T12:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 -- 172.21.15.81:0/345700844 learned_addr learned my addr 172.21.15.81:0/345700844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f314223e700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c0ffbc0 0x7f313c196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 -- 172.21.15.81:0/345700844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c0ffbc0 msgr2=0x7f313c196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c0ffbc0 0x7f313c196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 -- 172.21.15.81:0/345700844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134009d00 con 0x7f313c100dc0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f3141a3d700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f313000c8a0 tx=0x7f313000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f313000cea0 con 0x7f313c100dc0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3130004830 con 0x7f313c100dc0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.669+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c19bfa0 con 0x7f313c100dc0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.670+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31300055b0 con 0x7f313c100dc0 2024-09-18T12:57:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.670+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c19c4c0 con 0x7f313c100dc0 2024-09-18T12:57:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.670+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c068af0 con 0x7f313c100dc0 2024-09-18T12:57:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.671+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3130007ad0 con 0x7f313c100dc0 2024-09-18T12:57:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.672+0000 7f313b7fe700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 0x7f312407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.672+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f313009df40 con 0x7f313c100dc0 2024-09-18T12:57:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.672+0000 7f314223e700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 0x7f312407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.672+0000 7f314223e700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 0x7f312407d7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3134009fd0 tx=0x7f3134007a60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.676+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f31300d51f0 con 0x7f313c100dc0 2024-09-18T12:57:24.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.909+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f313c0695c0 con 0x7f312407b310 2024-09-18T12:57:24.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.910+0000 7f313b7fe700 1 -- 172.21.15.81:0/345700844 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f313c0695c0 con 0x7f312407b310 2024-09-18T12:57:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 msgr2=0x7f312407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 0x7f312407d7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3134009fd0 tx=0x7f3134007a60 comp rx=0 tx=0).stop 2024-09-18T12:57:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 msgr2=0x7f313c196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f313000c8a0 tx=0x7f313000cc60 comp rx=0 tx=0).stop 2024-09-18T12:57:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 shutdown_connections 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f312407b310 0x7f312407d7d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f313c0ffbc0 0x7f313c196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 --2- 172.21.15.81:0/345700844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313c100dc0 0x7f313c196d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 >> 172.21.15.81:0/345700844 conn(0x7f313c0fb160 msgr2=0x7f313c068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 shutdown_connections 2024-09-18T12:57:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:24.913+0000 7f31444a2700 1 -- 172.21.15.81:0/345700844 wait complete. 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 -- 172.21.15.81:0/362171467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc104110 msgr2=0x7f1afc106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 --2- 172.21.15.81:0/362171467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc104110 0x7f1afc106500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009910 tx=0x7f1af0009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 -- 172.21.15.81:0/362171467 shutdown_connections 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 --2- 172.21.15.81:0/362171467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc104110 0x7f1afc106500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 --2- 172.21.15.81:0/362171467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc1017e0 0x7f1afc103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 -- 172.21.15.81:0/362171467 >> 172.21.15.81:0/362171467 conn(0x7f1afc0fb150 msgr2=0x7f1afc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 -- 172.21.15.81:0/362171467 shutdown_connections 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 -- 172.21.15.81:0/362171467 wait complete. 2024-09-18T12:57:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.017+0000 7f1b044db700 1 Processor -- start 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b044db700 1 -- start start 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b044db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b044db700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc104110 0x7f1afc196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b044db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc196f70 con 0x7f1afc1017e0 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b044db700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1970b0 con 0x7f1afc104110 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58202/0 (socket says 172.21.15.81:58202) 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 -- 172.21.15.81:0/2573557862 learned_addr learned my addr 172.21.15.81:0/2573557862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b01a76700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc104110 0x7f1afc196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 -- 172.21.15.81:0/2573557862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc104110 msgr2=0x7f1afc196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc104110 0x7f1afc196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 -- 172.21.15.81:0/2573557862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00095f0 con 0x7f1afc1017e0 2024-09-18T12:57:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1b02277700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c8a0 tx=0x7f1af400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.018+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af400cea0 con 0x7f1afc1017e0 2024-09-18T12:57:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.019+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc19bb60 con 0x7f1afc1017e0 2024-09-18T12:57:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.019+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1af4004830 con 0x7f1afc1017e0 2024-09-18T12:57:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.019+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af40055b0 con 0x7f1afc1017e0 2024-09-18T12:57:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.019+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc19c0b0 con 0x7f1afc1017e0 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.019+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc190630 con 0x7f1afc1017e0 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.020+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1af4007ad0 con 0x7f1afc1017e0 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.021+0000 7f1afb7fe700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 0x7f1ae407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.021+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f1af409dfe0 con 0x7f1afc1017e0 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.021+0000 7f1b01a76700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 0x7f1ae407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.021+0000 7f1b01a76700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 0x7f1ae407d7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006010 tx=0x7f1af000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.025+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1af4061030 con 0x7f1afc1017e0 2024-09-18T12:57:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.243+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1afc0611d0 con 0x7f1ae407b310 2024-09-18T12:57:25.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:25 smithi081 ceph-mon[92545]: osdmap e86: 6 total, 6 up, 6 in 2024-09-18T12:57:25.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:25 smithi081 ceph-mon[92545]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:25.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:25 smithi081 ceph-mon[92545]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.253+0000 7f1afb7fe700 1 -- 172.21.15.81:0/2573557862 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1afc0611d0 con 0x7f1ae407b310 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (12m) 75s ago 14m 25.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (5m) 75s ago 15m 8376k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (5m) 8s ago 14m 7788k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (3m) 75s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (2m) 8s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (12m) 75s ago 14m 82.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (8m) 75s ago 8m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (8m) 75s ago 8m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (8m) 8s ago 8m 20.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (8m) 8s ago 8m 16.7M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:57:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (5m) 75s ago 16m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (4m) 8s ago 13m 455M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (3m) 75s ago 16m 46.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (3m) 8s ago 13m 38.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (15m) 75s ago 15m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (14m) 8s ago 14m 15.0M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (2m) 75s ago 12m 93.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (118s) 75s ago 11m 102M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (81s) 75s ago 11m 14.3M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (45s) 8s ago 11m 130M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (11s) 8s ago 10m 14.3M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (10m) 8s ago 10m 251M 2240M 18.2.1 5be31c24972a ac33f909879a 2024-09-18T12:57:25.256 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 75s ago 14m 67.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:57:25.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 msgr2=0x7f1ae407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 0x7f1ae407d7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006010 tx=0x7f1af000b540 comp rx=0 tx=0).stop 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 msgr2=0x7f1afc196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c8a0 tx=0x7f1af400cc60 comp rx=0 tx=0).stop 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 shutdown_connections 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ae407b310 0x7f1ae407d7d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1afc1017e0 0x7f1afc196410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.255+0000 7f1b044db700 1 --2- 172.21.15.81:0/2573557862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1afc104110 0x7f1afc196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.256+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 >> 172.21.15.81:0/2573557862 conn(0x7f1afc0fb150 msgr2=0x7f1afc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.256+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 shutdown_connections 2024-09-18T12:57:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.256+0000 7f1b044db700 1 -- 172.21.15.81:0/2573557862 wait complete. 2024-09-18T12:57:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:25 smithi136 ceph-mon[80179]: osdmap e86: 6 total, 6 up, 6 in 2024-09-18T12:57:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:25 smithi136 ceph-mon[80179]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:25 smithi136 ceph-mon[80179]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 -- 172.21.15.81:0/1383412624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 msgr2=0x7f0ac0102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/1383412624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0102310 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009910 tx=0x7f0aac009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 -- 172.21.15.81:0/1383412624 shutdown_connections 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/1383412624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0102310 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/1383412624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 0x7f0ac01010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 -- 172.21.15.81:0/1383412624 >> 172.21.15.81:0/1383412624 conn(0x7f0ac00fc230 msgr2=0x7f0ac00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 -- 172.21.15.81:0/1383412624 shutdown_connections 2024-09-18T12:57:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.358+0000 7f0ac6edd700 1 -- 172.21.15.81:0/1383412624 wait complete. 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 Processor -- start 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 -- start start 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 0x7f0ac0196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01970b0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.359+0000 7f0ac6edd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01971f0 con 0x7f0ac0100cb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40498/0 (socket says 172.21.15.81:40498) 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 -- 172.21.15.81:0/2045616524 learned_addr learned my addr 172.21.15.81:0/2045616524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0ac4c79700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 0x7f0ac0196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 -- 172.21.15.81:0/2045616524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 msgr2=0x7f0ac0196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 0x7f0ac0196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 -- 172.21.15.81:0/2045616524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0095f0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abffff700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac006010 tx=0x7f0aac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac01d070 con 0x7f0ac0101eb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0aac00f460 con 0x7f0ac0101eb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac019bc40 con 0x7f0ac0101eb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac021640 con 0x7f0ac0101eb0 2024-09-18T12:57:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.360+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac019c130 con 0x7f0ac0101eb0 2024-09-18T12:57:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.361+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac01098b0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.362+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0aac00fab0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.363+0000 7f0abdffb700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 0x7f0ab007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.363+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f0aac09f600 con 0x7f0ac0101eb0 2024-09-18T12:57:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.363+0000 7f0ac4c79700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 0x7f0ab007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.363+0000 7f0ac4c79700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 0x7f0ab007d7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0101d10 tx=0x7f0ab400d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.367+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0aac0626d0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.669+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ac0109aa0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.669+0000 7f0abdffb700 1 -- 172.21.15.81:0/2045616524 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f0aac0657f0 con 0x7f0ac0101eb0 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:25.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 9 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:57:25.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 msgr2=0x7f0ab007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 0x7f0ab007d7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0101d10 tx=0x7f0ab400d040 comp rx=0 tx=0).stop 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 msgr2=0x7f0ac0196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac006010 tx=0x7f0aac00bd70 comp rx=0 tx=0).stop 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 shutdown_connections 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ab007b310 0x7f0ab007d7d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac0100cb0 0x7f0ac0196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 --2- 172.21.15.81:0/2045616524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac0101eb0 0x7f0ac0196a90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 >> 172.21.15.81:0/2045616524 conn(0x7f0ac00fc230 msgr2=0x7f0ac01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 shutdown_connections 2024-09-18T12:57:25.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.671+0000 7f0ac6edd700 1 -- 172.21.15.81:0/2045616524 wait complete. 2024-09-18T12:57:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 -- 172.21.15.81:0/1919431753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0104080 msgr2=0x7f29f0106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 --2- 172.21.15.81:0/1919431753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0104080 0x7f29f0106470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009910 tx=0x7f29e0009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 -- 172.21.15.81:0/1919431753 shutdown_connections 2024-09-18T12:57:25.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 --2- 172.21.15.81:0/1919431753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0104080 0x7f29f0106470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 --2- 172.21.15.81:0/1919431753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0101750 0x7f29f0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 -- 172.21.15.81:0/1919431753 >> 172.21.15.81:0/1919431753 conn(0x7f29f00fb160 msgr2=0x7f29f00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:25.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 -- 172.21.15.81:0/1919431753 shutdown_connections 2024-09-18T12:57:25.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 -- 172.21.15.81:0/1919431753 wait complete. 2024-09-18T12:57:25.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.775+0000 7f29f7d04700 1 Processor -- start 2024-09-18T12:57:25.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 -- start start 2024-09-18T12:57:25.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 0x7f29f0196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01973c0 con 0x7f29f0101750 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0197500 con 0x7f29f0104080 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40518/0 (socket says 172.21.15.81:40518) 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 -- 172.21.15.81:0/3009348537 learned_addr learned my addr 172.21.15.81:0/3009348537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f529f700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 0x7f29f0196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 -- 172.21.15.81:0/3009348537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 msgr2=0x7f29f0196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 0x7f29f0196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 -- 172.21.15.81:0/3009348537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00095f0 con 0x7f29f0101750 2024-09-18T12:57:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f529f700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 0x7f29f0196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f5aa0700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00b4b0 tx=0x7f29ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29ec011800 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29ec011e10 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.776+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f019bfb0 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.777+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29ec00f2e0 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.777+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f019c470 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.777+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f01906b0 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.778+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f29ec010380 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.779+0000 7f29e6ffd700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 0x7f29dc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.779+0000 7f29f529f700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 0x7f29dc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.779+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f29ec09dde0 con 0x7f29f0101750 2024-09-18T12:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.779+0000 7f29f529f700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 0x7f29dc07d7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006010 tx=0x7f29e000b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:25.783+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f29ec060e30 con 0x7f29f0101750 2024-09-18T12:57:26.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.035+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f29f0068af0 con 0x7f29f0101750 2024-09-18T12:57:26.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.036+0000 7f29e6ffd700 1 -- 172.21.15.81:0/3009348537 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f29ec063f50 con 0x7f29f0101750 2024-09-18T12:57:26.037 INFO:teuthology.orchestra.run.smithi081.stdout:e22 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:55:39:334155+0000 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 22 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:57:26.038 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:55:39.283936+0000 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T12:57:26.039 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14556,14544 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:26.040 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:26.041 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 msgr2=0x7f29dc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 0x7f29dc07d7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006010 tx=0x7f29e000b580 comp rx=0 tx=0).stop 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 msgr2=0x7f29f0196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00b4b0 tx=0x7f29ec00b870 comp rx=0 tx=0).stop 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 shutdown_connections 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f29dc07b310 0x7f29dc07d7d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101750 0x7f29f0196860 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 --2- 172.21.15.81:0/3009348537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29f0104080 0x7f29f0196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 >> 172.21.15.81:0/3009348537 conn(0x7f29f00fb160 msgr2=0x7f29f00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 shutdown_connections 2024-09-18T12:57:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.038+0000 7f29f7d04700 1 -- 172.21.15.81:0/3009348537 wait complete. 2024-09-18T12:57:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-18T12:57:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 -- 172.21.15.81:0/1399373959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 msgr2=0x7fd290101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 --2- 172.21.15.81:0/1399373959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290101590 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd280009910 tx=0x7fd280009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 -- 172.21.15.81:0/1399373959 shutdown_connections 2024-09-18T12:57:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 --2- 172.21.15.81:0/1399373959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 0x7fd290100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 --2- 172.21.15.81:0/1399373959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290101590 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 -- 172.21.15.81:0/1399373959 >> 172.21.15.81:0/1399373959 conn(0x7fd2900fa8c0 msgr2=0x7fd2900fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 -- 172.21.15.81:0/1399373959 shutdown_connections 2024-09-18T12:57:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.142+0000 7fd2950de700 1 -- 172.21.15.81:0/1399373959 wait complete. 2024-09-18T12:57:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 Processor -- start 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 -- start start 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 0x7fd2901953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290195f30 con 0x7fd290101170 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.143+0000 7fd2950de700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290196070 con 0x7fd2900ffdd0 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40550/0 (socket says 172.21.15.81:40550) 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 -- 172.21.15.81:0/1300260543 learned_addr learned my addr 172.21.15.81:0/1300260543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28ed9d700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 0x7fd2901953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 -- 172.21.15.81:0/1300260543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 msgr2=0x7fd2901953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 0x7fd2901953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 -- 172.21.15.81:0/1300260543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800095f0 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd28e59c700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd28400d900 tx=0x7fd28400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2840041f0 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd284004350 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29019ab20 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd284003d20 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.144+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29019b070 con 0x7fd290101170 2024-09-18T12:57:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.145+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290108730 con 0x7fd290101170 2024-09-18T12:57:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.146+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fd284009730 con 0x7fd290101170 2024-09-18T12:57:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.146+0000 7fd277fff700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 0x7fd27807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.146+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fd28409e1e0 con 0x7fd290101170 2024-09-18T12:57:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.146+0000 7fd28ed9d700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 0x7fd27807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.147+0000 7fd28ed9d700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 0x7fd27807d7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd280006010 tx=0x7fd280005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.151+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fd284061230 con 0x7fd290101170 2024-09-18T12:57:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:26 smithi136 ceph-mon[80179]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:26 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2045616524' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:26 smithi136 ceph-mon[80179]: pgmap v155: 65 pgs: 5 peering, 7 active+undersized, 9 active+undersized+degraded, 44 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/369 objects degraded (10.027%) 2024-09-18T12:57:26.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:26 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3009348537' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:26.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:26 smithi081 ceph-mon[92545]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:26.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:26 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2045616524' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:26.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:26 smithi081 ceph-mon[92545]: pgmap v155: 65 pgs: 5 peering, 7 active+undersized, 9 active+undersized+degraded, 44 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/369 objects degraded (10.027%) 2024-09-18T12:57:26.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:26 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3009348537' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.377+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2900ff670 con 0x7fd27807b310 2024-09-18T12:57:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.378+0000 7fd277fff700 1 -- 172.21.15.81:0/1300260543 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd2900ff670 con 0x7fd27807b310 2024-09-18T12:57:26.379 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "11/23 daemons upgraded", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:57:26.380 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 msgr2=0x7fd27807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 0x7fd27807d7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd280006010 tx=0x7fd280005ec0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 msgr2=0x7fd290195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd28400d900 tx=0x7fd28400dc10 comp rx=0 tx=0).stop 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 shutdown_connections 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd27807b310 0x7fd27807d7d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2900ffdd0 0x7fd2901953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 --2- 172.21.15.81:0/1300260543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290101170 0x7fd290195910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.380+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 >> 172.21.15.81:0/1300260543 conn(0x7fd2900fa8c0 msgr2=0x7fd290104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.381+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 shutdown_connections 2024-09-18T12:57:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.381+0000 7fd2950de700 1 -- 172.21.15.81:0/1300260543 wait complete. 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 -- 172.21.15.81:0/360963574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 msgr2=0x7fa5940ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 --2- 172.21.15.81:0/360963574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa5940ff390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa584009910 tx=0x7fa584009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 -- 172.21.15.81:0/360963574 shutdown_connections 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 --2- 172.21.15.81:0/360963574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 0x7fa5941023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 --2- 172.21.15.81:0/360963574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa5940ff390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 -- 172.21.15.81:0/360963574 >> 172.21.15.81:0/360963574 conn(0x7fa5940fa8b0 msgr2=0x7fa5940fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 -- 172.21.15.81:0/360963574 shutdown_connections 2024-09-18T12:57:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.483+0000 7fa599139700 1 -- 172.21.15.81:0/360963574 wait complete. 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.484+0000 7fa599139700 1 Processor -- start 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.484+0000 7fa599139700 1 -- start start 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa599139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa599139700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 0x7fa594196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa599139700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594197070 con 0x7fa5940fef70 2024-09-18T12:57:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa599139700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5941971b0 con 0x7fa594101f50 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40572/0 (socket says 172.21.15.81:40572) 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 -- 172.21.15.81:0/261413354 learned_addr learned my addr 172.21.15.81:0/261413354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa59259c700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 0x7fa594196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 -- 172.21.15.81:0/261413354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 msgr2=0x7fa594196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 0x7fa594196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 -- 172.21.15.81:0/261413354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840095f0 con 0x7fa5940fef70 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa592d9d700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa58400bda0 tx=0x7fa58400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58401d070 con 0x7fa5940fef70 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa58400f460 con 0x7fa5940fef70 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59419bc00 con 0x7fa5940fef70 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.485+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa584021640 con 0x7fa5940fef70 2024-09-18T12:57:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.486+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59419c0f0 con 0x7fa5940fef70 2024-09-18T12:57:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.486+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa594109810 con 0x7fa5940fef70 2024-09-18T12:57:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.487+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa58400f5d0 con 0x7fa5940fef70 2024-09-18T12:57:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.487+0000 7fa57bfff700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 0x7fa57c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.488+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fa58409f4e0 con 0x7fa5940fef70 2024-09-18T12:57:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.488+0000 7fa59259c700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 0x7fa57c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.488+0000 7fa59259c700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 0x7fa57c07d7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa588005950 tx=0x7fa58800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:26.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.492+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa5840625b0 con 0x7fa5940fef70 2024-09-18T12:57:26.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.784+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa59419caf0 con 0x7fa5940fef70 2024-09-18T12:57:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.785+0000 7fa57bfff700 1 -- 172.21.15.81:0/261413354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+683 (secure 0 0 0) 0x7fa5840656d0 con 0x7fa5940fef70 2024-09-18T12:57:26.787 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_WARN Degraded data redundancy: 37/369 objects degraded (10.027%), 9 pgs degraded 2024-09-18T12:57:26.787 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/369 objects degraded (10.027%), 9 pgs degraded 2024-09-18T12:57:26.787 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-18T12:57:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-18T12:57:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.f is active+undersized+degraded, acting [3,5] 2024-09-18T12:57:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-18T12:57:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-18T12:57:26.789 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-18T12:57:26.789 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-18T12:57:26.789 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-09-18T12:57:26.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.787+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 msgr2=0x7fa57c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.787+0000 7fa599139700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 0x7fa57c07d7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa588005950 tx=0x7fa58800b410 comp rx=0 tx=0).stop 2024-09-18T12:57:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.787+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 msgr2=0x7fa594196510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.787+0000 7fa599139700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa58400bda0 tx=0x7fa58400bdd0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.787+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 shutdown_connections 2024-09-18T12:57:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa57c07b310 0x7fa57c07d7d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5940fef70 0x7fa594196510 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 --2- 172.21.15.81:0/261413354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa594101f50 0x7fa594196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 >> 172.21.15.81:0/261413354 conn(0x7fa5940fa8b0 msgr2=0x7fa594105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 shutdown_connections 2024-09-18T12:57:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:26.788+0000 7fa599139700 1 -- 172.21.15.81:0/261413354 wait complete. 2024-09-18T12:57:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:27 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 37/369 objects degraded (10.027%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:27 smithi136 ceph-mon[80179]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:27 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/261413354' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:27 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 37/369 objects degraded (10.027%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:27 smithi081 ceph-mon[92545]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:27 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/261413354' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:28 smithi136 ceph-mon[80179]: pgmap v156: 65 pgs: 5 peering, 4 active+undersized, 5 active+undersized+degraded, 51 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26/369 objects degraded (7.046%) 2024-09-18T12:57:28.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:28 smithi081 ceph-mon[92545]: pgmap v156: 65 pgs: 5 peering, 4 active+undersized, 5 active+undersized+degraded, 51 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26/369 objects degraded (7.046%) 2024-09-18T12:57:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:30 smithi136 ceph-mon[80179]: pgmap v157: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:30 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/369 objects degraded (7.046%), 5 pgs degraded) 2024-09-18T12:57:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:30 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:57:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:30 smithi081 ceph-mon[92545]: pgmap v157: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:30 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/369 objects degraded (7.046%), 5 pgs degraded) 2024-09-18T12:57:30.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:30 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:57:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:32 smithi136 ceph-mon[80179]: pgmap v158: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:32 smithi081 ceph-mon[92545]: pgmap v158: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:34 smithi136 ceph-mon[80179]: pgmap v159: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:34 smithi081 ceph-mon[92545]: pgmap v159: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:36.998 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:36 smithi136 ceph-mon[80179]: pgmap v160: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:36.998 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:36 smithi081 ceph-mon[92545]: pgmap v160: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:38.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:37 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:38.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:37 smithi136 ceph-mon[80179]: Upgrade: osd.5 is safe to restart 2024-09-18T12:57:38.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:38.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:57:38.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:37 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:37 smithi081 ceph-mon[92545]: Upgrade: osd.5 is safe to restart 2024-09-18T12:57:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:57:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:38 smithi081 ceph-mon[92545]: Upgrade: Updating osd.5 2024-09-18T12:57:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:38 smithi081 ceph-mon[92545]: Deploying daemon osd.5 on smithi136 2024-09-18T12:57:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:38 smithi081 ceph-mon[92545]: pgmap v161: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:39.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:38 smithi136 ceph-mon[80179]: Upgrade: Updating osd.5 2024-09-18T12:57:39.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:38 smithi136 ceph-mon[80179]: Deploying daemon osd.5 on smithi136 2024-09-18T12:57:39.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:38 smithi136 ceph-mon[80179]: pgmap v161: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:40.298 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:40 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:40.298 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:40 smithi136 ceph-mon[80179]: pgmap v162: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:40.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:40.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:40 smithi081 ceph-mon[92545]: pgmap v162: 65 pgs: 65 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:40.945 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:40 smithi136 systemd[1]: Stopping Ceph osd.5 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:41.205 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:40 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:57:40.943+0000 7f6153fa6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:57:41.205 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:40 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:57:40.943+0000 7f6153fa6700 -1 osd.5 86 *** Got signal Terminated *** 2024-09-18T12:57:41.205 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:40 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[54649]: 2024-09-18T12:57:40.943+0000 7f6153fa6700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:57:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:41 smithi136 ceph-mon[80179]: osd.5 marked itself down and dead 2024-09-18T12:57:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:41 smithi081 ceph-mon[92545]: osd.5 marked itself down and dead 2024-09-18T12:57:42.045 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:41 smithi136 podman[98518]: 2024-09-18 12:57:41.740484079 +0000 UTC m=+0.921900112 container died ac33f909879a40d00600a9d754589aba0ff78517d3cf821bae48370845642855 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1) 2024-09-18T12:57:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:42 smithi136 ceph-mon[80179]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:42 smithi136 ceph-mon[80179]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-18T12:57:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:42 smithi136 ceph-mon[80179]: osdmap e87: 6 total, 5 up, 6 in 2024-09-18T12:57:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:42 smithi136 ceph-mon[80179]: pgmap v164: 65 pgs: 5 peering, 11 stale+active+clean, 49 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:42.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:42 smithi136 podman[98518]: 2024-09-18 12:57:42.143758415 +0000 UTC m=+1.325174446 container cleanup ac33f909879a40d00600a9d754589aba0ff78517d3cf821bae48370845642855 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1) 2024-09-18T12:57:42.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:42 smithi136 bash[98518]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5 2024-09-18T12:57:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:42 smithi081 ceph-mon[92545]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:42 smithi081 ceph-mon[92545]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-18T12:57:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:42 smithi081 ceph-mon[92545]: osdmap e87: 6 total, 5 up, 6 in 2024-09-18T12:57:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:42 smithi081 ceph-mon[92545]: pgmap v164: 65 pgs: 5 peering, 11 stale+active+clean, 49 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:42.814 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:42 smithi136 podman[98533]: 2024-09-18 12:57:42.470771085 +0000 UTC m=+0.728741977 container remove ac33f909879a40d00600a9d754589aba0ff78517d3cf821bae48370845642855 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-09-18T12:57:43.124 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:42 smithi136 podman[98624]: 2024-09-18 12:57:42.731103025 +0000 UTC m=+0.015673947 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:43.125 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:42 smithi136 podman[98624]: 2024-09-18 12:57:42.855008765 +0000 UTC m=+0.139579672 container create 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-18T12:57:43.125 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 podman[98624]: 2024-09-18 12:57:43.124473114 +0000 UTC m=+0.409044032 container init 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS) 2024-09-18T12:57:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:43 smithi136 ceph-mon[80179]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:43 smithi136 ceph-mon[80179]: osdmap e88: 6 total, 5 up, 6 in 2024-09-18T12:57:43.565 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 podman[98624]: 2024-09-18 12:57:43.127887347 +0000 UTC m=+0.412458255 container start 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-18T12:57:43.565 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 podman[98624]: 2024-09-18 12:57:43.207565912 +0000 UTC m=+0.492136840 container attach 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-18T12:57:43.565 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 podman[98624]: 2024-09-18 12:57:43.327366707 +0000 UTC m=+0.611937622 container died 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T12:57:43.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:43 smithi081 ceph-mon[92545]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:43.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:43 smithi081 ceph-mon[92545]: osdmap e88: 6 total, 5 up, 6 in 2024-09-18T12:57:44.213 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 podman[98648]: 2024-09-18 12:57:43.928359288 +0000 UTC m=+0.595279364 container remove 39b0f453e8435f46ecf5d6976b75d0ec80a3ca4c83f9689a7f1282fcf21e70d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.schema-version=1.0) 2024-09-18T12:57:44.213 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-18T12:57:44.213 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 systemd[1]: Stopped Ceph osd.5 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:44.213 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:43 smithi136 systemd[1]: ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 2.785s CPU time. 2024-09-18T12:57:44.213 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 systemd[1]: Starting Ceph osd.5 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:44.492 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:44 smithi136 ceph-mon[80179]: pgmap v166: 65 pgs: 4 active+undersized, 13 peering, 3 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/369 objects degraded (8.672%) 2024-09-18T12:57:44.492 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 podman[98745]: 2024-09-18 12:57:44.261784815 +0000 UTC m=+0.015922006 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:44.492 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 podman[98745]: 2024-09-18 12:57:44.387844919 +0000 UTC m=+0.141982141 container create 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:44 smithi081 ceph-mon[92545]: pgmap v166: 65 pgs: 4 active+undersized, 13 peering, 3 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/369 objects degraded (8.672%) 2024-09-18T12:57:44.755 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 podman[98745]: 2024-09-18 12:57:44.623577421 +0000 UTC m=+0.377714607 container init 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS) 2024-09-18T12:57:44.755 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 podman[98745]: 2024-09-18 12:57:44.626901415 +0000 UTC m=+0.381038600 container start 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T12:57:44.756 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 podman[98745]: 2024-09-18 12:57:44.706889555 +0000 UTC m=+0.461026752 container attach 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:57:45.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:45.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 bash[98745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:45.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:45.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:44 smithi136 bash[98745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:45.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:45 smithi136 ceph-mon[80179]: Health check failed: Degraded data redundancy: 32/369 objects degraded (8.672%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:45.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:45 smithi081 ceph-mon[92545]: Health check failed: Degraded data redundancy: 32/369 objects degraded (8.672%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:46 smithi136 ceph-mon[80179]: pgmap v167: 65 pgs: 8 active+undersized, 13 peering, 8 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/369 objects degraded (10.569%) 2024-09-18T12:57:46.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:46 smithi081 ceph-mon[92545]: pgmap v167: 65 pgs: 8 active+undersized, 13 peering, 8 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/369 objects degraded (10.569%) 2024-09-18T12:57:47.383 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:47.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:47.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:47.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:47.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:47.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:47.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:57:47.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:57:47.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:57:47.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:57:47.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:47.711 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:47.711 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate[98760]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:57:47.711 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 bash[98745]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:57:47.711 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:47 smithi136 podman[98745]: 2024-09-18 12:57:47.416059569 +0000 UTC m=+3.170196751 container died 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:48.270 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:48 smithi136 ceph-mon[80179]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:48.270 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:48 smithi136 ceph-mon[80179]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-09-18T12:57:48.270 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 podman[98911]: 2024-09-18 12:57:48.001898661 +0000 UTC m=+0.579291604 container remove 83e799605b5624e572df98058194f98f345604f032839d7053b5b7fc2e26ac08 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-18T12:57:48.270 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 podman[98968]: 2024-09-18 12:57:48.123304025 +0000 UTC m=+0.016472442 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:48.270 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 podman[98968]: 2024-09-18 12:57:48.269822228 +0000 UTC m=+0.162990633 container create 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:48 smithi081 ceph-mon[92545]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:48.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:48 smithi081 ceph-mon[92545]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-09-18T12:57:49.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 podman[98968]: 2024-09-18 12:57:48.588288498 +0000 UTC m=+0.481456915 container init 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:57:49.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 podman[98968]: 2024-09-18 12:57:48.591518078 +0000 UTC m=+0.484686482 container start 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-18T12:57:49.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 ceph-osd[98988]: -- 172.21.15.136:0/2420051929 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b352c9a1e0 con 0x55b352c2a000 2024-09-18T12:57:49.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 bash[98968]: 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 2024-09-18T12:57:49.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:48 smithi136 systemd[1]: Started Ceph osd.5 for 2a553466-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:50.131 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.131 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.131 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:50.131 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:50.131 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:50.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:50 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T12:57:50.251+0000 7f69408f3640 -1 Falling back to public interface 2024-09-18T12:57:50.970 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:50 smithi136 ceph-mon[80179]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:51.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:50 smithi081 ceph-mon[92545]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:51 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 56/369 objects degraded (15.176%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:51 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:52.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:51 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:51 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 56/369 objects degraded (15.176%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:51 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:51 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:52 smithi136 ceph-mon[80179]: pgmap v170: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:53.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:53.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:52 smithi081 ceph-mon[92545]: pgmap v170: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:53.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:53.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:54 smithi136 ceph-mon[80179]: pgmap v171: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:55.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:54 smithi081 ceph-mon[92545]: pgmap v171: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:56.064 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:55 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T12:57:55.777+0000 7f69408f3640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-18T12:57:56.556 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T12:57:56.166+0000 7f69408f3640 -1 osd.5 86 log_to_monitors true 2024-09-18T12:57:56.556 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T12:57:56.555+0000 7f693869d640 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:57:56.557 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.557 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.557 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all osd 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T12:57:56.558 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: Upgrade: Setting require_osd_release to 19 squid 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:56.559 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:56 smithi136 ceph-mon[80179]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:56.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all osd 2024-09-18T12:57:56.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: Upgrade: Setting require_osd_release to 19 squid 2024-09-18T12:57:56.859 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-18T12:57:56.860 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:56.860 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:56.860 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:56 smithi081 ceph-mon[92545]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 -- 172.21.15.81:0/4039744530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c300ffbc0 msgr2=0x7f2c300fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 --2- 172.21.15.81:0/4039744530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c300ffbc0 0x7f2c300fffe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009910 tx=0x7f2c18009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 -- 172.21.15.81:0/4039744530 shutdown_connections 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 --2- 172.21.15.81:0/4039744530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c30100dc0 0x7f2c30101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 --2- 172.21.15.81:0/4039744530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c300ffbc0 0x7f2c300fffe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 -- 172.21.15.81:0/4039744530 >> 172.21.15.81:0/4039744530 conn(0x7f2c300fb160 msgr2=0x7f2c300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 -- 172.21.15.81:0/4039744530 shutdown_connections 2024-09-18T12:57:56.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.906+0000 7f2c3485d700 1 -- 172.21.15.81:0/4039744530 wait complete. 2024-09-18T12:57:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 Processor -- start 2024-09-18T12:57:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 -- start start 2024-09-18T12:57:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c300ffbc0 0x7f2c30103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c301026e0 con 0x7f2c30100dc0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.907+0000 7f2c3485d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30102820 con 0x7f2c300ffbc0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36388/0 (socket says 172.21.15.81:36388) 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 -- 172.21.15.81:0/1808596220 learned_addr learned my addr 172.21.15.81:0/1808596220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2e59c700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c300ffbc0 0x7f2c30103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 -- 172.21.15.81:0/1808596220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c300ffbc0 msgr2=0x7f2c30103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c300ffbc0 0x7f2c30103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 -- 172.21.15.81:0/1808596220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180095f0 con 0x7f2c30100dc0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c2dd9b700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c930 tx=0x7f2c2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c20007ad0 con 0x7f2c30100dc0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c2000ce80 con 0x7f2c30100dc0 2024-09-18T12:57:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c30102b00 con 0x7f2c30100dc0 2024-09-18T12:57:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c20018630 con 0x7f2c30100dc0 2024-09-18T12:57:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.908+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3019e850 con 0x7f2c30100dc0 2024-09-18T12:57:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.909+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c30068af0 con 0x7f2c30100dc0 2024-09-18T12:57:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.910+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2c20007c30 con 0x7f2c30100dc0 2024-09-18T12:57:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.911+0000 7f2c277fe700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 0x7f2c1c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:56.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.911+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f2c2009e1c0 con 0x7f2c30100dc0 2024-09-18T12:57:56.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.911+0000 7f2c2e59c700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 0x7f2c1c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:56.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.911+0000 7f2c2e59c700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 0x7f2c1c07d7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006010 tx=0x7f2c18005280 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:56.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:56.915+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f2c20061290 con 0x7f2c30100dc0 2024-09-18T12:57:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.146+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c300695e0 con 0x7f2c1c07b310 2024-09-18T12:57:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.147+0000 7f2c277fe700 1 -- 172.21.15.81:0/1808596220 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c300695e0 con 0x7f2c1c07b310 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 msgr2=0x7f2c1c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 0x7f2c1c07d7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006010 tx=0x7f2c18005280 comp rx=0 tx=0).stop 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 msgr2=0x7f2c301021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c930 tx=0x7f2c2000cc40 comp rx=0 tx=0).stop 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 shutdown_connections 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f2c1c07b310 0x7f2c1c07d7d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c300ffbc0 0x7f2c30103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 --2- 172.21.15.81:0/1808596220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c30100dc0 0x7f2c301021a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 >> 172.21.15.81:0/1808596220 conn(0x7f2c300fb160 msgr2=0x7f2c30068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 shutdown_connections 2024-09-18T12:57:57.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.150+0000 7f2c3485d700 1 -- 172.21.15.81:0/1808596220 wait complete. 2024-09-18T12:57:57.161 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:57:57.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.253+0000 7f3b3d211700 1 -- 172.21.15.81:0/3550180000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 msgr2=0x7f3b381023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 --2- 172.21.15.81:0/3550180000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b381023a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009910 tx=0x7f3b28009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:57.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 -- 172.21.15.81:0/3550180000 shutdown_connections 2024-09-18T12:57:57.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 --2- 172.21.15.81:0/3550180000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b381023a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 --2- 172.21.15.81:0/3550180000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 0x7f3b380ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 -- 172.21.15.81:0/3550180000 >> 172.21.15.81:0/3550180000 conn(0x7f3b380fa8c0 msgr2=0x7f3b380fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 -- 172.21.15.81:0/3550180000 shutdown_connections 2024-09-18T12:57:57.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 -- 172.21.15.81:0/3550180000 wait complete. 2024-09-18T12:57:57.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.254+0000 7f3b3d211700 1 Processor -- start 2024-09-18T12:57:57.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3d211700 1 -- start start 2024-09-18T12:57:57.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3d211700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 0x7f3b38196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3d211700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3d211700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381970d0 con 0x7f3b38101f40 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3d211700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38197210 con 0x7f3b380fef60 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36412/0 (socket says 172.21.15.81:36412) 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 -- 172.21.15.81:0/513575909 learned_addr learned my addr 172.21.15.81:0/513575909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b36d9d700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 0x7f3b38196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 -- 172.21.15.81:0/513575909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 msgr2=0x7f3b38196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 0x7f3b38196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 -- 172.21.15.81:0/513575909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280095f0 con 0x7f3b38101f40 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.255+0000 7f3b3659c700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800bd70 tx=0x7f3b2800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.256+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2801d070 con 0x7f3b38101f40 2024-09-18T12:57:57.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.256+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b28005940 con 0x7f3b38101f40 2024-09-18T12:57:57.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.256+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3819bc60 con 0x7f3b38101f40 2024-09-18T12:57:57.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.256+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b28021430 con 0x7f3b38101f40 2024-09-18T12:57:57.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.256+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3819c150 con 0x7f3b38101f40 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.257+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b381098a0 con 0x7f3b38101f40 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.257+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3b2800f860 con 0x7f3b38101f40 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.258+0000 7f3b1ffff700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 0x7f3b2007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.258+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f3b2809f6f0 con 0x7f3b38101f40 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.258+0000 7f3b36d9d700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 0x7f3b2007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.258+0000 7f3b36d9d700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 0x7f3b2007d7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b38068c10 tx=0x7f3b2c009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.262+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3b28062740 con 0x7f3b38101f40 2024-09-18T12:57:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.496+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b38106890 con 0x7f3b2007b310 2024-09-18T12:57:57.497 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-18T12:57:57.497 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: osdmap e89: 6 total, 5 up, 6 in 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: Upgrade: Scaling down filesystem cephfs 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:57.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:57 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} : dispatch 2024-09-18T12:57:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.497+0000 7f3b1ffff700 1 -- 172.21.15.81:0/513575909 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3b38106890 con 0x7f3b2007b310 2024-09-18T12:57:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 msgr2=0x7f3b2007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 0x7f3b2007d7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b38068c10 tx=0x7f3b2c009190 comp rx=0 tx=0).stop 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 msgr2=0x7f3b38196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800bd70 tx=0x7f3b2800bda0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 shutdown_connections 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3b2007b310 0x7f3b2007d7d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b380fef60 0x7f3b38196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 --2- 172.21.15.81:0/513575909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38101f40 0x7f3b38196ab0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 >> 172.21.15.81:0/513575909 conn(0x7f3b380fa8c0 msgr2=0x7f3b38105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.499+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 shutdown_connections 2024-09-18T12:57:57.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.500+0000 7f3b3d211700 1 -- 172.21.15.81:0/513575909 wait complete. 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 -- 172.21.15.81:0/1196328401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 msgr2=0x7fded40ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 --2- 172.21.15.81:0/1196328401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded40ff380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b0a0 tx=0x7fdecc00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 -- 172.21.15.81:0/1196328401 shutdown_connections 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 --2- 172.21.15.81:0/1196328401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 --2- 172.21.15.81:0/1196328401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded40ff380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 -- 172.21.15.81:0/1196328401 >> 172.21.15.81:0/1196328401 conn(0x7fded40fa8c0 msgr2=0x7fded40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 -- 172.21.15.81:0/1196328401 shutdown_connections 2024-09-18T12:57:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.616+0000 7fdedb54b700 1 -- 172.21.15.81:0/1196328401 wait complete. 2024-09-18T12:57:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 Processor -- start 2024-09-18T12:57:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 -- start start 2024-09-18T12:57:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded4196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4197030 con 0x7fded40fef60 2024-09-18T12:57:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fdedb54b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4197170 con 0x7fded4101f40 2024-09-18T12:57:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fded92e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fded92e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36430/0 (socket says 172.21.15.81:36430) 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fded92e7700 1 -- 172.21.15.81:0/285762632 learned_addr learned my addr 172.21.15.81:0/285762632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.617+0000 7fded8ae6700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded4196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded92e7700 1 -- 172.21.15.81:0/285762632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 msgr2=0x7fded4196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded92e7700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded4196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded92e7700 1 -- 172.21.15.81:0/285762632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc009d00 con 0x7fded40fef60 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded8ae6700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded4196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded92e7700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0077b0 tx=0x7fdecc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc00e040 con 0x7fded40fef60 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdecc00ce60 con 0x7fded40fef60 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded419bbc0 con 0x7fded40fef60 2024-09-18T12:57:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc01db10 con 0x7fded40fef60 2024-09-18T12:57:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.618+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded419c0b0 con 0x7fded40fef60 2024-09-18T12:57:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.619+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded4109800 con 0x7fded40fef60 2024-09-18T12:57:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.620+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdecc01dc70 con 0x7fded40fef60 2024-09-18T12:57:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.621+0000 7fded27fc700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 0x7fdebc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.621+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fdecc0a0850 con 0x7fded40fef60 2024-09-18T12:57:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.621+0000 7fded8ae6700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 0x7fdebc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.621+0000 7fded8ae6700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 0x7fdebc07d7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdec8005950 tx=0x7fdec8005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.625+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fdecc063920 con 0x7fded40fef60 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: osdmap e89: 6 total, 5 up, 6 in 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]} : dispatch 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: Upgrade: Scaling down filesystem cephfs 2024-09-18T12:57:57.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:57.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:57 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} : dispatch 2024-09-18T12:57:57.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.844+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fded4106890 con 0x7fdebc07b310 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.854+0000 7fded27fc700 1 -- 172.21.15.81:0/285762632 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fded4106890 con 0x7fdebc07b310 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (13m) 108s ago 15m 25.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (6m) 108s ago 15m 8376k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (5m) 6s ago 14m 8070k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (3m) 108s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (3m) 6s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:57:57.855 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (13m) 108s ago 15m 82.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (9m) 108s ago 9m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (9m) 108s ago 9m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (9m) 6s ago 9m 21.1M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (9m) 6s ago 9m 16.9M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (5m) 108s ago 16m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (4m) 6s ago 14m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (4m) 108s ago 16m 46.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (4m) 6s ago 14m 39.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (15m) 108s ago 15m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (14m) 6s ago 14m 14.7M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (3m) 108s ago 12m 93.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:57:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (2m) 108s ago 12m 102M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:57:57.857 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (114s) 108s ago 12m 14.3M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:57:57.857 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (78s) 6s ago 11m 133M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:57:57.857 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (44s) 6s ago 11m 93.6M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T12:57:57.857 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (9s) 6s ago 10m 12.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T12:57:57.857 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 108s ago 15m 67.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 msgr2=0x7fdebc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 0x7fdebc07d7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdec8005950 tx=0x7fdec8005f50 comp rx=0 tx=0).stop 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 msgr2=0x7fded41964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0077b0 tx=0x7fdecc003ce0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 shutdown_connections 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fdebc07b310 0x7fdebc07d7d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded40fef60 0x7fded41964d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 --2- 172.21.15.81:0/285762632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fded4101f40 0x7fded4196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 >> 172.21.15.81:0/285762632 conn(0x7fded40fa8c0 msgr2=0x7fded4105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 shutdown_connections 2024-09-18T12:57:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.856+0000 7fdedb54b700 1 -- 172.21.15.81:0/285762632 wait complete. 2024-09-18T12:57:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.959+0000 7f8c78268700 1 -- 172.21.15.81:0/3156236022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 msgr2=0x7f8c701010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.959+0000 7f8c78268700 1 --2- 172.21.15.81:0/3156236022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c701010d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00b0a0 tx=0x7f8c6c00b3b0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 -- 172.21.15.81:0/3156236022 shutdown_connections 2024-09-18T12:57:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 --2- 172.21.15.81:0/3156236022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c70101eb0 0x7f8c70102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 --2- 172.21.15.81:0/3156236022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c701010d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 -- 172.21.15.81:0/3156236022 >> 172.21.15.81:0/3156236022 conn(0x7f8c700fc230 msgr2=0x7f8c700fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 -- 172.21.15.81:0/3156236022 shutdown_connections 2024-09-18T12:57:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 -- 172.21.15.81:0/3156236022 wait complete. 2024-09-18T12:57:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 Processor -- start 2024-09-18T12:57:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.960+0000 7f8c78268700 1 -- start start 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c70101eb0 0x7f8c70196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701970d0 con 0x7f8c70100cb0 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70197210 con 0x7f8c70101eb0 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36450/0 (socket says 172.21.15.81:36450) 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 -- 172.21.15.81:0/3754672172 learned_addr learned my addr 172.21.15.81:0/3754672172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 -- 172.21.15.81:0/3754672172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c70101eb0 msgr2=0x7f8c70196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c70101eb0 0x7f8c70196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 -- 172.21.15.81:0/3754672172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009d00 con 0x7f8c70100cb0 2024-09-18T12:57:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c76004700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009fd0 tx=0x7f8c6c009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c00e040 con 0x7f8c70100cb0 2024-09-18T12:57:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7019bc60 con 0x7f8c70100cb0 2024-09-18T12:57:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c6c003de0 con 0x7f8c70100cb0 2024-09-18T12:57:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c01d980 con 0x7f8c70100cb0 2024-09-18T12:57:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.961+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7019c150 con 0x7f8c70100cb0 2024-09-18T12:57:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.962+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c70109830 con 0x7f8c70100cb0 2024-09-18T12:57:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.963+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8c6c004040 con 0x7f8c70100cb0 2024-09-18T12:57:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.964+0000 7f8c677fe700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 0x7f8c5c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.964+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f8c6c09fd60 con 0x7f8c70100cb0 2024-09-18T12:57:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.964+0000 7f8c75803700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 0x7f8c5c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.964+0000 7f8c75803700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 0x7f8c5c07d7d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005950 tx=0x7f8c600058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:57.968+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f8c6c062db0 con 0x7f8c70100cb0 2024-09-18T12:57:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.267+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c70109a20 con 0x7f8c70100cb0 2024-09-18T12:57:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.267+0000 7f8c677fe700 1 -- 172.21.15.81:0/3754672172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7f8c6c060e60 con 0x7f8c70100cb0 2024-09-18T12:57:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:57:58.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 10 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:57:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.269+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 msgr2=0x7f8c5c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.269+0000 7f8c78268700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 0x7f8c5c07d7d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005950 tx=0x7f8c600058e0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.269+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 msgr2=0x7f8c70196570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.269+0000 7f8c78268700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009fd0 tx=0x7f8c6c009790 comp rx=0 tx=0).stop 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 shutdown_connections 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f8c5c07b310 0x7f8c5c07d7d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c70100cb0 0x7f8c70196570 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 --2- 172.21.15.81:0/3754672172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c70101eb0 0x7f8c70196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 >> 172.21.15.81:0/3754672172 conn(0x7f8c700fc230 msgr2=0x7f8c701050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:58.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 shutdown_connections 2024-09-18T12:57:58.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.270+0000 7f8c78268700 1 -- 172.21.15.81:0/3754672172 wait complete. 2024-09-18T12:57:58.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 -- 172.21.15.81:0/654995417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 msgr2=0x7f151c100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 --2- 172.21.15.81:0/654995417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c100270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f150c009910 tx=0x7f150c009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 -- 172.21.15.81:0/654995417 shutdown_connections 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 --2- 172.21.15.81:0/654995417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c100270 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 --2- 172.21.15.81:0/654995417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 0x7f151c101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 -- 172.21.15.81:0/654995417 >> 172.21.15.81:0/654995417 conn(0x7f151c0fa8c0 msgr2=0x7f151c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 -- 172.21.15.81:0/654995417 shutdown_connections 2024-09-18T12:57:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.374+0000 7f1520a5a700 1 -- 172.21.15.81:0/654995417 wait complete. 2024-09-18T12:57:58.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 Processor -- start 2024-09-18T12:57:58.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 -- start start 2024-09-18T12:57:58.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 0x7f151c195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c195fa0 con 0x7f151c0ffdf0 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f1520a5a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c1960e0 con 0x7f151c101220 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f151a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f151a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36458/0 (socket says 172.21.15.81:36458) 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.375+0000 7f151a59c700 1 -- 172.21.15.81:0/81210631 learned_addr learned my addr 172.21.15.81:0/81210631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f1519d9b700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 0x7f151c195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f151a59c700 1 -- 172.21.15.81:0/81210631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 msgr2=0x7f151c195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f151a59c700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 0x7f151c195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f151a59c700 1 -- 172.21.15.81:0/81210631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0095f0 con 0x7f151c0ffdf0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f151a59c700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f151000b4b0 tx=0x7f151000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1510011800 con 0x7f151c0ffdf0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1510011e10 con 0x7f151c0ffdf0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f151000f2e0 con 0x7f151c0ffdf0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c19ab90 con 0x7f151c0ffdf0 2024-09-18T12:57:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.376+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c19b0e0 con 0x7f151c0ffdf0 2024-09-18T12:57:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.377+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c108840 con 0x7f151c0ffdf0 2024-09-18T12:57:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.378+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1510010380 con 0x7f151c0ffdf0 2024-09-18T12:57:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.378+0000 7f150b7fe700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 0x7f150407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.378+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f151009ddd0 con 0x7f151c0ffdf0 2024-09-18T12:57:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.378+0000 7f1519d9b700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 0x7f150407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.379+0000 7f1519d9b700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 0x7f150407d7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f150c0059d0 tx=0x7f150c005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.383+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1510060e20 con 0x7f151c0ffdf0 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634] boot 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: osdmap e90: 6 total, 6 up, 6 in 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: stopping daemon mds.cephfs.smithi081.hmnvyn 2024-09-18T12:57:58.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:stopping} 2 up:standby 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:57:58.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: pgmap v175: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:58.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:58 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3754672172' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.654+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f151c108a30 con 0x7f151c0ffdf0 2024-09-18T12:57:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.655+0000 7f150b7fe700 1 -- 172.21.15.81:0/81210631 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f1510063f40 con 0x7f151c0ffdf0 2024-09-18T12:57:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:e24 2024-09-18T12:57:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:57:57:557704+0000 2024-09-18T12:57:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:57:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 24 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:57:57.557701+0000 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:57:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544,1=14556} 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:57:58.660 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14544 2024-09-18T12:57:58.661 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:14556} state up:stopping seq 6 join_fscid=1 addr [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:58.662 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 msgr2=0x7f150407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 0x7f150407d7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f150c0059d0 tx=0x7f150c005920 comp rx=0 tx=0).stop 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 msgr2=0x7f151c195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f151000b4b0 tx=0x7f151000b870 comp rx=0 tx=0).stop 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 shutdown_connections 2024-09-18T12:57:58.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f150407b310 0x7f150407d7d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0ffdf0 0x7f151c195440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 --2- 172.21.15.81:0/81210631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f151c101220 0x7f151c195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 >> 172.21.15.81:0/81210631 conn(0x7f151c0fa8c0 msgr2=0x7f151c104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 shutdown_connections 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.657+0000 7f1520a5a700 1 -- 172.21.15.81:0/81210631 wait complete. 2024-09-18T12:57:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-18T12:57:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1500887589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8100cb0 msgr2=0x7fa1e81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1500887589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8100cb0 0x7fa1e81010d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009910 tx=0x7fa1dc009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1500887589 shutdown_connections 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1500887589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1500887589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8100cb0 0x7fa1e81010d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1500887589 >> 172.21.15.81:0/1500887589 conn(0x7fa1e80fc230 msgr2=0x7fa1e80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1500887589 shutdown_connections 2024-09-18T12:57:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.761+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1500887589 wait complete. 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 Processor -- start 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 -- start start 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8100cb0 0x7fa1e8198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e81992b0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1ed0d8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e81993f0 con 0x7fa1e8100cb0 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36466/0 (socket says 172.21.15.81:36466) 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1e659c700 1 -- 172.21.15.81:0/1093641031 learned_addr learned my addr 172.21.15.81:0/1093641031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.762+0000 7fa1e6d9d700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8100cb0 0x7fa1e8198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1e659c700 1 -- 172.21.15.81:0/1093641031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8100cb0 msgr2=0x7fa1e8198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1e659c700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8100cb0 0x7fa1e8198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1e659c700 1 -- 172.21.15.81:0/1093641031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0095f0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1e659c700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800b4b0 tx=0x7fa1d800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d8011800 con 0x7fa1e8101eb0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1d8011e10 con 0x7fa1e8101eb0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e819dea0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d800f2e0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.763+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e819e3c0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.764+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e8105f90 con 0x7fa1e8101eb0 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.765+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa1d8010380 con 0x7fa1e8101eb0 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.765+0000 7fa1cffff700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 0x7fa1d007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.765+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fa1d809dcc0 con 0x7fa1e8101eb0 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.765+0000 7fa1e6d9d700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 0x7fa1d007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.766+0000 7fa1e6d9d700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 0x7fa1d007d7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc006010 tx=0x7fa1dc005280 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.770+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa1d8060d90 con 0x7fa1e8101eb0 2024-09-18T12:57:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:58.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: osd.5 [v2:172.21.15.136:6816/63449634,v1:172.21.15.136:6817/63449634] boot 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: osdmap e90: 6 total, 6 up, 6 in 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: stopping daemon mds.cephfs.smithi081.hmnvyn 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:stopping} 2 up:standby 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:58.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: pgmap v175: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-18T12:57:58.816 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:58 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3754672172' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:59.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:58.998+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1e80611d0 con 0x7fa1d007b310 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.000+0000 7fa1cffff700 1 -- 172.21.15.81:0/1093641031 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa1e80611d0 con 0x7fa1d007b310 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T12:57:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "12/23 daemons upgraded", 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:57:59.002 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:57:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 msgr2=0x7fa1d007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 0x7fa1d007d7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc006010 tx=0x7fa1dc005280 comp rx=0 tx=0).stop 2024-09-18T12:57:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 msgr2=0x7fa1e8198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800b4b0 tx=0x7fa1d800b7c0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 shutdown_connections 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa1d007b310 0x7fa1d007d7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1e8100cb0 0x7fa1e8198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 --2- 172.21.15.81:0/1093641031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e8101eb0 0x7fa1e8198c90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 >> 172.21.15.81:0/1093641031 conn(0x7fa1e80fc230 msgr2=0x7fa1e81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 shutdown_connections 2024-09-18T12:57:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.003+0000 7fa1ed0d8700 1 -- 172.21.15.81:0/1093641031 wait complete. 2024-09-18T12:57:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 -- 172.21.15.81:0/1596876038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 msgr2=0x7f4b981010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/1596876038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981010d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009910 tx=0x7f4b8c009c20 comp rx=0 tx=0).stop 2024-09-18T12:57:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 -- 172.21.15.81:0/1596876038 shutdown_connections 2024-09-18T12:57:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/1596876038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 0x7f4b98102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/1596876038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981010d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 -- 172.21.15.81:0/1596876038 >> 172.21.15.81:0/1596876038 conn(0x7f4b980fc230 msgr2=0x7f4b980fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 -- 172.21.15.81:0/1596876038 shutdown_connections 2024-09-18T12:57:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 -- 172.21.15.81:0/1596876038 wait complete. 2024-09-18T12:57:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.106+0000 7f4b9f25d700 1 Processor -- start 2024-09-18T12:57:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 -- start start 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 0x7f4b98196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98197050 con 0x7f4b98100cb0 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98197190 con 0x7f4b98101eb0 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36480/0 (socket says 172.21.15.81:36480) 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 -- 172.21.15.81:0/3050482304 learned_addr learned my addr 172.21.15.81:0/3050482304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b97fff700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 0x7f4b98196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 -- 172.21.15.81:0/3050482304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 msgr2=0x7f4b98196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 0x7f4b98196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 -- 172.21.15.81:0/3050482304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0095f0 con 0x7f4b98100cb0 2024-09-18T12:57:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9cff9700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00bda0 tx=0x7f4b8c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8c01d070 con 0x7f4b98100cb0 2024-09-18T12:57:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b8c00f460 con 0x7f4b98100cb0 2024-09-18T12:57:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.107+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9819bbe0 con 0x7f4b98100cb0 2024-09-18T12:57:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.108+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8c021620 con 0x7f4b98100cb0 2024-09-18T12:57:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.108+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9819c080 con 0x7f4b98100cb0 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.109+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98109810 con 0x7f4b98100cb0 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.109+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4b8c00f5d0 con 0x7f4b98100cb0 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.110+0000 7f4b95ffb700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 0x7f4b8807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.110+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f4b8c09f590 con 0x7f4b98100cb0 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.110+0000 7f4b97fff700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 0x7f4b8807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.110+0000 7f4b97fff700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 0x7f4b8807d7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b84005950 tx=0x7f4b8400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.114+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4b8c0625e0 con 0x7f4b98100cb0 2024-09-18T12:57:59.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.411+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4b9819c690 con 0x7f4b98100cb0 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.411+0000 7f4b95ffb700 1 -- 172.21.15.81:0/3050482304 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+964 (secure 0 0 0) 0x7f4b8c065700 con 0x7f4b98100cb0 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_WARN Degraded data redundancy: 56/369 objects degraded (15.176%), 14 pgs degraded 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 56/369 objects degraded (15.176%), 14 pgs degraded 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.f is active+undersized+degraded, acting [4,3] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.413+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 msgr2=0x7f4b8807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.413+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 0x7f4b8807d7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b84005950 tx=0x7f4b8400b410 comp rx=0 tx=0).stop 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.413+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 msgr2=0x7f4b981964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00bda0 tx=0x7f4b8c00bdd0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 shutdown_connections 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4b8807b310 0x7f4b8807d7d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b98100cb0 0x7f4b981964f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 --2- 172.21.15.81:0/3050482304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b98101eb0 0x7f4b98196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:59.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 >> 172.21.15.81:0/3050482304 conn(0x7f4b980fc230 msgr2=0x7f4b981050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:59.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 shutdown_connections 2024-09-18T12:57:59.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:57:59.414+0000 7f4b9f25d700 1 -- 172.21.15.81:0/3050482304 wait complete. 2024-09-18T12:57:59.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:59 smithi136 ceph-mon[80179]: osdmap e91: 6 total, 6 up, 6 in 2024-09-18T12:57:59.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:59 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/81210631' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:59.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:59 smithi136 ceph-mon[80179]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:59.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:57:59 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3050482304' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:59.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:59 smithi081 ceph-mon[92545]: osdmap e91: 6 total, 6 up, 6 in 2024-09-18T12:57:59.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:59 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/81210631' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:59.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:59 smithi081 ceph-mon[92545]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:59.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:57:59 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3050482304' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:00.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:00 smithi136 ceph-mon[80179]: pgmap v177: 65 pgs: 7 peering, 12 active+undersized, 9 active+undersized+degraded, 37 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/369 objects degraded (7.588%) 2024-09-18T12:58:00.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:00 smithi081 ceph-mon[92545]: pgmap v177: 65 pgs: 7 peering, 12 active+undersized, 9 active+undersized+degraded, 37 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/369 objects degraded (7.588%) 2024-09-18T12:58:01.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:01 smithi136 ceph-mon[80179]: Health check update: Degraded data redundancy: 28/369 objects degraded (7.588%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:01.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:01 smithi081 ceph-mon[92545]: Health check update: Degraded data redundancy: 28/369 objects degraded (7.588%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:02.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:02 smithi136 ceph-mon[80179]: pgmap v178: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 0 op/s; 4/369 objects degraded (1.084%) 2024-09-18T12:58:02.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:02 smithi081 ceph-mon[92545]: pgmap v178: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 0 op/s; 4/369 objects degraded (1.084%) 2024-09-18T12:58:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:04 smithi136 ceph-mon[80179]: pgmap v179: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 0 op/s 2024-09-18T12:58:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:04 smithi136 ceph-mon[80179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2024-09-18T12:58:04.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:04 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:58:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:04 smithi081 ceph-mon[92545]: pgmap v179: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 0 op/s 2024-09-18T12:58:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:04 smithi081 ceph-mon[92545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2024-09-18T12:58:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:04 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:58:05.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:05.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:05.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:05.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:06.465 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:06 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:stopping} 2 up:standby 2024-09-18T12:58:06.465 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:06 smithi136 ceph-mon[80179]: pgmap v180: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-18T12:58:06.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:06 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:stopping} 2 up:standby 2024-09-18T12:58:06.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:06 smithi081 ceph-mon[92545]: pgmap v180: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-18T12:58:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:07 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:07 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:07 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:08.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:07 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:07 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:07 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:07 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:08.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:07 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:09.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:08 smithi136 ceph-mon[80179]: pgmap v181: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-09-18T12:58:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:09.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:09.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:08 smithi081 ceph-mon[92545]: pgmap v181: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-09-18T12:58:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:10 smithi136 ceph-mon[80179]: pgmap v182: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 89 B/s rd, 4.6 KiB/s wr, 2 op/s 2024-09-18T12:58:10.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:10.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:10 smithi081 ceph-mon[92545]: pgmap v182: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 89 B/s rd, 4.6 KiB/s wr, 2 op/s 2024-09-18T12:58:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:12 smithi136 ceph-mon[80179]: pgmap v183: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-18T12:58:13.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:12 smithi081 ceph-mon[92545]: pgmap v183: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-18T12:58:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:14 smithi136 ceph-mon[80179]: pgmap v184: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.7 KiB/s wr, 1 op/s 2024-09-18T12:58:15.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:14 smithi081 ceph-mon[92545]: pgmap v184: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.7 KiB/s wr, 1 op/s 2024-09-18T12:58:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:16 smithi136 ceph-mon[80179]: pgmap v185: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.1 KiB/s wr, 2 op/s 2024-09-18T12:58:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:16 smithi081 ceph-mon[92545]: pgmap v185: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.1 KiB/s wr, 2 op/s 2024-09-18T12:58:18.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:17 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:17 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: pgmap v186: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.8 KiB/s wr, 3 op/s 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:18 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: pgmap v186: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.8 KiB/s wr, 3 op/s 2024-09-18T12:58:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:18 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:20 smithi136 ceph-mon[80179]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:20 smithi081 ceph-mon[92545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:21 smithi136 ceph-mon[80179]: pgmap v187: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-18T12:58:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:21 smithi081 ceph-mon[92545]: pgmap v187: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-18T12:58:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:23 smithi136 ceph-mon[80179]: pgmap v188: 65 pgs: 65 active+clean; 255 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-18T12:58:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:23 smithi081 ceph-mon[92545]: pgmap v188: 65 pgs: 65 active+clean; 255 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-18T12:58:24.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:24 smithi136 ceph-mon[80179]: pgmap v189: 65 pgs: 65 active+clean; 191 MiB data, 968 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-18T12:58:24.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:24 smithi081 ceph-mon[92545]: pgmap v189: 65 pgs: 65 active+clean; 191 MiB data, 968 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-18T12:58:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:26 smithi136 ceph-mon[80179]: pgmap v190: 65 pgs: 65 active+clean; 171 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-18T12:58:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:26 smithi081 ceph-mon[92545]: pgmap v190: 65 pgs: 65 active+clean; 171 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-18T12:58:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: pgmap v191: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 7 op/s 2024-09-18T12:58:29.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.109 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: pgmap v191: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 7 op/s 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 -- 172.21.15.81:0/559098657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3118100dc0 msgr2=0x7f3118101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 --2- 172.21.15.81:0/559098657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3118100dc0 0x7f3118101220 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f310c009910 tx=0x7f310c009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 -- 172.21.15.81:0/559098657 shutdown_connections 2024-09-18T12:58:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 --2- 172.21.15.81:0/559098657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3118100dc0 0x7f3118101220 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 --2- 172.21.15.81:0/559098657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31180ffbc0 0x7f31180fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 -- 172.21.15.81:0/559098657 >> 172.21.15.81:0/559098657 conn(0x7f31180fb160 msgr2=0x7f31180fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 -- 172.21.15.81:0/559098657 shutdown_connections 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.533+0000 7f311ee57700 1 -- 172.21.15.81:0/559098657 wait complete. 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 Processor -- start 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 -- start start 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3118100dc0 0x7f3118196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118197330 con 0x7f31180ffbc0 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311ee57700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118197470 con 0x7f3118100dc0 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39972/0 (socket says 172.21.15.81:39972) 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 -- 172.21.15.81:0/607353175 learned_addr learned my addr 172.21.15.81:0/607353175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f3117fff700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3118100dc0 0x7f3118196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 -- 172.21.15.81:0/607353175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3118100dc0 msgr2=0x7f3118196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3118100dc0 0x7f3118196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.534+0000 7f311cbf3700 1 -- 172.21.15.81:0/607353175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0095f0 con 0x7f31180ffbc0 2024-09-18T12:58:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f311cbf3700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f310800d900 tx=0x7f310800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31080041f0 con 0x7f31180ffbc0 2024-09-18T12:58:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3108004350 con 0x7f31180ffbc0 2024-09-18T12:58:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311819bf20 con 0x7f31180ffbc0 2024-09-18T12:58:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3108003d20 con 0x7f31180ffbc0 2024-09-18T12:58:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.535+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311819c3e0 con 0x7f31180ffbc0 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.536+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3118068af0 con 0x7f31180ffbc0 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.536+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3108009730 con 0x7f31180ffbc0 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.537+0000 7f3115ffb700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 0x7f310007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.537+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f310809e0f0 con 0x7f31180ffbc0 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.537+0000 7f3117fff700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 0x7f310007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.538+0000 7f3117fff700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 0x7f310007d7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.541+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f31080611c0 con 0x7f31180ffbc0 2024-09-18T12:58:29.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.772+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3118069560 con 0x7f310007b310 2024-09-18T12:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.773+0000 7f3115ffb700 1 -- 172.21.15.81:0/607353175 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3118069560 con 0x7f310007b310 2024-09-18T12:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 msgr2=0x7f310007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 0x7f310007d7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c00b560 comp rx=0 tx=0).stop 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 msgr2=0x7f31181967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f310800d900 tx=0x7f310800dc10 comp rx=0 tx=0).stop 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 shutdown_connections 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f310007b310 0x7f310007d7d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31180ffbc0 0x7f31181967d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 --2- 172.21.15.81:0/607353175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3118100dc0 0x7f3118196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 >> 172.21.15.81:0/607353175 conn(0x7f31180fb160 msgr2=0x7f3118068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 shutdown_connections 2024-09-18T12:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.775+0000 7f311ee57700 1 -- 172.21.15.81:0/607353175 wait complete. 2024-09-18T12:58:29.787 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:58:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 -- 172.21.15.81:0/1107066441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b00ffba0 msgr2=0x7fa1b00fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 --2- 172.21.15.81:0/1107066441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b00ffba0 0x7fa1b00fffc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009910 tx=0x7fa1ac009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 -- 172.21.15.81:0/1107066441 shutdown_connections 2024-09-18T12:58:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 --2- 172.21.15.81:0/1107066441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b0100da0 0x7fa1b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 --2- 172.21.15.81:0/1107066441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b00ffba0 0x7fa1b00fffc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 -- 172.21.15.81:0/1107066441 >> 172.21.15.81:0/1107066441 conn(0x7fa1b00fb120 msgr2=0x7fa1b00fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 -- 172.21.15.81:0/1107066441 shutdown_connections 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.888+0000 7fa1b843a700 1 -- 172.21.15.81:0/1107066441 wait complete. 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 Processor -- start 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 -- start start 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 0x7fa1b0069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b019b880 con 0x7fa1b0100da0 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b843a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b019b9c0 con 0x7fa1b00ffba0 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39982/0 (socket says 172.21.15.81:39982) 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 -- 172.21.15.81:0/664607139 learned_addr learned my addr 172.21.15.81:0/664607139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b61d6700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 0x7fa1b0069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 -- 172.21.15.81:0/664607139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 msgr2=0x7fa1b0069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 0x7fa1b0069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b59d5700 1 -- 172.21.15.81:0/664607139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0095f0 con 0x7fa1b0100da0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.889+0000 7fa1b61d6700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 0x7fa1b0069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1b59d5700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000b4b0 tx=0x7fa1a000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a0011800 con 0x7fa1b0100da0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1a0011e10 con 0x7fa1b0100da0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a000f2e0 con 0x7fa1b0100da0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b019bca0 con 0x7fa1b0100da0 2024-09-18T12:58:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.890+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b019c1a0 con 0x7fa1b0100da0 2024-09-18T12:58:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.891+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b0108780 con 0x7fa1b0100da0 2024-09-18T12:58:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.892+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa1a0010380 con 0x7fa1b0100da0 2024-09-18T12:58:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.892+0000 7fa1a77fe700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 0x7fa19c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.892+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fa1a009dda0 con 0x7fa1b0100da0 2024-09-18T12:58:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.892+0000 7fa1b61d6700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 0x7fa19c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.892+0000 7fa1b61d6700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 0x7fa19c07d7d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00b5c0 tx=0x7fa1ac005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:29.896+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa1a0060df0 con 0x7fa1b0100da0 2024-09-18T12:58:30.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:29 smithi081 ceph-mon[92545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:30.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:29 smithi081 ceph-mon[92545]: daemon mds.cephfs.smithi081.hmnvyn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-18T12:58:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.133+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1b01056f0 con 0x7fa19c07b310 2024-09-18T12:58:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.134+0000 7fa1a77fe700 1 -- 172.21.15.81:0/664607139 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa1b01056f0 con 0x7fa19c07b310 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.136+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 msgr2=0x7fa19c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.136+0000 7fa1b843a700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 0x7fa19c07d7d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00b5c0 tx=0x7fa1ac005e20 comp rx=0 tx=0).stop 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.136+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 msgr2=0x7fa1b019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.136+0000 7fa1b843a700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000b4b0 tx=0x7fa1a000b870 comp rx=0 tx=0).stop 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 shutdown_connections 2024-09-18T12:58:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa19c07b310 0x7fa19c07d7d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b00ffba0 0x7fa1b0069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 --2- 172.21.15.81:0/664607139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b0100da0 0x7fa1b019b2b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 >> 172.21.15.81:0/664607139 conn(0x7fa1b00fb120 msgr2=0x7fa1b0103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 shutdown_connections 2024-09-18T12:58:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.137+0000 7fa1b843a700 1 -- 172.21.15.81:0/664607139 wait complete. 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 -- 172.21.15.81:0/3152070678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 msgr2=0x7f43a01064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 --2- 172.21.15.81:0/3152070678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a01064d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4394009910 tx=0x7f4394009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 -- 172.21.15.81:0/3152070678 shutdown_connections 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 --2- 172.21.15.81:0/3152070678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a01064d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 --2- 172.21.15.81:0/3152070678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 0x7f43a0103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 -- 172.21.15.81:0/3152070678 >> 172.21.15.81:0/3152070678 conn(0x7f43a00fb160 msgr2=0x7f43a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 -- 172.21.15.81:0/3152070678 shutdown_connections 2024-09-18T12:58:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.241+0000 7f43a7977700 1 -- 172.21.15.81:0/3152070678 wait complete. 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 Processor -- start 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 -- start start 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 0x7f43a0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0197380 con 0x7f43a01040e0 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a7977700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01974c0 con 0x7f43a01017b0 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a4f12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a4f12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40018/0 (socket says 172.21.15.81:40018) 2024-09-18T12:58:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.242+0000 7f43a4f12700 1 -- 172.21.15.81:0/1927639318 learned_addr learned my addr 172.21.15.81:0/1927639318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a5713700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 0x7f43a0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a4f12700 1 -- 172.21.15.81:0/1927639318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 msgr2=0x7f43a0196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a4f12700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 0x7f43a0196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a4f12700 1 -- 172.21.15.81:0/1927639318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940095f0 con 0x7f43a01040e0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a4f12700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f439400bd70 tx=0x7f439400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f439401d070 con 0x7f43a01040e0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a019bf10 con 0x7f43a01040e0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4394005940 con 0x7f43a01040e0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4394021430 con 0x7f43a01040e0 2024-09-18T12:58:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.243+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a019c3d0 con 0x7f43a01040e0 2024-09-18T12:58:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.244+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a01906b0 con 0x7f43a01040e0 2024-09-18T12:58:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.245+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f439400f860 con 0x7f43a01040e0 2024-09-18T12:58:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.245+0000 7f43927fc700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 0x7f438c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.246+0000 7f43a5713700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 0x7f438c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.246+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f439409f6d0 con 0x7f43a01040e0 2024-09-18T12:58:30.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.246+0000 7f43a5713700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 0x7f438c07d7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f439c009a10 tx=0x7f439c009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.250+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4394062720 con 0x7f43a01040e0 2024-09-18T12:58:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:29 smithi136 ceph-mon[80179]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-18T12:58:30.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:29 smithi136 ceph-mon[80179]: daemon mds.cephfs.smithi081.hmnvyn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-18T12:58:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.466+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a00611d0 con 0x7f438c07b310 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.475+0000 7f43927fc700 1 -- 172.21.15.81:0/1927639318 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f43a00611d0 con 0x7f438c07b310 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (13m) 2m ago 15m 25.0M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (6m) 2m ago 16m 8376k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (6m) 38s ago 15m 8070k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:58:30.476 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (4m) 2m ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (4m) 38s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (13m) 2m ago 15m 82.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (9m) 2m ago 9m 128M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (9m) 2m ago 9m 132M - 18.2.1 5be31c24972a 67cefdd01e4e 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (9m) 38s ago 9m 21.1M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (9m) 38s ago 9m 16.9M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (6m) 2m ago 17m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (5m) 38s ago 15m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (5m) 2m ago 17m 46.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (4m) 38s ago 14m 39.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (16m) 2m ago 16m 16.0M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:58:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (15m) 38s ago 15m 14.7M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (3m) 2m ago 13m 93.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 2m ago 13m 102M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (2m) 2m ago 12m 14.3M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (110s) 38s ago 12m 133M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (76s) 38s ago 11m 93.6M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (42s) 38s ago 11m 12.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 2m ago 15m 67.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:58:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 msgr2=0x7f438c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 0x7f438c07d7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f439c009a10 tx=0x7f439c009190 comp rx=0 tx=0).stop 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 msgr2=0x7f43a0196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f439400bd70 tx=0x7f439400bda0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 shutdown_connections 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f438c07b310 0x7f438c07d7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a01017b0 0x7f43a0196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 --2- 172.21.15.81:0/1927639318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01040e0 0x7f43a0196d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 >> 172.21.15.81:0/1927639318 conn(0x7f43a00fb160 msgr2=0x7f43a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 shutdown_connections 2024-09-18T12:58:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.477+0000 7f43a7977700 1 -- 172.21.15.81:0/1927639318 wait complete. 2024-09-18T12:58:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- 172.21.15.81:0/2601307554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 msgr2=0x7f4350073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 --2- 172.21.15.81:0/2601307554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f4350073220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f434c009910 tx=0x7f434c009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- 172.21.15.81:0/2601307554 shutdown_connections 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 --2- 172.21.15.81:0/2601307554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 0x7f4350073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 --2- 172.21.15.81:0/2601307554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f4350073220 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- 172.21.15.81:0/2601307554 >> 172.21.15.81:0/2601307554 conn(0x7f43500fc230 msgr2=0x7f43500fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- 172.21.15.81:0/2601307554 shutdown_connections 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- 172.21.15.81:0/2601307554 wait complete. 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 Processor -- start 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.581+0000 7f4358126700 1 -- start start 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4358126700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 0x7f435019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4358126700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4358126700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435019d610 con 0x7f4350074dc0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4358126700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435019d750 con 0x7f43500737f0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40036/0 (socket says 172.21.15.81:40036) 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 -- 172.21.15.81:0/2007707942 learned_addr learned my addr 172.21.15.81:0/2007707942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4355ec2700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 0x7f435019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 -- 172.21.15.81:0/2007707942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 msgr2=0x7f435019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 0x7f435019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 -- 172.21.15.81:0/2007707942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c0095f0 con 0x7f4350074dc0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f43556c1700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f434000e8f0 tx=0x7f434000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4340009790 con 0x7f4350074dc0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43400044d0 con 0x7f4350074dc0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43501a2200 con 0x7f4350074dc0 2024-09-18T12:58:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.582+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4340003da0 con 0x7f4350074dc0 2024-09-18T12:58:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.583+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43501a2750 con 0x7f4350074dc0 2024-09-18T12:58:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.583+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435010fe20 con 0x7f4350074dc0 2024-09-18T12:58:30.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.584+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f434000cba0 con 0x7f4350074dc0 2024-09-18T12:58:30.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.585+0000 7f4346ffd700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 0x7f433c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.585+0000 7f4355ec2700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 0x7f433c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.585+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f4340014070 con 0x7f4350074dc0 2024-09-18T12:58:30.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.585+0000 7f4355ec2700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 0x7f433c07d7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f434c00b6f0 tx=0x7f434c009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.589+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f43400617b0 con 0x7f4350074dc0 2024-09-18T12:58:30.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.887+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43501a2390 con 0x7f4350074dc0 2024-09-18T12:58:30.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.887+0000 7f4346ffd700 1 -- 172.21.15.81:0/2007707942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7f43501a2390 con 0x7f4350074dc0 2024-09-18T12:58:30.888 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3 2024-09-18T12:58:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:58:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:58:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-09-18T12:58:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 10 2024-09-18T12:58:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:58:30.890 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 msgr2=0x7f433c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 0x7f433c07d7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f434c00b6f0 tx=0x7f434c009f70 comp rx=0 tx=0).stop 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 msgr2=0x7f435019cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f434000e8f0 tx=0x7f434000ecb0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 shutdown_connections 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f433c07b310 0x7f433c07d7d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43500737f0 0x7f435019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 --2- 172.21.15.81:0/2007707942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350074dc0 0x7f435019cff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.889+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 >> 172.21.15.81:0/2007707942 conn(0x7f43500fc230 msgr2=0x7f4350102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.890+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 shutdown_connections 2024-09-18T12:58:30.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.890+0000 7f4358126700 1 -- 172.21.15.81:0/2007707942 wait complete. 2024-09-18T12:58:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 -- 172.21.15.81:0/3901669732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 msgr2=0x7f7578103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3901669732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f7578103c30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7568009910 tx=0x7f7568009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 -- 172.21.15.81:0/3901669732 shutdown_connections 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3901669732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 0x7f7578106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3901669732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f7578103c30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 -- 172.21.15.81:0/3901669732 >> 172.21.15.81:0/3901669732 conn(0x7f75780fb190 msgr2=0x7f75780fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 -- 172.21.15.81:0/3901669732 shutdown_connections 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 -- 172.21.15.81:0/3901669732 wait complete. 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.994+0000 7f757d5bd700 1 Processor -- start 2024-09-18T12:58:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f757d5bd700 1 -- start start 2024-09-18T12:58:30.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f757d5bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f757d5bd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 0x7f75780ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f757d5bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780ffd30 con 0x7f7578101840 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f757d5bd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780ffe70 con 0x7f7578104170 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40054/0 (socket says 172.21.15.81:40054) 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 -- 172.21.15.81:0/3607027310 learned_addr learned my addr 172.21.15.81:0/3607027310 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f756e7fc700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 0x7f75780ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 -- 172.21.15.81:0/3607027310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 msgr2=0x7f75780ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 0x7f75780ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 -- 172.21.15.81:0/3607027310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680095f0 con 0x7f7578101840 2024-09-18T12:58:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.995+0000 7f7576ffd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7568006010 tx=0x7f756800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.998+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756801d070 con 0x7f7578101840 2024-09-18T12:58:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.998+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75781000f0 con 0x7f7578101840 2024-09-18T12:58:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.998+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75781005e0 con 0x7f7578101840 2024-09-18T12:58:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.998+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f756800f460 con 0x7f7578101840 2024-09-18T12:58:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.998+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7568017630 con 0x7f7578101840 2024-09-18T12:58:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:30.999+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7558005320 con 0x7f7578101840 2024-09-18T12:58:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.001+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f7568003a60 con 0x7f7578101840 2024-09-18T12:58:31.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.002+0000 7f7574ff9700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 0x7f756407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.002+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f756809f720 con 0x7f7578101840 2024-09-18T12:58:31.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.002+0000 7f756e7fc700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 0x7f756407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.002+0000 7f756e7fc700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 0x7f756407d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7560009a10 tx=0x7f7560009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:31.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.005+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f75680628a0 con 0x7f7578101840 2024-09-18T12:58:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.256+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7558005cc0 con 0x7f7578101840 2024-09-18T12:58:31.258 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:31 smithi081 ceph-mon[92545]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:31.258 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:31 smithi081 ceph-mon[92545]: pgmap v192: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 6 op/s 2024-09-18T12:58:31.258 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:31 smithi081 ceph-mon[92545]: mds.1 [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] down:stopped 2024-09-18T12:58:31.258 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:31 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2 up:standby 2024-09-18T12:58:31.258 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:31 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2007707942' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.257+0000 7f7574ff9700 1 -- 172.21.15.81:0/3607027310 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1930 (secure 0 0 0) 0x7f75680659c0 con 0x7f7578101840 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:e27 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:58:30:995349+0000 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 26 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:58:31.259 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:58:29.924210+0000 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-09-18T12:58:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14544} 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 1 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14544 members: 14544 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:14544} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.81:6826/3849514001,v1:172.21.15.81:6827/3849514001] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:58:31.261 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:24307} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/1745950760,v1:172.21.15.81:6829/1745950760] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 msgr2=0x7f756407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 0x7f756407d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7560009a10 tx=0x7f7560009190 comp rx=0 tx=0).stop 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 msgr2=0x7f75781011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7568006010 tx=0x7f756800bd70 comp rx=0 tx=0).stop 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 shutdown_connections 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f756407b310 0x7f756407d7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578101840 0x7f75781011a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 --2- 172.21.15.81:0/3607027310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7578104170 0x7f75780ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 >> 172.21.15.81:0/3607027310 conn(0x7f75780fb190 msgr2=0x7f75780fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 shutdown_connections 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.260+0000 7f757d5bd700 1 -- 172.21.15.81:0/3607027310 wait complete. 2024-09-18T12:58:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-18T12:58:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:31 smithi136 ceph-mon[80179]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:31 smithi136 ceph-mon[80179]: pgmap v192: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 6 op/s 2024-09-18T12:58:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:31 smithi136 ceph-mon[80179]: mds.1 [v2:172.21.15.81:6828/4043840025,v1:172.21.15.81:6829/4043840025] down:stopped 2024-09-18T12:58:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:31 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2 up:standby 2024-09-18T12:58:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:31 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2007707942' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.364+0000 7f112c95a700 1 -- 172.21.15.81:0/782844095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 msgr2=0x7f1128106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.364+0000 7f112c95a700 1 --2- 172.21.15.81:0/782844095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f1128106450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1118009910 tx=0x7f1118009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.364+0000 7f112c95a700 1 -- 172.21.15.81:0/782844095 shutdown_connections 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.364+0000 7f112c95a700 1 --2- 172.21.15.81:0/782844095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f1128106450 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.364+0000 7f112c95a700 1 --2- 172.21.15.81:0/782844095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- 172.21.15.81:0/782844095 >> 172.21.15.81:0/782844095 conn(0x7f11280fb120 msgr2=0x7f11280fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- 172.21.15.81:0/782844095 shutdown_connections 2024-09-18T12:58:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- 172.21.15.81:0/782844095 wait complete. 2024-09-18T12:58:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 Processor -- start 2024-09-18T12:58:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- start start 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1128196f50 con 0x7f1128104060 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.365+0000 7f112c95a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1128197090 con 0x7f1128101730 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40080/0 (socket says 172.21.15.81:40080) 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 -- 172.21.15.81:0/1552166877 learned_addr learned my addr 172.21.15.81:0/1552166877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f112659c700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 -- 172.21.15.81:0/1552166877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 msgr2=0x7f1128196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 -- 172.21.15.81:0/1552166877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180095f0 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f112659c700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f1125d9b700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f111800bda0 tx=0x7f111800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f111801d070 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1118004c50 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112819baf0 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f111800f690 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.366+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112819bfb0 con 0x7f1128104060 2024-09-18T12:58:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.367+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1128190610 con 0x7f1128104060 2024-09-18T12:58:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.368+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f11180229b0 con 0x7f1128104060 2024-09-18T12:58:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.368+0000 7f111f7fe700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 0x7f111407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.368+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f111809fa10 con 0x7f1128104060 2024-09-18T12:58:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.368+0000 7f112659c700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 0x7f111407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.369+0000 7f112659c700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 0x7f111407d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1110005fd0 tx=0x7f1110005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.373+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1118062b80 con 0x7f1128104060 2024-09-18T12:58:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.601+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11280611d0 con 0x7f111407b310 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.603+0000 7f111f7fe700 1 -- 172.21.15.81:0/1552166877 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f11280611d0 con 0x7f111407b310 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T12:58:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "12/23 daemons upgraded", 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:58:31.605 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:58:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 msgr2=0x7f111407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 0x7f111407d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1110005fd0 tx=0x7f1110005e20 comp rx=0 tx=0).stop 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 msgr2=0x7f11281969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f111800bda0 tx=0x7f111800be80 comp rx=0 tx=0).stop 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 shutdown_connections 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f111407b310 0x7f111407d7d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128101730 0x7f1128196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 --2- 172.21.15.81:0/1552166877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128104060 0x7f11281969c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 >> 172.21.15.81:0/1552166877 conn(0x7f11280fb120 msgr2=0x7f11280fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 shutdown_connections 2024-09-18T12:58:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.605+0000 7f112c95a700 1 -- 172.21.15.81:0/1552166877 wait complete. 2024-09-18T12:58:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 -- 172.21.15.81:0/2515533129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b0101f00 msgr2=0x7f09b0104390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 --2- 172.21.15.81:0/2515533129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b0101f00 0x7f09b0104390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009910 tx=0x7f09a4009c20 comp rx=0 tx=0).stop 2024-09-18T12:58:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 -- 172.21.15.81:0/2515533129 shutdown_connections 2024-09-18T12:58:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 --2- 172.21.15.81:0/2515533129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b0101f00 0x7f09b0104390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 --2- 172.21.15.81:0/2515533129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b00ff590 0x7f09b01019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 -- 172.21.15.81:0/2515533129 >> 172.21.15.81:0/2515533129 conn(0x7f09b00fb190 msgr2=0x7f09b00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:31.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 -- 172.21.15.81:0/2515533129 shutdown_connections 2024-09-18T12:58:31.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.708+0000 7f09b5b34700 1 -- 172.21.15.81:0/2515533129 wait complete. 2024-09-18T12:58:31.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.709+0000 7f09b5b34700 1 Processor -- start 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.709+0000 7f09b5b34700 1 -- start start 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.709+0000 7f09b5b34700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.709+0000 7f09b5b34700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 0x7f09b019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.709+0000 7f09b5b34700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b019d5f0 con 0x7f09b00ff590 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09b5b34700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b019d730 con 0x7f09b0101f00 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40104/0 (socket says 172.21.15.81:40104) 2024-09-18T12:58:31.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 -- 172.21.15.81:0/3023450384 learned_addr learned my addr 172.21.15.81:0/3023450384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09aeffd700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 0x7f09b019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 -- 172.21.15.81:0/3023450384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 msgr2=0x7f09b019cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 0x7f09b019cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 -- 172.21.15.81:0/3023450384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40095f0 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09aeffd700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 0x7f09b019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09af7fe700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09a000d8d0 tx=0x7f09a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a0009940 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09a0010460 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01a21e0 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a000f5f0 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.710+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01a2730 con 0x7f09b00ff590 2024-09-18T12:58:31.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.711+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0196c00 con 0x7f09b00ff590 2024-09-18T12:58:31.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.712+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f09a00105d0 con 0x7f09b00ff590 2024-09-18T12:58:31.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.713+0000 7f09acff9700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 0x7f099807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:31.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.713+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f09a009e2d0 con 0x7f09b00ff590 2024-09-18T12:58:31.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.713+0000 7f09aeffd700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 0x7f099807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:31.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.713+0000 7f09aeffd700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 0x7f099807d7d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a400b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:31.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:31.717+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f09a0061320 con 0x7f09b00ff590 2024-09-18T12:58:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.011+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f09b00619a0 con 0x7f09b00ff590 2024-09-18T12:58:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.011+0000 7f09acff9700 1 -- 172.21.15.81:0/3023450384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f09a0064440 con 0x7f09b00ff590 2024-09-18T12:58:32.013 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:58:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 msgr2=0x7f099807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 0x7f099807d7d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a400b580 comp rx=0 tx=0).stop 2024-09-18T12:58:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 msgr2=0x7f09b019ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09a000d8d0 tx=0x7f09a000dc90 comp rx=0 tx=0).stop 2024-09-18T12:58:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 shutdown_connections 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f099807b310 0x7f099807d7d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09b00ff590 0x7f09b019ca90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 --2- 172.21.15.81:0/3023450384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09b0101f00 0x7f09b019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 >> 172.21.15.81:0/3023450384 conn(0x7f09b00fb190 msgr2=0x7f09b00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 shutdown_connections 2024-09-18T12:58:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:58:32.014+0000 7f09b5b34700 1 -- 172.21.15.81:0/3023450384 wait complete. 2024-09-18T12:58:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6828/1745950760,v1:172.21.15.81:6829/1745950760] up:boot 2024-09-18T12:58:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:58:32.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:58:32.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:32 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3607027310' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6828/1745950760,v1:172.21.15.81:6829/1745950760] up:boot 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:58:32.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:32 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3607027310' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:33 smithi136 ceph-mon[80179]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:33 smithi136 ceph-mon[80179]: pgmap v193: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-09-18T12:58:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:33 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3023450384' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:33 smithi081 ceph-mon[92545]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:33 smithi081 ceph-mon[92545]: pgmap v193: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-09-18T12:58:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:33 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3023450384' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:34 smithi136 ceph-mon[80179]: pgmap v194: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-09-18T12:58:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:34 smithi081 ceph-mon[92545]: pgmap v194: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-09-18T12:58:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:36.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:36 smithi136 ceph-mon[80179]: pgmap v195: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T12:58:36.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:36 smithi081 ceph-mon[92545]: pgmap v195: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: pgmap v196: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:39.033 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:38 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.irimad"]} : dispatch 2024-09-18T12:58:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: pgmap v196: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T12:58:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:39.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:38 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.irimad"]} : dispatch 2024-09-18T12:58:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:39 smithi081 ceph-mon[92545]: Upgrade: It appears safe to stop mds.cephfs.smithi081.irimad 2024-09-18T12:58:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:40.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:39 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:39 smithi136 ceph-mon[80179]: Upgrade: It appears safe to stop mds.cephfs.smithi081.irimad 2024-09-18T12:58:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.irimad", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:39 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:41.286 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:40 smithi081 ceph-mon[92545]: Upgrade: Updating mds.cephfs.smithi081.irimad 2024-09-18T12:58:41.286 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:40 smithi081 ceph-mon[92545]: pgmap v197: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:58:41.286 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:40 smithi081 ceph-mon[92545]: Deploying daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:58:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:40 smithi136 ceph-mon[80179]: Upgrade: Updating mds.cephfs.smithi081.irimad 2024-09-18T12:58:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:40 smithi136 ceph-mon[80179]: pgmap v197: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:58:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:40 smithi136 ceph-mon[80179]: Deploying daemon mds.cephfs.smithi081.irimad on smithi081 2024-09-18T12:58:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[92541]: 2024-09-18T12:58:41.840+0000 7fd3a52f4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:58:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:58:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:58:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: osdmap e92: 6 total, 6 up, 6 in 2024-09-18T12:58:42.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: Standby daemon mds.cephfs.smithi136.lwvlbo assigned to filesystem cephfs as rank 0 2024-09-18T12:58:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:58:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T12:58:42.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:41 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:replay} 2 up:standby 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: osdmap e92: 6 total, 6 up, 6 in 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: Standby daemon mds.cephfs.smithi136.lwvlbo assigned to filesystem cephfs as rank 0 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T12:58:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:41 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:replay} 2 up:standby 2024-09-18T12:58:43.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:42 smithi136 ceph-mon[80179]: pgmap v199: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:58:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:42 smithi081 ceph-mon[92545]: pgmap v199: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:58:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:45 smithi136 ceph-mon[80179]: pgmap v200: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-18T12:58:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:45 smithi081 ceph-mon[92545]: pgmap v200: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-18T12:58:47.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:47 smithi136 ceph-mon[80179]: pgmap v201: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-09-18T12:58:47.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:47 smithi081 ceph-mon[92545]: pgmap v201: 65 pgs: 65 active+clean; 171 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-09-18T12:58:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:49 smithi081 ceph-mon[92545]: pgmap v202: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-18T12:58:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:49 smithi136 ceph-mon[80179]: pgmap v202: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: reconnect by client.14598 v1:172.21.15.136:0/975665321 after 0 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: reconnect by client.24323 v1:172.21.15.81:0/2933002301 after 0 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:reconnect 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:reconnect} 2 up:standby 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:50 smithi136 ceph-mon[80179]: pgmap v203: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-18T12:58:50.340 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: reconnect by client.14598 v1:172.21.15.136:0/975665321 after 0 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: reconnect by client.24323 v1:172.21.15.81:0/2933002301 after 0 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:reconnect 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:reconnect} 2 up:standby 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:50.341 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:50 smithi081 ceph-mon[92545]: pgmap v203: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-18T12:58:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:51 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:rejoin 2024-09-18T12:58:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:51 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:rejoin} 2 up:standby 2024-09-18T12:58:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:51 smithi136 ceph-mon[80179]: daemon mds.cephfs.smithi136.lwvlbo is now active in filesystem cephfs as rank 0 2024-09-18T12:58:51.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:51 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:rejoin 2024-09-18T12:58:51.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:51 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi136.lwvlbo=up:rejoin} 2 up:standby 2024-09-18T12:58:51.333 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:51 smithi081 ceph-mon[92545]: daemon mds.cephfs.smithi136.lwvlbo is now active in filesystem cephfs as rank 0 2024-09-18T12:58:52.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:52 smithi081 ceph-mon[92545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:58:52.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:52 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:58:52.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:52 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:active 2024-09-18T12:58:52.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:52 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:58:52.285 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:52 smithi081 ceph-mon[92545]: pgmap v204: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 710 B/s wr, 8 op/s 2024-09-18T12:58:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:52 smithi136 ceph-mon[80179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:58:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:52 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:58:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:52 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] up:active 2024-09-18T12:58:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:52 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:58:52.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:52 smithi136 ceph-mon[80179]: pgmap v204: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 710 B/s wr, 8 op/s 2024-09-18T12:58:53.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:53.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:53.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:53.986 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:boot 2024-09-18T12:58:53.987 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:58:53.987 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:53 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:boot 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:58:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:53 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:58:54.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:54 smithi081 ceph-mon[92545]: pgmap v205: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 682 B/s wr, 8 op/s 2024-09-18T12:58:55.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:54 smithi136 ceph-mon[80179]: pgmap v205: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 682 B/s wr, 8 op/s 2024-09-18T12:58:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:56 smithi136 ceph-mon[80179]: pgmap v206: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 938 B/s wr, 8 op/s 2024-09-18T12:58:57.349 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:56 smithi081 ceph-mon[92545]: pgmap v206: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 938 B/s wr, 8 op/s 2024-09-18T12:58:59.090 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.090 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.091 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:58 smithi081 ceph-mon[92545]: pgmap v207: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-18T12:58:59.091 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.091 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:58:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:58 smithi136 ceph-mon[80179]: pgmap v207: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-18T12:58:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:58:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:58:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:01.310 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:00 smithi081 ceph-mon[92545]: pgmap v208: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-18T12:59:01.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:00 smithi136 ceph-mon[80179]: pgmap v208: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-18T12:59:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 -- 172.21.15.81:0/2367214472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 msgr2=0x7efd38102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/2367214472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38102310 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd34009910 tx=0x7efd34009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 -- 172.21.15.81:0/2367214472 shutdown_connections 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/2367214472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38102310 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/2367214472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 0x7efd381010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.136+0000 7efd3f8f2700 1 -- 172.21.15.81:0/2367214472 >> 172.21.15.81:0/2367214472 conn(0x7efd380fc230 msgr2=0x7efd380fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 -- 172.21.15.81:0/2367214472 shutdown_connections 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 -- 172.21.15.81:0/2367214472 wait complete. 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 Processor -- start 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 -- start start 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 0x7efd38196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd381970b0 con 0x7efd38101eb0 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3f8f2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd381971f0 con 0x7efd38100cb0 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3ce8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3ce8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55814/0 (socket says 172.21.15.81:55814) 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.137+0000 7efd3ce8d700 1 -- 172.21.15.81:0/519328023 learned_addr learned my addr 172.21.15.81:0/519328023 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3d68e700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 0x7efd38196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3ce8d700 1 -- 172.21.15.81:0/519328023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 msgr2=0x7efd38196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3ce8d700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 0x7efd38196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3ce8d700 1 -- 172.21.15.81:0/519328023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340095f0 con 0x7efd38101eb0 2024-09-18T12:59:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3ce8d700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd34006010 tx=0x7efd3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3401d070 con 0x7efd38101eb0 2024-09-18T12:59:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3819bc40 con 0x7efd38101eb0 2024-09-18T12:59:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd3400f460 con 0x7efd38101eb0 2024-09-18T12:59:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd34021640 con 0x7efd38101eb0 2024-09-18T12:59:02.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.138+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3819c130 con 0x7efd38101eb0 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.139+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd381098b0 con 0x7efd38101eb0 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.140+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7efd3400fab0 con 0x7efd38101eb0 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.141+0000 7efd2a7fc700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 0x7efd2407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.141+0000 7efd3d68e700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 0x7efd2407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.141+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7efd3409f830 con 0x7efd38101eb0 2024-09-18T12:59:02.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.141+0000 7efd3d68e700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 0x7efd2407d7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd2c006fd0 tx=0x7efd2c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.145+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7efd34062820 con 0x7efd38101eb0 2024-09-18T12:59:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.379+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd38106800 con 0x7efd2407b310 2024-09-18T12:59:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.380+0000 7efd2a7fc700 1 -- 172.21.15.81:0/519328023 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efd38106800 con 0x7efd2407b310 2024-09-18T12:59:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 msgr2=0x7efd2407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 0x7efd2407d7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd2c006fd0 tx=0x7efd2c008040 comp rx=0 tx=0).stop 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 msgr2=0x7efd38196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd34006010 tx=0x7efd3400be20 comp rx=0 tx=0).stop 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 shutdown_connections 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efd2407b310 0x7efd2407d7d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd38100cb0 0x7efd38196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 --2- 172.21.15.81:0/519328023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd38101eb0 0x7efd38196a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 >> 172.21.15.81:0/519328023 conn(0x7efd380fc230 msgr2=0x7efd381050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 shutdown_connections 2024-09-18T12:59:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.383+0000 7efd3f8f2700 1 -- 172.21.15.81:0/519328023 wait complete. 2024-09-18T12:59:02.395 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:59:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1162935738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41040d0 msgr2=0x7fa5e41064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1162935738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41040d0 0x7fa5e41064c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009910 tx=0x7fa5cc009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1162935738 shutdown_connections 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1162935738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41040d0 0x7fa5e41064c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1162935738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41017a0 0x7fa5e4103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1162935738 >> 172.21.15.81:0/1162935738 conn(0x7fa5e40fb190 msgr2=0x7fa5e40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1162935738 shutdown_connections 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1162935738 wait complete. 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.490+0000 7fa5e8d1b700 1 Processor -- start 2024-09-18T12:59:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e8d1b700 1 -- start start 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e8d1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e8d1b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41040d0 0x7fa5e40ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e8d1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40ffc90 con 0x7fa5e41017a0 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e8d1b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40ffdd0 con 0x7fa5e41040d0 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55832/0 (socket says 172.21.15.81:55832) 2024-09-18T12:59:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 -- 172.21.15.81:0/1485951758 learned_addr learned my addr 172.21.15.81:0/1485951758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5d9d9b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41040d0 0x7fa5e40ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 -- 172.21.15.81:0/1485951758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41040d0 msgr2=0x7fa5e40ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41040d0 0x7fa5e40ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 -- 172.21.15.81:0/1485951758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0095f0 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.491+0000 7fa5e259c700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400d8d0 tx=0x7fa5d400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.492+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d40098a0 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.492+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5d4010460 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.492+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d400f5f0 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.492+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e41000b0 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.492+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e419e4b0 con 0x7fa5e41017a0 2024-09-18T12:59:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.493+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4190610 con 0x7fa5e41017a0 2024-09-18T12:59:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.493+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa5d4009a00 con 0x7fa5e41017a0 2024-09-18T12:59:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.494+0000 7fa5dbfff700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 0x7fa5d007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.494+0000 7fa5d9d9b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 0x7fa5d007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.494+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa5d409e230 con 0x7fa5e41017a0 2024-09-18T12:59:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.494+0000 7fa5d9d9b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 0x7fa5d007d7d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc006010 tx=0x7fa5cc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.498+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa5d4061220 con 0x7fa5e41017a0 2024-09-18T12:59:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.739+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5e40611d0 con 0x7fa5d007b310 2024-09-18T12:59:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.740+0000 7fa5dbfff700 1 -- 172.21.15.81:0/1485951758 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa5e40611d0 con 0x7fa5d007b310 2024-09-18T12:59:02.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 msgr2=0x7fa5d007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 0x7fa5d007d7d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc006010 tx=0x7fa5cc00b560 comp rx=0 tx=0).stop 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 msgr2=0x7fa5e4101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400d8d0 tx=0x7fa5d400dbe0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 shutdown_connections 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa5d007b310 0x7fa5d007d7d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e41017a0 0x7fa5e4101100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 --2- 172.21.15.81:0/1485951758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41040d0 0x7fa5e40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.742+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 >> 172.21.15.81:0/1485951758 conn(0x7fa5e40fb190 msgr2=0x7fa5e40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.743+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 shutdown_connections 2024-09-18T12:59:02.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.743+0000 7fa5e8d1b700 1 -- 172.21.15.81:0/1485951758 wait complete. 2024-09-18T12:59:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2297538856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c100e10 msgr2=0x7f9c3c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2297538856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c100e10 0x7f9c3c101270 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009910 tx=0x7f9c24009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2297538856 shutdown_connections 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2297538856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c100e10 0x7f9c3c101270 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2297538856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2297538856 >> 172.21.15.81:0/2297538856 conn(0x7f9c3c0fb190 msgr2=0x7f9c3c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2297538856 shutdown_connections 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.849+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2297538856 wait complete. 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 Processor -- start 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 -- start start 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c100e10 0x7f9c3c1958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c195f00 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c40ca3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c196040 con 0x7f9c3c100e10 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55852/0 (socket says 172.21.15.81:55852) 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 -- 172.21.15.81:0/2072350804 learned_addr learned my addr 172.21.15.81:0/2072350804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c39d9b700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c100e10 0x7f9c3c1958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 -- 172.21.15.81:0/2072350804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c100e10 msgr2=0x7f9c3c1958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c100e10 0x7f9c3c1958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.850+0000 7f9c3a59c700 1 -- 172.21.15.81:0/2072350804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240095f0 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c3a59c700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c34007e90 tx=0x7f9c3400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c34017070 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9c3400f040 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c34004880 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c19aaf0 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.851+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c19b040 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.852+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c108700 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.852+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9c340040b0 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.853+0000 7f9c337fe700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 0x7f9c2807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.853+0000 7f9c39d9b700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 0x7f9c2807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.853+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f9c3409dc40 con 0x7f9c3c0ffc10 2024-09-18T12:59:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.853+0000 7f9c39d9b700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 0x7f9c2807d7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c24005b40 tx=0x7f9c24005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:02.857+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9c34060cb0 con 0x7f9c3c0ffc10 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: Detected new or changed devices on smithi081 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.hmnvyn"]} : dispatch 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: Upgrade: It appears safe to stop mds.cephfs.smithi081.hmnvyn 2024-09-18T12:59:03.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:02 smithi136 ceph-mon[80179]: pgmap v209: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 6.2 KiB/s wr, 6 op/s 2024-09-18T12:59:03.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.080+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3c105760 con 0x7f9c2807b310 2024-09-18T12:59:03.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: Detected new or changed devices on smithi081 2024-09-18T12:59:03.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.hmnvyn"]} : dispatch 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: Upgrade: It appears safe to stop mds.cephfs.smithi081.hmnvyn 2024-09-18T12:59:03.083 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:02 smithi081 ceph-mon[92545]: pgmap v209: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 6.2 KiB/s wr, 6 op/s 2024-09-18T12:59:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.090+0000 7f9c337fe700 1 -- 172.21.15.81:0/2072350804 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f9c3c105760 con 0x7f9c2807b310 2024-09-18T12:59:03.091 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (14m) 5s ago 16m 25.5M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (7m) 5s ago 16m 8665k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (7m) 71s ago 15m 8070k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (4m) 5s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (4m) 71s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (14m) 5s ago 16m 84.2M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (10m) 5s ago 10m 11.8M - 18.2.1 5be31c24972a af9505b31a98 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (10s) 5s ago 10m 10.8M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (10m) 71s ago 10m 21.1M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (10m) 71s ago 10m 16.9M - 18.2.1 5be31c24972a f6095221da3f 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (6m) 5s ago 17m 519M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:59:03.092 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (5m) 71s ago 15m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (5m) 5s ago 18m 54.0M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (5m) 71s ago 15m 39.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (16m) 5s ago 16m 15.9M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (15m) 71s ago 15m 14.7M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 5s ago 14m 111M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 5s ago 13m 204M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (2m) 5s ago 13m 99.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (2m) 71s ago 12m 133M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (109s) 71s ago 12m 93.6M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (74s) 71s ago 11m 12.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T12:59:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 5s ago 16m 77.3M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 msgr2=0x7f9c2807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 0x7f9c2807d7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c24005b40 tx=0x7f9c24005a90 comp rx=0 tx=0).stop 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 msgr2=0x7f9c3c1953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c34007e90 tx=0x7f9c3400d3b0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 shutdown_connections 2024-09-18T12:59:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c2807b310 0x7f9c2807d7d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0ffc10 0x7f9c3c1953a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 --2- 172.21.15.81:0/2072350804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c100e10 0x7f9c3c1958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 >> 172.21.15.81:0/2072350804 conn(0x7f9c3c0fb190 msgr2=0x7f9c3c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:03.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 shutdown_connections 2024-09-18T12:59:03.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.093+0000 7f9c40ca3700 1 -- 172.21.15.81:0/2072350804 wait complete. 2024-09-18T12:59:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 -- 172.21.15.81:0/191803043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa514100e10 msgr2=0x7fa514101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/191803043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa514100e10 0x7fa514101270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa508009910 tx=0x7fa508009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 -- 172.21.15.81:0/191803043 shutdown_connections 2024-09-18T12:59:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/191803043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa514100e10 0x7fa514101270 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/191803043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5140ffc10 0x7fa514100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 -- 172.21.15.81:0/191803043 >> 172.21.15.81:0/191803043 conn(0x7fa5140fb190 msgr2=0x7fa5140fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 -- 172.21.15.81:0/191803043 shutdown_connections 2024-09-18T12:59:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.196+0000 7fa51a4d5700 1 -- 172.21.15.81:0/191803043 wait complete. 2024-09-18T12:59:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 Processor -- start 2024-09-18T12:59:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 -- start start 2024-09-18T12:59:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa514100e10 0x7fa5141958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514195f00 con 0x7fa5140ffc10 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa51a4d5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514196040 con 0x7fa514100e10 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55876/0 (socket says 172.21.15.81:55876) 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 -- 172.21.15.81:0/1273011501 learned_addr learned my addr 172.21.15.81:0/1273011501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa5137fe700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa514100e10 0x7fa5141958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 -- 172.21.15.81:0/1273011501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa514100e10 msgr2=0x7fa5141958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa514100e10 0x7fa5141958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.197+0000 7fa513fff700 1 -- 172.21.15.81:0/1273011501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080095f0 con 0x7fa5140ffc10 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa513fff700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa50400c8f0 tx=0x7fa50400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa504007a70 con 0x7fa5140ffc10 2024-09-18T12:59:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa504007bd0 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51419aaf0 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa504018630 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.198+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51419b040 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.199+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514108700 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.200+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa50400f450 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.200+0000 7fa5117fa700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 0x7fa4fc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.200+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa50409e380 con 0x7fa5140ffc10 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.200+0000 7fa5137fe700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 0x7fa4fc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.201+0000 7fa5137fe700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 0x7fa4fc07d7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa508006010 tx=0x7fa50800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:03.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.205+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa504061370 con 0x7fa5140ffc10 2024-09-18T12:59:03.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.524+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa51419b650 con 0x7fa5140ffc10 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.524+0000 7fa5117fa700 1 -- 172.21.15.81:0/1273011501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fa504064490 con 0x7fa5140ffc10 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:59:03.526 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 11 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:59:03.527 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:59:03.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 msgr2=0x7fa4fc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 0x7fa4fc07d7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa508006010 tx=0x7fa50800b540 comp rx=0 tx=0).stop 2024-09-18T12:59:03.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 msgr2=0x7fa5141953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa50400c8f0 tx=0x7fa50400ccb0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 shutdown_connections 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa4fc07b310 0x7fa4fc07d7d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140ffc10 0x7fa5141953a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 --2- 172.21.15.81:0/1273011501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa514100e10 0x7fa5141958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 >> 172.21.15.81:0/1273011501 conn(0x7fa5140fb190 msgr2=0x7fa514104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 shutdown_connections 2024-09-18T12:59:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.527+0000 7fa51a4d5700 1 -- 172.21.15.81:0/1273011501 wait complete. 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- 172.21.15.81:0/819216939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210104080 msgr2=0x7f7210106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 --2- 172.21.15.81:0/819216939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210104080 0x7f7210106470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7200009910 tx=0x7f7200009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- 172.21.15.81:0/819216939 shutdown_connections 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 --2- 172.21.15.81:0/819216939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210104080 0x7f7210106470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 --2- 172.21.15.81:0/819216939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210101750 0x7f7210103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- 172.21.15.81:0/819216939 >> 172.21.15.81:0/819216939 conn(0x7f72100fb160 msgr2=0x7f72100fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- 172.21.15.81:0/819216939 shutdown_connections 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- 172.21.15.81:0/819216939 wait complete. 2024-09-18T12:59:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 Processor -- start 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- start start 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210104080 0x7f7210196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210197300 con 0x7f7210101750 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.638+0000 7f7217d74700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210197440 con 0x7f7210104080 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55896/0 (socket says 172.21.15.81:55896) 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 -- 172.21.15.81:0/2926370107 learned_addr learned my addr 172.21.15.81:0/2926370107 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f721530f700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210104080 0x7f7210196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 -- 172.21.15.81:0/2926370107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210104080 msgr2=0x7f7210196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210104080 0x7f7210196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 -- 172.21.15.81:0/2926370107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000095f0 con 0x7f7210101750 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7215b10700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d900 tx=0x7f720c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720c0041f0 con 0x7f7210101750 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f720c004ce0 con 0x7f7210101750 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721019bef0 con 0x7f7210101750 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720c00b750 con 0x7f7210101750 2024-09-18T12:59:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.639+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721019c3b0 con 0x7f7210101750 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.640+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7210190630 con 0x7f7210101750 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.641+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f720c004350 con 0x7f7210101750 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.641+0000 7f7206ffd700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 0x7f71fc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.642+0000 7f721530f700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 0x7f71fc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.642+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f720c09e490 con 0x7f7210101750 2024-09-18T12:59:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.642+0000 7f721530f700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 0x7f71fc07d7d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7200006010 tx=0x7f720000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:03.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.646+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f720c061480 con 0x7f7210101750 2024-09-18T12:59:03.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.908+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f721002cfe0 con 0x7f7210101750 2024-09-18T12:59:03.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.909+0000 7f7206ffd700 1 -- 172.21.15.81:0/2926370107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1931 (secure 0 0 0) 0x7f720c0645a0 con 0x7f7210101750 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:e33 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:58:53:031785+0000 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 32 2024-09-18T12:59:03.911 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:58:51.019444+0000 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 92 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:59:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24307} 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 1 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24307 members: 24307 2024-09-18T12:59:03.913 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{0:24307} state up:active seq 153 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:24311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/2568560818,v1:172.21.15.136:6825/2568560818] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/1745950760,v1:172.21.15.81:6829/1745950760] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:59:03.914 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 msgr2=0x7f71fc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 0x7f71fc07d7d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7200006010 tx=0x7f720000b540 comp rx=0 tx=0).stop 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 msgr2=0x7f72101967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d900 tx=0x7f720c00dcc0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 shutdown_connections 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f71fc07b310 0x7f71fc07d7d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210101750 0x7f72101967a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 --2- 172.21.15.81:0/2926370107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210104080 0x7f7210196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 >> 172.21.15.81:0/2926370107 conn(0x7f72100fb160 msgr2=0x7f72100fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 shutdown_connections 2024-09-18T12:59:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:03.912+0000 7f7217d74700 1 -- 172.21.15.81:0/2926370107 wait complete. 2024-09-18T12:59:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 -- 172.21.15.81:0/3914637228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81040ffbc0 msgr2=0x7f81040fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 --2- 172.21.15.81:0/3914637228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81040ffbc0 0x7f81040fffe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009910 tx=0x7f80f4009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 -- 172.21.15.81:0/3914637228 shutdown_connections 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 --2- 172.21.15.81:0/3914637228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8104100dc0 0x7f8104101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 --2- 172.21.15.81:0/3914637228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81040ffbc0 0x7f81040fffe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 -- 172.21.15.81:0/3914637228 >> 172.21.15.81:0/3914637228 conn(0x7f81040fb160 msgr2=0x7f81040fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 -- 172.21.15.81:0/3914637228 shutdown_connections 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 -- 172.21.15.81:0/3914637228 wait complete. 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.019+0000 7f810a680700 1 Processor -- start 2024-09-18T12:59:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f810a680700 1 -- start start 2024-09-18T12:59:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f810a680700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81040ffbc0 0x7f8104069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f810a680700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f810a680700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810419bb70 con 0x7f8104100dc0 2024-09-18T12:59:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f810a680700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810419bce0 con 0x7f81040ffbc0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55910/0 (socket says 172.21.15.81:55910) 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 -- 172.21.15.81:0/1921502168 learned_addr learned my addr 172.21.15.81:0/1921502168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f8103fff700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81040ffbc0 0x7f8104069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 -- 172.21.15.81:0/1921502168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81040ffbc0 msgr2=0x7f8104069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81040ffbc0 0x7f8104069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.020+0000 7f81037fe700 1 -- 172.21.15.81:0/1921502168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40095f0 con 0x7f8104100dc0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f81037fe700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b4b0 tx=0x7f80ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ec011800 con 0x7f8104100dc0 2024-09-18T12:59:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80ec011e10 con 0x7f8104100dc0 2024-09-18T12:59:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810419bfc0 con 0x7f8104100dc0 2024-09-18T12:59:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ec00f2e0 con 0x7f8104100dc0 2024-09-18T12:59:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.021+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810419c4e0 con 0x7f8104100dc0 2024-09-18T12:59:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.022+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810418f5b0 con 0x7f8104100dc0 2024-09-18T12:59:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.022+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f80ec010380 con 0x7f8104100dc0 2024-09-18T12:59:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.023+0000 7f81017fa700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 0x7f80f007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.023+0000 7f8103fff700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 0x7f80f007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.023+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f80ec09dd80 con 0x7f8104100dc0 2024-09-18T12:59:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.024+0000 7f8103fff700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 0x7f80f007d7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006010 tx=0x7f80f4005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.027+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f80ec060df0 con 0x7f8104100dc0 2024-09-18T12:59:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:04.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:04.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:03 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1273011501' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.hmnvyn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:04.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:03 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1273011501' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.266+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f810402d050 con 0x7f80f007b310 2024-09-18T12:59:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.267+0000 7f81017fa700 1 -- 172.21.15.81:0/1921502168 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f810402d050 con 0x7f80f007b310 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:59:04.269 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:59:04.270 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "13/23 daemons upgraded", 2024-09-18T12:59:04.270 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:59:04.270 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:59:04.270 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 msgr2=0x7f80f007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 0x7f80f007d7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006010 tx=0x7f80f4005920 comp rx=0 tx=0).stop 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 msgr2=0x7f810419b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b4b0 tx=0x7f80ec00b870 comp rx=0 tx=0).stop 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 shutdown_connections 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f80f007b310 0x7f80f007d7d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81040ffbc0 0x7f8104069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 --2- 172.21.15.81:0/1921502168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8104100dc0 0x7f810419b5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 >> 172.21.15.81:0/1921502168 conn(0x7f81040fb160 msgr2=0x7f81041040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 shutdown_connections 2024-09-18T12:59:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.270+0000 7f810a680700 1 -- 172.21.15.81:0/1921502168 wait complete. 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/469170162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec0fed00 msgr2=0x7f0eec0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/469170162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec0fed00 0x7f0eec0ff160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009910 tx=0x7f0ee0009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/469170162 shutdown_connections 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/469170162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec0fed00 0x7f0eec0ff160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/469170162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec102280 0x7f0eec1026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.374+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/469170162 >> 172.21.15.81:0/469170162 conn(0x7f0eec0fa8c0 msgr2=0x7f0eec0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/469170162 shutdown_connections 2024-09-18T12:59:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/469170162 wait complete. 2024-09-18T12:59:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 Processor -- start 2024-09-18T12:59:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 -- start start 2024-09-18T12:59:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0fed00 0x7f0eec1966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec197230 con 0x7f0eec102280 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.375+0000 7f0ef0a9b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec197370 con 0x7f0eec0fed00 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55932/0 (socket says 172.21.15.81:55932) 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 -- 172.21.15.81:0/4007747197 learned_addr learned my addr 172.21.15.81:0/4007747197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0eea59c700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0fed00 0x7f0eec1966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 -- 172.21.15.81:0/4007747197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0fed00 msgr2=0x7f0eec1966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0fed00 0x7f0eec1966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 -- 172.21.15.81:0/4007747197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00095f0 con 0x7f0eec102280 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ee9d9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006010 tx=0x7f0ee00056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee001d070 con 0x7f0eec102280 2024-09-18T12:59:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec19bdc0 con 0x7f0eec102280 2024-09-18T12:59:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ee000f460 con 0x7f0eec102280 2024-09-18T12:59:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee0021640 con 0x7f0eec102280 2024-09-18T12:59:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.376+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec19c2b0 con 0x7f0eec102280 2024-09-18T12:59:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.377+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec1098b0 con 0x7f0eec102280 2024-09-18T12:59:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.378+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0ee000fa60 con 0x7f0eec102280 2024-09-18T12:59:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.379+0000 7f0edb7fe700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 0x7f0ed407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.379+0000 7f0eea59c700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 0x7f0ed407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.379+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f0ee009f700 con 0x7f0eec102280 2024-09-18T12:59:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.379+0000 7f0eea59c700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 0x7f0ed407d7d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006fd0 tx=0x7f0edc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.383+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0ee00626f0 con 0x7f0eec102280 2024-09-18T12:59:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.685+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0eec19cb70 con 0x7f0eec102280 2024-09-18T12:59:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.685+0000 7f0edb7fe700 1 -- 172.21.15.81:0/4007747197 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0ee0065810 con 0x7f0eec102280 2024-09-18T12:59:04.686 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:59:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 msgr2=0x7f0ed407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 0x7f0ed407d7d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006fd0 tx=0x7f0edc008040 comp rx=0 tx=0).stop 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 msgr2=0x7f0eec196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006010 tx=0x7f0ee00056a0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 shutdown_connections 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0ed407b310 0x7f0ed407d7d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0fed00 0x7f0eec1966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 --2- 172.21.15.81:0/4007747197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec102280 0x7f0eec196c10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 >> 172.21.15.81:0/4007747197 conn(0x7f0eec0fa8c0 msgr2=0x7f0eec105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 shutdown_connections 2024-09-18T12:59:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:04.687+0000 7f0ef0a9b700 1 -- 172.21.15.81:0/4007747197 wait complete. 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: Upgrade: Updating mds.cephfs.smithi081.hmnvyn 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: Deploying daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2926370107' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: pgmap v210: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-18T12:59:05.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:05.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:05.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:04 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/4007747197' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: Upgrade: Updating mds.cephfs.smithi081.hmnvyn 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: Deploying daemon mds.cephfs.smithi081.hmnvyn on smithi081 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2926370107' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: pgmap v210: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:05.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:04 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/4007747197' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:06.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:05 smithi136 ceph-mon[80179]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:06.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:05 smithi081 ceph-mon[92545]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:06 smithi136 ceph-mon[80179]: osdmap e93: 6 total, 6 up, 6 in 2024-09-18T12:59:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:06 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:59:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:06 smithi136 ceph-mon[80179]: pgmap v212: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s wr, 2 op/s 2024-09-18T12:59:07.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:06 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:07.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:06 smithi081 ceph-mon[92545]: osdmap e93: 6 total, 6 up, 6 in 2024-09-18T12:59:07.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:06 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:59:07.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:06 smithi081 ceph-mon[92545]: pgmap v212: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s wr, 2 op/s 2024-09-18T12:59:07.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:06 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:08 smithi081 ceph-mon[92545]: pgmap v213: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:08 smithi136 ceph-mon[80179]: pgmap v213: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:11.165 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:10 smithi081 ceph-mon[92545]: pgmap v214: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:10 smithi136 ceph-mon[80179]: pgmap v214: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: pgmap v215: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] up:boot 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:59:12.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: pgmap v215: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] up:boot 2024-09-18T12:59:12.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:59:12.815 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:15.282 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:14 smithi081 ceph-mon[92545]: pgmap v216: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:14 smithi136 ceph-mon[80179]: pgmap v216: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:16 smithi136 ceph-mon[80179]: pgmap v217: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:16 smithi081 ceph-mon[92545]: pgmap v217: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:19 smithi136 ceph-mon[80179]: pgmap v218: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:19.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:19 smithi081 ceph-mon[92545]: pgmap v218: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:20.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:21.219 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: pgmap v219: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:21.219 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.219 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi136.tfcykk"]} : dispatch 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: pgmap v219: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:21.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi136.tfcykk"]} : dispatch 2024-09-18T12:59:22.233 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:22 smithi136 ceph-mon[80179]: Upgrade: It appears safe to stop mds.cephfs.smithi136.tfcykk 2024-09-18T12:59:22.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:22.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:22.234 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:22 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:22 smithi081 ceph-mon[92545]: Upgrade: It appears safe to stop mds.cephfs.smithi136.tfcykk 2024-09-18T12:59:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.tfcykk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:22.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:22 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:23.211 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:23 smithi136 ceph-mon[80179]: Upgrade: Updating mds.cephfs.smithi136.tfcykk 2024-09-18T12:59:23.212 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:23 smithi136 ceph-mon[80179]: Deploying daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:59:23.212 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:23 smithi136 ceph-mon[80179]: pgmap v220: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:23.276 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:23 smithi081 ceph-mon[92545]: Upgrade: Updating mds.cephfs.smithi136.tfcykk 2024-09-18T12:59:23.276 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:23 smithi081 ceph-mon[92545]: Deploying daemon mds.cephfs.smithi136.tfcykk on smithi136 2024-09-18T12:59:23.276 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:23 smithi081 ceph-mon[92545]: pgmap v220: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:25 smithi136 ceph-mon[80179]: pgmap v221: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:25.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:25 smithi136 ceph-mon[80179]: osdmap e94: 6 total, 6 up, 6 in 2024-09-18T12:59:25.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:25 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:59:25.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:25 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:25 smithi081 ceph-mon[92545]: pgmap v221: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:25 smithi081 ceph-mon[92545]: osdmap e94: 6 total, 6 up, 6 in 2024-09-18T12:59:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:25 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 2 up:standby 2024-09-18T12:59:25.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:25 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:27.206 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:26 smithi136 ceph-mon[80179]: pgmap v223: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:26 smithi081 ceph-mon[92545]: pgmap v223: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:28.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: pgmap v224: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] up:boot 2024-09-18T12:59:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:59:28.858 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: pgmap v224: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] up:boot 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi136.lwvlbo=up:active} 3 up:standby 2024-09-18T12:59:28.872 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:31 smithi136 ceph-mon[80179]: pgmap v225: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:31 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:31 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:31 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:31 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:31 smithi081 ceph-mon[92545]: pgmap v225: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:31 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:31 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:31 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:31 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:33.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:33 smithi136 ceph-mon[80179]: pgmap v226: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:33.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:33 smithi081 ceph-mon[92545]: pgmap v226: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 -- 172.21.15.81:0/1825224981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 msgr2=0x7f9c901010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 --2- 172.21.15.81:0/1825224981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c901010d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009910 tx=0x7f9c88009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 -- 172.21.15.81:0/1825224981 shutdown_connections 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 --2- 172.21.15.81:0/1825224981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 --2- 172.21.15.81:0/1825224981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c901010d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 -- 172.21.15.81:0/1825224981 >> 172.21.15.81:0/1825224981 conn(0x7f9c900fc230 msgr2=0x7f9c900fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 -- 172.21.15.81:0/1825224981 shutdown_connections 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.794+0000 7f9c95327700 1 -- 172.21.15.81:0/1825224981 wait complete. 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 Processor -- start 2024-09-18T12:59:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 -- start start 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900736c0 con 0x7f9c90100cb0 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c95327700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90073800 con 0x7f9c90101eb0 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c8effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c8effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48766/0 (socket says 172.21.15.81:48766) 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c8effd700 1 -- 172.21.15.81:0/2772133347 learned_addr learned my addr 172.21.15.81:0/2772133347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.795+0000 7f9c8e7fc700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c8effd700 1 -- 172.21.15.81:0/2772133347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 msgr2=0x7f9c90073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c8effd700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c8effd700 1 -- 172.21.15.81:0/2772133347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880095f0 con 0x7f9c90100cb0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c8e7fc700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c8effd700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800bda0 tx=0x7f9c8800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8801d070 con 0x7f9c90100cb0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c90073a80 con 0x7f9c90100cb0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9c88004c50 con 0x7f9c90100cb0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8800f690 con 0x7f9c90100cb0 2024-09-18T12:59:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.796+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90073f70 con 0x7f9c90100cb0 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.797+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c90109890 con 0x7f9c90100cb0 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.798+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9c880229b0 con 0x7f9c90100cb0 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.798+0000 7f9c87fff700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 0x7f9c7c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.798+0000 7f9c8e7fc700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 0x7f9c7c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.798+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f9c8809fa40 con 0x7f9c90100cb0 2024-09-18T12:59:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.799+0000 7f9c8e7fc700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 0x7f9c7c07d7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c780099d0 tx=0x7f9c78008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:34.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:34.802+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9c88062ae0 con 0x7f9c90100cb0 2024-09-18T12:59:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.036+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c9019ea40 con 0x7f9c7c07b310 2024-09-18T12:59:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.037+0000 7f9c87fff700 1 -- 172.21.15.81:0/2772133347 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9c9019ea40 con 0x7f9c7c07b310 2024-09-18T12:59:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 msgr2=0x7f9c7c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 0x7f9c7c07d7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c780099d0 tx=0x7f9c78008040 comp rx=0 tx=0).stop 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 msgr2=0x7f9c90074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800bda0 tx=0x7f9c8800be80 comp rx=0 tx=0).stop 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 shutdown_connections 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9c7c07b310 0x7f9c7c07d7d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c90100cb0 0x7f9c90074b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 --2- 172.21.15.81:0/2772133347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c90101eb0 0x7f9c90073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 >> 172.21.15.81:0/2772133347 conn(0x7f9c900fc230 msgr2=0x7f9c901050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 shutdown_connections 2024-09-18T12:59:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.039+0000 7f9c95327700 1 -- 172.21.15.81:0/2772133347 wait complete. 2024-09-18T12:59:35.051 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T12:59:35.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- 172.21.15.81:0/3127166780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 msgr2=0x7efcd0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 --2- 172.21.15.81:0/3127166780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd0101270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009910 tx=0x7efcb8009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:35.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- 172.21.15.81:0/3127166780 shutdown_connections 2024-09-18T12:59:35.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 --2- 172.21.15.81:0/3127166780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd0101270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 --2- 172.21.15.81:0/3127166780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 0x7efcd0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- 172.21.15.81:0/3127166780 >> 172.21.15.81:0/3127166780 conn(0x7efcd00fb190 msgr2=0x7efcd00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- 172.21.15.81:0/3127166780 shutdown_connections 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- 172.21.15.81:0/3127166780 wait complete. 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 Processor -- start 2024-09-18T12:59:35.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.144+0000 7efcd552e700 1 -- start start 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcd552e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 0x7efcd0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcd552e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcd552e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0196fe0 con 0x7efcd0100e10 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcd552e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0197120 con 0x7efcd00ffc10 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48794/0 (socket says 172.21.15.81:48794) 2024-09-18T12:59:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 -- 172.21.15.81:0/2726916485 learned_addr learned my addr 172.21.15.81:0/2726916485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcceffd700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 0x7efcd0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 -- 172.21.15.81:0/2726916485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 msgr2=0x7efcd0196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 0x7efcd0196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 -- 172.21.15.81:0/2726916485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80095f0 con 0x7efcd0100e10 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcc7fff700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b5c0 tx=0x7efcb800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb801d070 con 0x7efcd0100e10 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efcb800f460 con 0x7efcd0100e10 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd019bb70 con 0x7efcd0100e10 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.145+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb8021640 con 0x7efcd0100e10 2024-09-18T12:59:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.146+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd019c060 con 0x7efcd0100e10 2024-09-18T12:59:35.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.147+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd0108700 con 0x7efcd0100e10 2024-09-18T12:59:35.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.147+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7efcb800fa60 con 0x7efcd0100e10 2024-09-18T12:59:35.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.148+0000 7efcccff9700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 0x7efcbc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.148+0000 7efcceffd700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 0x7efcbc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.148+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7efcb809f5c0 con 0x7efcd0100e10 2024-09-18T12:59:35.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.148+0000 7efcceffd700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 0x7efcbc07d7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efcd0100c70 tx=0x7efcc000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.152+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7efcb80625b0 con 0x7efcd0100e10 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: pgmap v227: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi136.lwvlbo"]} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: pgmap v227: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:35.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi136.lwvlbo"]} : dispatch 2024-09-18T12:59:35.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.382+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcd0068c90 con 0x7efcbc07b310 2024-09-18T12:59:35.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.383+0000 7efcccff9700 1 -- 172.21.15.81:0/2726916485 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efcd0068c90 con 0x7efcbc07b310 2024-09-18T12:59:35.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 msgr2=0x7efcbc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 0x7efcbc07d7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efcd0100c70 tx=0x7efcc000b410 comp rx=0 tx=0).stop 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 msgr2=0x7efcd01969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b5c0 tx=0x7efcb800bd70 comp rx=0 tx=0).stop 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 shutdown_connections 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efcbc07b310 0x7efcbc07d7d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcd00ffc10 0x7efcd0196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 --2- 172.21.15.81:0/2726916485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0100e10 0x7efcd01969c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 >> 172.21.15.81:0/2726916485 conn(0x7efcd00fb190 msgr2=0x7efcd0068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 shutdown_connections 2024-09-18T12:59:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.385+0000 7efcd552e700 1 -- 172.21.15.81:0/2726916485 wait complete. 2024-09-18T12:59:35.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.489+0000 7fb00f1fc700 1 -- 172.21.15.81:0/1940486270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 msgr2=0x7fb008101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.489+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/1940486270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb008101210 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faff4009910 tx=0x7faff4009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- 172.21.15.81:0/1940486270 shutdown_connections 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/1940486270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb008101210 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/1940486270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 0x7fb0080fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- 172.21.15.81:0/1940486270 >> 172.21.15.81:0/1940486270 conn(0x7fb0080fb150 msgr2=0x7fb0080fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- 172.21.15.81:0/1940486270 shutdown_connections 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- 172.21.15.81:0/1940486270 wait complete. 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 Processor -- start 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- start start 2024-09-18T12:59:35.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 0x7fb0080699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00819b7d0 con 0x7fb008100db0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.490+0000 7fb00f1fc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00819b910 con 0x7fb0080ffbb0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37170/0 (socket says 172.21.15.81:37170) 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 -- 172.21.15.81:0/4228719552 learned_addr learned my addr 172.21.15.81:0/4228719552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb00cf98700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 0x7fb0080699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 -- 172.21.15.81:0/4228719552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 msgr2=0x7fb0080699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 0x7fb0080699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 -- 172.21.15.81:0/4228719552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40095f0 con 0x7fb008100db0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb007fff700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faff4006010 tx=0x7faff400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff401d070 con 0x7fb008100db0 2024-09-18T12:59:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faff400f460 con 0x7fb008100db0 2024-09-18T12:59:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00819bb90 con 0x7fb008100db0 2024-09-18T12:59:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff4021640 con 0x7fb008100db0 2024-09-18T12:59:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.491+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00819c080 con 0x7fb008100db0 2024-09-18T12:59:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.492+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008108710 con 0x7fb008100db0 2024-09-18T12:59:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.494+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7faff400fab0 con 0x7fb008100db0 2024-09-18T12:59:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.494+0000 7fb005ffb700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 0x7faff807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.494+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7faff409f980 con 0x7fb008100db0 2024-09-18T12:59:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.494+0000 7fb00cf98700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 0x7faff807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.495+0000 7fb00cf98700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 0x7faff807d7d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb008100c10 tx=0x7faffc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.498+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7faff40629f0 con 0x7fb008100db0 2024-09-18T12:59:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.727+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb008105700 con 0x7faff807b310 2024-09-18T12:59:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.739+0000 7fb005ffb700 1 -- 172.21.15.81:0/4228719552 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb008105700 con 0x7faff807b310 2024-09-18T12:59:35.740 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:35.740 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (15m) 19s ago 17m 25.5M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T12:59:35.740 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (7m) 19s ago 17m 8694k - 18.2.1 5be31c24972a 92c21635605a 2024-09-18T12:59:35.740 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (7m) 5s ago 16m 8560k - 18.2.1 5be31c24972a f34fbb4d1716 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (5m) 19s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (5m) 5s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (14m) 19s ago 16m 84.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (24s) 19s ago 10m 11.8M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (43s) 19s ago 10m 12.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (10m) 5s ago 10m 70.8M - 18.2.1 5be31c24972a d07fdf3bce3b 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (8s) 5s ago 10m 13.3M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (7m) 19s ago 18m 520M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (6m) 5s ago 16m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (6m) 19s ago 18m 54.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (5m) 5s ago 16m 41.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (17m) 19s ago 17m 16.1M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T12:59:35.741 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (16m) 5s ago 16m 14.9M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 19s ago 14m 111M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 19s ago 14m 205M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (3m) 19s ago 13m 99.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (2m) 5s ago 13m 128M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (2m) 5s ago 12m 97.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (107s) 5s ago 12m 96.5M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 19s ago 16m 77.3M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T12:59:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 msgr2=0x7faff807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 0x7faff807d7d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb008100c10 tx=0x7faffc00b410 comp rx=0 tx=0).stop 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 msgr2=0x7fb00819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faff4006010 tx=0x7faff400bd70 comp rx=0 tx=0).stop 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 shutdown_connections 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7faff807b310 0x7faff807d7d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0080ffbb0 0x7fb0080699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 --2- 172.21.15.81:0/4228719552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb008100db0 0x7fb00819b1b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 >> 172.21.15.81:0/4228719552 conn(0x7fb0080fb150 msgr2=0x7fb008103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 shutdown_connections 2024-09-18T12:59:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.741+0000 7fb00f1fc700 1 -- 172.21.15.81:0/4228719552 wait complete. 2024-09-18T12:59:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 -- 172.21.15.81:0/1449933741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c101eb0 msgr2=0x7f689c102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 --2- 172.21.15.81:0/1449933741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c101eb0 0x7f689c102310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6890009910 tx=0x7f6890009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 -- 172.21.15.81:0/1449933741 shutdown_connections 2024-09-18T12:59:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 --2- 172.21.15.81:0/1449933741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c101eb0 0x7f689c102310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 --2- 172.21.15.81:0/1449933741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c100cb0 0x7f689c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 -- 172.21.15.81:0/1449933741 >> 172.21.15.81:0/1449933741 conn(0x7f689c0fc230 msgr2=0x7f689c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 -- 172.21.15.81:0/1449933741 shutdown_connections 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.844+0000 7f68a186b700 1 -- 172.21.15.81:0/1449933741 wait complete. 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 Processor -- start 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 -- start start 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c101eb0 0x7f689c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c196f80 con 0x7f689c100cb0 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f68a186b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c1970c0 con 0x7f689c101eb0 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f689affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f689affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37180/0 (socket says 172.21.15.81:37180) 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f689affd700 1 -- 172.21.15.81:0/2187307046 learned_addr learned my addr 172.21.15.81:0/2187307046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.845+0000 7f689a7fc700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c101eb0 0x7f689c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f689affd700 1 -- 172.21.15.81:0/2187307046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c101eb0 msgr2=0x7f689c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f689affd700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c101eb0 0x7f689c1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f689affd700 1 -- 172.21.15.81:0/2187307046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900095f0 con 0x7f689c100cb0 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f689affd700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f688c00c910 tx=0x7f688c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688c0041f0 con 0x7f689c100cb0 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f688c00ce60 con 0x7f689c100cb0 2024-09-18T12:59:35.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c19bb80 con 0x7f689c100cb0 2024-09-18T12:59:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688c003d20 con 0x7f689c100cb0 2024-09-18T12:59:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.846+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c19c0a0 con 0x7f689c100cb0 2024-09-18T12:59:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.847+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c109810 con 0x7f689c100cb0 2024-09-18T12:59:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.848+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f688c007900 con 0x7f689c100cb0 2024-09-18T12:59:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.848+0000 7f68a0869700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 0x7f688407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.848+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f688c09df60 con 0x7f689c100cb0 2024-09-18T12:59:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.848+0000 7f689a7fc700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 0x7f688407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.849+0000 7f689a7fc700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 0x7f688407d7d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6890006010 tx=0x7f689000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:35.852+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f688c0d51f0 con 0x7f689c100cb0 2024-09-18T12:59:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.152+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f689c19cb30 con 0x7f689c100cb0 2024-09-18T12:59:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.153+0000 7f68a0869700 1 -- 172.21.15.81:0/2187307046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f688c060fd0 con 0x7f689c100cb0 2024-09-18T12:59:36.154 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:59:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T12:59:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T12:59:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 13 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 msgr2=0x7f688407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 0x7f688407d7d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6890006010 tx=0x7f689000b560 comp rx=0 tx=0).stop 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 msgr2=0x7f689c1964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f688c00c910 tx=0x7f688c00cc20 comp rx=0 tx=0).stop 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 shutdown_connections 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f688407b310 0x7f688407d7d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c100cb0 0x7f689c1964b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 --2- 172.21.15.81:0/2187307046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f689c101eb0 0x7f689c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.155+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 >> 172.21.15.81:0/2187307046 conn(0x7f689c0fc230 msgr2=0x7f689c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.156+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 shutdown_connections 2024-09-18T12:59:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.156+0000 7f68a186b700 1 -- 172.21.15.81:0/2187307046 wait complete. 2024-09-18T12:59:36.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:36 smithi136 ceph-mon[80179]: Detected new or changed devices on smithi136 2024-09-18T12:59:36.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:36 smithi136 ceph-mon[80179]: Upgrade: It appears safe to stop mds.cephfs.smithi136.lwvlbo 2024-09-18T12:59:36.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:36.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:36.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2167285676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 msgr2=0x7fe2041010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2167285676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041010d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe200009910 tx=0x7fe200009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2167285676 shutdown_connections 2024-09-18T12:59:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2167285676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 0x7fe204102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2167285676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041010d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2167285676 >> 172.21.15.81:0/2167285676 conn(0x7fe2040fc230 msgr2=0x7fe2040fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.262 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:36 smithi081 ceph-mon[92545]: Detected new or changed devices on smithi136 2024-09-18T12:59:36.262 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:36 smithi081 ceph-mon[92545]: Upgrade: It appears safe to stop mds.cephfs.smithi136.lwvlbo 2024-09-18T12:59:36.262 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:36.262 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi136.lwvlbo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:59:36.262 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2167285676 shutdown_connections 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.260+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2167285676 wait complete. 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 Processor -- start 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 -- start start 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 0x7fe204196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204197020 con 0x7fe204100cb0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20c3e7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204197160 con 0x7fe204101eb0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37192/0 (socket says 172.21.15.81:37192) 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 -- 172.21.15.81:0/2653955707 learned_addr learned my addr 172.21.15.81:0/2653955707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe209982700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 0x7fe204196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 -- 172.21.15.81:0/2653955707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 msgr2=0x7fe204196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 0x7fe204196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 -- 172.21.15.81:0/2653955707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000095f0 con 0x7fe204100cb0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.261+0000 7fe20a183700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe20000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.262+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe20001d070 con 0x7fe204100cb0 2024-09-18T12:59:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.262+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe200005dc0 con 0x7fe204100cb0 2024-09-18T12:59:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.262+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20419bbb0 con 0x7fe204100cb0 2024-09-18T12:59:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.262+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe200022470 con 0x7fe204100cb0 2024-09-18T12:59:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.262+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20419c0a0 con 0x7fe204100cb0 2024-09-18T12:59:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.263+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe204109810 con 0x7fe204100cb0 2024-09-18T12:59:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.264+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe200003810 con 0x7fe204100cb0 2024-09-18T12:59:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.264+0000 7fe1fb7fe700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 0x7fe1f007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.264+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe20009f860 con 0x7fe204100cb0 2024-09-18T12:59:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.264+0000 7fe209982700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 0x7fe1f007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.265+0000 7fe209982700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 0x7fe1f007d7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009c60 tx=0x7fe1f4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.268+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe200062850 con 0x7fe204100cb0 2024-09-18T12:59:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.521+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe204109a00 con 0x7fe204100cb0 2024-09-18T12:59:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.522+0000 7fe1fb7fe700 1 -- 172.21.15.81:0/2653955707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1933 (secure 0 0 0) 0x7fe200065970 con 0x7fe204100cb0 2024-09-18T12:59:36.523 INFO:teuthology.orchestra.run.smithi081.stdout:e37 2024-09-18T12:59:36.523 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:59:27:949259+0000 2024-09-18T12:59:36.523 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 32 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:58:51.019444+0000 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T12:59:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 92 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24307} 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 1 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T12:59:36.525 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24307 members: 24307 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{0:24307} state up:active seq 153 join_fscid=1 addr [v2:172.21.15.136:6826/3787656045,v1:172.21.15.136:6827/3787656045] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{-1:34466} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:36.526 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 msgr2=0x7fe1f007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 0x7fe1f007d7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009c60 tx=0x7fe1f4009260 comp rx=0 tx=0).stop 2024-09-18T12:59:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 msgr2=0x7fe2041964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe20000f690 comp rx=0 tx=0).stop 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 shutdown_connections 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe1f007b310 0x7fe1f007d7d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe204100cb0 0x7fe2041964c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 --2- 172.21.15.81:0/2653955707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe204101eb0 0x7fe204196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 >> 172.21.15.81:0/2653955707 conn(0x7fe2040fc230 msgr2=0x7fe2041050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 shutdown_connections 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.524+0000 7fe20c3e7700 1 -- 172.21.15.81:0/2653955707 wait complete. 2024-09-18T12:59:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 37 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 -- 172.21.15.81:0/1513416272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93081040b0 msgr2=0x7f93081064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 --2- 172.21.15.81:0/1513416272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93081040b0 0x7f93081064a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009910 tx=0x7f92f0009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 -- 172.21.15.81:0/1513416272 shutdown_connections 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 --2- 172.21.15.81:0/1513416272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93081040b0 0x7f93081064a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 --2- 172.21.15.81:0/1513416272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9308101780 0x7f9308103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 -- 172.21.15.81:0/1513416272 >> 172.21.15.81:0/1513416272 conn(0x7f93080fb150 msgr2=0x7f93080fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 -- 172.21.15.81:0/1513416272 shutdown_connections 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.629+0000 7f930e527700 1 -- 172.21.15.81:0/1513416272 wait complete. 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 Processor -- start 2024-09-18T12:59:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 -- start start 2024-09-18T12:59:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 0x7f93081969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308196fe0 con 0x7f9308101780 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f930e527700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308197120 con 0x7f93081040b0 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37208/0 (socket says 172.21.15.81:37208) 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 -- 172.21.15.81:0/2761951985 learned_addr learned my addr 172.21.15.81:0/2761951985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f93077fe700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 0x7f93081969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 -- 172.21.15.81:0/2761951985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 msgr2=0x7f93081969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 0x7f93081969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f9307fff700 1 -- 172.21.15.81:0/2761951985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00095f0 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.630+0000 7f93077fe700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 0x7f93081969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f9307fff700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f92f800e920 tx=0x7f92f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f8009790 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92f800cba0 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930819bbd0 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f8018630 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.631+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930819c120 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.632+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308190630 con 0x7f9308101780 2024-09-18T12:59:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.632+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f92f800cd10 con 0x7f9308101780 2024-09-18T12:59:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.633+0000 7f93057fa700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 0x7f92f407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.633+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f92f8014070 con 0x7f9308101780 2024-09-18T12:59:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.633+0000 7f93077fe700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 0x7f92f407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.633+0000 7f93077fe700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 0x7f92f407d7d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92f0000c00 tx=0x7f92f0009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.637+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f92f8064dd0 con 0x7f9308101780 2024-09-18T12:59:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.865+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93080611d0 con 0x7f92f407b310 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.866+0000 7f93057fa700 1 -- 172.21.15.81:0/2761951985 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f93080611d0 con 0x7f92f407b310 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T12:59:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mon" 2024-09-18T12:59:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T12:59:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "15/23 daemons upgraded", 2024-09-18T12:59:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:59:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T12:59:36.869 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T12:59:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 msgr2=0x7f92f407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 0x7f92f407d7d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92f0000c00 tx=0x7f92f0009f70 comp rx=0 tx=0).stop 2024-09-18T12:59:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 msgr2=0x7f9308196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f92f800e920 tx=0x7f92f800ece0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 shutdown_connections 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f92f407b310 0x7f92f407d7d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9308101780 0x7f9308196480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 --2- 172.21.15.81:0/2761951985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93081040b0 0x7f93081969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 >> 172.21.15.81:0/2761951985 conn(0x7f93080fb150 msgr2=0x7f93080fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 shutdown_connections 2024-09-18T12:59:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.869+0000 7f930e527700 1 -- 172.21.15.81:0/2761951985 wait complete. 2024-09-18T12:59:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- 172.21.15.81:0/947536290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c104060 msgr2=0x7f395c106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 --2- 172.21.15.81:0/947536290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c104060 0x7f395c106450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3948009910 tx=0x7f3948009c20 comp rx=0 tx=0).stop 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- 172.21.15.81:0/947536290 shutdown_connections 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 --2- 172.21.15.81:0/947536290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c104060 0x7f395c106450 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 --2- 172.21.15.81:0/947536290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c101730 0x7f395c103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- 172.21.15.81:0/947536290 >> 172.21.15.81:0/947536290 conn(0x7f395c0fb120 msgr2=0x7f395c0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- 172.21.15.81:0/947536290 shutdown_connections 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- 172.21.15.81:0/947536290 wait complete. 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 Processor -- start 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- start start 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 0x7f395c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c199290 con 0x7f395c101730 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.974+0000 7f396318f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1993d0 con 0x7f395c104060 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37222/0 (socket says 172.21.15.81:37222) 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 -- 172.21.15.81:0/2926712282 learned_addr learned my addr 172.21.15.81:0/2926712282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f395bfff700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 0x7f395c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 -- 172.21.15.81:0/2926712282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 msgr2=0x7f395c198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 0x7f395c198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 -- 172.21.15.81:0/2926712282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39480095f0 con 0x7f395c101730 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f395bfff700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 0x7f395c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3960f2b700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f395000b4b0 tx=0x7f395000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950011800 con 0x7f395c101730 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3950011e10 con 0x7f395c101730 2024-09-18T12:59:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395000f2e0 con 0x7f395c101730 2024-09-18T12:59:36.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.975+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c19de30 con 0x7f395c101730 2024-09-18T12:59:36.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.976+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c19e2f0 con 0x7f395c101730 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.976+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c0fcd10 con 0x7f395c101730 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.977+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3950010380 con 0x7f395c101730 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.977+0000 7f3959ffb700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 0x7f394c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.978+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f395009dde0 con 0x7f395c101730 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.978+0000 7f395bfff700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 0x7f394c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.978+0000 7f395bfff700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 0x7f394c07d7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39480059d0 tx=0x7f3948005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:36.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:36.982+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3950060e50 con 0x7f395c101730 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: Upgrade: Updating mds.cephfs.smithi136.lwvlbo 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: Deploying daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: pgmap v228: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:37.037 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2187307046' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:37.038 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:37 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2653955707' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.278+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f395c02cc70 con 0x7f395c101730 2024-09-18T12:59:37.280 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.280 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: Upgrade: Updating mds.cephfs.smithi136.lwvlbo 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: Deploying daemon mds.cephfs.smithi136.lwvlbo on smithi136 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: pgmap v228: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2187307046' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:37.281 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2653955707' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.279+0000 7f3959ffb700 1 -- 172.21.15.81:0/2926712282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3950063f70 con 0x7f395c101730 2024-09-18T12:59:37.281 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 msgr2=0x7f394c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 0x7f394c07d7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39480059d0 tx=0x7f3948005920 comp rx=0 tx=0).stop 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 msgr2=0x7f395c198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f395000b4b0 tx=0x7f395000b870 comp rx=0 tx=0).stop 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 shutdown_connections 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f394c07b310 0x7f394c07d7d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c101730 0x7f395c198730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 --2- 172.21.15.81:0/2926712282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f395c104060 0x7f395c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 >> 172.21.15.81:0/2926712282 conn(0x7f395c0fb120 msgr2=0x7f395c0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 shutdown_connections 2024-09-18T12:59:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T12:59:37.281+0000 7f396318f700 1 -- 172.21.15.81:0/2926712282 wait complete. 2024-09-18T12:59:37.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:37 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[92541]: 2024-09-18T12:59:37.582+0000 7fd3a52f4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:59:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2926712282' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: osdmap e95: 6 total, 6 up, 6 in 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: Standby daemon mds.cephfs.smithi081.irimad assigned to filesystem cephfs as rank 0 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T12:59:38.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:38 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:replay} 2 up:standby 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2926712282' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: osdmap e95: 6 total, 6 up, 6 in 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: Standby daemon mds.cephfs.smithi081.irimad assigned to filesystem cephfs as rank 0 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T12:59:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:38 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:replay} 2 up:standby 2024-09-18T12:59:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:39 smithi081 ceph-mon[92545]: pgmap v230: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:39 smithi136 ceph-mon[80179]: pgmap v230: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:59:40.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:40 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:40 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:41 smithi136 ceph-mon[80179]: pgmap v231: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-18T12:59:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:41 smithi081 ceph-mon[92545]: pgmap v231: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-18T12:59:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:42 smithi081 ceph-mon[92545]: pgmap v232: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-09-18T12:59:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:42 smithi136 ceph-mon[80179]: pgmap v232: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-09-18T12:59:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:44 smithi081 ceph-mon[92545]: reconnect by client.24323 v1:172.21.15.81:0/2933002301 after 0.000999981 2024-09-18T12:59:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:44 smithi081 ceph-mon[92545]: reconnect by client.14598 v1:172.21.15.136:0/975665321 after 0.000999981 2024-09-18T12:59:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:44 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:reconnect 2024-09-18T12:59:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:44 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:reconnect} 2 up:standby 2024-09-18T12:59:44.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:44 smithi081 ceph-mon[92545]: pgmap v233: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-18T12:59:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:44 smithi136 ceph-mon[80179]: reconnect by client.24323 v1:172.21.15.81:0/2933002301 after 0.000999981 2024-09-18T12:59:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:44 smithi136 ceph-mon[80179]: reconnect by client.14598 v1:172.21.15.136:0/975665321 after 0.000999981 2024-09-18T12:59:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:44 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:reconnect 2024-09-18T12:59:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:44 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:reconnect} 2 up:standby 2024-09-18T12:59:44.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:44 smithi136 ceph-mon[80179]: pgmap v233: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-18T12:59:45.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:45 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:rejoin 2024-09-18T12:59:45.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:45 smithi136 ceph-mon[80179]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:rejoin} 2 up:standby 2024-09-18T12:59:45.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:45 smithi136 ceph-mon[80179]: daemon mds.cephfs.smithi081.irimad is now active in filesystem cephfs as rank 0 2024-09-18T12:59:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:45 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:rejoin 2024-09-18T12:59:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:45 smithi081 ceph-mon[92545]: fsmap cephfs:1/1 {0=cephfs.smithi081.irimad=up:rejoin} 2 up:standby 2024-09-18T12:59:45.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:45 smithi081 ceph-mon[92545]: daemon mds.cephfs.smithi081.irimad is now active in filesystem cephfs as rank 0 2024-09-18T12:59:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:46 smithi136 ceph-mon[80179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:59:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:46 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:59:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:46 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:active 2024-09-18T12:59:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:46 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2 up:standby 2024-09-18T12:59:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:46 smithi136 ceph-mon[80179]: pgmap v234: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-18T12:59:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:46 smithi081 ceph-mon[92545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:59:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:46 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:59:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:46 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] up:active 2024-09-18T12:59:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:46 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 2 up:standby 2024-09-18T12:59:46.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:46 smithi081 ceph-mon[92545]: pgmap v234: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] up:boot 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: pgmap v235: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 98 B/s wr, 7 op/s 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:49.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:48 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] up:boot 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "mds metadata", "who": "cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: pgmap v235: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 98 B/s wr, 7 op/s 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:49.243 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:49.244 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:48 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:50 smithi136 ceph-mon[80179]: pgmap v236: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T12:59:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:51.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:50 smithi081 ceph-mon[92545]: pgmap v236: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T12:59:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:51.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:52 smithi136 ceph-mon[80179]: pgmap v237: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T12:59:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:52.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:52 smithi081 ceph-mon[92545]: pgmap v237: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: pgmap v238: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.311 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.hmnvyn"}]': finished 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.irimad"}]': finished 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.lwvlbo"}]': finished 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.tfcykk"}]': finished 2024-09-18T12:59:55.312 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:55 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} : dispatch 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: pgmap v238: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.hmnvyn"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.hmnvyn"}]': finished 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.irimad"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.irimad"}]': finished 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.lwvlbo"} : dispatch 2024-09-18T12:59:55.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.lwvlbo"}]': finished 2024-09-18T12:59:55.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.tfcykk"} : dispatch 2024-09-18T12:59:55.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi136.tfcykk"}]': finished 2024-09-18T12:59:55.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:55 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} : dispatch 2024-09-18T12:59:56.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all mds 2024-09-18T12:59:56.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-18T12:59:56.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:59:56.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:59:56.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: daemon mds.cephfs.smithi081.hmnvyn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: Cluster is now healthy 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:starting} 2 up:standby 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: daemon mds.cephfs.smithi081.hmnvyn is now active in filesystem cephfs as rank 1 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all mds 2024-09-18T12:59:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-18T12:59:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: daemon mds.cephfs.smithi081.hmnvyn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: Cluster is now healthy 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: fsmap cephfs:1 {0=cephfs.smithi081.irimad=up:active} 3 up:standby 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:starting} 2 up:standby 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: daemon mds.cephfs.smithi081.hmnvyn is now active in filesystem cephfs as rank 1 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:56.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:56.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:57 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all rgw 2024-09-18T12:59:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:57 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:59:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:57 smithi081 ceph-mon[92545]: pgmap v239: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T12:59:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:57 smithi081 ceph-mon[92545]: mds.? [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] up:active 2024-09-18T12:59:57.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:57 smithi081 ceph-mon[92545]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:59:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:57 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all rgw 2024-09-18T12:59:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:57 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:59:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:57 smithi136 ceph-mon[80179]: pgmap v239: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T12:59:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:57 smithi136 ceph-mon[80179]: mds.? [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] up:active 2024-09-18T12:59:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:57 smithi136 ceph-mon[80179]: fsmap cephfs:2 {0=cephfs.smithi081.irimad=up:active,1=cephfs.smithi081.hmnvyn=up:active} 2 up:standby 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: Upgrade: Updating ceph-exporter.smithi081 (1/2) 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: Deploying daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:59:58.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 12:59:58 smithi081 ceph-mon[92545]: pgmap v240: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: Upgrade: Updating ceph-exporter.smithi081 (1/2) 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi081", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: Deploying daemon ceph-exporter.smithi081 on smithi081 2024-09-18T12:59:59.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 12:59:58 smithi136 ceph-mon[80179]: pgmap v240: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-18T13:00:00.236 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:00 smithi081 ceph-mon[92545]: pgmap v241: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-18T13:00:00.236 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:00 smithi081 ceph-mon[92545]: overall HEALTH_OK 2024-09-18T13:00:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:00 smithi136 ceph-mon[80179]: pgmap v241: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-18T13:00:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:00 smithi136 ceph-mon[80179]: overall HEALTH_OK 2024-09-18T13:00:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:02 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:03.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:02 smithi136 ceph-mon[80179]: pgmap v242: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T13:00:03.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:03.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:02 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:03.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:02 smithi081 ceph-mon[92545]: pgmap v242: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T13:00:04.302 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:03 smithi136 ceph-mon[80179]: Upgrade: Updating ceph-exporter.smithi136 (2/2) 2024-09-18T13:00:04.302 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:04.303 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:00:04.303 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:03 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:04.303 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:03 smithi136 ceph-mon[80179]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T13:00:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:03 smithi081 ceph-mon[92545]: Upgrade: Updating ceph-exporter.smithi136 (2/2) 2024-09-18T13:00:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi136", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:00:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:03 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:03 smithi081 ceph-mon[92545]: Deploying daemon ceph-exporter.smithi136 on smithi136 2024-09-18T13:00:05.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:04 smithi136 ceph-mon[80179]: pgmap v243: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:05.220 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:04 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:04 smithi081 ceph-mon[92545]: pgmap v243: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:04 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:07.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:06 smithi081 ceph-mon[92545]: pgmap v244: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:07.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:06 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:07.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:06 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:07.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:06 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:06 smithi136 ceph-mon[80179]: pgmap v244: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:06 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:06 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:06 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 -- 172.21.15.81:0/3232999621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4100cb0 msgr2=0x7feab41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 --2- 172.21.15.81:0/3232999621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4100cb0 0x7feab41010d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009910 tx=0x7feaa8009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 -- 172.21.15.81:0/3232999621 shutdown_connections 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 --2- 172.21.15.81:0/3232999621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4101eb0 0x7feab4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 --2- 172.21.15.81:0/3232999621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4100cb0 0x7feab41010d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 -- 172.21.15.81:0/3232999621 >> 172.21.15.81:0/3232999621 conn(0x7feab40fc230 msgr2=0x7feab40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 -- 172.21.15.81:0/3232999621 shutdown_connections 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.390+0000 7feab8d82700 1 -- 172.21.15.81:0/3232999621 wait complete. 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 Processor -- start 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 -- start start 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4100cb0 0x7feab41964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab4197020 con 0x7feab4101eb0 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab8d82700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab4197160 con 0x7feab4100cb0 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.391+0000 7feab1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59064/0 (socket says 172.21.15.81:59064) 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 -- 172.21.15.81:0/2666215330 learned_addr learned my addr 172.21.15.81:0/2666215330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab259c700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4100cb0 0x7feab41964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 -- 172.21.15.81:0/2666215330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4100cb0 msgr2=0x7feab41964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4100cb0 0x7feab41964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 -- 172.21.15.81:0/2666215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80095f0 con 0x7feab4101eb0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab1d9b700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c8a0 tx=0x7feaa400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa40078e0 con 0x7feab4101eb0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feaa400f450 con 0x7feab4101eb0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab419bc10 con 0x7feab4101eb0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa400e5e0 con 0x7feab4101eb0 2024-09-18T13:00:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.392+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab419c160 con 0x7feab4101eb0 2024-09-18T13:00:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.393+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab4109810 con 0x7feab4101eb0 2024-09-18T13:00:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.394+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7feaa400f5c0 con 0x7feab4101eb0 2024-09-18T13:00:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.395+0000 7feaa37fe700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 0x7fea9c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.395+0000 7feab259c700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 0x7fea9c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.395+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7feaa409e230 con 0x7feab4101eb0 2024-09-18T13:00:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.395+0000 7feab259c700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 0x7fea9c07d7d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.399+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7feaa4061250 con 0x7feab4101eb0 2024-09-18T13:00:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.653+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feab4106800 con 0x7fea9c07b310 2024-09-18T13:00:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.654+0000 7feaa37fe700 1 -- 172.21.15.81:0/2666215330 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7feab4106800 con 0x7fea9c07b310 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 msgr2=0x7fea9c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 0x7fea9c07d7d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa800b540 comp rx=0 tx=0).stop 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 msgr2=0x7feab4196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c8a0 tx=0x7feaa400cbb0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 shutdown_connections 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fea9c07b310 0x7fea9c07d7d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab4100cb0 0x7feab41964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 --2- 172.21.15.81:0/2666215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4101eb0 0x7feab4196a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 >> 172.21.15.81:0/2666215330 conn(0x7feab40fc230 msgr2=0x7feab41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 shutdown_connections 2024-09-18T13:00:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.657+0000 7feab8d82700 1 -- 172.21.15.81:0/2666215330 wait complete. 2024-09-18T13:00:07.670 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T13:00:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/1963795292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 msgr2=0x7ff9e0101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/1963795292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e0101220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009910 tx=0x7ff9d4009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/1963795292 shutdown_connections 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/1963795292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e0101220 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/1963795292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 0x7ff9e00fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/1963795292 >> 172.21.15.81:0/1963795292 conn(0x7ff9e00fb160 msgr2=0x7ff9e00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/1963795292 shutdown_connections 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/1963795292 wait complete. 2024-09-18T13:00:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.774+0000 7ff9e5bc1700 1 Processor -- start 2024-09-18T13:00:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9e5bc1700 1 -- start start 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9e5bc1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 0x7ff9e0103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9e5bc1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9e5bc1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01026e0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9e5bc1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0102820 con 0x7ff9e00ffbc0 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59086/0 (socket says 172.21.15.81:59086) 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 -- 172.21.15.81:0/3347331614 learned_addr learned my addr 172.21.15.81:0/3347331614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9df7fe700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 0x7ff9e0103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 -- 172.21.15.81:0/3347331614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 msgr2=0x7ff9e0103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 0x7ff9e0103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 -- 172.21.15.81:0/3347331614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40095f0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.775+0000 7ff9deffd700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4000c00 tx=0x7ff9d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.776+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d401d070 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.776+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9d4005dc0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.776+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d40226a0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.776+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e0102aa0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.776+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e0102f90 con 0x7ff9e0100dc0 2024-09-18T13:00:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.777+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e0068af0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.777+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff9d40038f0 con 0x7ff9e0100dc0 2024-09-18T13:00:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.778+0000 7ff9dcff9700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 0x7ff9c807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.778+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff9d409f760 con 0x7ff9e0100dc0 2024-09-18T13:00:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.778+0000 7ff9df7fe700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 0x7ff9c807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.778+0000 7ff9df7fe700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 0x7ff9c807d7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0100c20 tx=0x7ff9d0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:07.782+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff9d4062780 con 0x7ff9e0100dc0 2024-09-18T13:00:08.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.015+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e0069560 con 0x7ff9c807b310 2024-09-18T13:00:08.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.017+0000 7ff9dcff9700 1 -- 172.21.15.81:0/3347331614 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ff9e0069560 con 0x7ff9c807b310 2024-09-18T13:00:08.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 msgr2=0x7ff9c807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 0x7ff9c807d7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0100c20 tx=0x7ff9d0009260 comp rx=0 tx=0).stop 2024-09-18T13:00:08.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 msgr2=0x7ff9e01021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4000c00 tx=0x7ff9d400f690 comp rx=0 tx=0).stop 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 shutdown_connections 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff9c807b310 0x7ff9c807d7d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9e00ffbc0 0x7ff9e0103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 --2- 172.21.15.81:0/3347331614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e0100dc0 0x7ff9e01021a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 >> 172.21.15.81:0/3347331614 conn(0x7ff9e00fb160 msgr2=0x7ff9e0068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 shutdown_connections 2024-09-18T13:00:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.019+0000 7ff9e5bc1700 1 -- 172.21.15.81:0/3347331614 wait complete. 2024-09-18T13:00:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.124+0000 7f5bbe69e700 1 -- 172.21.15.81:0/352374674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 msgr2=0x7f5bb8106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.124+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/352374674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8106470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009910 tx=0x7f5ba8009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 -- 172.21.15.81:0/352374674 shutdown_connections 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/352374674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8106470 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/352374674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 0x7f5bb8103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 -- 172.21.15.81:0/352374674 >> 172.21.15.81:0/352374674 conn(0x7f5bb80fb160 msgr2=0x7f5bb80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 -- 172.21.15.81:0/352374674 shutdown_connections 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 -- 172.21.15.81:0/352374674 wait complete. 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 Processor -- start 2024-09-18T13:00:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.125+0000 7f5bbe69e700 1 -- start start 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bbe69e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 0x7f5bb81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bbe69e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bbe69e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8197300 con 0x7f5bb8104080 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bbe69e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8197440 con 0x7f5bb8101750 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59108/0 (socket says 172.21.15.81:59108) 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 -- 172.21.15.81:0/602781275 learned_addr learned my addr 172.21.15.81:0/602781275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb7fff700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 0x7f5bb81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 -- 172.21.15.81:0/602781275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 msgr2=0x7f5bb81967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 0x7f5bb81967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 -- 172.21.15.81:0/602781275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80095f0 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb77fe700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000c00 tx=0x7f5ba800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba801d070 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ba8005dc0 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb819be90 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.126+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba80226a0 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.127+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb819c350 con 0x7f5bb8104080 2024-09-18T13:00:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.128+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb8190630 con 0x7f5bb8104080 2024-09-18T13:00:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.128+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5ba80038f0 con 0x7f5bb8104080 2024-09-18T13:00:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.129+0000 7f5bb57fa700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 0x7f5ba007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.129+0000 7f5bb7fff700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 0x7f5ba007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.129+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f5ba809f870 con 0x7f5bb8104080 2024-09-18T13:00:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.129+0000 7f5bb7fff700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 0x7f5ba007d7d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009c60 tx=0x7f5bac009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.133+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5ba8062810 con 0x7f5bb8104080 2024-09-18T13:00:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.358+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bb80611d0 con 0x7f5ba007b310 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.367+0000 7f5bb57fa700 1 -- 172.21.15.81:0/602781275 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5bb80611d0 con 0x7f5ba007b310 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (15m) 51s ago 17m 25.5M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 starting - - - - 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 starting - - - - 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (5m) 51s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (5m) 17s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (15m) 51s ago 17m 84.3M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (57s) 51s ago 11m 11.8M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T13:00:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (76s) 51s ago 11m 12.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (20s) 17s ago 11m 15.4M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 465fbfb22e85 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (41s) 17s ago 11m 15.4M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (8m) 51s ago 19m 520M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (6m) 17s ago 16m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (6m) 51s ago 19m 54.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (6m) 17s ago 16m 42.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (17m) 51s ago 17m 16.1M - 1.5.0 0da6a335fe13 97dc1e39c370 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (16m) 17s ago 16m 14.9M - 1.5.0 0da6a335fe13 e3a8cd6c25c3 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 51s ago 15m 111M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 51s ago 14m 205M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 51s ago 14m 99.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (3m) 17s ago 13m 129M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T13:00:08.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (2m) 17s ago 13m 99.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T13:00:08.371 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (2m) 17s ago 12m 98.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T13:00:08.371 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 51s ago 17m 77.3M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T13:00:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 msgr2=0x7f5ba007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 0x7f5ba007d7d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009c60 tx=0x7f5bac009260 comp rx=0 tx=0).stop 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 msgr2=0x7f5bb8196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000c00 tx=0x7f5ba800f690 comp rx=0 tx=0).stop 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 shutdown_connections 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5ba007b310 0x7f5ba007d7d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb8101750 0x7f5bb81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 --2- 172.21.15.81:0/602781275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb8104080 0x7f5bb8196ce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 >> 172.21.15.81:0/602781275 conn(0x7f5bb80fb160 msgr2=0x7f5bb80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 shutdown_connections 2024-09-18T13:00:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.370+0000 7f5bbe69e700 1 -- 172.21.15.81:0/602781275 wait complete. 2024-09-18T13:00:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 -- 172.21.15.81:0/2968674633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 msgr2=0x7f9778100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 --2- 172.21.15.81:0/2968674633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778100980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9764009910 tx=0x7f9764009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 -- 172.21.15.81:0/2968674633 shutdown_connections 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 --2- 172.21.15.81:0/2968674633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778100980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 --2- 172.21.15.81:0/2968674633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 0x7f97780ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 -- 172.21.15.81:0/2968674633 >> 172.21.15.81:0/2968674633 conn(0x7f97780fa8c0 msgr2=0x7f97780fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 -- 172.21.15.81:0/2968674633 shutdown_connections 2024-09-18T13:00:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.477+0000 7f977f04c700 1 -- 172.21.15.81:0/2968674633 wait complete. 2024-09-18T13:00:08.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 Processor -- start 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 -- start start 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 0x7f97781986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778199230 con 0x7f9778100520 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977f04c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778199370 con 0x7f97780ff320 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f9777fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f9777fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59130/0 (socket says 172.21.15.81:59130) 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f9777fff700 1 -- 172.21.15.81:0/2252659619 learned_addr learned my addr 172.21.15.81:0/2252659619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.478+0000 7f977cde8700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 0x7f97781986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9777fff700 1 -- 172.21.15.81:0/2252659619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 msgr2=0x7f97781986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9777fff700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 0x7f97781986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9777fff700 1 -- 172.21.15.81:0/2252659619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640095f0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9777fff700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9764000c00 tx=0x7f976400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976401d070 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977819ddc0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9764005dc0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.479+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97640226a0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.480+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977819e2b0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.481+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97781075f0 con 0x7f9778100520 2024-09-18T13:00:08.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.481+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f976400faf0 con 0x7f9778100520 2024-09-18T13:00:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.482+0000 7f9775ffb700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 0x7f976807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.482+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f976409f790 con 0x7f9778100520 2024-09-18T13:00:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.482+0000 7f977cde8700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 0x7f976807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.483+0000 7f977cde8700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 0x7f976807d7d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9778100380 tx=0x7f976c00f040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.487+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f97640627b0 con 0x7f9778100520 2024-09-18T13:00:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.807+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97781077e0 con 0x7f9778100520 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.808+0000 7f9775ffb700 1 -- 172.21.15.81:0/2252659619 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f97640658d0 con 0x7f9778100520 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T13:00:08.810 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 msgr2=0x7f976807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 0x7f976807d7d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9778100380 tx=0x7f976c00f040 comp rx=0 tx=0).stop 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 msgr2=0x7f9778198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9764000c00 tx=0x7f976400f690 comp rx=0 tx=0).stop 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 shutdown_connections 2024-09-18T13:00:08.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f976807b310 0x7f976807d7d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97780ff320 0x7f97781986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 --2- 172.21.15.81:0/2252659619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9778100520 0x7f9778198c10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 >> 172.21.15.81:0/2252659619 conn(0x7f97780fa8c0 msgr2=0x7f9778103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 shutdown_connections 2024-09-18T13:00:08.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.810+0000 7f977f04c700 1 -- 172.21.15.81:0/2252659619 wait complete. 2024-09-18T13:00:08.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 -- 172.21.15.81:0/264554777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb4100dc0 msgr2=0x7f7cb4101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/264554777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4101220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009910 tx=0x7f7ca8009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 -- 172.21.15.81:0/264554777 shutdown_connections 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/264554777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4101220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/264554777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb40fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 -- 172.21.15.81:0/264554777 >> 172.21.15.81:0/264554777 conn(0x7f7cb40fb160 msgr2=0x7f7cb40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 -- 172.21.15.81:0/264554777 shutdown_connections 2024-09-18T13:00:08.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.916+0000 7f7cb8e76700 1 -- 172.21.15.81:0/264554777 wait complete. 2024-09-18T13:00:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 Processor -- start 2024-09-18T13:00:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 -- start start 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4197330 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb8e76700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4197470 con 0x7f7cb4100dc0 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59144/0 (socket says 172.21.15.81:59144) 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb259c700 1 -- 172.21.15.81:0/2477584642 learned_addr learned my addr 172.21.15.81:0/2477584642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.917+0000 7f7cb1d9b700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb259c700 1 -- 172.21.15.81:0/2477584642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb4100dc0 msgr2=0x7f7cb4196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb259c700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb259c700 1 -- 172.21.15.81:0/2477584642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80095f0 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb259c700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400d900 tx=0x7f7ca400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca40041f0 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb419bf20 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb419c3e0 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ca4004350 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.918+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca4003d20 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.919+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94005320 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.920+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f7ca4009730 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.920+0000 7f7ca37fe700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 0x7f7c9c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.920+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f7ca409e1d0 con 0x7f7cb40ffbc0 2024-09-18T13:00:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.920+0000 7f7cb1d9b700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 0x7f7c9c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.921+0000 7f7cb1d9b700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 0x7f7c9c07d7d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006010 tx=0x7f7ca800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:08.924+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f7ca40611f0 con 0x7f7cb40ffbc0 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: pgmap v245: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:09.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:08 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2252659619' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.184+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7c94006200 con 0x7f7cb40ffbc0 2024-09-18T13:00:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.185+0000 7f7ca37fe700 1 -- 172.21.15.81:0/2477584642 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1991 (secure 0 0 0) 0x7f7ca4003e80 con 0x7f7cb40ffbc0 2024-09-18T13:00:09.186 INFO:teuthology.orchestra.run.smithi081.stdout:e46 2024-09-18T13:00:09.186 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:59:56:556179+0000 2024-09-18T13:00:09.186 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 46 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:59:56.556173+0000 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T13:00:09.187 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 95 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34434,1=34466} 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T13:00:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34434 members: 34434,34466 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:34466} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T13:00:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:09.190 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:09.190 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:09.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 msgr2=0x7f7c9c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 0x7f7c9c07d7d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006010 tx=0x7f7ca800b540 comp rx=0 tx=0).stop 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 msgr2=0x7f7cb41967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400d900 tx=0x7f7ca400dc10 comp rx=0 tx=0).stop 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 shutdown_connections 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f7c9c07b310 0x7f7c9c07d7d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb40ffbc0 0x7f7cb41967d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 --2- 172.21.15.81:0/2477584642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb4100dc0 0x7f7cb4196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 >> 172.21.15.81:0/2477584642 conn(0x7f7cb40fb160 msgr2=0x7f7cb4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 shutdown_connections 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.187+0000 7f7cb8e76700 1 -- 172.21.15.81:0/2477584642 wait complete. 2024-09-18T13:00:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: pgmap v245: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:08 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2252659619' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 -- 172.21.15.81:0/1925357877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 msgr2=0x7f9e7c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 --2- 172.21.15.81:0/1925357877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c101220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009910 tx=0x7f9e70009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 -- 172.21.15.81:0/1925357877 shutdown_connections 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 --2- 172.21.15.81:0/1925357877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c101220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 --2- 172.21.15.81:0/1925357877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 0x7f9e7c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 -- 172.21.15.81:0/1925357877 >> 172.21.15.81:0/1925357877 conn(0x7f9e7c0fb160 msgr2=0x7f9e7c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 -- 172.21.15.81:0/1925357877 shutdown_connections 2024-09-18T13:00:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.319+0000 7f9e8089a700 1 -- 172.21.15.81:0/1925357877 wait complete. 2024-09-18T13:00:09.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 Processor -- start 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 -- start start 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 0x7f9e7c1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c197330 con 0x7f9e7c100dc0 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e8089a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c197470 con 0x7f9e7c0ffbc0 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e79d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e79d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59162/0 (socket says 172.21.15.81:59162) 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e79d9b700 1 -- 172.21.15.81:0/641259017 learned_addr learned my addr 172.21.15.81:0/641259017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.320+0000 7f9e7a59c700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 0x7f9e7c1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e79d9b700 1 -- 172.21.15.81:0/641259017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 msgr2=0x7f9e7c1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e79d9b700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 0x7f9e7c1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e79d9b700 1 -- 172.21.15.81:0/641259017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700095f0 con 0x7f9e7c100dc0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e79d9b700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006010 tx=0x7f9e7000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e7001d070 con 0x7f9e7c100dc0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c19bec0 con 0x7f9e7c100dc0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e7000f460 con 0x7f9e7c100dc0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e70021640 con 0x7f9e7c100dc0 2024-09-18T13:00:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.321+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c19c380 con 0x7f9e7c100dc0 2024-09-18T13:00:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.322+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c068af0 con 0x7f9e7c100dc0 2024-09-18T13:00:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.323+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9e7000fab0 con 0x7f9e7c100dc0 2024-09-18T13:00:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.323+0000 7f9e6b7fe700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 0x7f9e6407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.324+0000 7f9e7a59c700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 0x7f9e6407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.324+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f9e7009f520 con 0x7f9e7c100dc0 2024-09-18T13:00:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.324+0000 7f9e7a59c700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 0x7f9e6407d7d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c100c20 tx=0x7f9e6c007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.329+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9e70062540 con 0x7f9e7c100dc0 2024-09-18T13:00:09.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.594+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e7c069560 con 0x7f9e6407b310 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.596+0000 7f9e6b7fe700 1 -- 172.21.15.81:0/641259017 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f9e7c069560 con 0x7f9e6407b310 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-09-18T13:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "osd" 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "17/23 daemons upgraded", 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T13:00:09.598 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:00:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 msgr2=0x7f9e6407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 0x7f9e6407d7d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c100c20 tx=0x7f9e6c007400 comp rx=0 tx=0).stop 2024-09-18T13:00:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 msgr2=0x7f9e7c196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006010 tx=0x7f9e7000bd70 comp rx=0 tx=0).stop 2024-09-18T13:00:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 shutdown_connections 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9e6407b310 0x7f9e6407d7d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e7c0ffbc0 0x7f9e7c1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 --2- 172.21.15.81:0/641259017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c100dc0 0x7f9e7c196d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 >> 172.21.15.81:0/641259017 conn(0x7f9e7c0fb160 msgr2=0x7f9e7c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 shutdown_connections 2024-09-18T13:00:09.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.599+0000 7f9e8089a700 1 -- 172.21.15.81:0/641259017 wait complete. 2024-09-18T13:00:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 -- 172.21.15.81:0/4020286329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a381000c0 msgr2=0x7f9a381004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 --2- 172.21.15.81:0/4020286329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a381000c0 0x7f9a381004e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009910 tx=0x7f9a28009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 -- 172.21.15.81:0/4020286329 shutdown_connections 2024-09-18T13:00:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 --2- 172.21.15.81:0/4020286329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a38100de0 0x7f9a38101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 --2- 172.21.15.81:0/4020286329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a381000c0 0x7f9a381004e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.711+0000 7f9a3e392700 1 -- 172.21.15.81:0/4020286329 >> 172.21.15.81:0/4020286329 conn(0x7f9a380fa8c0 msgr2=0x7f9a380fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.712+0000 7f9a3e392700 1 -- 172.21.15.81:0/4020286329 shutdown_connections 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.712+0000 7f9a3e392700 1 -- 172.21.15.81:0/4020286329 wait complete. 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.712+0000 7f9a3e392700 1 Processor -- start 2024-09-18T13:00:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.712+0000 7f9a3e392700 1 -- start start 2024-09-18T13:00:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a3e392700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 0x7f9a380ff780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a3e392700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a3e392700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3819b830 con 0x7f9a38100de0 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a3e392700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3819b970 con 0x7f9a381000c0 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59182/0 (socket says 172.21.15.81:59182) 2024-09-18T13:00:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 -- 172.21.15.81:0/1350066734 learned_addr learned my addr 172.21.15.81:0/1350066734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a37fff700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 0x7f9a380ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 -- 172.21.15.81:0/1350066734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 msgr2=0x7f9a380ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 0x7f9a380ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 -- 172.21.15.81:0/1350066734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280095f0 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a37fff700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 0x7f9a380ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a377fe700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00e8f0 tx=0x7f9a2c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c009790 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.713+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3819bc50 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.714+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3819c1a0 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.714+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a2c00c810 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.714+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c003d20 con 0x7f9a38100de0 2024-09-18T13:00:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.715+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24005320 con 0x7f9a38100de0 2024-09-18T13:00:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.715+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9a2c018430 con 0x7f9a38100de0 2024-09-18T13:00:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.716+0000 7f9a357fa700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 0x7f9a2007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.716+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f9a2c014070 con 0x7f9a38100de0 2024-09-18T13:00:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.716+0000 7f9a37fff700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 0x7f9a2007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.717+0000 7f9a37fff700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 0x7f9a2007d7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009fd0 tx=0x7f9a28005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:09.721+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f9a2c061550 con 0x7f9a38100de0 2024-09-18T13:00:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.039+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9a24005190 con 0x7f9a38100de0 2024-09-18T13:00:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.039+0000 7f9a357fa700 1 -- 172.21.15.81:0/1350066734 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9a2c064670 con 0x7f9a38100de0 2024-09-18T13:00:10.041 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 msgr2=0x7f9a2007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 0x7f9a2007d7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009fd0 tx=0x7f9a28005a90 comp rx=0 tx=0).stop 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 msgr2=0x7f9a3819b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00e8f0 tx=0x7f9a2c00ec00 comp rx=0 tx=0).stop 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 shutdown_connections 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f9a2007b310 0x7f9a2007d7d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a381000c0 0x7f9a380ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 --2- 172.21.15.81:0/1350066734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38100de0 0x7f9a3819b260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 >> 172.21.15.81:0/1350066734 conn(0x7f9a380fa8c0 msgr2=0x7f9a38104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 shutdown_connections 2024-09-18T13:00:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:10.042+0000 7f9a3e392700 1 -- 172.21.15.81:0/1350066734 wait complete. 2024-09-18T13:00:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:09 smithi136 ceph-mon[80179]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:09 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:10.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:09 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2477584642' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:10.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:09 smithi081 ceph-mon[92545]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:10.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:10.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:09 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:10.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:09 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2477584642' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:11.120 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:10 smithi136 ceph-mon[80179]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:11.120 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:10 smithi136 ceph-mon[80179]: pgmap v246: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-18T13:00:11.120 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:10 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1350066734' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:10 smithi081 ceph-mon[92545]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:10 smithi081 ceph-mon[92545]: pgmap v246: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-18T13:00:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:10 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1350066734' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:12.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.094 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:12 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:12.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:12 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:13.251 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:13 smithi081 ceph-mon[92545]: pgmap v247: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-18T13:00:13.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:13.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:13 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:13 smithi136 ceph-mon[80179]: pgmap v247: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-18T13:00:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:13 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: pgmap v248: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.268 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi081"} : dispatch 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi081"}]': finished 2024-09-18T13:00:15.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi136"} : dispatch 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi136"}]': finished 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: pgmap v248: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi081"} : dispatch 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi081"}]': finished 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi136"} : dispatch 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi136"}]': finished 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:15.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:16 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:00:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:16 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:00:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:16 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all nfs 2024-09-18T13:00:16.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:16 smithi136 ceph-mon[80179]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:00:16.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:16 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:00:16.331 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:16 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:00:16.331 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:16 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all nfs 2024-09-18T13:00:16.331 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:16 smithi081 ceph-mon[92545]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:00:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:17 smithi136 ceph-mon[80179]: pgmap v249: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:17.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:17 smithi081 ceph-mon[92545]: pgmap v249: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:18.294 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:18 smithi136 ceph-mon[80179]: Upgrade: Updating node-exporter.smithi081 (1/2) 2024-09-18T13:00:18.294 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:18 smithi136 ceph-mon[80179]: Deploying daemon node-exporter.smithi081 on smithi081 2024-09-18T13:00:18.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:18 smithi081 ceph-mon[92545]: Upgrade: Updating node-exporter.smithi081 (1/2) 2024-09-18T13:00:18.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:18 smithi081 ceph-mon[92545]: Deploying daemon node-exporter.smithi081 on smithi081 2024-09-18T13:00:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:19 smithi136 ceph-mon[80179]: pgmap v250: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:19.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:19 smithi081 ceph-mon[92545]: pgmap v250: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:20 smithi136 ceph-mon[80179]: pgmap v251: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:20 smithi081 ceph-mon[92545]: pgmap v251: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:22.246 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:22.246 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:21 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:22.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:21 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:22 smithi136 ceph-mon[80179]: pgmap v252: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:23.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:22 smithi081 ceph-mon[92545]: pgmap v252: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:24.181 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:23 smithi136 ceph-mon[80179]: Upgrade: Updating node-exporter.smithi136 (2/2) 2024-09-18T13:00:24.181 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:23 smithi136 ceph-mon[80179]: Deploying daemon node-exporter.smithi136 on smithi136 2024-09-18T13:00:24.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:23 smithi081 ceph-mon[92545]: Upgrade: Updating node-exporter.smithi136 (2/2) 2024-09-18T13:00:24.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:23 smithi081 ceph-mon[92545]: Deploying daemon node-exporter.smithi136 on smithi136 2024-09-18T13:00:25.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:24 smithi136 ceph-mon[80179]: pgmap v253: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:25.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:24 smithi081 ceph-mon[92545]: pgmap v253: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:27 smithi136 ceph-mon[80179]: pgmap v254: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:27 smithi081 ceph-mon[92545]: pgmap v254: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:28.400 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:28.400 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:28.400 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:28 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:28.400 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:28 smithi136 ceph-mon[80179]: pgmap v255: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:28.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:28.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:28.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:28 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:28.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:28 smithi081 ceph-mon[92545]: pgmap v255: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:30.546 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.546 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.547 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.547 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:30 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.547 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:30 smithi136 ceph-mon[80179]: pgmap v256: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:30 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:30.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:30 smithi081 ceph-mon[92545]: pgmap v256: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:32.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:32 smithi081 ceph-mon[92545]: pgmap v257: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:32.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.877 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.877 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.877 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:32 smithi136 ceph-mon[80179]: pgmap v257: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:32.877 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:32.877 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:34.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:34.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:33 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:33 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:34 smithi081 ceph-mon[92545]: pgmap v258: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:35.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:34 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:34 smithi136 ceph-mon[80179]: pgmap v258: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:34 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:36.894 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.895 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:36.896 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:36 smithi136 ceph-mon[80179]: pgmap v259: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:37.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:37.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:36 smithi081 ceph-mon[92545]: pgmap v259: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:39 smithi081 ceph-mon[92545]: Upgrade: Updating prometheus.smithi081 2024-09-18T13:00:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:39 smithi081 ceph-mon[92545]: Deploying daemon prometheus.smithi081 on smithi081 2024-09-18T13:00:39.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:39 smithi081 ceph-mon[92545]: pgmap v260: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:39 smithi136 ceph-mon[80179]: Upgrade: Updating prometheus.smithi081 2024-09-18T13:00:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:39 smithi136 ceph-mon[80179]: Deploying daemon prometheus.smithi081 on smithi081 2024-09-18T13:00:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:39 smithi136 ceph-mon[80179]: pgmap v260: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.157+0000 7fb401f5d700 1 -- 172.21.15.81:0/897495121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 msgr2=0x7fb3fc1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.157+0000 7fb401f5d700 1 --2- 172.21.15.81:0/897495121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc1026b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009910 tx=0x7fb3f0009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 -- 172.21.15.81:0/897495121 shutdown_connections 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 --2- 172.21.15.81:0/897495121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 0x7fb3fc0ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 --2- 172.21.15.81:0/897495121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc1026b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 -- 172.21.15.81:0/897495121 >> 172.21.15.81:0/897495121 conn(0x7fb3fc0fa8b0 msgr2=0x7fb3fc0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 -- 172.21.15.81:0/897495121 shutdown_connections 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 -- 172.21.15.81:0/897495121 wait complete. 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 Processor -- start 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 -- start start 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.158+0000 7fb401f5d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 0x7fb3fc196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb401f5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb401f5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1971a0 con 0x7fb3fc102290 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb401f5d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1972e0 con 0x7fb3fc0fed10 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59494/0 (socket says 172.21.15.81:59494) 2024-09-18T13:00:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 -- 172.21.15.81:0/3302923057 learned_addr learned my addr 172.21.15.81:0/3302923057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3fb7fe700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 0x7fb3fc196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 -- 172.21.15.81:0/3302923057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 msgr2=0x7fb3fc196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 0x7fb3fc196640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 -- 172.21.15.81:0/3302923057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00095f0 con 0x7fb3fc102290 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3faffd700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00b4b0 tx=0x7fb3ec00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3ec011800 con 0x7fb3fc102290 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb3ec011e10 con 0x7fb3fc102290 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc19bd90 con 0x7fb3fc102290 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3ec00f2e0 con 0x7fb3fc102290 2024-09-18T13:00:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.159+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc19c2b0 con 0x7fb3fc102290 2024-09-18T13:00:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.160+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3fc1098a0 con 0x7fb3fc102290 2024-09-18T13:00:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.161+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fb3ec010380 con 0x7fb3fc102290 2024-09-18T13:00:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.161+0000 7fb3f8ff9700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 0x7fb3e407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.162+0000 7fb3fb7fe700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 0x7fb3e407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.162+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fb3ec09de20 con 0x7fb3fc102290 2024-09-18T13:00:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.162+0000 7fb3fb7fe700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 0x7fb3e407d7d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0006010 tx=0x7fb3f000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.166+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fb3ec060dc0 con 0x7fb3fc102290 2024-09-18T13:00:40.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.399+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3fc106980 con 0x7fb3e407b310 2024-09-18T13:00:40.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.400+0000 7fb3f8ff9700 1 -- 172.21.15.81:0/3302923057 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fb3fc106980 con 0x7fb3e407b310 2024-09-18T13:00:40.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 msgr2=0x7fb3e407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 0x7fb3e407d7d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0006010 tx=0x7fb3f000b540 comp rx=0 tx=0).stop 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 msgr2=0x7fb3fc196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00b4b0 tx=0x7fb3ec00b7c0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 shutdown_connections 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fb3e407b310 0x7fb3e407d7d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3fc0fed10 0x7fb3fc196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 --2- 172.21.15.81:0/3302923057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3fc102290 0x7fb3fc196b80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 >> 172.21.15.81:0/3302923057 conn(0x7fb3fc0fa8b0 msgr2=0x7fb3fc105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 shutdown_connections 2024-09-18T13:00:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.402+0000 7fb401f5d700 1 -- 172.21.15.81:0/3302923057 wait complete. 2024-09-18T13:00:40.413 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T13:00:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 -- 172.21.15.81:0/800616351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 msgr2=0x7ff8c8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/800616351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c8102310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009910 tx=0x7ff8b0009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 -- 172.21.15.81:0/800616351 shutdown_connections 2024-09-18T13:00:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/800616351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c8102310 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/800616351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 0x7ff8c81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 -- 172.21.15.81:0/800616351 >> 172.21.15.81:0/800616351 conn(0x7ff8c80fc230 msgr2=0x7ff8c80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 -- 172.21.15.81:0/800616351 shutdown_connections 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 -- 172.21.15.81:0/800616351 wait complete. 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.508+0000 7ff8ccde6700 1 Processor -- start 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 -- start start 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 0x7ff8c81964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8197010 con 0x7ff8c8101eb0 2024-09-18T13:00:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8197150 con 0x7ff8c8100cb0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59516/0 (socket says 172.21.15.81:59516) 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 -- 172.21.15.81:0/1208452523 learned_addr learned my addr 172.21.15.81:0/1208452523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c659c700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 0x7ff8c81964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 -- 172.21.15.81:0/1208452523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 msgr2=0x7ff8c81964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 0x7ff8c81964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 -- 172.21.15.81:0/1208452523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00095f0 con 0x7ff8c8101eb0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8c5d9b700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0006010 tx=0x7ff8b000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8b001d070 con 0x7ff8c8101eb0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8b000f460 con 0x7ff8c8101eb0 2024-09-18T13:00:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.509+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c819bba0 con 0x7ff8c8101eb0 2024-09-18T13:00:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.510+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8b0021640 con 0x7ff8c8101eb0 2024-09-18T13:00:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.510+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c819c090 con 0x7ff8c8101eb0 2024-09-18T13:00:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.511+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c8109810 con 0x7ff8c8101eb0 2024-09-18T13:00:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.511+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff8b000fab0 con 0x7ff8c8101eb0 2024-09-18T13:00:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.512+0000 7ff8bf7fe700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 0x7ff8b407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.512+0000 7ff8c659c700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 0x7ff8b407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.512+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff8b009f520 con 0x7ff8c8101eb0 2024-09-18T13:00:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.512+0000 7ff8c659c700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 0x7ff8b407d7d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8101d10 tx=0x7ff8b800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.516+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff8b0062540 con 0x7ff8c8101eb0 2024-09-18T13:00:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.753+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8c8106800 con 0x7ff8b407b310 2024-09-18T13:00:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.755+0000 7ff8bf7fe700 1 -- 172.21.15.81:0/1208452523 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7ff8c8106800 con 0x7ff8b407b310 2024-09-18T13:00:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 msgr2=0x7ff8b407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 0x7ff8b407d7d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8101d10 tx=0x7ff8b800b410 comp rx=0 tx=0).stop 2024-09-18T13:00:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 msgr2=0x7ff8c81969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0006010 tx=0x7ff8b000bd70 comp rx=0 tx=0).stop 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 shutdown_connections 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff8b407b310 0x7ff8b407d7d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8c8100cb0 0x7ff8c81964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 --2- 172.21.15.81:0/1208452523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c8101eb0 0x7ff8c81969f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 >> 172.21.15.81:0/1208452523 conn(0x7ff8c80fc230 msgr2=0x7ff8c81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 shutdown_connections 2024-09-18T13:00:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.757+0000 7ff8ccde6700 1 -- 172.21.15.81:0/1208452523 wait complete. 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- 172.21.15.81:0/1937556949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 msgr2=0x7f92b00ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 --2- 172.21.15.81:0/1937556949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b00ff740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00aa20 tx=0x7f92ac00ad30 comp rx=0 tx=0).stop 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- 172.21.15.81:0/1937556949 shutdown_connections 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 --2- 172.21.15.81:0/1937556949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 --2- 172.21.15.81:0/1937556949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b00ff740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- 172.21.15.81:0/1937556949 >> 172.21.15.81:0/1937556949 conn(0x7f92b00fa8c0 msgr2=0x7f92b00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:40.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- 172.21.15.81:0/1937556949 shutdown_connections 2024-09-18T13:00:40.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- 172.21.15.81:0/1937556949 wait complete. 2024-09-18T13:00:40.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 Processor -- start 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.861+0000 7f92b797d700 1 -- start start 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b797d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b797d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b797d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0197040 con 0x7f92b00ff320 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b797d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0197180 con 0x7f92b0100520 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59528/0 (socket says 172.21.15.81:59528) 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 -- 172.21.15.81:0/2500352459 learned_addr learned my addr 172.21.15.81:0/2500352459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b4f18700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 -- 172.21.15.81:0/2500352459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 msgr2=0x7f92b0196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 -- 172.21.15.81:0/2500352459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac00a700 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b4f18700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.862+0000 7f92b5719700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00d010 tx=0x7f92ac00fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.863+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac005070 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.863+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92ac0051d0 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.863+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac016920 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.863+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b019bbd0 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.863+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b019c070 con 0x7f92b00ff320 2024-09-18T13:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.864+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0190410 con 0x7f92b00ff320 2024-09-18T13:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.864+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f92ac016ba0 con 0x7f92b00ff320 2024-09-18T13:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.865+0000 7f92a67fc700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 0x7f929c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.865+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f92ac012070 con 0x7f92b00ff320 2024-09-18T13:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.865+0000 7f92b4f18700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 0x7f929c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.865+0000 7f92b4f18700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 0x7f929c07d7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005950 tx=0x7f92a00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:40.869+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f92ac063140 con 0x7f92b00ff320 2024-09-18T13:00:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.096+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92b00611d0 con 0x7f929c07b310 2024-09-18T13:00:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.105+0000 7f92a67fc700 1 -- 172.21.15.81:0/2500352459 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f92b00611d0 con 0x7f929c07b310 2024-09-18T13:00:41.106 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:41.106 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (16m) 9s ago 18m 25.5M - 0.25.0 c8568f914cd2 067cf3d1376c 2024-09-18T13:00:41.106 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (39s) 9s ago 18m 8422k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 6ff0bf972297 2024-09-18T13:00:41.106 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (35s) 11s ago 17m 8056k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 3227e6684b04 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 9s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (6m) 11s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (16m) 9s ago 17m 84.9M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (90s) 9s ago 11m 17.5M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (108s) 9s ago 11m 68.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (53s) 11s ago 11m 16.3M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 465fbfb22e85 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (74s) 11s ago 11m 15.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (8m) 9s ago 19m 523M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (7m) 11s ago 17m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (7m) 9s ago 19m 58.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (6m) 11s ago 17m 45.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (20s) 9s ago 18m 7894k - 1.7.0 72c9c2088986 3df23878a733 2024-09-18T13:00:41.107 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (14s) 11s ago 17m 3330k - 1.7.0 72c9c2088986 6d9d1864aea4 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 9s ago 15m 112M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 9s ago 15m 206M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 9s ago 14m 101M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (4m) 11s ago 14m 130M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (3m) 11s ago 13m 100M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (2m) 11s ago 13m 98.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T13:00:41.108 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 9s ago 17m 79.5M - 2.43.0 a07b618ecd1d 36b55942723f 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 msgr2=0x7f929c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 0x7f929c07d7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005950 tx=0x7f92a00058e0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 msgr2=0x7f92b01964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00d010 tx=0x7f92ac00fe40 comp rx=0 tx=0).stop 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 shutdown_connections 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f929c07b310 0x7f929c07d7d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b00ff320 0x7f92b01964e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 --2- 172.21.15.81:0/2500352459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92b0100520 0x7f92b0196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 >> 172.21.15.81:0/2500352459 conn(0x7f92b00fa8c0 msgr2=0x7f92b0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 shutdown_connections 2024-09-18T13:00:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.107+0000 7f92b797d700 1 -- 172.21.15.81:0/2500352459 wait complete. 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/2118260495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 msgr2=0x7f5f18103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/2118260495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18103b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009910 tx=0x7f5f08009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/2118260495 shutdown_connections 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/2118260495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f181040d0 0x7f5f181064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/2118260495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18103b90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/2118260495 >> 172.21.15.81:0/2118260495 conn(0x7f5f180fb190 msgr2=0x7f5f180fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/2118260495 shutdown_connections 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.214+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/2118260495 wait complete. 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 Processor -- start 2024-09-18T13:00:41.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 -- start start 2024-09-18T13:00:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f181040d0 0x7f5f181969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18196fc0 con 0x7f5f181017a0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f1ea0c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18197100 con 0x7f5f181040d0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59536/0 (socket says 172.21.15.81:59536) 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 -- 172.21.15.81:0/561421696 learned_addr learned my addr 172.21.15.81:0/561421696 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 -- 172.21.15.81:0/561421696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f181040d0 msgr2=0x7f5f181969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f181040d0 0x7f5f181969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.215+0000 7f5f17fff700 1 -- 172.21.15.81:0/561421696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080095f0 con 0x7f5f181017a0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f17fff700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f08006010 tx=0x7f5f0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0801d070 con 0x7f5f181017a0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f0800f460 con 0x7f5f181017a0 2024-09-18T13:00:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1819bb50 con 0x7f5f181017a0 2024-09-18T13:00:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f08017630 con 0x7f5f181017a0 2024-09-18T13:00:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.216+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1819c040 con 0x7f5f181017a0 2024-09-18T13:00:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.217+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f18190610 con 0x7f5f181017a0 2024-09-18T13:00:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.217+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5f08003a60 con 0x7f5f181017a0 2024-09-18T13:00:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.218+0000 7f5f157fa700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 0x7f5f0007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.218+0000 7f5f177fe700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 0x7f5f0007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.218+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f5f0809f870 con 0x7f5f181017a0 2024-09-18T13:00:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.219+0000 7f5f177fe700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 0x7f5f0007d7d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005950 tx=0x7f5f0c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.223+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5f08062810 con 0x7f5f181017a0 2024-09-18T13:00:41.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:41 smithi136 ceph-mon[80179]: pgmap v261: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:41 smithi081 ceph-mon[92545]: pgmap v261: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:41.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.541+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f1802cc70 con 0x7f5f181017a0 2024-09-18T13:00:41.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.541+0000 7f5f157fa700 1 -- 172.21.15.81:0/561421696 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f5f08065930 con 0x7f5f181017a0 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:41.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T13:00:41.544 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.543+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 msgr2=0x7f5f0007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.543+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 0x7f5f0007d7d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005950 tx=0x7f5f0c0058e0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.543+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 msgr2=0x7f5f18196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.543+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f08006010 tx=0x7f5f0800be20 comp rx=0 tx=0).stop 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 shutdown_connections 2024-09-18T13:00:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5f0007b310 0x7f5f0007d7d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f181017a0 0x7f5f18196460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 --2- 172.21.15.81:0/561421696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f181040d0 0x7f5f181969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 >> 172.21.15.81:0/561421696 conn(0x7f5f180fb190 msgr2=0x7f5f180fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 shutdown_connections 2024-09-18T13:00:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.544+0000 7f5f1ea0c700 1 -- 172.21.15.81:0/561421696 wait complete. 2024-09-18T13:00:41.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.647+0000 7f38ade35700 1 -- 172.21.15.81:0/4019905884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ffc10 msgr2=0x7f38a8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.647+0000 7f38ade35700 1 --2- 172.21.15.81:0/4019905884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ffc10 0x7f38a8100030 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3898009910 tx=0x7f3898009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:41.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 -- 172.21.15.81:0/4019905884 shutdown_connections 2024-09-18T13:00:41.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 --2- 172.21.15.81:0/4019905884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a8100e10 0x7f38a8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 --2- 172.21.15.81:0/4019905884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a80ffc10 0x7f38a8100030 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 -- 172.21.15.81:0/4019905884 >> 172.21.15.81:0/4019905884 conn(0x7f38a80fb190 msgr2=0x7f38a80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 -- 172.21.15.81:0/4019905884 shutdown_connections 2024-09-18T13:00:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 -- 172.21.15.81:0/4019905884 wait complete. 2024-09-18T13:00:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.648+0000 7f38ade35700 1 Processor -- start 2024-09-18T13:00:41.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38ade35700 1 -- start start 2024-09-18T13:00:41.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38ade35700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a80ffc10 0x7f38a80690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38ade35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38ade35700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a819b880 con 0x7f38a8100e10 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38ade35700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a819b9c0 con 0x7f38a80ffc10 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59554/0 (socket says 172.21.15.81:59554) 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 -- 172.21.15.81:0/3449429969 learned_addr learned my addr 172.21.15.81:0/3449429969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a77fe700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a80ffc10 0x7f38a80690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 -- 172.21.15.81:0/3449429969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a80ffc10 msgr2=0x7f38a80690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a80ffc10 0x7f38a80690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 -- 172.21.15.81:0/3449429969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980095f0 con 0x7f38a8100e10 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.649+0000 7f38a6ffd700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b4b0 tx=0x7f389c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.650+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389c011800 con 0x7f38a8100e10 2024-09-18T13:00:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.650+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f389c011e10 con 0x7f38a8100e10 2024-09-18T13:00:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.650+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a819bca0 con 0x7f38a8100e10 2024-09-18T13:00:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.650+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389c00f2e0 con 0x7f38a8100e10 2024-09-18T13:00:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.650+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a819c1f0 con 0x7f38a8100e10 2024-09-18T13:00:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.651+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a8108780 con 0x7f38a8100e10 2024-09-18T13:00:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.651+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f389c011960 con 0x7f38a8100e10 2024-09-18T13:00:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.652+0000 7f38a4ff9700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 0x7f389007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.652+0000 7f38a77fe700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 0x7f389007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.652+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f389c09dde0 con 0x7f38a8100e10 2024-09-18T13:00:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.652+0000 7f38a77fe700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 0x7f389007d7d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3898006010 tx=0x7f389800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:41.656+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f389c060d80 con 0x7f38a8100e10 2024-09-18T13:00:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.024+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38a81089a0 con 0x7f38a8100e10 2024-09-18T13:00:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.024+0000 7f38a4ff9700 1 -- 172.21.15.81:0/3449429969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1991 (secure 0 0 0) 0x7f389c063ea0 con 0x7f38a8100e10 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:e46 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:59:56:556179+0000 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 46 2024-09-18T13:00:42.026 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:59:56.556173+0000 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 95 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T13:00:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34434,1=34466} 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34434 members: 34434,34466 2024-09-18T13:00:42.028 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:34466} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.027+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 msgr2=0x7f389007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.027+0000 7f38ade35700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 0x7f389007d7d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3898006010 tx=0x7f389800b560 comp rx=0 tx=0).stop 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.027+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 msgr2=0x7f38a819b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.027+0000 7f38ade35700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b4b0 tx=0x7f389c00b7c0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 shutdown_connections 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f389007b310 0x7f389007d7d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38a80ffc10 0x7f38a80690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 --2- 172.21.15.81:0/3449429969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a8100e10 0x7f38a819b2b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 >> 172.21.15.81:0/3449429969 conn(0x7f38a80fb190 msgr2=0x7f38a8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 shutdown_connections 2024-09-18T13:00:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.028+0000 7f38ade35700 1 -- 172.21.15.81:0/3449429969 wait complete. 2024-09-18T13:00:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 -- 172.21.15.81:0/2895880061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 msgr2=0x7f4a1c0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 --2- 172.21.15.81:0/2895880061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c0fffe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009910 tx=0x7f4a18009c20 comp rx=0 tx=0).stop 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 -- 172.21.15.81:0/2895880061 shutdown_connections 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 --2- 172.21.15.81:0/2895880061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 0x7f4a1c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 --2- 172.21.15.81:0/2895880061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c0fffe0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.152+0000 7f4a236fa700 1 -- 172.21.15.81:0/2895880061 >> 172.21.15.81:0/2895880061 conn(0x7f4a1c0fb160 msgr2=0x7f4a1c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 -- 172.21.15.81:0/2895880061 shutdown_connections 2024-09-18T13:00:42.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 -- 172.21.15.81:0/2895880061 wait complete. 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 Processor -- start 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 -- start start 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 0x7f4a1c1021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1026e0 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a236fa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c102820 con 0x7f4a1c100dc0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a21496700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a21496700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59566/0 (socket says 172.21.15.81:59566) 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.153+0000 7f4a21496700 1 -- 172.21.15.81:0/1090183365 learned_addr learned my addr 172.21.15.81:0/1090183365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a20c95700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 0x7f4a1c1021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a21496700 1 -- 172.21.15.81:0/1090183365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 msgr2=0x7f4a1c1021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a21496700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 0x7f4a1c1021a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a21496700 1 -- 172.21.15.81:0/1090183365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180095f0 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a21496700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bda0 tx=0x7f4a1800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1801d070 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4a1800f460 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c102aa0 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18021620 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.154+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c102f90 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.155+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c068af0 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.156+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4a1800f5d0 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.156+0000 7f4a127fc700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 0x7f4a0807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.156+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4a1809f550 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.156+0000 7f4a20c95700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 0x7f4a0807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.157+0000 7f4a20c95700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 0x7f4a0807d7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005950 tx=0x7f4a0c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.161+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4a18062570 con 0x7f4a1c0ffbc0 2024-09-18T13:00:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:42 smithi136 ceph-mon[80179]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:42 smithi136 ceph-mon[80179]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:42.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:42 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/561421696' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:42 smithi081 ceph-mon[92545]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:42 smithi081 ceph-mon[92545]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:42 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/561421696' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.417+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a1c0695e0 con 0x7f4a0807b310 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.419+0000 7f4a127fc700 1 -- 172.21.15.81:0/1090183365 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f4a1c0695e0 con 0x7f4a0807b310 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-09-18T13:00:42.420 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph-exporter" 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "18/23 daemons upgraded", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T13:00:42.421 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:00:42.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.421+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 msgr2=0x7f4a0807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.421+0000 7f4a236fa700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 0x7f4a0807d7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005950 tx=0x7f4a0c00b410 comp rx=0 tx=0).stop 2024-09-18T13:00:42.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.421+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 msgr2=0x7f4a1c103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.421+0000 7f4a236fa700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bda0 tx=0x7f4a1800bdd0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 shutdown_connections 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4a0807b310 0x7f4a0807d7d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c0ffbc0 0x7f4a1c103b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 --2- 172.21.15.81:0/1090183365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a1c100dc0 0x7f4a1c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 >> 172.21.15.81:0/1090183365 conn(0x7f4a1c0fb160 msgr2=0x7f4a1c068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 shutdown_connections 2024-09-18T13:00:42.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.422+0000 7f4a236fa700 1 -- 172.21.15.81:0/1090183365 wait complete. 2024-09-18T13:00:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 -- 172.21.15.81:0/3001029480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17100ffba0 msgr2=0x7f17100fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 --2- 172.21.15.81:0/3001029480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17100ffba0 0x7f17100fffc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f170c009990 tx=0x7f170c009ca0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 -- 172.21.15.81:0/3001029480 shutdown_connections 2024-09-18T13:00:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 --2- 172.21.15.81:0/3001029480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1710100da0 0x7f1710101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 --2- 172.21.15.81:0/3001029480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17100ffba0 0x7f17100fffc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 -- 172.21.15.81:0/3001029480 >> 172.21.15.81:0/3001029480 conn(0x7f17100fb120 msgr2=0x7f17100fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 -- 172.21.15.81:0/3001029480 shutdown_connections 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.556+0000 7f171780a700 1 -- 172.21.15.81:0/3001029480 wait complete. 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 Processor -- start 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 -- start start 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100ffba0 0x7f17101986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710199210 con 0x7f1710100da0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f171780a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710199350 con 0x7f17100ffba0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59594/0 (socket says 172.21.15.81:59594) 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 -- 172.21.15.81:0/3475833478 learned_addr learned my addr 172.21.15.81:0/3475833478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f17155a6700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100ffba0 0x7f17101986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 -- 172.21.15.81:0/3475833478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100ffba0 msgr2=0x7f17101986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100ffba0 0x7f17101986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.557+0000 7f1714da5700 1 -- 172.21.15.81:0/3475833478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0095f0 con 0x7f1710100da0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f1714da5700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f170000d8d0 tx=0x7f170000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1700009940 con 0x7f1710100da0 2024-09-18T13:00:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1700010460 con 0x7f1710100da0 2024-09-18T13:00:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f170000f5f0 con 0x7f1710100da0 2024-09-18T13:00:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171019de00 con 0x7f1710100da0 2024-09-18T13:00:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.558+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171019e2d0 con 0x7f1710100da0 2024-09-18T13:00:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.559+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17101075f0 con 0x7f1710100da0 2024-09-18T13:00:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.560+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f17000105d0 con 0x7f1710100da0 2024-09-18T13:00:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.561+0000 7f17067fc700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 0x7f16fc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.561+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f170009e380 con 0x7f1710100da0 2024-09-18T13:00:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.561+0000 7f17155a6700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 0x7f16fc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.561+0000 7f17155a6700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 0x7f16fc07d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f170c000c00 tx=0x7f170c005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.566+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1700061320 con 0x7f1710100da0 2024-09-18T13:00:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.909+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f171019e960 con 0x7f1710100da0 2024-09-18T13:00:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.910+0000 7f17067fc700 1 -- 172.21.15.81:0/3475833478 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1700064440 con 0x7f1710100da0 2024-09-18T13:00:42.911 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T13:00:42.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 msgr2=0x7f16fc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 0x7f16fc07d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f170c000c00 tx=0x7f170c005fb0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 msgr2=0x7f1710198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:42.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f170000d8d0 tx=0x7f170000dc90 comp rx=0 tx=0).stop 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 shutdown_connections 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f16fc07b310 0x7f16fc07d7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100ffba0 0x7f17101986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 --2- 172.21.15.81:0/3475833478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710100da0 0x7f1710198bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 >> 172.21.15.81:0/3475833478 conn(0x7f17100fb120 msgr2=0x7f1710103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 shutdown_connections 2024-09-18T13:00:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:00:42.912+0000 7f171780a700 1 -- 172.21.15.81:0/3475833478 wait complete. 2024-09-18T13:00:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:43 smithi136 ceph-mon[80179]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:43 smithi136 ceph-mon[80179]: pgmap v262: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:43 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3449429969' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:43.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:43 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3475833478' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:43 smithi081 ceph-mon[92545]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:43 smithi081 ceph-mon[92545]: pgmap v262: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:43 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3449429969' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:43 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3475833478' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:44.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:44 smithi136 ceph-mon[80179]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:44.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:44 smithi081 ceph-mon[92545]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:45 smithi136 ceph-mon[80179]: pgmap v263: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:45 smithi081 ceph-mon[92545]: pgmap v263: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:46.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:46 smithi136 ceph-mon[80179]: pgmap v264: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:46.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:46 smithi081 ceph-mon[92545]: pgmap v264: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:49.232 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:49 smithi081 ceph-mon[92545]: pgmap v265: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:49 smithi136 ceph-mon[80179]: pgmap v265: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:51.277 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:51 smithi081 ceph-mon[92545]: pgmap v266: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:51.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:51 smithi136 ceph-mon[80179]: pgmap v266: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:52 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:52.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:52 smithi081 ceph-mon[92545]: pgmap v267: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:52 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:52 smithi136 ceph-mon[80179]: pgmap v267: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:55.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:55 smithi081 ceph-mon[92545]: pgmap v268: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:55 smithi136 ceph-mon[80179]: pgmap v268: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:56 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:56 smithi136 ceph-mon[80179]: pgmap v269: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:56.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:56 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:56.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:56 smithi081 ceph-mon[92545]: pgmap v269: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:59 smithi136 ceph-mon[80179]: pgmap v270: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:00:59 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:00:59.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:59 smithi081 ceph-mon[92545]: pgmap v270: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:00:59.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:00:59 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-18T13:01:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:00 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.358 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:00.359 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:00 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:01 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T13:01:01.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:01 smithi136 ceph-mon[80179]: pgmap v271: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:01.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:01 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T13:01:01.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:01 smithi081 ceph-mon[92545]: pgmap v271: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:02 smithi136 ceph-mon[80179]: Upgrade: Updating alertmanager.smithi081 2024-09-18T13:01:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:02 smithi136 ceph-mon[80179]: Deploying daemon alertmanager.smithi081 on smithi081 2024-09-18T13:01:02.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:02 smithi136 ceph-mon[80179]: pgmap v272: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:02.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:02 smithi081 ceph-mon[92545]: Upgrade: Updating alertmanager.smithi081 2024-09-18T13:01:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:02 smithi081 ceph-mon[92545]: Deploying daemon alertmanager.smithi081 on smithi081 2024-09-18T13:01:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:02 smithi081 ceph-mon[92545]: pgmap v272: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:05 smithi136 ceph-mon[80179]: pgmap v273: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:05.331 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:05 smithi081 ceph-mon[92545]: pgmap v273: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:05.332 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:07.278 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:07 smithi081 ceph-mon[92545]: pgmap v274: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:07.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:07 smithi136 ceph-mon[80179]: pgmap v274: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:09.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:09 smithi136 ceph-mon[80179]: pgmap v275: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:09.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:09 smithi081 ceph-mon[92545]: pgmap v275: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:10 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:10 smithi136 ceph-mon[80179]: pgmap v276: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:10 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:10 smithi081 ceph-mon[92545]: pgmap v276: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:13.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 -- 172.21.15.81:0/2544958677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc80ffbb0 msgr2=0x7f5cc80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 --2- 172.21.15.81:0/2544958677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc80fffd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009910 tx=0x7f5cbc009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 -- 172.21.15.81:0/2544958677 shutdown_connections 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 --2- 172.21.15.81:0/2544958677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc8100db0 0x7f5cc8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 --2- 172.21.15.81:0/2544958677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc80fffd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 -- 172.21.15.81:0/2544958677 >> 172.21.15.81:0/2544958677 conn(0x7f5cc80fb150 msgr2=0x7f5cc80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 -- 172.21.15.81:0/2544958677 shutdown_connections 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.038+0000 7f5ccec47700 1 -- 172.21.15.81:0/2544958677 wait complete. 2024-09-18T13:01:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 Processor -- start 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 -- start start 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc8069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc819b780 con 0x7f5cc8100db0 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccec47700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc819b8f0 con 0x7f5cc80ffbb0 2024-09-18T13:01:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57194/0 (socket says 172.21.15.81:57194) 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 -- 172.21.15.81:0/1136353844 learned_addr learned my addr 172.21.15.81:0/1136353844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5ccc9e3700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc8069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 -- 172.21.15.81:0/1136353844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc80ffbb0 msgr2=0x7f5cc8069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc8069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.039+0000 7f5cc7fff700 1 -- 172.21.15.81:0/1136353844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0095f0 con 0x7f5cc8100db0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5cc7fff700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d8d0 tx=0x7f5cb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb4009940 con 0x7f5cc8100db0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc819bbd0 con 0x7f5cc8100db0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5cb4010460 con 0x7f5cc8100db0 2024-09-18T13:01:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb400f5f0 con 0x7f5cc8100db0 2024-09-18T13:01:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.040+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc819c120 con 0x7f5cc8100db0 2024-09-18T13:01:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.041+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc8108710 con 0x7f5cc8100db0 2024-09-18T13:01:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.042+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5cb40105d0 con 0x7f5cc8100db0 2024-09-18T13:01:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.042+0000 7f5cc5ffb700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 0x7f5cb807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.043+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f5cb409e330 con 0x7f5cc8100db0 2024-09-18T13:01:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.043+0000 7f5ccc9e3700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 0x7f5cb807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.043+0000 7f5ccc9e3700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 0x7f5cb807d7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc006010 tx=0x7f5cbc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.051+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5cb40612b0 con 0x7f5cc8100db0 2024-09-18T13:01:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.293+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc8105700 con 0x7f5cb807b310 2024-09-18T13:01:13.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:13 smithi081 ceph-mon[92545]: pgmap v277: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.294+0000 7f5cc5ffb700 1 -- 172.21.15.81:0/1136353844 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f5cc8105700 con 0x7f5cb807b310 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.296+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 msgr2=0x7f5cb807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.296+0000 7f5ccec47700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 0x7f5cb807d7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc006010 tx=0x7f5cbc005a90 comp rx=0 tx=0).stop 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.296+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 msgr2=0x7f5cc819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.296+0000 7f5ccec47700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d8d0 tx=0x7f5cb400dc90 comp rx=0 tx=0).stop 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 shutdown_connections 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5cb807b310 0x7f5cb807d7d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cc80ffbb0 0x7f5cc8069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 --2- 172.21.15.81:0/1136353844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc8100db0 0x7f5cc819b1b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 >> 172.21.15.81:0/1136353844 conn(0x7f5cc80fb150 msgr2=0x7f5cc8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 shutdown_connections 2024-09-18T13:01:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.297+0000 7f5ccec47700 1 -- 172.21.15.81:0/1136353844 wait complete. 2024-09-18T13:01:13.310 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T13:01:13.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:13 smithi136 ceph-mon[80179]: pgmap v277: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.403+0000 7f43f036b700 1 -- 172.21.15.81:0/2729379214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 msgr2=0x7f43e80fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.403+0000 7f43f036b700 1 --2- 172.21.15.81:0/2729379214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e80fffe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009910 tx=0x7f43e4009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 -- 172.21.15.81:0/2729379214 shutdown_connections 2024-09-18T13:01:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 --2- 172.21.15.81:0/2729379214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 --2- 172.21.15.81:0/2729379214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e80fffe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 -- 172.21.15.81:0/2729379214 >> 172.21.15.81:0/2729379214 conn(0x7f43e80fb160 msgr2=0x7f43e80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 -- 172.21.15.81:0/2729379214 shutdown_connections 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 -- 172.21.15.81:0/2729379214 wait complete. 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 Processor -- start 2024-09-18T13:01:13.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 -- start start 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.404+0000 7f43f036b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43f036b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8196250 con 0x7f43e80ffbc0 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43f036b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8196390 con 0x7f43e8100dc0 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57226/0 (socket says 172.21.15.81:57226) 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 -- 172.21.15.81:0/113423037 learned_addr learned my addr 172.21.15.81:0/113423037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ed906700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 -- 172.21.15.81:0/113423037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 msgr2=0x7f43e8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 -- 172.21.15.81:0/113423037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40095f0 con 0x7f43e80ffbc0 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ed906700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43ee107700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f43e400bda0 tx=0x7f43e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e401d070 con 0x7f43e80ffbc0 2024-09-18T13:01:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43e4004c50 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e819ade0 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e400f690 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.405+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e819b270 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.406+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e818f5b0 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.407+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f43e400f900 con 0x7f43e80ffbc0 2024-09-18T13:01:13.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.407+0000 7f43df7fe700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 0x7f43d407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.408+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f43e409fc80 con 0x7f43e80ffbc0 2024-09-18T13:01:13.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.408+0000 7f43ed906700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 0x7f43d407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.408+0000 7f43ed906700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 0x7f43d407d7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43d80099d0 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.412+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f43e4062b80 con 0x7f43e80ffbc0 2024-09-18T13:01:13.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.663+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e80611d0 con 0x7f43d407b310 2024-09-18T13:01:13.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.665+0000 7f43df7fe700 1 -- 172.21.15.81:0/113423037 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f43e80611d0 con 0x7f43d407b310 2024-09-18T13:01:13.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 msgr2=0x7f43d407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 0x7f43d407d7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43d80099d0 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2024-09-18T13:01:13.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 msgr2=0x7f43e81956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f43e400bda0 tx=0x7f43e400be80 comp rx=0 tx=0).stop 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 shutdown_connections 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f43d407b310 0x7f43d407d7d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80ffbc0 0x7f43e81956f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 --2- 172.21.15.81:0/113423037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43e8100dc0 0x7f43e8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 >> 172.21.15.81:0/113423037 conn(0x7f43e80fb160 msgr2=0x7f43e81040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 shutdown_connections 2024-09-18T13:01:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.667+0000 7f43f036b700 1 -- 172.21.15.81:0/113423037 wait complete. 2024-09-18T13:01:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 -- 172.21.15.81:0/3774878423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c0ffdf0 msgr2=0x7f200c100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3774878423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c0ffdf0 0x7f200c100270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2000009910 tx=0x7f2000009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 -- 172.21.15.81:0/3774878423 shutdown_connections 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3774878423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c0ffdf0 0x7f200c100270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3774878423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c101220 0x7f200c101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 -- 172.21.15.81:0/3774878423 >> 172.21.15.81:0/3774878423 conn(0x7f200c0fa8c0 msgr2=0x7f200c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 -- 172.21.15.81:0/3774878423 shutdown_connections 2024-09-18T13:01:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.772+0000 7f2010f8a700 1 -- 172.21.15.81:0/3774878423 wait complete. 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 Processor -- start 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 -- start start 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c0ffdf0 0x7f200c0ff840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c19b8b0 con 0x7f200c101220 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2010f8a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c19b9f0 con 0x7f200c0ffdf0 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2009d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2009d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57240/0 (socket says 172.21.15.81:57240) 2024-09-18T13:01:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.773+0000 7f2009d9b700 1 -- 172.21.15.81:0/3988837059 learned_addr learned my addr 172.21.15.81:0/3988837059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f200a59c700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c0ffdf0 0x7f200c0ff840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2009d9b700 1 -- 172.21.15.81:0/3988837059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c0ffdf0 msgr2=0x7f200c0ff840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2009d9b700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c0ffdf0 0x7f200c0ff840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2009d9b700 1 -- 172.21.15.81:0/3988837059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000095f0 con 0x7f200c101220 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2009d9b700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f200000bd70 tx=0x7f200000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200001d070 con 0x7f200c101220 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2000005940 con 0x7f200c101220 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2000021430 con 0x7f200c101220 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c19bc70 con 0x7f200c101220 2024-09-18T13:01:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.774+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c19c110 con 0x7f200c101220 2024-09-18T13:01:13.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.775+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c108840 con 0x7f200c101220 2024-09-18T13:01:13.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.776+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f200000f860 con 0x7f200c101220 2024-09-18T13:01:13.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.776+0000 7f1ffb7fe700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 0x7f1ff407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:13.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.777+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f200009f850 con 0x7f200c101220 2024-09-18T13:01:13.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.777+0000 7f200a59c700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 0x7f1ff407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:13.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.777+0000 7f200a59c700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 0x7f1ff407d7d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009a10 tx=0x7f1ffc009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:13.781+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f2000062750 con 0x7f200c101220 2024-09-18T13:01:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.012+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f200c105750 con 0x7f1ff407b310 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.022+0000 7f1ffb7fe700 1 -- 172.21.15.81:0/3988837059 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f200c105750 con 0x7f1ff407b310 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 starting - - - - 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (72s) 18s ago 18m 8468k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 6ff0bf972297 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (68s) 44s ago 17m 8056k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 3227e6684b04 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 18s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (6m) 44s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T13:01:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (16m) 18s ago 18m 85.1M - 9.4.7 954c08fa6188 6e6770d613fc 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (2m) 18s ago 12m 18.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (2m) 18s ago 12m 68.8M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (86s) 44s ago 12m 16.3M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 465fbfb22e85 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (106s) 44s ago 12m 15.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (9m) 18s ago 20m 525M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (8m) 44s ago 17m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (7m) 18s ago 20m 59.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (7m) 44s ago 17m 45.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (53s) 18s ago 18m 8162k - 1.7.0 72c9c2088986 3df23878a733 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (47s) 44s ago 17m 3330k - 1.7.0 72c9c2088986 6d9d1864aea4 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 18s ago 16m 112M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T13:01:14.025 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 18s ago 15m 205M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T13:01:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 18s ago 15m 100M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T13:01:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (4m) 44s ago 14m 130M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T13:01:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (4m) 44s ago 14m 100M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T13:01:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (3m) 44s ago 14m 98.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T13:01:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (24s) 18s ago 18m 43.7M - 2.51.0 1d3b7f56885b ee27d7ca06c6 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 msgr2=0x7f1ff407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 0x7f1ff407d7d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009a10 tx=0x7f1ffc009190 comp rx=0 tx=0).stop 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 msgr2=0x7f200c19b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f200000bd70 tx=0x7f200000bda0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 shutdown_connections 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1ff407b310 0x7f1ff407d7d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200c0ffdf0 0x7f200c0ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 --2- 172.21.15.81:0/3988837059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f200c101220 0x7f200c19b2e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 >> 172.21.15.81:0/3988837059 conn(0x7f200c0fa8c0 msgr2=0x7f200c104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 shutdown_connections 2024-09-18T13:01:14.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.024+0000 7f2010f8a700 1 -- 172.21.15.81:0/3988837059 wait complete. 2024-09-18T13:01:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 -- 172.21.15.81:0/2173624250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 msgr2=0x7f4e980fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/2173624250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e980fffd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009910 tx=0x7f4e88009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 -- 172.21.15.81:0/2173624250 shutdown_connections 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/2173624250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 0x7f4e98101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/2173624250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e980fffd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 -- 172.21.15.81:0/2173624250 >> 172.21.15.81:0/2173624250 conn(0x7f4e980fb150 msgr2=0x7f4e980fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 -- 172.21.15.81:0/2173624250 shutdown_connections 2024-09-18T13:01:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.128+0000 7f4e9e26a700 1 -- 172.21.15.81:0/2173624250 wait complete. 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 Processor -- start 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 -- start start 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 0x7f4e9819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9819b7f0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e9e26a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9819b960 con 0x7f4e98100db0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57266/0 (socket says 172.21.15.81:57266) 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 -- 172.21.15.81:0/3820510404 learned_addr learned my addr 172.21.15.81:0/3820510404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e8ffff700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 0x7f4e9819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 -- 172.21.15.81:0/3820510404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 msgr2=0x7f4e9819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 0x7f4e9819b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.129+0000 7f4e97fff700 1 -- 172.21.15.81:0/3820510404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880095f0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e97fff700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800bda0 tx=0x7f4e8800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8801d070 con 0x7f4e980ffbb0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e8800f460 con 0x7f4e980ffbb0 2024-09-18T13:01:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9819bbe0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e88021640 con 0x7f4e980ffbb0 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.130+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9819c0d0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.131+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98108710 con 0x7f4e980ffbb0 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.131+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4e8800fa00 con 0x7f4e980ffbb0 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.132+0000 7f4e95ffb700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 0x7f4e8407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.132+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4e8809f6c0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.132+0000 7f4e8ffff700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 0x7f4e8407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.132+0000 7f4e8ffff700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 0x7f4e8407d7d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005950 tx=0x7f4e800058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.136+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f4e880625c0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.474+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e98108900 con 0x7f4e980ffbb0 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.474+0000 7f4e95ffb700 1 -- 172.21.15.81:0/3820510404 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4e880656e0 con 0x7f4e980ffbb0 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T13:01:14.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 msgr2=0x7f4e8407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 0x7f4e8407d7d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005950 tx=0x7f4e800058e0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 msgr2=0x7f4e98069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800bda0 tx=0x7f4e8800be80 comp rx=0 tx=0).stop 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 shutdown_connections 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f4e8407b310 0x7f4e8407d7d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e980ffbb0 0x7f4e98069990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 --2- 172.21.15.81:0/3820510404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e98100db0 0x7f4e9819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 >> 172.21.15.81:0/3820510404 conn(0x7f4e980fb150 msgr2=0x7f4e98103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 shutdown_connections 2024-09-18T13:01:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.477+0000 7f4e9e26a700 1 -- 172.21.15.81:0/3820510404 wait complete. 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 -- 172.21.15.81:0/2678177268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc40ff320 msgr2=0x7f1cc40ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/2678177268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc40ff320 0x7f1cc40ff740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009910 tx=0x7f1cc0009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 -- 172.21.15.81:0/2678177268 shutdown_connections 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/2678177268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc4100520 0x7f1cc4100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/2678177268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc40ff320 0x7f1cc40ff740 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 -- 172.21.15.81:0/2678177268 >> 172.21.15.81:0/2678177268 conn(0x7f1cc40fa8c0 msgr2=0x7f1cc40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 -- 172.21.15.81:0/2678177268 shutdown_connections 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.590+0000 7f1ccbca3700 1 -- 172.21.15.81:0/2678177268 wait complete. 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 Processor -- start 2024-09-18T13:01:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 -- start start 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc40ff320 0x7f1cc41964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4197050 con 0x7f1cc4100520 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1ccbca3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4197190 con 0x7f1cc40ff320 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1cc923e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1cc923e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57282/0 (socket says 172.21.15.81:57282) 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.591+0000 7f1cc923e700 1 -- 172.21.15.81:0/1989644962 learned_addr learned my addr 172.21.15.81:0/1989644962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cc9a3f700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc40ff320 0x7f1cc41964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cc923e700 1 -- 172.21.15.81:0/1989644962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc40ff320 msgr2=0x7f1cc41964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cc923e700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc40ff320 0x7f1cc41964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cc923e700 1 -- 172.21.15.81:0/1989644962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00095f0 con 0x7f1cc4100520 2024-09-18T13:01:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cc923e700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c8f0 tx=0x7f1cb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb4007a70 con 0x7f1cc4100520 2024-09-18T13:01:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1cb4004ce0 con 0x7f1cc4100520 2024-09-18T13:01:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc419bc40 con 0x7f1cc4100520 2024-09-18T13:01:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb4005610 con 0x7f1cc4100520 2024-09-18T13:01:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.592+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc419c190 con 0x7f1cc4100520 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.593+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc4107ea0 con 0x7f1cc4100520 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.594+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1cb4004750 con 0x7f1cc4100520 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.595+0000 7f1cbaffd700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 0x7f1cb007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.595+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f1cb4013070 con 0x7f1cc4100520 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.595+0000 7f1cc9a3f700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 0x7f1cb007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.595+0000 7f1cc9a3f700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 0x7f1cb007d7d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0006010 tx=0x7f1cc000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:14.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.599+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1cb4061190 con 0x7f1cc4100520 2024-09-18T13:01:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.871+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cc4108090 con 0x7f1cc4100520 2024-09-18T13:01:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.872+0000 7f1cbaffd700 1 -- 172.21.15.81:0/1989644962 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1991 (secure 0 0 0) 0x7f1cb40642b0 con 0x7f1cc4100520 2024-09-18T13:01:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:e46 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:59:56:556179+0000 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 46 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:59:56.556173+0000 2024-09-18T13:01:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 95 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T13:01:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34434,1=34466} 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34434 members: 34434,34466 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:34466} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 msgr2=0x7f1cb007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 0x7f1cb007d7d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0006010 tx=0x7f1cc000b540 comp rx=0 tx=0).stop 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 msgr2=0x7f1cc4196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c8f0 tx=0x7f1cb400ccb0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 shutdown_connections 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1cb007b310 0x7f1cb007d7d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cc40ff320 0x7f1cc41964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 --2- 172.21.15.81:0/1989644962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4100520 0x7f1cc4196a30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 >> 172.21.15.81:0/1989644962 conn(0x7f1cc40fa8c0 msgr2=0x7f1cc40fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 shutdown_connections 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.875+0000 7f1ccbca3700 1 -- 172.21.15.81:0/1989644962 wait complete. 2024-09-18T13:01:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 -- 172.21.15.81:0/2177461088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec1011a0 msgr2=0x7f27ec1015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 --2- 172.21.15.81:0/2177461088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec1011a0 0x7f27ec1015c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009910 tx=0x7f27e8009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 -- 172.21.15.81:0/2177461088 shutdown_connections 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 --2- 172.21.15.81:0/2177461088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec0ffe50 0x7f27ec1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 --2- 172.21.15.81:0/2177461088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec1011a0 0x7f27ec1015c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 -- 172.21.15.81:0/2177461088 >> 172.21.15.81:0/2177461088 conn(0x7f27ec0fa8c0 msgr2=0x7f27ec0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 -- 172.21.15.81:0/2177461088 shutdown_connections 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.990+0000 7f27f36ec700 1 -- 172.21.15.81:0/2177461088 wait complete. 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 Processor -- start 2024-09-18T13:01:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 -- start start 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec1011a0 0x7f27ec196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1970f0 con 0x7f27ec0ffe50 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f36ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec197230 con 0x7f27ec1011a0 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f1488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f1488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57296/0 (socket says 172.21.15.81:57296) 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f1488700 1 -- 172.21.15.81:0/288461899 learned_addr learned my addr 172.21.15.81:0/288461899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.991+0000 7f27f0c87700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec1011a0 0x7f27ec196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f1488700 1 -- 172.21.15.81:0/288461899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec1011a0 msgr2=0x7f27ec196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f1488700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec1011a0 0x7f27ec196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f1488700 1 -- 172.21.15.81:0/288461899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80095f0 con 0x7f27ec0ffe50 2024-09-18T13:01:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f1488700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bda0 tx=0x7f27e800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:14.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e801d070 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27e8022470 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec19bc80 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e800f650 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.992+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec19c170 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.993+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec1087c0 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.994+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f27e80225e0 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.994+0000 7f27e27fc700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 0x7f27d807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.994+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f27e809f900 con 0x7f27ec0ffe50 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.994+0000 7f27f0c87700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 0x7f27d807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.995+0000 7f27f0c87700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 0x7f27d807d7d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27ec100ed0 tx=0x7f27dc009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:15.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:14.999+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f27e80629d0 con 0x7f27ec0ffe50 2024-09-18T13:01:15.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.242+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27ec0ff450 con 0x7f27d807b310 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: pgmap v278: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3820510404' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:15.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:15.246 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:15.246 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1989644962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:15.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.244+0000 7f27e27fc700 1 -- 172.21.15.81:0/288461899 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f27ec0ff450 con 0x7f27d807b310 2024-09-18T13:01:15.246 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:01:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:01:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-09-18T13:01:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph-exporter" 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "18/23 daemons upgraded", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T13:01:15.247 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 msgr2=0x7f27d807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 0x7f27d807d7d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27ec100ed0 tx=0x7f27dc009190 comp rx=0 tx=0).stop 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 msgr2=0x7f27ec196590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bda0 tx=0x7f27e800bdd0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 shutdown_connections 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f27d807b310 0x7f27d807d7d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec0ffe50 0x7f27ec196590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 --2- 172.21.15.81:0/288461899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27ec1011a0 0x7f27ec196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.247+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 >> 172.21.15.81:0/288461899 conn(0x7f27ec0fa8c0 msgr2=0x7f27ec0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:15.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.248+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 shutdown_connections 2024-09-18T13:01:15.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.248+0000 7f27f36ec700 1 -- 172.21.15.81:0/288461899 wait complete. 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: pgmap v278: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3820510404' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:15.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1989644962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 -- 172.21.15.81:0/766149773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c101750 msgr2=0x7f513c103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 --2- 172.21.15.81:0/766149773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c101750 0x7f513c103b40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5130009910 tx=0x7f5130009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 -- 172.21.15.81:0/766149773 shutdown_connections 2024-09-18T13:01:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 --2- 172.21.15.81:0/766149773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c104080 0x7f513c106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 --2- 172.21.15.81:0/766149773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c101750 0x7f513c103b40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 -- 172.21.15.81:0/766149773 >> 172.21.15.81:0/766149773 conn(0x7f513c0fb160 msgr2=0x7f513c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 -- 172.21.15.81:0/766149773 shutdown_connections 2024-09-18T13:01:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.363+0000 7f51431ef700 1 -- 172.21.15.81:0/766149773 wait complete. 2024-09-18T13:01:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 Processor -- start 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 -- start start 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c101750 0x7f513c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c197340 con 0x7f513c104080 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f51431ef700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c197480 con 0x7f513c101750 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f513bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f513bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41470/0 (socket says 172.21.15.81:41470) 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.364+0000 7f513bfff700 1 -- 172.21.15.81:0/1173447846 learned_addr learned my addr 172.21.15.81:0/1173447846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f5140f8b700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c101750 0x7f513c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f513bfff700 1 -- 172.21.15.81:0/1173447846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c101750 msgr2=0x7f513c1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f513bfff700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c101750 0x7f513c1967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f513bfff700 1 -- 172.21.15.81:0/1173447846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300095f0 con 0x7f513c104080 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f513bfff700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f512800c8a0 tx=0x7f512800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512800cea0 con 0x7f513c104080 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5128004830 con 0x7f513c104080 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51280055b0 con 0x7f513c104080 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.365+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c19bf30 con 0x7f513c104080 2024-09-18T13:01:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.366+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c19c450 con 0x7f513c104080 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.367+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c190630 con 0x7f513c104080 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.367+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5128007ad0 con 0x7f513c104080 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.368+0000 7f5139ffb700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 0x7f512c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.368+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f512809e090 con 0x7f513c104080 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.368+0000 7f5140f8b700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 0x7f512c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.368+0000 7f5140f8b700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 0x7f512c07d7d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51300059d0 tx=0x7f5130005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:15.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.372+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5128061010 con 0x7f513c104080 2024-09-18T13:01:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.700+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f513c068af0 con 0x7f513c104080 2024-09-18T13:01:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.701+0000 7f5139ffb700 1 -- 172.21.15.81:0/1173447846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5128064130 con 0x7f513c104080 2024-09-18T13:01:15.703 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T13:01:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 msgr2=0x7f512c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 0x7f512c07d7d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51300059d0 tx=0x7f5130005920 comp rx=0 tx=0).stop 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 msgr2=0x7f513c196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f512800c8a0 tx=0x7f512800cc60 comp rx=0 tx=0).stop 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 shutdown_connections 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f512c07b310 0x7f512c07d7d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f513c101750 0x7f513c1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 --2- 172.21.15.81:0/1173447846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513c104080 0x7f513c196d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 >> 172.21.15.81:0/1173447846 conn(0x7f513c0fb160 msgr2=0x7f513c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 shutdown_connections 2024-09-18T13:01:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:15.703+0000 7f51431ef700 1 -- 172.21.15.81:0/1173447846 wait complete. 2024-09-18T13:01:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:16 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:16 smithi136 ceph-mon[80179]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:16 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1173447846' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:16 smithi136 ceph-mon[80179]: pgmap v279: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:16.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:16.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:16 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:16.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:16 smithi081 ceph-mon[92545]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:16.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:16 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1173447846' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:16.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:16 smithi081 ceph-mon[92545]: pgmap v279: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: pgmap v280: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-18T13:01:19.192 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.193 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.194 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.194 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.194 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: pgmap v280: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.315 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.316 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:20 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T13:01:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:20.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:20 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T13:01:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:21 smithi136 ceph-mon[80179]: Upgrade: Updating grafana.smithi081 2024-09-18T13:01:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:21 smithi136 ceph-mon[80179]: pgmap v281: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:21 smithi136 ceph-mon[80179]: Deploying daemon grafana.smithi081 on smithi081 2024-09-18T13:01:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:21 smithi081 ceph-mon[92545]: Upgrade: Updating grafana.smithi081 2024-09-18T13:01:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:21 smithi081 ceph-mon[92545]: pgmap v281: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:21 smithi081 ceph-mon[92545]: Deploying daemon grafana.smithi081 on smithi081 2024-09-18T13:01:23.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:23 smithi136 ceph-mon[80179]: pgmap v282: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:23.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:23 smithi081 ceph-mon[92545]: pgmap v282: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:24.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:24 smithi081 ceph-mon[92545]: pgmap v283: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:24.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:24 smithi136 ceph-mon[80179]: pgmap v283: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:27 smithi136 ceph-mon[80179]: pgmap v284: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:27.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:27 smithi081 ceph-mon[92545]: pgmap v284: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:29.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:29 smithi136 ceph-mon[80179]: pgmap v285: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:29.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:29 smithi081 ceph-mon[92545]: pgmap v285: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:31 smithi136 ceph-mon[80179]: pgmap v286: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:31.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:31 smithi081 ceph-mon[92545]: pgmap v286: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:33.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:33.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:33.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:32 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:33.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:32 smithi136 ceph-mon[80179]: pgmap v287: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:32 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:33.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:32 smithi081 ceph-mon[92545]: pgmap v287: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:35 smithi136 ceph-mon[80179]: pgmap v288: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:35 smithi081 ceph-mon[92545]: pgmap v288: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:37 smithi136 ceph-mon[80179]: pgmap v289: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:37 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:37 smithi081 ceph-mon[92545]: pgmap v289: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:37.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:37 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:39 smithi136 ceph-mon[80179]: pgmap v290: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:39.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:39 smithi081 ceph-mon[92545]: pgmap v290: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:40.201 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:40 smithi081 ceph-mon[92545]: pgmap v291: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:40.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:40 smithi136 ceph-mon[80179]: pgmap v291: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T13:01:41.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.566 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: Upgrade: Finalizing container_image settings 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:01:41.567 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:01:41.568 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.569 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: Upgrade: Complete! 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.570 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.571 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.609 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: Upgrade: Finalizing container_image settings 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:01:41.610 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:01:41.611 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.612 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: Upgrade: Complete! 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:41.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:41.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:41.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:41.614 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:42 smithi136 ceph-mon[80179]: pgmap v292: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:42 smithi081 ceph-mon[92545]: pgmap v292: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:45 smithi136 ceph-mon[80179]: pgmap v293: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:45 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:45 smithi081 ceph-mon[92545]: pgmap v293: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:45 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:01:45.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 -- 172.21.15.81:0/1785342771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0100e10 msgr2=0x7f5ea0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:45.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 --2- 172.21.15.81:0/1785342771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0100e10 0x7f5ea0101270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009910 tx=0x7f5e90009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 -- 172.21.15.81:0/1785342771 shutdown_connections 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 --2- 172.21.15.81:0/1785342771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0100e10 0x7f5ea0101270 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 --2- 172.21.15.81:0/1785342771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 -- 172.21.15.81:0/1785342771 >> 172.21.15.81:0/1785342771 conn(0x7f5ea00fb190 msgr2=0x7f5ea00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 -- 172.21.15.81:0/1785342771 shutdown_connections 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.823+0000 7f5ea7666700 1 -- 172.21.15.81:0/1785342771 wait complete. 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 Processor -- start 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 -- start start 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea0100e10 0x7f5ea01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0196fe0 con 0x7f5ea00ffc10 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea7666700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0197120 con 0x7f5ea0100e10 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea5402700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea5402700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53834/0 (socket says 172.21.15.81:53834) 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.824+0000 7f5ea5402700 1 -- 172.21.15.81:0/4199428787 learned_addr learned my addr 172.21.15.81:0/4199428787 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea4c01700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea0100e10 0x7f5ea01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea5402700 1 -- 172.21.15.81:0/4199428787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea0100e10 msgr2=0x7f5ea01969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea5402700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea0100e10 0x7f5ea01969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea5402700 1 -- 172.21.15.81:0/4199428787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900095f0 con 0x7f5ea00ffc10 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea5402700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c007e90 tx=0x7f5e9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9c017070 con 0x7f5ea00ffc10 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea019bbd0 con 0x7f5ea00ffc10 2024-09-18T13:01:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e9c00f040 con 0x7f5ea00ffc10 2024-09-18T13:01:45.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9c004850 con 0x7f5ea00ffc10 2024-09-18T13:01:45.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.825+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea019c120 con 0x7f5ea00ffc10 2024-09-18T13:01:45.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.826+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea0108700 con 0x7f5ea00ffc10 2024-09-18T13:01:45.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.827+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5e9c003a00 con 0x7f5ea00ffc10 2024-09-18T13:01:45.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.827+0000 7f5e967fc700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 0x7f5e8c07d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:45.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.828+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f5e9c09dde0 con 0x7f5ea00ffc10 2024-09-18T13:01:45.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.828+0000 7f5ea4c01700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 0x7f5e8c07d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:45.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.828+0000 7f5ea4c01700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 0x7f5e8c07d760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006010 tx=0x7f5e9000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:45.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:45.832+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5e9c060d80 con 0x7f5ea00ffc10 2024-09-18T13:01:46.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.062+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea0068c90 con 0x7f5e8c07b2a0 2024-09-18T13:01:46.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.063+0000 7f5e967fc700 1 -- 172.21.15.81:0/4199428787 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f5ea0068c90 con 0x7f5e8c07b2a0 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.065+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 msgr2=0x7f5e8c07d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.065+0000 7f5ea7666700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 0x7f5e8c07d760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006010 tx=0x7f5e9000b540 comp rx=0 tx=0).stop 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.065+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 msgr2=0x7f5ea0196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.065+0000 7f5ea7666700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c007e90 tx=0x7f5e9c00d3b0 comp rx=0 tx=0).stop 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 shutdown_connections 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e8c07b2a0 0x7f5e8c07d760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea00ffc10 0x7f5ea0196480 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 --2- 172.21.15.81:0/4199428787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea0100e10 0x7f5ea01969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 >> 172.21.15.81:0/4199428787 conn(0x7f5ea00fb190 msgr2=0x7f5ea0068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 shutdown_connections 2024-09-18T13:01:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:46.066+0000 7f5ea7666700 1 -- 172.21.15.81:0/4199428787 wait complete. 2024-09-18T13:01:46.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:01:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:01:47.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:47 smithi081 ceph-mon[92545]: pgmap v294: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:47.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:47 smithi136 ceph-mon[80179]: pgmap v294: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:48.313 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:48 smithi081 ceph-mon[92545]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:48.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:48 smithi136 ceph-mon[80179]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:48.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 -- 172.21.15.81:0/992648343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ff5a0 msgr2=0x7f97bc0ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 --2- 172.21.15.81:0/992648343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc0ff980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b0a0 tx=0x7f97b800b3b0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 -- 172.21.15.81:0/992648343 shutdown_connections 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 --2- 172.21.15.81:0/992648343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ffec0 0x7f97bc1048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 --2- 172.21.15.81:0/992648343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc0ff980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 -- 172.21.15.81:0/992648343 >> 172.21.15.81:0/992648343 conn(0x7f97bc074e30 msgr2=0x7f97bc075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 -- 172.21.15.81:0/992648343 shutdown_connections 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.545+0000 7f97c39d0700 1 -- 172.21.15.81:0/992648343 wait complete. 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 Processor -- start 2024-09-18T13:01:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 -- start start 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc19dc50 con 0x7f97bc0ffec0 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c39d0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc1a1990 con 0x7f97bc0ff5a0 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53858/0 (socket says 172.21.15.81:53858) 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 -- 172.21.15.81:0/2349787378 learned_addr learned my addr 172.21.15.81:0/2349787378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c176c700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 -- 172.21.15.81:0/2349787378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 msgr2=0x7f97bc19d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc19d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 -- 172.21.15.81:0/2349787378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8009d00 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c176c700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.546+0000 7f97c0f6b700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00b480 tx=0x7f97ac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.547+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97ac0118c0 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.547+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97ac010380 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.547+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc1a1c70 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.547+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97ac00f4f0 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.547+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc1a21c0 con 0x7f97bc0ffec0 2024-09-18T13:01:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.548+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc102050 con 0x7f97bc0ffec0 2024-09-18T13:01:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.548+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f97ac0104f0 con 0x7f97bc0ffec0 2024-09-18T13:01:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.549+0000 7f97b27fc700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 0x7f97a807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.549+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f97ac09de20 con 0x7f97bc0ffec0 2024-09-18T13:01:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.549+0000 7f97c176c700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 0x7f97a807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.549+0000 7f97c176c700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 0x7f97a807d7d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009480 tx=0x7f97b8000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.553+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f97ac060e40 con 0x7f97bc0ffec0 2024-09-18T13:01:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.779+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f97bc1a2490 con 0x7f97a807b310 2024-09-18T13:01:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.789+0000 7f97b27fc700 1 -- 172.21.15.81:0/2349787378 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f97bc1a2490 con 0x7f97a807b310 2024-09-18T13:01:48.790 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:01:48.790 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (39s) 12s ago 19m 17.5M - 0.27.0 11f11916f8cd 52fc4beb8753 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (107s) 12s ago 19m 8548k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 6ff0bf972297 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (102s) 79s ago 18m 8056k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 3227e6684b04 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (7m) 12s ago 19m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (7m) 79s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (17s) 12s ago 19m 48.4M - 10.4.0 c8b91775d855 82b42e91caad 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (2m) 12s ago 12m 19.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (2m) 12s ago 13m 69.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (2m) 79s ago 12m 16.3M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 465fbfb22e85 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (2m) 79s ago 13m 15.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (9m) 12s ago 20m 533M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (8m) 79s ago 18m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (8m) 12s ago 20m 60.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T13:01:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (8m) 79s ago 18m 45.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (88s) 12s ago 19m 8392k - 1.7.0 72c9c2088986 3df23878a733 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (82s) 79s ago 18m 3330k - 1.7.0 72c9c2088986 6d9d1864aea4 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 12s ago 16m 112M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (6m) 12s ago 16m 205M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 12s ago 15m 100M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (5m) 79s ago 15m 130M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (4m) 79s ago 15m 100M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (4m) 79s ago 14m 98.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T13:01:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (59s) 12s ago 18m 52.6M - 2.51.0 1d3b7f56885b ee27d7ca06c6 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 msgr2=0x7f97a807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 0x7f97a807d7d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009480 tx=0x7f97b8000f40 comp rx=0 tx=0).stop 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 msgr2=0x7f97bc19d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00b480 tx=0x7f97ac00b840 comp rx=0 tx=0).stop 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 shutdown_connections 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f97a807b310 0x7f97a807d7d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc0ff5a0 0x7f97bc19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 --2- 172.21.15.81:0/2349787378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97bc0ffec0 0x7f97bc19d570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.791+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 >> 172.21.15.81:0/2349787378 conn(0x7f97bc074e30 msgr2=0x7f97bc111b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.792+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 shutdown_connections 2024-09-18T13:01:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:48.792+0000 7f97c39d0700 1 -- 172.21.15.81:0/2349787378 wait complete. 2024-09-18T13:01:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:49 smithi136 ceph-mon[80179]: pgmap v295: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:49 smithi136 ceph-mon[80179]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:49 smithi081 ceph-mon[92545]: pgmap v295: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:49 smithi081 ceph-mon[92545]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:49.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade status' 2024-09-18T13:01:49.711 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:01:50.102 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:50.102 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:50 smithi081 ceph-mon[92545]: pgmap v296: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:50 smithi136 ceph-mon[80179]: pgmap v296: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 -- 172.21.15.81:0/3702935304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 msgr2=0x7f1db0105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 --2- 172.21.15.81:0/3702935304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0105880 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009910 tx=0x7f1da4009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 -- 172.21.15.81:0/3702935304 shutdown_connections 2024-09-18T13:01:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 --2- 172.21.15.81:0/3702935304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0105880 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 --2- 172.21.15.81:0/3702935304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 0x7f1db0101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 -- 172.21.15.81:0/3702935304 >> 172.21.15.81:0/3702935304 conn(0x7f1db00fc710 msgr2=0x7f1db00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 -- 172.21.15.81:0/3702935304 shutdown_connections 2024-09-18T13:01:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.436+0000 7f1db5976700 1 -- 172.21.15.81:0/3702935304 wait complete. 2024-09-18T13:01:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 Processor -- start 2024-09-18T13:01:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 -- start start 2024-09-18T13:01:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 0x7f1db0196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0197540 con 0x7f1db0101830 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.437+0000 7f1db5976700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db019b350 con 0x7f1db0100e80 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53876/0 (socket says 172.21.15.81:53876) 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 -- 172.21.15.81:0/1774954677 learned_addr learned my addr 172.21.15.81:0/1774954677 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1daeffd700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 0x7f1db0196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 -- 172.21.15.81:0/1774954677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 msgr2=0x7f1db0196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 0x7f1db0196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 -- 172.21.15.81:0/1774954677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40095f0 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1dae7fc700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1da40092e0 tx=0x7f1da400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da401d070 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1da400f460 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db019b5d0 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da40175d0 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.438+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db019bac0 con 0x7f1db0101830 2024-09-18T13:01:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.439+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db01091d0 con 0x7f1db0101830 2024-09-18T13:01:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.440+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1da400f5d0 con 0x7f1db0101830 2024-09-18T13:01:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.440+0000 7f1db4974700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 0x7f1d9807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.440+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f1da409f870 con 0x7f1db0101830 2024-09-18T13:01:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.440+0000 7f1daeffd700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 0x7f1d9807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.441+0000 7f1daeffd700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 0x7f1d9807d7d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009a10 tx=0x7f1da0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.445+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f1da4062810 con 0x7f1db0101830 2024-09-18T13:01:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.677+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1db0197d90 con 0x7f1d9807b310 2024-09-18T13:01:51.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.678+0000 7f1db4974700 1 -- 172.21.15.81:0/1774954677 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f1db0197d90 con 0x7f1d9807b310 2024-09-18T13:01:51.679 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:01:51.679 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": null, 2024-09-18T13:01:51.679 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": false, 2024-09-18T13:01:51.679 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "", 2024-09-18T13:01:51.680 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-09-18T13:01:51.680 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": null, 2024-09-18T13:01:51.680 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-18T13:01:51.680 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-09-18T13:01:51.680 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 msgr2=0x7f1d9807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 0x7f1d9807d7d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009a10 tx=0x7f1da0009190 comp rx=0 tx=0).stop 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 msgr2=0x7f1db0196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1da40092e0 tx=0x7f1da400bd70 comp rx=0 tx=0).stop 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 shutdown_connections 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f1d9807b310 0x7f1d9807d7d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1db0100e80 0x7f1db0196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 --2- 172.21.15.81:0/1774954677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db0101830 0x7f1db0196eb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 >> 172.21.15.81:0/1774954677 conn(0x7f1db00fc710 msgr2=0x7f1db00fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 shutdown_connections 2024-09-18T13:01:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:51.680+0000 7f1db5976700 1 -- 172.21.15.81:0/1774954677 wait complete. 2024-09-18T13:01:52.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph health detail' 2024-09-18T13:01:52.586 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:01:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:53 smithi136 ceph-mon[80179]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:53 smithi136 ceph-mon[80179]: pgmap v297: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:53.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:53 smithi081 ceph-mon[92545]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:53.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:53 smithi081 ceph-mon[92545]: pgmap v297: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 -- 172.21.15.81:0/3801345990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fff50 msgr2=0x7ffa80105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 --2- 172.21.15.81:0/3801345990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fff50 0x7ffa80105840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009910 tx=0x7ffa74009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 -- 172.21.15.81:0/3801345990 shutdown_connections 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 --2- 172.21.15.81:0/3801345990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fff50 0x7ffa80105840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 --2- 172.21.15.81:0/3801345990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800ff5a0 0x7ffa800ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 -- 172.21.15.81:0/3801345990 >> 172.21.15.81:0/3801345990 conn(0x7ffa80074e30 msgr2=0x7ffa80075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 -- 172.21.15.81:0/3801345990 shutdown_connections 2024-09-18T13:01:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.308+0000 7ffa849d7700 1 -- 172.21.15.81:0/3801345990 wait complete. 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 Processor -- start 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 -- start start 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 0x7ffa80100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80100fa0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa849d7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801010e0 con 0x7ffa800fff50 2024-09-18T13:01:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53902/0 (socket says 172.21.15.81:53902) 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 -- 172.21.15.81:0/315509581 learned_addr learned my addr 172.21.15.81:0/315509581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7dd9b700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 0x7ffa80100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 -- 172.21.15.81:0/315509581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 msgr2=0x7ffa80100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 0x7ffa80100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7e59c700 1 -- 172.21.15.81:0/315509581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740095f0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.309+0000 7ffa7dd9b700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 0x7ffa80100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa7e59c700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000d8d0 tx=0x7ffa7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa70009940 con 0x7ffa800ff5a0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa70010460 con 0x7ffa800ff5a0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7000f5f0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa801a2a90 con 0x7ffa800ff5a0 2024-09-18T13:01:54.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.310+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa801a2ea0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.311+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa80109200 con 0x7ffa800ff5a0 2024-09-18T13:01:54.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.311+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ffa700105d0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.312+0000 7ffa6f7fe700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 0x7ffa6807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.312+0000 7ffa7dd9b700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 0x7ffa6807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.312+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ffa7009e2e0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.313+0000 7ffa7dd9b700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 0x7ffa6807d7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa80101d10 tx=0x7ffa7401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.317+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ffa70061300 con 0x7ffa800ff5a0 2024-09-18T13:01:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.613+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffa8004f2e0 con 0x7ffa800ff5a0 2024-09-18T13:01:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.613+0000 7ffa6f7fe700 1 -- 172.21.15.81:0/315509581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ffa70064420 con 0x7ffa800ff5a0 2024-09-18T13:01:54.615 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-09-18T13:01:54.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 msgr2=0x7ffa6807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 0x7ffa6807d7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa80101d10 tx=0x7ffa7401a040 comp rx=0 tx=0).stop 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 msgr2=0x7ffa80100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000d8d0 tx=0x7ffa7000dc90 comp rx=0 tx=0).stop 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 shutdown_connections 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ffa6807b310 0x7ffa6807d7d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800ff5a0 0x7ffa80100520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 --2- 172.21.15.81:0/315509581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa800fff50 0x7ffa80100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 >> 172.21.15.81:0/315509581 conn(0x7ffa80074e30 msgr2=0x7ffa800fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.615+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 shutdown_connections 2024-09-18T13:01:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:54.616+0000 7ffa849d7700 1 -- 172.21.15.81:0/315509581 wait complete. 2024-09-18T13:01:55.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:55 smithi081 ceph-mon[92545]: pgmap v298: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:55.295 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:55 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/315509581' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:55 smithi136 ceph-mon[80179]: pgmap v298: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:55.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:55 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/315509581' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:55.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:01:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:01:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 -- 172.21.15.81:0/452714390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 msgr2=0x7f34340ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 --2- 172.21.15.81:0/452714390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f34340ff980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f341c009910 tx=0x7f341c009c20 comp rx=0 tx=0).stop 2024-09-18T13:01:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 -- 172.21.15.81:0/452714390 shutdown_connections 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 --2- 172.21.15.81:0/452714390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 0x7f3434105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 --2- 172.21.15.81:0/452714390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f34340ff980 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 -- 172.21.15.81:0/452714390 >> 172.21.15.81:0/452714390 conn(0x7f3434074e30 msgr2=0x7f3434075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 -- 172.21.15.81:0/452714390 shutdown_connections 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.156+0000 7f343b069700 1 -- 172.21.15.81:0/452714390 wait complete. 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 Processor -- start 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 -- start start 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 0x7f343419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343419d3b0 con 0x7f34340ff5a0 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f343b069700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3434196860 con 0x7f34340fff50 2024-09-18T13:01:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50038/0 (socket says 172.21.15.81:50038) 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 -- 172.21.15.81:0/2018212477 learned_addr learned my addr 172.21.15.81:0/2018212477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3433fff700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 0x7f343419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 -- 172.21.15.81:0/2018212477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 msgr2=0x7f343419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 0x7f343419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 -- 172.21.15.81:0/2018212477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0095f0 con 0x7f34340ff5a0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.157+0000 7f3438e05700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f341c006010 tx=0x7f341c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.158+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341c01d070 con 0x7f34340ff5a0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.158+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f341c004fb0 con 0x7f34340ff5a0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.158+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3434196ae0 con 0x7f34340ff5a0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.158+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341c00f690 con 0x7f34340ff5a0 2024-09-18T13:01:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.158+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3434196fd0 con 0x7f34340ff5a0 2024-09-18T13:01:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.159+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3434109270 con 0x7f34340ff5a0 2024-09-18T13:01:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.160+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f341c0228a0 con 0x7f34340ff5a0 2024-09-18T13:01:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.160+0000 7f3431ffb700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 0x7f342007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.160+0000 7f3433fff700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 0x7f342007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.160+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f341c09fb90 con 0x7f34340ff5a0 2024-09-18T13:01:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.161+0000 7f3433fff700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 0x7f342007d7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3434107790 tx=0x7f34240072f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.165+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f341c062bb0 con 0x7f34340ff5a0 2024-09-18T13:01:57.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:57 smithi136 ceph-mon[80179]: pgmap v299: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:57.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:57 smithi081 ceph-mon[92545]: pgmap v299: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.465+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f343404f2e0 con 0x7f34340ff5a0 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.465+0000 7f3431ffb700 1 -- 172.21.15.81:0/2018212477 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f341c027280 con 0x7f34340ff5a0 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T13:01:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T13:01:57.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:01:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 msgr2=0x7f342007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 0x7f342007d7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3434107790 tx=0x7f34240072f0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 msgr2=0x7f343419c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f341c006010 tx=0x7f341c00be20 comp rx=0 tx=0).stop 2024-09-18T13:01:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 shutdown_connections 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f342007b310 0x7f342007d7d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34340ff5a0 0x7f343419c7e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 --2- 172.21.15.81:0/2018212477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340fff50 0x7f343419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 >> 172.21.15.81:0/2018212477 conn(0x7f3434074e30 msgr2=0x7f34340fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 shutdown_connections 2024-09-18T13:01:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:01:57.468+0000 7f343b069700 1 -- 172.21.15.81:0/2018212477 wait complete. 2024-09-18T13:01:58.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:58 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2018212477' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:58.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:58 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2018212477' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:59.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:01:59 smithi081 ceph-mon[92545]: pgmap v300: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:01:59.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:01:59 smithi136 ceph-mon[80179]: pgmap v300: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:00 smithi136 ceph-mon[80179]: pgmap v301: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:00 smithi081 ceph-mon[92545]: pgmap v301: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:01.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-18T13:02:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:02:03.272 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:03 smithi081 ceph-mon[92545]: pgmap v302: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:03.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:03 smithi136 ceph-mon[80179]: pgmap v302: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:03.514 INFO:teuthology.orchestra.run.smithi081.stdout:wait for servicemap items w/ changing names to refresh 2024-09-18T13:02:04.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'sleep 60' 2024-09-18T13:02:04.413 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:02:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:05 smithi081 ceph-mon[92545]: pgmap v303: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:05.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:05 smithi136 ceph-mon[80179]: pgmap v303: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:05.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:07.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:07 smithi136 ceph-mon[80179]: pgmap v304: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:07.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:07 smithi081 ceph-mon[92545]: pgmap v304: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:08 smithi081 ceph-mon[92545]: pgmap v305: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:08.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:08 smithi136 ceph-mon[80179]: pgmap v305: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:11.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:11 smithi136 ceph-mon[80179]: pgmap v306: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:11.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:11 smithi081 ceph-mon[92545]: pgmap v306: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:13.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:13 smithi136 ceph-mon[80179]: pgmap v307: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:13.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:13 smithi081 ceph-mon[92545]: pgmap v307: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:14 smithi081 ceph-mon[92545]: pgmap v308: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:14.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:14 smithi136 ceph-mon[80179]: pgmap v308: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:17.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:17 smithi136 ceph-mon[80179]: pgmap v309: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:17.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:17 smithi081 ceph-mon[92545]: pgmap v309: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:19.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:19 smithi136 ceph-mon[80179]: pgmap v310: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:19.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:19 smithi081 ceph-mon[92545]: pgmap v310: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:20.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:20 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:20.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:20 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:21.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:21 smithi136 ceph-mon[80179]: pgmap v311: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:21.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:21 smithi081 ceph-mon[92545]: pgmap v311: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:22.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:22 smithi136 ceph-mon[80179]: pgmap v312: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:22.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:22 smithi081 ceph-mon[92545]: pgmap v312: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:25.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:25 smithi136 ceph-mon[80179]: pgmap v313: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:25.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:25 smithi081 ceph-mon[92545]: pgmap v313: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:27.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:27 smithi136 ceph-mon[80179]: pgmap v314: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:27.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:27 smithi081 ceph-mon[92545]: pgmap v314: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:28.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:28 smithi136 ceph-mon[80179]: pgmap v315: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:28.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:28 smithi081 ceph-mon[92545]: pgmap v315: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:31.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:31 smithi136 ceph-mon[80179]: pgmap v316: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:31.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:31 smithi081 ceph-mon[92545]: pgmap v316: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:33.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:33 smithi136 ceph-mon[80179]: pgmap v317: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:33.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:33 smithi081 ceph-mon[92545]: pgmap v317: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:34.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:34 smithi136 ceph-mon[80179]: pgmap v318: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:34.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:34 smithi081 ceph-mon[92545]: pgmap v318: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:35.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:35.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:36.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:36 smithi136 ceph-mon[80179]: pgmap v319: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:36.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:36 smithi081 ceph-mon[92545]: pgmap v319: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:39.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:39 smithi136 ceph-mon[80179]: pgmap v320: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:39.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:39 smithi081 ceph-mon[92545]: pgmap v320: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:40 smithi081 ceph-mon[92545]: pgmap v321: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:40.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:40 smithi136 ceph-mon[80179]: pgmap v321: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:02:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:02:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:02:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:02:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:42.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:42 smithi081 ceph-mon[92545]: pgmap v322: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:02:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:02:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:02:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:42 smithi136 ceph-mon[80179]: pgmap v322: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:45.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:45 smithi136 ceph-mon[80179]: pgmap v323: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:45.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:45 smithi081 ceph-mon[92545]: pgmap v323: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:46.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:46 smithi081 ceph-mon[92545]: pgmap v324: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:46 smithi136 ceph-mon[80179]: pgmap v324: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:49.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:49 smithi136 ceph-mon[80179]: pgmap v325: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:49.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:49 smithi081 ceph-mon[92545]: pgmap v325: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:50 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:50.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:50 smithi136 ceph-mon[80179]: pgmap v326: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:50 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:50.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:50 smithi081 ceph-mon[92545]: pgmap v326: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:53.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:53 smithi136 ceph-mon[80179]: pgmap v327: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:53.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:53 smithi081 ceph-mon[92545]: pgmap v327: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:54.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:54 smithi136 ceph-mon[80179]: pgmap v328: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:54.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:54 smithi081 ceph-mon[92545]: pgmap v328: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:56 smithi081 ceph-mon[92545]: pgmap v329: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:56 smithi136 ceph-mon[80179]: pgmap v329: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:58.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:02:58 smithi081 ceph-mon[92545]: pgmap v330: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:02:58.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:02:58 smithi136 ceph-mon[80179]: pgmap v330: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:00.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:00 smithi081 ceph-mon[92545]: pgmap v331: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:00.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:00 smithi136 ceph-mon[80179]: pgmap v331: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:02.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:02 smithi081 ceph-mon[92545]: pgmap v332: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:02 smithi136 ceph-mon[80179]: pgmap v332: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:04.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:04 smithi081 ceph-mon[92545]: pgmap v333: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:04.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:04 smithi136 ceph-mon[80179]: pgmap v333: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:05.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:05.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:06.239 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:06 smithi081 ceph-mon[92545]: pgmap v334: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:06.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:06 smithi136 ceph-mon[80179]: pgmap v334: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:06.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:03:06.819 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:08.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:08 smithi081 ceph-mon[92545]: pgmap v335: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:08.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:08 smithi136 ceph-mon[80179]: pgmap v335: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2051131738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ffda0 msgr2=0x7f08a4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2051131738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ffda0 0x7f08a4100180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009910 tx=0x7f08a0009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2051131738 shutdown_connections 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2051131738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a4100750 0x7f08a41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2051131738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ffda0 0x7f08a4100180 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.634+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2051131738 >> 172.21.15.81:0/2051131738 conn(0x7f08a40fb650 msgr2=0x7f08a40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2051131738 shutdown_connections 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2051131738 wait complete. 2024-09-18T13:03:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 Processor -- start 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 -- start start 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a40ffda0 0x7f08a419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a419d350 con 0x7f08a4100750 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.635+0000 7f08ab7ed700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4196800 con 0x7f08a40ffda0 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55642/0 (socket says 172.21.15.81:55642) 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 -- 172.21.15.81:0/2576755455 learned_addr learned my addr 172.21.15.81:0/2576755455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a9589700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a40ffda0 0x7f08a419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 -- 172.21.15.81:0/2576755455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a40ffda0 msgr2=0x7f08a419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a40ffda0 0x7f08a419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 -- 172.21.15.81:0/2576755455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00095f0 con 0x7f08a4100750 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08a8d88700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f089400b480 tx=0x7f089400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08940118c0 con 0x7f08a4100750 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4196ae0 con 0x7f08a4100750 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a4197030 con 0x7f08a4100750 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0894010380 con 0x7f08a4100750 2024-09-18T13:03:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.636+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f089400f4f0 con 0x7f08a4100750 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.637+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a4108140 con 0x7f08a4100750 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.638+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f08940104f0 con 0x7f08a4100750 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.639+0000 7f089a7fc700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 0x7f089007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.639+0000 7f08a9589700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 0x7f089007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.639+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f089409e200 con 0x7f08a4100750 2024-09-18T13:03:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.639+0000 7f08a9589700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 0x7f089007d7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.642+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f08940612c0 con 0x7f08a4100750 2024-09-18T13:03:08.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.855+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 --> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08a4197300 con 0x7f089007b310 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.865+0000 7f089a7fc700 1 -- 172.21.15.81:0/2576755455 <== mgr.34104 v2:172.21.15.81:6800/3835064710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f08a4197300 con 0x7f089007b310 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (119s) 92s ago 20m 17.5M - 0.27.0 11f11916f8cd 52fc4beb8753 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi081 smithi081 running (3m) 92s ago 20m 8548k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 6ff0bf972297 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-exporter.smithi136 smithi136 running (3m) 2m ago 19m 8056k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 3227e6684b04 2024-09-18T13:03:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (8m) 92s ago 20m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b9b52044184c 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi136 smithi136 running (8m) 2m ago 19m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 fbec6d6ac41c 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (97s) 92s ago 20m 48.4M - 10.4.0 c8b91775d855 82b42e91caad 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.hmnvyn smithi081 running (3m) 92s ago 14m 19.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 123b3655568e 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.irimad smithi081 running (4m) 92s ago 14m 69.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f268fd36df48 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.lwvlbo smithi136 running (3m) 2m ago 14m 16.3M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 465fbfb22e85 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi136.tfcykk smithi136 running (3m) 2m ago 14m 15.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9631e30075f5 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.pfnvgp smithi081 *:8443,9283,8765 running (11m) 92s ago 22m 533M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 5137ed98f8e9 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi136.vdkrdt smithi136 *:8443,9283,8765 running (9m) 2m ago 19m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 20edcab3b520 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (9m) 92s ago 22m 60.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e507e4a0d8f8 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi136 smithi136 running (9m) 2m ago 19m 45.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2dbae2016988 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (2m) 92s ago 20m 8392k - 1.7.0 72c9c2088986 3df23878a733 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi136 smithi136 *:9100 running (2m) 2m ago 19m 3330k - 1.7.0 72c9c2088986 6d9d1864aea4 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 92s ago 18m 112M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 abc5ecb73052 2024-09-18T13:03:08.867 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 92s ago 17m 205M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 713392197e86 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 92s ago 17m 100M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9f36a95559cd 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi136 running (6m) 2m ago 16m 130M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 07ef5686c7b9 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi136 running (5m) 2m ago 16m 100M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 be46e31b7ed1 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi136 running (5m) 2m ago 15m 98.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 15714fb1bccc 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 92s ago 20m 52.6M - 2.51.0 1d3b7f56885b ee27d7ca06c6 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 msgr2=0x7f089007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 0x7f089007d7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a001a040 comp rx=0 tx=0).stop 2024-09-18T13:03:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 msgr2=0x7f08a419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f089400b480 tx=0x7f089400b840 comp rx=0 tx=0).stop 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 shutdown_connections 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f089007b310 0x7f089007d7d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08a40ffda0 0x7f08a419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 --2- 172.21.15.81:0/2576755455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4100750 0x7f08a419ccc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 >> 172.21.15.81:0/2576755455 conn(0x7f08a40fb650 msgr2=0x7f08a40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 shutdown_connections 2024-09-18T13:03:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:08.867+0000 7f08ab7ed700 1 -- 172.21.15.81:0/2576755455 wait complete. 2024-09-18T13:03:09.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:09 smithi081 ceph-mon[92545]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:09.465 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:09 smithi136 ceph-mon[80179]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:09.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:03:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:10.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:10 smithi081 ceph-mon[92545]: pgmap v336: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:10 smithi136 ceph-mon[80179]: pgmap v336: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 -- 172.21.15.81:0/763279734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4440ffb40 msgr2=0x7fc4440fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/763279734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4440ffb40 0x7fc4440fffc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009910 tx=0x7fc42c009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 -- 172.21.15.81:0/763279734 shutdown_connections 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/763279734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4440ffb40 0x7fc4440fffc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/763279734 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc444105bf0 0x7fc444105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 -- 172.21.15.81:0/763279734 >> 172.21.15.81:0/763279734 conn(0x7fc4440fb610 msgr2=0x7fc4440fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 -- 172.21.15.81:0/763279734 shutdown_connections 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.407+0000 7fc44a6ea700 1 -- 172.21.15.81:0/763279734 wait complete. 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 Processor -- start 2024-09-18T13:03:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 -- start start 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4440ffb40 0x7fc44419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44419d140 con 0x7fc444105bf0 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc44a6ea700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444196680 con 0x7fc4440ffb40 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55662/0 (socket says 172.21.15.81:55662) 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 -- 172.21.15.81:0/3866280866 learned_addr learned my addr 172.21.15.81:0/3866280866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 -- 172.21.15.81:0/3866280866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4440ffb40 msgr2=0x7fc44419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4440ffb40 0x7fc44419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 -- 172.21.15.81:0/3866280866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0095f0 con 0x7fc444105bf0 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.408+0000 7fc43bfff700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006010 tx=0x7fc42c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.409+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42c01d070 con 0x7fc444105bf0 2024-09-18T13:03:11.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.409+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc42c004fb0 con 0x7fc444105bf0 2024-09-18T13:03:11.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.409+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc444196900 con 0x7fc444105bf0 2024-09-18T13:03:11.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.409+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42c022ea0 con 0x7fc444105bf0 2024-09-18T13:03:11.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.409+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc444196df0 con 0x7fc444105bf0 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.410+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44404f2e0 con 0x7fc444105bf0 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.410+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc42c022470 con 0x7fc444105bf0 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.411+0000 7fc441ffb700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 0x7fc43007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.411+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc42c09f880 con 0x7fc444105bf0 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.411+0000 7fc443fff700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 0x7fc43007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:11.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.411+0000 7fc443fff700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 0x7fc43007d7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc434005fd0 tx=0x7fc434005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.415+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fc42c062950 con 0x7fc444105bf0 2024-09-18T13:03:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.712+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc444197b90 con 0x7fc444105bf0 2024-09-18T13:03:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.712+0000 7fc441ffb700 1 -- 172.21.15.81:0/3866280866 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fc42c022720 con 0x7fc444105bf0 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-18T13:03:11.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:03:11.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T13:03:11.715 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-09-18T13:03:11.715 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:03:11.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T13:03:11.715 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 msgr2=0x7fc43007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 0x7fc43007d7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc434005fd0 tx=0x7fc434005d00 comp rx=0 tx=0).stop 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 msgr2=0x7fc44419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006010 tx=0x7fc42c00be20 comp rx=0 tx=0).stop 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 shutdown_connections 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc43007b310 0x7fc43007d7d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4440ffb40 0x7fc44419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 --2- 172.21.15.81:0/3866280866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc444105bf0 0x7fc44419cb40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 >> 172.21.15.81:0/3866280866 conn(0x7fc4440fb610 msgr2=0x7fc444068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 shutdown_connections 2024-09-18T13:03:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:11.715+0000 7fc44a6ea700 1 -- 172.21.15.81:0/3866280866 wait complete. 2024-09-18T13:03:12.035 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:11 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3866280866' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:12.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:11 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3866280866' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:12.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-18T13:03:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:12.972 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:12 smithi081 ceph-mon[92545]: pgmap v337: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:13.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:12 smithi136 ceph-mon[80179]: pgmap v337: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:14.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 -- 172.21.15.81:0/3516414465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780ff5a0 msgr2=0x7f01780ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 --2- 172.21.15.81:0/3516414465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780ff5a0 0x7f01780ff980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0168009910 tx=0x7f0168009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 -- 172.21.15.81:0/3516414465 shutdown_connections 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 --2- 172.21.15.81:0/3516414465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780fff50 0x7f0178105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 --2- 172.21.15.81:0/3516414465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780ff5a0 0x7f01780ff980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 -- 172.21.15.81:0/3516414465 >> 172.21.15.81:0/3516414465 conn(0x7f0178074e30 msgr2=0x7f0178075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 -- 172.21.15.81:0/3516414465 shutdown_connections 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.238+0000 7f017e450700 1 -- 172.21.15.81:0/3516414465 wait complete. 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 Processor -- start 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 -- start start 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780ff5a0 0x7f017819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017819d2d0 con 0x7f01780fff50 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f017e450700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178196780 con 0x7f01780ff5a0 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55674/0 (socket says 172.21.15.81:55674) 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 -- 172.21.15.81:0/3191035823 learned_addr learned my addr 172.21.15.81:0/3191035823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f0177fff700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780ff5a0 0x7f017819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 -- 172.21.15.81:0/3191035823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780ff5a0 msgr2=0x7f017819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780ff5a0 0x7f017819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.239+0000 7f01777fe700 1 -- 172.21.15.81:0/3191035823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680095f0 con 0x7f01780fff50 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f01777fe700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c8f0 tx=0x7f016c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c007a50 con 0x7f01780fff50 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178196a60 con 0x7f01780fff50 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f016c007bb0 con 0x7f01780fff50 2024-09-18T13:03:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c018630 con 0x7f01780fff50 2024-09-18T13:03:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.240+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0178196fb0 con 0x7f01780fff50 2024-09-18T13:03:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.241+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178109270 con 0x7f01780fff50 2024-09-18T13:03:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.241+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f016c007d20 con 0x7f01780fff50 2024-09-18T13:03:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.242+0000 7f01757fa700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 0x7f016007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.242+0000 7f0177fff700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 0x7f016007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.242+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f016c09e390 con 0x7f01780fff50 2024-09-18T13:03:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.242+0000 7f0177fff700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 0x7f016007d7d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f016800b5c0 tx=0x7f016801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.246+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f016c061330 con 0x7f01780fff50 2024-09-18T13:03:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:14 smithi081 ceph-mon[92545]: pgmap v338: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.554+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f017804f2e0 con 0x7f01780fff50 2024-09-18T13:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.555+0000 7f01757fa700 1 -- 172.21.15.81:0/3191035823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f016c064450 con 0x7f01780fff50 2024-09-18T13:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 msgr2=0x7f016007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 0x7f016007d7d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f016800b5c0 tx=0x7f016801a040 comp rx=0 tx=0).stop 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 msgr2=0x7f017819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c8f0 tx=0x7f016c00ccb0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 shutdown_connections 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f016007b310 0x7f016007d7d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01780ff5a0 0x7f017819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 --2- 172.21.15.81:0/3191035823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01780fff50 0x7f017819cc40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 >> 172.21.15.81:0/3191035823 conn(0x7f0178074e30 msgr2=0x7f01780fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 shutdown_connections 2024-09-18T13:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:14.557+0000 7f017e450700 1 -- 172.21.15.81:0/3191035823 wait complete. 2024-09-18T13:03:14.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:14 smithi136 ceph-mon[80179]: pgmap v338: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:14.568 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-09-18T13:03:15.230 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3191035823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:15.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-18T13:03:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:15.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3191035823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:16.309 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:16 smithi081 ceph-mon[92545]: pgmap v339: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:16.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:16 smithi136 ceph-mon[80179]: pgmap v339: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 -- 172.21.15.81:0/1473142065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 msgr2=0x7f40741047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 --2- 172.21.15.81:0/1473142065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f40741047a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f405c009910 tx=0x7f405c009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 -- 172.21.15.81:0/1473142065 shutdown_connections 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 --2- 172.21.15.81:0/1473142065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f40741047a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 --2- 172.21.15.81:0/1473142065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 0x7f4074100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 -- 172.21.15.81:0/1473142065 >> 172.21.15.81:0/1473142065 conn(0x7f40740fb650 msgr2=0x7f40740fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 -- 172.21.15.81:0/1473142065 shutdown_connections 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.144+0000 7f4079d0c700 1 -- 172.21.15.81:0/1473142065 wait complete. 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 Processor -- start 2024-09-18T13:03:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 -- start start 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 0x7f407419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407419c210 con 0x7f4074100750 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4079d0c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074195730 con 0x7f40740ffda0 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4072ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4072ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56982/0 (socket says 172.21.15.81:56982) 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.145+0000 7f4072ffd700 1 -- 172.21.15.81:0/326784612 learned_addr learned my addr 172.21.15.81:0/326784612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f40737fe700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 0x7f407419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4072ffd700 1 -- 172.21.15.81:0/326784612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 msgr2=0x7f407419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4072ffd700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 0x7f407419b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4072ffd700 1 -- 172.21.15.81:0/326784612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0095f0 con 0x7f4074100750 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4072ffd700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c005f50 tx=0x7f405c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c01d070 con 0x7f4074100750 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4074195960 con 0x7f4074100750 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f405c00f460 con 0x7f4074100750 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c017630 con 0x7f4074100750 2024-09-18T13:03:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.146+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4074195e50 con 0x7f4074100750 2024-09-18T13:03:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.147+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407404f2e0 con 0x7f4074100750 2024-09-18T13:03:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.148+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f405c00f5d0 con 0x7f4074100750 2024-09-18T13:03:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.148+0000 7f4070ff9700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 0x7f406007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.149+0000 7f40737fe700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 0x7f406007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.149+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f405c09f9b0 con 0x7f4074100750 2024-09-18T13:03:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.149+0000 7f40737fe700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 0x7f406007d7d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4064007dc0 tx=0x7f40640072f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.153+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f405c062950 con 0x7f4074100750 2024-09-18T13:03:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.447+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4074196c40 con 0x7f4074100750 2024-09-18T13:03:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.447+0000 7f4070ff9700 1 -- 172.21.15.81:0/326784612 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f405c065a70 con 0x7f4074100750 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.449+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 msgr2=0x7f406007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.449+0000 7f4079d0c700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 0x7f406007d7d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4064007dc0 tx=0x7f40640072f0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.449+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 msgr2=0x7f407419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.449+0000 7f4079d0c700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c005f50 tx=0x7f405c00be20 comp rx=0 tx=0).stop 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 shutdown_connections 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f406007b310 0x7f406007d7d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40740ffda0 0x7f407419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 --2- 172.21.15.81:0/326784612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4074100750 0x7f407419bb80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 >> 172.21.15.81:0/326784612 conn(0x7f40740fb650 msgr2=0x7f40740fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 shutdown_connections 2024-09-18T13:03:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:17.450+0000 7f4079d0c700 1 -- 172.21.15.81:0/326784612 wait complete. 2024-09-18T13:03:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)" 2024-09-18T13:03:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:17 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/326784612' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:17.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:17 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/326784612' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:18.364 DEBUG:teuthology.parallel:result is None 2024-09-18T13:03:18.365 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T13:03:18.376 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T13:03:18.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T13:03:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:18.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:18 smithi081 ceph-mon[92545]: pgmap v340: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:18 smithi136 ceph-mon[80179]: pgmap v340: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:19.671 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:19.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 -- 172.21.15.81:0/1251745241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 msgr2=0x7fe8701058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 --2- 172.21.15.81:0/1251745241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe8701058a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe864009910 tx=0x7fe864009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 -- 172.21.15.81:0/1251745241 shutdown_connections 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 --2- 172.21.15.81:0/1251745241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe8701058a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 --2- 172.21.15.81:0/1251745241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 0x7fe870101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 -- 172.21.15.81:0/1251745241 >> 172.21.15.81:0/1251745241 conn(0x7fe8700fc750 msgr2=0x7fe8700feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 -- 172.21.15.81:0/1251745241 shutdown_connections 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 -- 172.21.15.81:0/1251745241 wait complete. 2024-09-18T13:03:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.294+0000 7fe87548c700 1 Processor -- start 2024-09-18T13:03:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe87548c700 1 -- start start 2024-09-18T13:03:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe87548c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 0x7fe87019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe87548c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe87548c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87019d2d0 con 0x7fe870101850 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe87548c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870196780 con 0x7fe870100ea0 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57002/0 (socket says 172.21.15.81:57002) 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 -- 172.21.15.81:0/1761464825 learned_addr learned my addr 172.21.15.81:0/1761464825 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86effd700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 0x7fe87019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 -- 172.21.15.81:0/1761464825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 msgr2=0x7fe87019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 0x7fe87019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.295+0000 7fe86e7fc700 1 -- 172.21.15.81:0/1761464825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640095f0 con 0x7fe870101850 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe86e7fc700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe86400bd70 tx=0x7fe86400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86401d070 con 0x7fe870101850 2024-09-18T13:03:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe864005dc0 con 0x7fe870101850 2024-09-18T13:03:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe870196a00 con 0x7fe870101850 2024-09-18T13:03:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe864017400 con 0x7fe870101850 2024-09-18T13:03:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.296+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870196ef0 con 0x7fe870101850 2024-09-18T13:03:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.297+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8701092a0 con 0x7fe870101850 2024-09-18T13:03:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.298+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe86400f460 con 0x7fe870101850 2024-09-18T13:03:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.299+0000 7fe857fff700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 0x7fe85807d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.299+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe86409f880 con 0x7fe870101850 2024-09-18T13:03:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.299+0000 7fe86effd700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 0x7fe85807d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.301+0000 7fe86effd700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 0x7fe85807d820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe860005950 tx=0x7fe86000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:20.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.305+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe864062780 con 0x7fe870101850 2024-09-18T13:03:20.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.562+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe87004f2e0 con 0x7fe870101850 2024-09-18T13:03:20.563 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:20 smithi081 ceph-mon[92545]: pgmap v341: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:20.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.562+0000 7fe857fff700 1 -- 172.21.15.81:0/1761464825 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1991 (secure 0 0 0) 0x7fe8640658a0 con 0x7fe870101850 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:e46 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-18T12:59:56:556179+0000 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-18T13:03:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 46 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T12:48:39.794953+0000 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T12:59:56.556173+0000 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-18T13:03:20.565 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 95 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 2 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34434,1=34466} 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-09-18T13:03:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34434 members: 34434,34466 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.irimad{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.81:6826/380455521,v1:172.21.15.81:6827/380455521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.hmnvyn{1:34466} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.81:6828/3322153794,v1:172.21.15.81:6829/3322153794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.tfcykk{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6824/1684210373,v1:172.21.15.136:6825/1684210373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:20.567 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi136.lwvlbo{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.136:6826/1739515569,v1:172.21.15.136:6827/1739515569] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 msgr2=0x7fe85807d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 0x7fe85807d820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe860005950 tx=0x7fe86000b410 comp rx=0 tx=0).stop 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 msgr2=0x7fe87019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe86400bd70 tx=0x7fe86400bda0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 shutdown_connections 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe85807b360 0x7fe85807d820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe870100ea0 0x7fe87019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 --2- 172.21.15.81:0/1761464825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe870101850 0x7fe87019cc40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.564+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 >> 172.21.15.81:0/1761464825 conn(0x7fe8700fc750 msgr2=0x7fe8700fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:20.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.565+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 shutdown_connections 2024-09-18T13:03:20.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:20.565+0000 7fe87548c700 1 -- 172.21.15.81:0/1761464825 wait complete. 2024-09-18T13:03:20.569 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-18T13:03:20.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:20 smithi136 ceph-mon[80179]: pgmap v341: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:21.245 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-18T13:03:21.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T13:03:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:21.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:21 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1761464825' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:21.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:21 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1761464825' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:22.795 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:22 smithi081 ceph-mon[92545]: pgmap v342: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:22.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:22 smithi136 ceph-mon[80179]: pgmap v342: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:23.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 -- 172.21.15.81:0/1490419060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0ffc20 msgr2=0x7fc40c100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 --2- 172.21.15.81:0/1490419060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0ffc20 0x7fc40c100080 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 -- 172.21.15.81:0/1490419060 shutdown_connections 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 --2- 172.21.15.81:0/1490419060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0ffc20 0x7fc40c100080 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 --2- 172.21.15.81:0/1490419060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c105bd0 0x7fc40c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 -- 172.21.15.81:0/1490419060 >> 172.21.15.81:0/1490419060 conn(0x7fc40c075670 msgr2=0x7fc40c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 -- 172.21.15.81:0/1490419060 shutdown_connections 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.260+0000 7fc41103e700 1 -- 172.21.15.81:0/1490419060 wait complete. 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 Processor -- start 2024-09-18T13:03:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 -- start start 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c0ffc20 0x7fc40c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c195620 con 0x7fc40c105bd0 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc41103e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c195790 con 0x7fc40c0ffc20 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57020/0 (socket says 172.21.15.81:57020) 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc40a59c700 1 -- 172.21.15.81:0/1032650462 learned_addr learned my addr 172.21.15.81:0/1032650462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.261+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c0ffc20 0x7fc40c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc40a59c700 1 -- 172.21.15.81:0/1032650462 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c0ffc20 msgr2=0x7fc40c19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc40a59c700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c0ffc20 0x7fc40c19b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc40a59c700 1 -- 172.21.15.81:0/1032650462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0095f0 con 0x7fc40c105bd0 2024-09-18T13:03:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc40a59c700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0092e0 tx=0x7fc3fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3fc01d070 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3fc005e00 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3fc017400 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c195a10 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.262+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c195f00 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.263+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c1080d0 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.264+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc3fc00f460 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.264+0000 7fc3f3fff700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 0x7fc3f407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.264+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc3fc09f920 con 0x7fc40c105bd0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.264+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 0x7fc3f407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.264+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 0x7fc3f407d7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc400005950 tx=0x7fc4000058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.268+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fc3fc062860 con 0x7fc40c105bd0 2024-09-18T13:03:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.534+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc40c196b80 con 0x7fc40c105bd0 2024-09-18T13:03:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.534+0000 7fc3f3fff700 1 -- 172.21.15.81:0/1032650462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+5275 (secure 0 0 0) 0x7fc3fc065980 con 0x7fc40c105bd0 2024-09-18T13:03:23.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:23.536 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"btime":"2024-09-18T12:59:56:556179+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44325,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6827/1739515569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1739515569},{"type":"v1","addr":"172.21.15.136:6827","nonce":1739515569}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:56.556173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":45,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434,34466]},"id":1}]} 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 msgr2=0x7fc3f407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 0x7fc3f407d7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc400005950 tx=0x7fc4000058e0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 msgr2=0x7fc40c19bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0092e0 tx=0x7fc3fc00be20 comp rx=0 tx=0).stop 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 shutdown_connections 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc3f407b310 0x7fc3f407d7d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc40c0ffc20 0x7fc40c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 --2- 172.21.15.81:0/1032650462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c105bd0 0x7fc40c19bb70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 >> 172.21.15.81:0/1032650462 conn(0x7fc40c075670 msgr2=0x7fc40c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 shutdown_connections 2024-09-18T13:03:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:23.537+0000 7fc41103e700 1 -- 172.21.15.81:0/1032650462 wait complete. 2024-09-18T13:03:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-18T13:03:23.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:23 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1032650462' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:03:24.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:23 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1032650462' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:03:24.228 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-18T13:03:24.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-18T13:03:24.429 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:24.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:24 smithi136 ceph-mon[80179]: pgmap v343: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:24.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:24 smithi081 ceph-mon[92545]: pgmap v343: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 -- 172.21.15.81:0/4106675480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d4101060 msgr2=0x7ff2d41047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 --2- 172.21.15.81:0/4106675480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d4101060 0x7ff2d41047b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b0a0 tx=0x7ff2c400b3b0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 -- 172.21.15.81:0/4106675480 shutdown_connections 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 --2- 172.21.15.81:0/4106675480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d4101060 0x7ff2d41047b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 --2- 172.21.15.81:0/4106675480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d41006b0 0x7ff2d4100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 -- 172.21.15.81:0/4106675480 >> 172.21.15.81:0/4106675480 conn(0x7ff2d4074e30 msgr2=0x7ff2d4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 -- 172.21.15.81:0/4106675480 shutdown_connections 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.060+0000 7ff2db177700 1 -- 172.21.15.81:0/4106675480 wait complete. 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 Processor -- start 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 -- start start 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d4101060 0x7ff2d4196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4197540 con 0x7ff2d41006b0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2db177700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d419b350 con 0x7ff2d4101060 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2d8f13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2d8f13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58394/0 (socket says 172.21.15.81:58394) 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.061+0000 7ff2d8f13700 1 -- 172.21.15.81:0/367220044 learned_addr learned my addr 172.21.15.81:0/367220044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d8f13700 1 -- 172.21.15.81:0/367220044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d4101060 msgr2=0x7ff2d4196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d3fff700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d4101060 0x7ff2d4196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d8f13700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d4101060 0x7ff2d4196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d8f13700 1 -- 172.21.15.81:0/367220044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009d00 con 0x7ff2d41006b0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d8f13700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b4b0 tx=0x7ff2cc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2cc011800 con 0x7ff2d41006b0 2024-09-18T13:03:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2cc011e20 con 0x7ff2d41006b0 2024-09-18T13:03:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d419b630 con 0x7ff2d41006b0 2024-09-18T13:03:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2cc00f2e0 con 0x7ff2d41006b0 2024-09-18T13:03:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.062+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d419bb80 con 0x7ff2d41006b0 2024-09-18T13:03:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.063+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4109150 con 0x7ff2d41006b0 2024-09-18T13:03:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.064+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff2cc010380 con 0x7ff2d41006b0 2024-09-18T13:03:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.064+0000 7ff2d1ffb700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 0x7ff2c007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.065+0000 7ff2d3fff700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 0x7ff2c007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.065+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff2cc09dda0 con 0x7ff2d41006b0 2024-09-18T13:03:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.065+0000 7ff2d3fff700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 0x7ff2c007d7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4006070 tx=0x7ff2c4006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.069+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff2cc060dc0 con 0x7ff2d41006b0 2024-09-18T13:03:26.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.324+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7ff2d404f2e0 con 0x7ff2d41006b0 2024-09-18T13:03:26.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.325+0000 7ff2d1ffb700 1 -- 172.21.15.81:0/367220044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v46) v1 ==== 107+0+4921 (secure 0 0 0) 0x7ff2cc063ee0 con 0x7ff2d41006b0 2024-09-18T13:03:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:26.326 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:50:34.867341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:26.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 msgr2=0x7ff2c007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 0x7ff2c007d7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4006070 tx=0x7ff2c4006000 comp rx=0 tx=0).stop 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 msgr2=0x7ff2d4196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b4b0 tx=0x7ff2cc00b870 comp rx=0 tx=0).stop 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 shutdown_connections 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff2c007b310 0x7ff2c007d7d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41006b0 0x7ff2d4196970 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 --2- 172.21.15.81:0/367220044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2d4101060 0x7ff2d4196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.327+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 >> 172.21.15.81:0/367220044 conn(0x7ff2d4074e30 msgr2=0x7ff2d4103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.328+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 shutdown_connections 2024-09-18T13:03:26.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:26.328+0000 7ff2db177700 1 -- 172.21.15.81:0/367220044 wait complete. 2024-09-18T13:03:26.330 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2024-09-18T13:03:26.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:26 smithi081 ceph-mon[92545]: pgmap v344: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:26.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:26 smithi136 ceph-mon[80179]: pgmap v344: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:27.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-18T13:03:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:27.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:27 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/367220044' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:03:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:27 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/367220044' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:03:28.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:28 smithi136 ceph-mon[80179]: pgmap v345: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:28.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:28 smithi081 ceph-mon[92545]: pgmap v345: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 -- 172.21.15.81:0/1626008520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4101850 msgr2=0x7fe9b41058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/1626008520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4101850 0x7fe9b41058a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009910 tx=0x7fe9b0009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 -- 172.21.15.81:0/1626008520 shutdown_connections 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/1626008520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4101850 0x7fe9b41058a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/1626008520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4100ea0 0x7fe9b4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 -- 172.21.15.81:0/1626008520 >> 172.21.15.81:0/1626008520 conn(0x7fe9b40fc750 msgr2=0x7fe9b40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 -- 172.21.15.81:0/1626008520 shutdown_connections 2024-09-18T13:03:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.081+0000 7fe9bb96d700 1 -- 172.21.15.81:0/1626008520 wait complete. 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 Processor -- start 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 -- start start 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4101850 0x7fe9b419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b419f3a0 con 0x7fe9b4100ea0 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9bb96d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b41988e0 con 0x7fe9b4101850 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9b9709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9b9709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58414/0 (socket says 172.21.15.81:58414) 2024-09-18T13:03:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.082+0000 7fe9b9709700 1 -- 172.21.15.81:0/290465397 learned_addr learned my addr 172.21.15.81:0/290465397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9b8f08700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4101850 0x7fe9b419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9b9709700 1 -- 172.21.15.81:0/290465397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4101850 msgr2=0x7fe9b419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9b9709700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4101850 0x7fe9b419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9b9709700 1 -- 172.21.15.81:0/290465397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00095f0 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9b9709700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c930 tx=0x7fe9a400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a4007ad0 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9a4007c30 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b4198bc0 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a4018610 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.083+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b4199110 con 0x7fe9b4100ea0 2024-09-18T13:03:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.084+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b4105020 con 0x7fe9b4100ea0 2024-09-18T13:03:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.085+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe9a400f450 con 0x7fe9b4100ea0 2024-09-18T13:03:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.085+0000 7fe9aa7fc700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 0x7fe9a007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.085+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe9a409e500 con 0x7fe9b4100ea0 2024-09-18T13:03:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.085+0000 7fe9b8f08700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 0x7fe9a007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.086+0000 7fe9b8f08700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 0x7fe9a007d7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40fcee0 tx=0x7fe9b001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:29.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.090+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe9a4061520 con 0x7fe9b4100ea0 2024-09-18T13:03:29.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.347+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fe9b4199e20 con 0x7fe9b4100ea0 2024-09-18T13:03:29.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.348+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/290465397 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v46) v1 ==== 107+0+4922 (secure 0 0 0) 0x7fe9a4064640 con 0x7fe9b4100ea0 2024-09-18T13:03:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:29.349 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:51:55.319596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 msgr2=0x7fe9a007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 0x7fe9a007d7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40fcee0 tx=0x7fe9b001a040 comp rx=0 tx=0).stop 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 msgr2=0x7fe9b419e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c930 tx=0x7fe9a400ccf0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 shutdown_connections 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe9a007b310 0x7fe9a007d7d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4100ea0 0x7fe9b419e860 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.350+0000 7fe9bb96d700 1 --2- 172.21.15.81:0/290465397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9b4101850 0x7fe9b419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.351+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 >> 172.21.15.81:0/290465397 conn(0x7fe9b40fc750 msgr2=0x7fe9b40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.351+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 shutdown_connections 2024-09-18T13:03:29.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:29.351+0000 7fe9bb96d700 1 -- 172.21.15.81:0/290465397 wait complete. 2024-09-18T13:03:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-18T13:03:29.608 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:29 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/290465397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:03:29.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:29 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/290465397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:03:29.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-18T13:03:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:30.563 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:30 smithi081 ceph-mon[92545]: pgmap v346: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:30.813 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:30 smithi136 ceph-mon[80179]: pgmap v346: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 -- 172.21.15.81:0/974267498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 msgr2=0x7f855c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 --2- 172.21.15.81:0/974267498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c101280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8544009910 tx=0x7f8544009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 -- 172.21.15.81:0/974267498 shutdown_connections 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 --2- 172.21.15.81:0/974267498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 0x7f855c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 --2- 172.21.15.81:0/974267498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c101280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 -- 172.21.15.81:0/974267498 >> 172.21.15.81:0/974267498 conn(0x7f855c0fc750 msgr2=0x7f855c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 -- 172.21.15.81:0/974267498 shutdown_connections 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.913+0000 7f8562a1b700 1 -- 172.21.15.81:0/974267498 wait complete. 2024-09-18T13:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 Processor -- start 2024-09-18T13:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 -- start start 2024-09-18T13:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 0x7f855c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c19d350 con 0x7f855c100ea0 2024-09-18T13:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f8562a1b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c196800 con 0x7f855c101850 2024-09-18T13:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f855bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f855bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58432/0 (socket says 172.21.15.81:58432) 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.914+0000 7f855bfff700 1 -- 172.21.15.81:0/1883684318 learned_addr learned my addr 172.21.15.81:0/1883684318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f855bfff700 1 -- 172.21.15.81:0/1883684318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 msgr2=0x7f855c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f855b7fe700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 0x7f855c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f855bfff700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 0x7f855c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f855bfff700 1 -- 172.21.15.81:0/1883684318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440095f0 con 0x7f855c100ea0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f855bfff700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8544006010 tx=0x7f854400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854401d070 con 0x7f855c100ea0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8544004fb0 con 0x7f855c100ea0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c196a80 con 0x7f855c100ea0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854400f690 con 0x7f855c100ea0 2024-09-18T13:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.915+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c196f70 con 0x7f855c100ea0 2024-09-18T13:03:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.916+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c109240 con 0x7f855c100ea0 2024-09-18T13:03:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.918+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f85440228a0 con 0x7f855c100ea0 2024-09-18T13:03:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.918+0000 7f85597fa700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 0x7f854807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.918+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f85440a03a0 con 0x7f855c100ea0 2024-09-18T13:03:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.918+0000 7f855b7fe700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 0x7f854807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.919+0000 7f855b7fe700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 0x7f854807d7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f854c006fd0 tx=0x7f854c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:31.922+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f85440633c0 con 0x7f855c100ea0 2024-09-18T13:03:32.183 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:32 smithi081 ceph-mon[92545]: pgmap v347: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.182+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f855c04f2e0 con 0x7f855c100ea0 2024-09-18T13:03:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.182+0000 7f85597fa700 1 -- 172.21.15.81:0/1883684318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v46) v1 ==== 107+0+4936 (secure 0 0 0) 0x7f85440664e0 con 0x7f855c100ea0 2024-09-18T13:03:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:32.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"btime":"2024-09-18T12:55:24:937672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:55:24.937670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544,14556]},"id":1}]} 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.184+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 msgr2=0x7f854807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.184+0000 7f8562a1b700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 0x7f854807d7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f854c006fd0 tx=0x7f854c008040 comp rx=0 tx=0).stop 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.184+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 msgr2=0x7f855c19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.184+0000 7f8562a1b700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8544006010 tx=0x7f854400be20 comp rx=0 tx=0).stop 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 shutdown_connections 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f854807b310 0x7f854807d7d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f855c100ea0 0x7f855c19c780 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 --2- 172.21.15.81:0/1883684318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f855c101850 0x7f855c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 >> 172.21.15.81:0/1883684318 conn(0x7f855c0fc750 msgr2=0x7f855c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 shutdown_connections 2024-09-18T13:03:32.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:32.185+0000 7f8562a1b700 1 -- 172.21.15.81:0/1883684318 wait complete. 2024-09-18T13:03:32.187 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 21 2024-09-18T13:03:32.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:32 smithi136 ceph-mon[80179]: pgmap v347: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:32.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-18T13:03:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:33.242 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:33 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1883684318' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:03:33.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:33 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1883684318' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:03:34.403 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:34 smithi081 ceph-mon[92545]: pgmap v348: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:34.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:34 smithi136 ceph-mon[80179]: pgmap v348: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:34.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 -- 172.21.15.81:0/3559232317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10102700 msgr2=0x7fef1010abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 --2- 172.21.15.81:0/3559232317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10102700 0x7fef1010abf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef00009910 tx=0x7fef00009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:34.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 -- 172.21.15.81:0/3559232317 shutdown_connections 2024-09-18T13:03:34.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 --2- 172.21.15.81:0/3559232317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10102700 0x7fef1010abf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 --2- 172.21.15.81:0/3559232317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10101de0 0x7fef101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 -- 172.21.15.81:0/3559232317 >> 172.21.15.81:0/3559232317 conn(0x7fef100fb610 msgr2=0x7fef100fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 -- 172.21.15.81:0/3559232317 shutdown_connections 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.813+0000 7fef1827c700 1 -- 172.21.15.81:0/3559232317 wait complete. 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 Processor -- start 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 -- start start 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10102700 0x7fef1019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1019d220 con 0x7fef10101de0 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef1827c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10196720 con 0x7fef10102700 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58458/0 (socket says 172.21.15.81:58458) 2024-09-18T13:03:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 -- 172.21.15.81:0/306121649 learned_addr learned my addr 172.21.15.81:0/306121649 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef15817700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10102700 0x7fef1019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 -- 172.21.15.81:0/306121649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10102700 msgr2=0x7fef1019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10102700 0x7fef1019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.814+0000 7fef16018700 1 -- 172.21.15.81:0/306121649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000095f0 con 0x7fef10101de0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef16018700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0060b0 tx=0x7fef0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef0c00dda0 con 0x7fef10101de0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef0c00f040 con 0x7fef10101de0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10196a00 con 0x7fef10101de0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef0c0146f0 con 0x7fef10101de0 2024-09-18T13:03:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.815+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef10196f50 con 0x7fef10101de0 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.816+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef101082f0 con 0x7fef10101de0 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.817+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fef0c015400 con 0x7fef10101de0 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.817+0000 7fef077fe700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 0x7feefc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.817+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fef0c09dda0 con 0x7fef10101de0 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.817+0000 7fef15817700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 0x7feefc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.818+0000 7fef15817700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 0x7feefc07d7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef10197b40 tx=0x7fef0001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:34.821+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fef0c060df0 con 0x7fef10101de0 2024-09-18T13:03:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.084+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fef1004f2e0 con 0x7fef10101de0 2024-09-18T13:03:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.085+0000 7fef077fe700 1 -- 172.21.15.81:0/306121649 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v46) v1 ==== 107+0+4935 (secure 0 0 0) 0x7fef0c063f10 con 0x7fef10101de0 2024-09-18T13:03:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:35.086 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-18T12:55:39:334155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:55:39.283936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14556,14544]},"id":1}]} 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 msgr2=0x7feefc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 0x7feefc07d7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef10197b40 tx=0x7fef0001a040 comp rx=0 tx=0).stop 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 msgr2=0x7fef1019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0060b0 tx=0x7fef0c00d3b0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 shutdown_connections 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7feefc07b310 0x7feefc07d7d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef10101de0 0x7fef1019c650 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 --2- 172.21.15.81:0/306121649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef10102700 0x7fef1019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.087+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 >> 172.21.15.81:0/306121649 conn(0x7fef100fb610 msgr2=0x7fef10105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.088+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 shutdown_connections 2024-09-18T13:03:35.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:35.088+0000 7fef1827c700 1 -- 172.21.15.81:0/306121649 wait complete. 2024-09-18T13:03:35.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-18T13:03:35.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:35 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/306121649' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:03:35.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:35.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:35 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/306121649' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:03:35.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-18T13:03:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:36.370 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:36 smithi081 ceph-mon[92545]: pgmap v349: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:36.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:36 smithi136 ceph-mon[80179]: pgmap v349: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:37.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 -- 172.21.15.81:0/1390396556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3400ffb40 msgr2=0x7fc3400fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 --2- 172.21.15.81:0/1390396556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3400ffb40 0x7fc3400fffc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc334009910 tx=0x7fc334009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:37.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 -- 172.21.15.81:0/1390396556 shutdown_connections 2024-09-18T13:03:37.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 --2- 172.21.15.81:0/1390396556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3400ffb40 0x7fc3400fffc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 --2- 172.21.15.81:0/1390396556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc340105bf0 0x7fc340105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 -- 172.21.15.81:0/1390396556 >> 172.21.15.81:0/1390396556 conn(0x7fc3400fb650 msgr2=0x7fc3400fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:37.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 -- 172.21.15.81:0/1390396556 shutdown_connections 2024-09-18T13:03:37.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 -- 172.21.15.81:0/1390396556 wait complete. 2024-09-18T13:03:37.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.653+0000 7fc344b91700 1 Processor -- start 2024-09-18T13:03:37.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc344b91700 1 -- start start 2024-09-18T13:03:37.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc344b91700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3400ffb40 0x7fc34019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc344b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc344b91700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34019c100 con 0x7fc340105bf0 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc344b91700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401955b0 con 0x7fc3400ffb40 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35794/0 (socket says 172.21.15.81:35794) 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 -- 172.21.15.81:0/255961457 learned_addr learned my addr 172.21.15.81:0/255961457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33e59c700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3400ffb40 0x7fc34019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 -- 172.21.15.81:0/255961457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3400ffb40 msgr2=0x7fc34019b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3400ffb40 0x7fc34019b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 -- 172.21.15.81:0/255961457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340095f0 con 0x7fc340105bf0 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.654+0000 7fc33dd9b700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc3340092e0 tx=0x7fc33400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:37.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33401f070 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc334019610 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340195830 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33400f690 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc340195d20 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.655+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34004f2e0 con 0x7fc340105bf0 2024-09-18T13:03:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.656+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc334019780 con 0x7fc340105bf0 2024-09-18T13:03:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.657+0000 7fc32f7fe700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 0x7fc32807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.657+0000 7fc33e59c700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 0x7fc32807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.657+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc3340a1bb0 con 0x7fc340105bf0 2024-09-18T13:03:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.657+0000 7fc33e59c700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 0x7fc32807d7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc330005950 tx=0x7fc3300058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:37.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.661+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fc3340a8080 con 0x7fc340105bf0 2024-09-18T13:03:37.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.912+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fc340196ac0 con 0x7fc340105bf0 2024-09-18T13:03:37.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.913+0000 7fc32f7fe700 1 -- 172.21.15.81:0/255961457 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v46) v1 ==== 107+0+4935 (secure 0 0 0) 0x7fc33406f020 con 0x7fc340105bf0 2024-09-18T13:03:37.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:37.914 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-18T12:57:57:541930+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:57:56.544100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544,14556]},"id":1}]} 2024-09-18T13:03:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 msgr2=0x7fc32807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 0x7fc32807d7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc330005950 tx=0x7fc3300058e0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 msgr2=0x7fc34019ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc3340092e0 tx=0x7fc33400be20 comp rx=0 tx=0).stop 2024-09-18T13:03:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 shutdown_connections 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc32807b310 0x7fc32807d7d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3400ffb40 0x7fc34019b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 --2- 172.21.15.81:0/255961457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc340105bf0 0x7fc34019ba70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 >> 172.21.15.81:0/255961457 conn(0x7fc3400fb650 msgr2=0x7fc3400fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 shutdown_connections 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:37.915+0000 7fc344b91700 1 -- 172.21.15.81:0/255961457 wait complete. 2024-09-18T13:03:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-18T13:03:38.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:37 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/255961457' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:03:38.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:37 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/255961457' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:03:38.848 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-18T13:03:38.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-18T13:03:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:39.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:38 smithi081 ceph-mon[92545]: pgmap v350: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:39.313 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:38 smithi136 ceph-mon[80179]: pgmap v350: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:40.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:40 smithi081 ceph-mon[92545]: pgmap v351: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:40.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:40 smithi136 ceph-mon[80179]: pgmap v351: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- 172.21.15.81:0/2007734111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 msgr2=0x7f3de01029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 --2- 172.21.15.81:0/2007734111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de01029e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009910 tx=0x7f3dd0009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- 172.21.15.81:0/2007734111 shutdown_connections 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 --2- 172.21.15.81:0/2007734111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de01029e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 --2- 172.21.15.81:0/2007734111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 0x7f3de01011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- 172.21.15.81:0/2007734111 >> 172.21.15.81:0/2007734111 conn(0x7f3de00fc590 msgr2=0x7f3de00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- 172.21.15.81:0/2007734111 shutdown_connections 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- 172.21.15.81:0/2007734111 wait complete. 2024-09-18T13:03:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 Processor -- start 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.945+0000 7f3de61a1700 1 -- start start 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 0x7f3de01966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01972a0 con 0x7f3de0102560 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0199fd0 con 0x7f3de0100e10 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35808/0 (socket says 172.21.15.81:35808) 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 -- 172.21.15.81:0/623804649 learned_addr learned my addr 172.21.15.81:0/623804649 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de519f700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 0x7f3de01966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 -- 172.21.15.81:0/623804649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 msgr2=0x7f3de01966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 0x7f3de01966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 -- 172.21.15.81:0/623804649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00095f0 con 0x7f3de0102560 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de499e700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00092e0 tx=0x7f3dd000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd001d070 con 0x7f3de0102560 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dd0005e00 con 0x7f3de0102560 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de019a250 con 0x7f3de0102560 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd0017400 con 0x7f3de0102560 2024-09-18T13:03:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.946+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de019a7c0 con 0x7f3de0102560 2024-09-18T13:03:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.947+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de01090f0 con 0x7f3de0102560 2024-09-18T13:03:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.948+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3dd000f6f0 con 0x7f3de0102560 2024-09-18T13:03:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.949+0000 7f3dd67fc700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 0x7f3dcc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.949+0000 7f3de519f700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 0x7f3dcc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.949+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f3dd009f7f0 con 0x7f3de0102560 2024-09-18T13:03:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.949+0000 7f3de519f700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 0x7f3dcc07d7d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005950 tx=0x7f3ddc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:40.953+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f3dd0062770 con 0x7f3de0102560 2024-09-18T13:03:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.209+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f3de00623c0 con 0x7f3de0102560 2024-09-18T13:03:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.210+0000 7f3dd67fc700 1 -- 172.21.15.81:0/623804649 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v46) v1 ==== 107+0+4931 (secure 0 0 0) 0x7f3dd0065890 con 0x7f3de0102560 2024-09-18T13:03:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-18T12:57:57:557704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:57:57.557701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:stopping","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544]},"id":1}]} 2024-09-18T13:03:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 msgr2=0x7f3dcc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 0x7f3dcc07d7d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005950 tx=0x7f3ddc00b410 comp rx=0 tx=0).stop 2024-09-18T13:03:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 msgr2=0x7f3de0196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00092e0 tx=0x7f3dd000bd70 comp rx=0 tx=0).stop 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 shutdown_connections 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f3dcc07b310 0x7f3dcc07d7d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de0100e10 0x7f3de01966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 --2- 172.21.15.81:0/623804649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de0102560 0x7f3de0196c10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 >> 172.21.15.81:0/623804649 conn(0x7f3de00fc590 msgr2=0x7f3de00fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 shutdown_connections 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:41.212+0000 7f3de61a1700 1 -- 172.21.15.81:0/623804649 wait complete. 2024-09-18T13:03:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-18T13:03:41.375 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:41 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/623804649' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:03:41.375 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:41 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:03:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:41 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/623804649' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:03:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:41 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:03:42.031 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-18T13:03:42.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-18T13:03:42.233 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:42 smithi081 ceph-mon[92545]: pgmap v352: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:03:42.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:42 smithi136 ceph-mon[80179]: pgmap v352: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2249202890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 msgr2=0x7f5e5c105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2249202890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c105730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009910 tx=0x7f5e58009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2249202890 shutdown_connections 2024-09-18T13:03:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2249202890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 0x7f5e5c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2249202890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c105730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2249202890 >> 172.21.15.81:0/2249202890 conn(0x7f5e5c074e30 msgr2=0x7f5e5c075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2249202890 shutdown_connections 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2249202890 wait complete. 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 Processor -- start 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.188+0000 7f5e63ab1700 1 -- start start 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 0x7f5e5c100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c101a40 con 0x7f5e5c105350 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c101b80 con 0x7f5e5c0ff340 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35832/0 (socket says 172.21.15.81:35832) 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 -- 172.21.15.81:0/2188785474 learned_addr learned my addr 172.21.15.81:0/2188785474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6184d700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 0x7f5e5c100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 -- 172.21.15.81:0/2188785474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 msgr2=0x7f5e5c100fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 0x7f5e5c100fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 -- 172.21.15.81:0/2188785474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580095f0 con 0x7f5e5c105350 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e6104c700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c930 tx=0x7f5e4c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c007ad0 con 0x7f5e5c105350 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c1a2a40 con 0x7f5e5c105350 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e4c007c30 con 0x7f5e5c105350 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c018610 con 0x7f5e5c105350 2024-09-18T13:03:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.189+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c1a2da0 con 0x7f5e5c105350 2024-09-18T13:03:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.190+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c109880 con 0x7f5e5c105350 2024-09-18T13:03:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.191+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5e4c00f450 con 0x7f5e5c105350 2024-09-18T13:03:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.191+0000 7f5e52ffd700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 0x7f5e4807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.192+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f5e4c09e5f0 con 0x7f5e5c105350 2024-09-18T13:03:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.192+0000 7f5e6184d700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 0x7f5e4807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.192+0000 7f5e6184d700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 0x7f5e4807d7d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800b5c0 tx=0x7f5e5801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.196+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f5e4c061590 con 0x7f5e5c105350 2024-09-18T13:03:44.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:44 smithi081 ceph-mon[92545]: pgmap v353: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.451+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f5e5c101d40 con 0x7f5e5c105350 2024-09-18T13:03:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.451+0000 7f5e52ffd700 1 -- 172.21.15.81:0/2188785474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v46) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f5e4c0646b0 con 0x7f5e5c105350 2024-09-18T13:03:44.453 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:44.453 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-18T12:58:05:151318+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:04.923197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14544,"mds_1":14556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14556":{"gid":14556,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":14,"state":"up:stopping","state_seq":6,"addr":"172.21.15.81:6829/4043840025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4043840025},{"type":"v1","addr":"172.21.15.81:6829","nonce":4043840025}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544]},"id":1}]} 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 msgr2=0x7f5e4807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 0x7f5e4807d7d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800b5c0 tx=0x7f5e5801a040 comp rx=0 tx=0).stop 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 msgr2=0x7f5e5c101500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c930 tx=0x7f5e4c00ccf0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 shutdown_connections 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f5e4807b310 0x7f5e4807d7d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c0ff340 0x7f5e5c100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 --2- 172.21.15.81:0/2188785474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e5c105350 0x7f5e5c101500 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.453+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 >> 172.21.15.81:0/2188785474 conn(0x7f5e5c074e30 msgr2=0x7f5e5c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.454+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 shutdown_connections 2024-09-18T13:03:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:44.454+0000 7f5e63ab1700 1 -- 172.21.15.81:0/2188785474 wait complete. 2024-09-18T13:03:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-18T13:03:44.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:44 smithi136 ceph-mon[80179]: pgmap v353: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:45.164 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-18T13:03:45.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-18T13:03:45.369 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:45.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:45 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2188785474' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:03:45.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:45 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2188785474' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:03:46.528 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:46 smithi081 ceph-mon[92545]: pgmap v354: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:46.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:46 smithi136 ceph-mon[80179]: pgmap v354: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 -- 172.21.15.81:0/3214024126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 msgr2=0x7fae60105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 --2- 172.21.15.81:0/3214024126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae60105fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae50009910 tx=0x7fae50009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 -- 172.21.15.81:0/3214024126 shutdown_connections 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 --2- 172.21.15.81:0/3214024126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae600fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 --2- 172.21.15.81:0/3214024126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae60105fd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 -- 172.21.15.81:0/3214024126 >> 172.21.15.81:0/3214024126 conn(0x7fae600fb650 msgr2=0x7fae600fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 -- 172.21.15.81:0/3214024126 shutdown_connections 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.045+0000 7fae666be700 1 -- 172.21.15.81:0/3214024126 wait complete. 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 Processor -- start 2024-09-18T13:03:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 -- start start 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae6019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6019d170 con 0x7fae60105bf0 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae666be700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60196620 con 0x7fae600ffb40 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45358/0 (socket says 172.21.15.81:45358) 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae5f7fe700 1 -- 172.21.15.81:0/3630032409 learned_addr learned my addr 172.21.15.81:0/3630032409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.046+0000 7fae5ffff700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae6019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5f7fe700 1 -- 172.21.15.81:0/3630032409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 msgr2=0x7fae6019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5f7fe700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae6019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5f7fe700 1 -- 172.21.15.81:0/3630032409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500095f0 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5ffff700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae6019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5f7fe700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae5400d900 tx=0x7fae5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae540041f0 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae60196900 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae54004cf0 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5400b750 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.047+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae60196e50 con 0x7fae60105bf0 2024-09-18T13:03:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.048+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6004f2e0 con 0x7fae60105bf0 2024-09-18T13:03:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.049+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fae54004830 con 0x7fae60105bf0 2024-09-18T13:03:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.049+0000 7fae5d7fa700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 0x7fae4807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.049+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fae5409e520 con 0x7fae60105bf0 2024-09-18T13:03:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.049+0000 7fae5ffff700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 0x7fae4807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.050+0000 7fae5ffff700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 0x7fae4807d7d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae5000b5c0 tx=0x7fae500053a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.053+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fae540614c0 con 0x7fae60105bf0 2024-09-18T13:03:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.307+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fae60197200 con 0x7fae60105bf0 2024-09-18T13:03:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.307+0000 7fae5d7fa700 1 -- 172.21.15.81:0/3630032409 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v46) v1 ==== 107+0+4135 (secure 0 0 0) 0x7fae540645e0 con 0x7fae60105bf0 2024-09-18T13:03:47.309 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:47.309 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-18T12:58:29:988713+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:29.924210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14544},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544]},"id":1}]} 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.309+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 msgr2=0x7fae4807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.309+0000 7fae666be700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 0x7fae4807d7d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae5000b5c0 tx=0x7fae500053a0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 msgr2=0x7fae6019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae5400d900 tx=0x7fae5400dcc0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 shutdown_connections 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fae4807b310 0x7fae4807d7d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae600ffb40 0x7fae6019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 --2- 172.21.15.81:0/3630032409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae60105bf0 0x7fae6019cae0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 >> 172.21.15.81:0/3630032409 conn(0x7fae600fb650 msgr2=0x7fae60068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 shutdown_connections 2024-09-18T13:03:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:47.310+0000 7fae666be700 1 -- 172.21.15.81:0/3630032409 wait complete. 2024-09-18T13:03:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-18T13:03:47.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:47 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3630032409' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:03:47.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:47 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3630032409' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:03:48.004 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-18T13:03:48.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-18T13:03:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:48.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:48 smithi081 ceph-mon[92545]: pgmap v355: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:48.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:48 smithi136 ceph-mon[80179]: pgmap v355: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:49.656 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:49.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:50.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- 172.21.15.81:0/861444629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180ff5a0 msgr2=0x7fa7180ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 --2- 172.21.15.81:0/861444629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180ff5a0 0x7fa7180ff980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa714009910 tx=0x7fa714009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- 172.21.15.81:0/861444629 shutdown_connections 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 --2- 172.21.15.81:0/861444629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180fff50 0x7fa718105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 --2- 172.21.15.81:0/861444629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180ff5a0 0x7fa7180ff980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- 172.21.15.81:0/861444629 >> 172.21.15.81:0/861444629 conn(0x7fa718074e30 msgr2=0x7fa718075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- 172.21.15.81:0/861444629 shutdown_connections 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- 172.21.15.81:0/861444629 wait complete. 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 Processor -- start 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.019+0000 7fa7200e4700 1 -- start start 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180ff5a0 0x7fa71819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71819d250 con 0x7fa7180fff50 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718196700 con 0x7fa7180ff5a0 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45384/0 (socket says 172.21.15.81:45384) 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 -- 172.21.15.81:0/4112632915 learned_addr learned my addr 172.21.15.81:0/4112632915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71de80700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180ff5a0 0x7fa71819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 -- 172.21.15.81:0/4112632915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180ff5a0 msgr2=0x7fa71819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180ff5a0 0x7fa71819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 -- 172.21.15.81:0/4112632915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140095f0 con 0x7fa7180fff50 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa71d67f700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa70800d900 tx=0x7fa70800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa708009900 con 0x7fa7180fff50 2024-09-18T13:03:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7181969e0 con 0x7fa7180fff50 2024-09-18T13:03:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa708010460 con 0x7fa7180fff50 2024-09-18T13:03:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70800f5f0 con 0x7fa7180fff50 2024-09-18T13:03:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.020+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa718196f30 con 0x7fa7180fff50 2024-09-18T13:03:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.021+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa718109270 con 0x7fa7180fff50 2024-09-18T13:03:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.022+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa7080105d0 con 0x7fa7180fff50 2024-09-18T13:03:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.023+0000 7fa70effd700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 0x7fa70407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.023+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa70809df70 con 0x7fa7180fff50 2024-09-18T13:03:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.023+0000 7fa71de80700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 0x7fa70407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.023+0000 7fa71de80700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 0x7fa70407d7d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa71401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.027+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa7080d51f0 con 0x7fa7180fff50 2024-09-18T13:03:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.276+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa71804f2e0 con 0x7fa7180fff50 2024-09-18T13:03:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:50.278 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-18T12:58:30:995349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:29.924210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14544},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6827/3849514001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3849514001},{"type":"v1","addr":"172.21.15.81:6827","nonce":3849514001}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14544,"qdb_cluster":[14544]},"id":1}]} 2024-09-18T13:03:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.277+0000 7fa70effd700 1 -- 172.21.15.81:0/4112632915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v46) v1 ==== 107+0+4914 (secure 0 0 0) 0x7fa708060f10 con 0x7fa7180fff50 2024-09-18T13:03:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 msgr2=0x7fa70407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 0x7fa70407d7d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa71401a040 comp rx=0 tx=0).stop 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 msgr2=0x7fa71819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa70800d900 tx=0x7fa70800dc10 comp rx=0 tx=0).stop 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 shutdown_connections 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa70407b310 0x7fa70407d7d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7180ff5a0 0x7fa71819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 --2- 172.21.15.81:0/4112632915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7180fff50 0x7fa71819cbc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 >> 172.21.15.81:0/4112632915 conn(0x7fa718074e30 msgr2=0x7fa7180fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 shutdown_connections 2024-09-18T13:03:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:50.279+0000 7fa7200e4700 1 -- 172.21.15.81:0/4112632915 wait complete. 2024-09-18T13:03:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-18T13:03:50.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:50 smithi081 ceph-mon[92545]: pgmap v356: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:50.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:50 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/4112632915' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:03:50.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:50 smithi136 ceph-mon[80179]: pgmap v356: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:50.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:50 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/4112632915' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:03:50.953 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-18T13:03:50.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-18T13:03:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:52.434 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:52 smithi081 ceph-mon[92545]: pgmap v357: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:52.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:52 smithi136 ceph-mon[80179]: pgmap v357: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.966+0000 7f82dd4ff700 1 -- 172.21.15.81:0/905339991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8105bd0 msgr2=0x7f82d8105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.966+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/905339991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8105bd0 0x7f82d8105fb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009910 tx=0x7f82c8009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.966+0000 7f82dd4ff700 1 -- 172.21.15.81:0/905339991 shutdown_connections 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.966+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/905339991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d80ffc20 0x7f82d8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.966+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/905339991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8105bd0 0x7f82d8105fb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.967+0000 7f82dd4ff700 1 -- 172.21.15.81:0/905339991 >> 172.21.15.81:0/905339991 conn(0x7f82d8075670 msgr2=0x7f82d8075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.967+0000 7f82dd4ff700 1 -- 172.21.15.81:0/905339991 shutdown_connections 2024-09-18T13:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.967+0000 7f82dd4ff700 1 -- 172.21.15.81:0/905339991 wait complete. 2024-09-18T13:03:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.967+0000 7f82dd4ff700 1 Processor -- start 2024-09-18T13:03:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82dd4ff700 1 -- start start 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82dd4ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82dd4ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d8105bd0 0x7f82d8197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82dd4ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d8198200 con 0x7f82d80ffc20 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82dd4ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d8198340 con 0x7f82d8105bd0 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45404/0 (socket says 172.21.15.81:45404) 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 -- 172.21.15.81:0/3951365974 learned_addr learned my addr 172.21.15.81:0/3951365974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d67fc700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d8105bd0 0x7f82d8197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 -- 172.21.15.81:0/3951365974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d8105bd0 msgr2=0x7f82d8197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d8105bd0 0x7f82d8197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 -- 172.21.15.81:0/3951365974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80095f0 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.968+0000 7f82d6ffd700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f82c800b5c0 tx=0x7f82c800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c801d070 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d81a06e0 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82c800f460 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d81a0b50 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c8017630 con 0x7f82d80ffc20 2024-09-18T13:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.969+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d81080f0 con 0x7f82d80ffc20 2024-09-18T13:03:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.970+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f82c800f5d0 con 0x7f82d80ffc20 2024-09-18T13:03:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.971+0000 7f82bffff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 0x7f82c007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.971+0000 7f82d67fc700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 0x7f82c007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.971+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f82c809f8d0 con 0x7f82d80ffc20 2024-09-18T13:03:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.971+0000 7f82d67fc700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 0x7f82c007d7d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82d8069210 tx=0x7f82cc00a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:52.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:52.975+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f82c8062870 con 0x7f82d80ffc20 2024-09-18T13:03:53.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.228+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f82d8068c90 con 0x7f82d80ffc20 2024-09-18T13:03:53.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.228+0000 7f82bffff700 1 -- 172.21.15.81:0/3951365974 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v46) v1 ==== 107+0+4116 (secure 0 0 0) 0x7f82c8065990 con 0x7f82d80ffc20 2024-09-18T13:03:53.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:53.231 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-18T12:58:41:841091+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:41.841088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 msgr2=0x7f82c007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 0x7f82c007d7d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82d8069210 tx=0x7f82cc00a380 comp rx=0 tx=0).stop 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 msgr2=0x7f82d8197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f82c800b5c0 tx=0x7f82c800bd50 comp rx=0 tx=0).stop 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 shutdown_connections 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f82c007b310 0x7f82c007d7d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d80ffc20 0x7f82d8197670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 --2- 172.21.15.81:0/3951365974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82d8105bd0 0x7f82d8197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 >> 172.21.15.81:0/3951365974 conn(0x7f82d8075670 msgr2=0x7f82d80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 shutdown_connections 2024-09-18T13:03:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:53.231+0000 7f82dd4ff700 1 -- 172.21.15.81:0/3951365974 wait complete. 2024-09-18T13:03:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-18T13:03:53.537 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:53 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3951365974' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:03:53.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:53 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3951365974' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:03:53.858 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-18T13:03:53.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-18T13:03:54.059 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:54.493 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:54 smithi081 ceph-mon[92545]: pgmap v358: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:54.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:54 smithi136 ceph-mon[80179]: pgmap v358: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 -- 172.21.15.81:0/4096412394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 msgr2=0x7f7960105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 --2- 172.21.15.81:0/4096412394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f7960105fb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7954009910 tx=0x7f7954009c20 comp rx=0 tx=0).stop 2024-09-18T13:03:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 -- 172.21.15.81:0/4096412394 shutdown_connections 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 --2- 172.21.15.81:0/4096412394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 0x7f7960100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 --2- 172.21.15.81:0/4096412394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f7960105fb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 -- 172.21.15.81:0/4096412394 >> 172.21.15.81:0/4096412394 conn(0x7f7960075670 msgr2=0x7f7960075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 -- 172.21.15.81:0/4096412394 shutdown_connections 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.790+0000 7f7967c8c700 1 -- 172.21.15.81:0/4096412394 wait complete. 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 Processor -- start 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 -- start start 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 0x7f796019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796019d1f0 con 0x7f7960105bd0 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7967c8c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601966a0 con 0x7f79600ffc20 2024-09-18T13:03:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7965227700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7965227700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59736/0 (socket says 172.21.15.81:59736) 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7965227700 1 -- 172.21.15.81:0/1122833610 learned_addr learned my addr 172.21.15.81:0/1122833610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.791+0000 7f7965a28700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 0x7f796019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7965227700 1 -- 172.21.15.81:0/1122833610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 msgr2=0x7f796019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7965227700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 0x7f796019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7965227700 1 -- 172.21.15.81:0/1122833610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540095f0 con 0x7f7960105bd0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7965227700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f795c00d8d0 tx=0x7f795c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c0098a0 con 0x7f7960105bd0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7960196980 con 0x7f7960105bd0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795c010460 con 0x7f7960105bd0 2024-09-18T13:03:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c00f5f0 con 0x7f7960105bd0 2024-09-18T13:03:55.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.792+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7960196ed0 con 0x7f7960105bd0 2024-09-18T13:03:55.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.793+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796004f2e0 con 0x7f7960105bd0 2024-09-18T13:03:55.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.794+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f795c009a00 con 0x7f7960105bd0 2024-09-18T13:03:55.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.794+0000 7f7952ffd700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 0x7f794c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.795+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f795c09e2a0 con 0x7f7960105bd0 2024-09-18T13:03:55.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.795+0000 7f7965a28700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 0x7f794c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.795+0000 7f7965a28700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 0x7f794c07d7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f795400b5c0 tx=0x7f795401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:55.798+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f795c0612d0 con 0x7f7960105bd0 2024-09-18T13:03:56.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.074+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f7960197bb0 con 0x7f7960105bd0 2024-09-18T13:03:56.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.074+0000 7f7952ffd700 1 -- 172.21.15.81:0/1122833610 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v46) v1 ==== 107+0+4127 (secure 0 0 0) 0x7f795c0643f0 con 0x7f7960105bd0 2024-09-18T13:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-18T12:58:41:847897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:41.847890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:replay","state_seq":2,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 msgr2=0x7f794c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 0x7f794c07d7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f795400b5c0 tx=0x7f795401a040 comp rx=0 tx=0).stop 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 msgr2=0x7f796019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f795c00d8d0 tx=0x7f795c00dbe0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 shutdown_connections 2024-09-18T13:03:56.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f794c07b310 0x7f794c07d7d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79600ffc20 0x7f796019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 --2- 172.21.15.81:0/1122833610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7960105bd0 0x7f796019cb60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 >> 172.21.15.81:0/1122833610 conn(0x7f7960075670 msgr2=0x7f79600686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 shutdown_connections 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:56.077+0000 7f7967c8c700 1 -- 172.21.15.81:0/1122833610 wait complete. 2024-09-18T13:03:56.080 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-18T13:03:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:56 smithi081 ceph-mon[92545]: pgmap v359: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:56.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:56 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1122833610' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:03:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:56 smithi136 ceph-mon[80179]: pgmap v359: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:56.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:56 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1122833610' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:03:56.792 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-18T13:03:56.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-18T13:03:56.996 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:03:58.461 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:58 smithi081 ceph-mon[92545]: pgmap v360: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:58.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:58 smithi136 ceph-mon[80179]: pgmap v360: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:03:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 -- 172.21.15.81:0/1295770055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 msgr2=0x7ff9801000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 --2- 172.21.15.81:0/1295770055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff9801000f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff97000b0a0 tx=0x7ff97000b3b0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 -- 172.21.15.81:0/1295770055 shutdown_connections 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 --2- 172.21.15.81:0/1295770055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff9801018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 --2- 172.21.15.81:0/1295770055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff9801000f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 -- 172.21.15.81:0/1295770055 >> 172.21.15.81:0/1295770055 conn(0x7ff9800fb470 msgr2=0x7ff9800fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.698+0000 7ff984da2700 1 -- 172.21.15.81:0/1295770055 shutdown_connections 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 -- 172.21.15.81:0/1295770055 wait complete. 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 Processor -- start 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 -- start start 2024-09-18T13:03:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff980197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9801980b0 con 0x7ff9800ffd10 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.699+0000 7ff984da2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980198220 con 0x7ff980101460 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59762/0 (socket says 172.21.15.81:59762) 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 -- 172.21.15.81:0/2455315997 learned_addr learned my addr 172.21.15.81:0/2455315997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97effd700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff980197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 -- 172.21.15.81:0/2455315997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 msgr2=0x7ff980197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff980197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 -- 172.21.15.81:0/2455315997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970009d00 con 0x7ff9800ffd10 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97effd700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff980197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97f7fe700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff970000f80 tx=0x7ff970003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:58.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97000e040 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff970007c00 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9801a05c0 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97001d6b0 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.700+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9801a0a30 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.701+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980108010 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.702+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff970004040 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.702+0000 7ff97cff9700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 0x7ff96c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.702+0000 7ff97effd700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 0x7ff96c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.702+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff97009f9f0 con 0x7ff9800ffd10 2024-09-18T13:03:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.703+0000 7ff97effd700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 0x7ff96c07d7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff968005fd0 tx=0x7ff968005f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.707+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7ff9700a1e60 con 0x7ff9800ffd10 2024-09-18T13:03:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.958+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7ff9800623c0 con 0x7ff9800ffd10 2024-09-18T13:03:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.958+0000 7ff97cff9700 1 -- 172.21.15.81:0/2455315997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v46) v1 ==== 107+0+4132 (secure 0 0 0) 0x7ff970062a10 con 0x7ff9800ffd10 2024-09-18T13:03:58.960 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:03:58.960 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-18T12:58:49:004387+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:48.475091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":151,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 msgr2=0x7ff96c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 0x7ff96c07d7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff968005fd0 tx=0x7ff968005f00 comp rx=0 tx=0).stop 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 msgr2=0x7ff980197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff970000f80 tx=0x7ff970003ce0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 shutdown_connections 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7ff96c07b310 0x7ff96c07d7d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9800ffd10 0x7ff980197550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 --2- 172.21.15.81:0/2455315997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff980101460 0x7ff980197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 >> 172.21.15.81:0/2455315997 conn(0x7ff9800fb470 msgr2=0x7ff9800fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 shutdown_connections 2024-09-18T13:03:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:03:58.961+0000 7ff984da2700 1 -- 172.21.15.81:0/2455315997 wait complete. 2024-09-18T13:03:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-18T13:03:59.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:03:59 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2455315997' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:03:59.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:03:59 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2455315997' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:03:59.965 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-18T13:03:59.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-18T13:04:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:00.245 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:00 smithi081 ceph-mon[92545]: pgmap v361: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:00.314 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:00 smithi136 ceph-mon[80179]: pgmap v361: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:01.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- 172.21.15.81:0/3901876531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 msgr2=0x7f094c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 --2- 172.21.15.81:0/3901876531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c105fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f093c009910 tx=0x7f093c009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- 172.21.15.81:0/3901876531 shutdown_connections 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 --2- 172.21.15.81:0/3901876531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 0x7f094c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 --2- 172.21.15.81:0/3901876531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c105fb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- 172.21.15.81:0/3901876531 >> 172.21.15.81:0/3901876531 conn(0x7f094c075670 msgr2=0x7f094c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- 172.21.15.81:0/3901876531 shutdown_connections 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- 172.21.15.81:0/3901876531 wait complete. 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 Processor -- start 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.882+0000 7f09509a5700 1 -- start start 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f09509a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 0x7f094c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f09509a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f09509a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c195590 con 0x7f094c105bd0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f09509a5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c195700 con 0x7f094c0ffc20 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59786/0 (socket says 172.21.15.81:59786) 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 -- 172.21.15.81:0/653328282 learned_addr learned my addr 172.21.15.81:0/653328282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f094a59c700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 0x7f094c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 -- 172.21.15.81:0/653328282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 msgr2=0x7f094c19b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 0x7f094c19b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 -- 172.21.15.81:0/653328282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0095f0 con 0x7f094c105bd0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f0949d9b700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f094000d8d0 tx=0x7f094000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09400098a0 con 0x7f094c105bd0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.883+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0940010460 con 0x7f094c105bd0 2024-09-18T13:04:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.884+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1959e0 con 0x7f094c105bd0 2024-09-18T13:04:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.884+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094000f5f0 con 0x7f094c105bd0 2024-09-18T13:04:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.884+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c195f30 con 0x7f094c105bd0 2024-09-18T13:04:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.884+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c1080d0 con 0x7f094c105bd0 2024-09-18T13:04:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.885+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0940009a00 con 0x7f094c105bd0 2024-09-18T13:04:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.886+0000 7f093b7fe700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 0x7f093407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.886+0000 7f094a59c700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 0x7f093407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.886+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f094009e1c0 con 0x7f094c105bd0 2024-09-18T13:04:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.886+0000 7f094a59c700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 0x7f093407d7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f093c006010 tx=0x7f093c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:01.889+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0940061290 con 0x7f094c105bd0 2024-09-18T13:04:02.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.146+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f094c04f2e0 con 0x7f094c105bd0 2024-09-18T13:04:02.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.147+0000 7f093b7fe700 1 -- 172.21.15.81:0/653328282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v46) v1 ==== 107+0+4129 (secure 0 0 0) 0x7f09400643b0 con 0x7f094c105bd0 2024-09-18T13:04:02.148 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:02.148 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"btime":"2024-09-18T12:58:50:013853+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:49.015986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":152,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:04:02.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 msgr2=0x7f093407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:02.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 0x7f093407d7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f093c006010 tx=0x7f093c01a040 comp rx=0 tx=0).stop 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 msgr2=0x7f094c19bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f094000d8d0 tx=0x7f094000dbe0 comp rx=0 tx=0).stop 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 shutdown_connections 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f093407b310 0x7f093407d7d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f094c0ffc20 0x7f094c19b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 --2- 172.21.15.81:0/653328282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c105bd0 0x7f094c19bae0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 >> 172.21.15.81:0/653328282 conn(0x7f094c075670 msgr2=0x7f094c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 shutdown_connections 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:02.149+0000 7f09509a5700 1 -- 172.21.15.81:0/653328282 wait complete. 2024-09-18T13:04:02.151 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2024-09-18T13:04:02.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:02 smithi136 ceph-mon[80179]: pgmap v362: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:02.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:02 smithi081 ceph-mon[92545]: pgmap v362: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:02.873 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-18T13:04:02.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-18T13:04:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:03.446 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:03 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/653328282' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:04:03.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:03 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/653328282' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:04:04.301 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:04 smithi081 ceph-mon[92545]: pgmap v363: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:04.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:04 smithi136 ceph-mon[80179]: pgmap v363: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 -- 172.21.15.81:0/3251669112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc80ffb40 msgr2=0x7fcdc80fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 --2- 172.21.15.81:0/3251669112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc80ffb40 0x7fcdc80fffc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009910 tx=0x7fcdb0009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 -- 172.21.15.81:0/3251669112 shutdown_connections 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 --2- 172.21.15.81:0/3251669112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc80ffb40 0x7fcdc80fffc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 --2- 172.21.15.81:0/3251669112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc8105bf0 0x7fcdc8105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 -- 172.21.15.81:0/3251669112 >> 172.21.15.81:0/3251669112 conn(0x7fcdc80fb650 msgr2=0x7fcdc80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 -- 172.21.15.81:0/3251669112 shutdown_connections 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.988+0000 7fcdcce69700 1 -- 172.21.15.81:0/3251669112 wait complete. 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 Processor -- start 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 -- start start 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc80ffb40 0x7fcdc819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc819d100 con 0x7fcdc8105bf0 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdcce69700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8196640 con 0x7fcdc80ffb40 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.989+0000 7fcdc5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59806/0 (socket says 172.21.15.81:59806) 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 -- 172.21.15.81:0/1525395769 learned_addr learned my addr 172.21.15.81:0/1525395769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc659c700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc80ffb40 0x7fcdc819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 -- 172.21.15.81:0/1525395769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc80ffb40 msgr2=0x7fcdc819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc80ffb40 0x7fcdc819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 -- 172.21.15.81:0/1525395769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00095f0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdc5d9b700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb001d070 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdb0004fb0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc81968c0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb0022ea0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.990+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc8196db0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.991+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc804f2e0 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.992+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fcdb0022470 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.992+0000 7fcdbf7fe700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 0x7fcdb407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.992+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fcdb009f970 con 0x7fcdc8105bf0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.992+0000 7fcdc659c700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 0x7fcdb407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.993+0000 7fcdc659c700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 0x7fcdb407d7d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000e270 tx=0x7fcdc0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:04.997+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fcdb00629c0 con 0x7fcdc8105bf0 2024-09-18T13:04:05.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.251+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fcdc8197b50 con 0x7fcdc8105bf0 2024-09-18T13:04:05.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:05 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.252+0000 7fcdbf7fe700 1 -- 172.21.15.81:0/1525395769 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v46) v1 ==== 107+0+4138 (secure 0 0 0) 0x7fcdb0022720 con 0x7fcdc8105bf0 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-18T12:58:51:019448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 msgr2=0x7fcdb407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 0x7fcdb407d7d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000e270 tx=0x7fcdc0009040 comp rx=0 tx=0).stop 2024-09-18T13:04:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 msgr2=0x7fcdc819cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb000be20 comp rx=0 tx=0).stop 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 shutdown_connections 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fcdb407b310 0x7fcdb407d7d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdc80ffb40 0x7fcdc819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 --2- 172.21.15.81:0/1525395769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdc8105bf0 0x7fcdc819cb00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 >> 172.21.15.81:0/1525395769 conn(0x7fcdc80fb650 msgr2=0x7fcdc8068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 shutdown_connections 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:05.255+0000 7fcdcce69700 1 -- 172.21.15.81:0/1525395769 wait complete. 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-18T13:04:05.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:05 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:05.938 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-18T13:04:05.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-18T13:04:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:06.215 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:06 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1525395769' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:04:06.215 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:06 smithi081 ceph-mon[92545]: pgmap v364: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:06.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:06 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1525395769' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:04:06.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:06 smithi136 ceph-mon[80179]: pgmap v364: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 -- 172.21.15.81:0/2153041425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 msgr2=0x7fc940101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 --2- 172.21.15.81:0/2153041425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc940101280 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc930009910 tx=0x7fc930009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 -- 172.21.15.81:0/2153041425 shutdown_connections 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 --2- 172.21.15.81:0/2153041425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 0x7fc9401058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 --2- 172.21.15.81:0/2153041425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc940101280 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 -- 172.21.15.81:0/2153041425 >> 172.21.15.81:0/2153041425 conn(0x7fc9400fc750 msgr2=0x7fc9400feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.853+0000 7fc94599e700 1 -- 172.21.15.81:0/2153041425 shutdown_connections 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 -- 172.21.15.81:0/2153041425 wait complete. 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 Processor -- start 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 -- start start 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 0x7fc94019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94019f440 con 0x7fc940100ea0 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.854+0000 7fc94599e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401988f0 con 0x7fc940101850 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54348/0 (socket says 172.21.15.81:54348) 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 -- 172.21.15.81:0/268795863 learned_addr learned my addr 172.21.15.81:0/268795863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93e7fc700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 0x7fc94019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 -- 172.21.15.81:0/268795863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 msgr2=0x7fc94019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 0x7fc94019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 -- 172.21.15.81:0/268795863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300095f0 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc93effd700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc930006010 tx=0x7fc93000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93001d070 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc930005dc0 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc940198b70 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc930017400 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.855+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc940199060 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.856+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc940105020 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.857+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc930003a60 con 0x7fc940100ea0 2024-09-18T13:04:07.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.857+0000 7fc94499c700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 0x7fc92807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:07.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.858+0000 7fc93e7fc700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 0x7fc92807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:07.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.858+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc93009f850 con 0x7fc940100ea0 2024-09-18T13:04:07.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.858+0000 7fc93e7fc700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 0x7fc92807d7d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9400fce90 tx=0x7fc93400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:07.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:07.862+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fc9300627f0 con 0x7fc940100ea0 2024-09-18T13:04:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.118+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fc940104a00 con 0x7fc940100ea0 2024-09-18T13:04:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.118+0000 7fc94499c700 1 -- 172.21.15.81:0/268795863 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v46) v1 ==== 107+0+4982 (secure 0 0 0) 0x7fc930065910 con 0x7fc940100ea0 2024-09-18T13:04:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"btime":"2024-09-18T12:58:53:031785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34410,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/1745950760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1745950760},{"type":"v1","addr":"172.21.15.81:6829","nonce":1745950760}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 msgr2=0x7fc92807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 0x7fc92807d7d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9400fce90 tx=0x7fc93400b410 comp rx=0 tx=0).stop 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 msgr2=0x7fc94019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc930006010 tx=0x7fc93000bd70 comp rx=0 tx=0).stop 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 shutdown_connections 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fc92807b310 0x7fc92807d7d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc940100ea0 0x7fc94019e870 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 --2- 172.21.15.81:0/268795863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc940101850 0x7fc94019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:08.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 >> 172.21.15.81:0/268795863 conn(0x7fc9400fc750 msgr2=0x7fc9400fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:08.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 shutdown_connections 2024-09-18T13:04:08.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:08.121+0000 7fc94599e700 1 -- 172.21.15.81:0/268795863 wait complete. 2024-09-18T13:04:08.123 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2024-09-18T13:04:08.490 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:08 smithi081 ceph-mon[92545]: pgmap v365: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:08.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:08 smithi136 ceph-mon[80179]: pgmap v365: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:08.828 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-18T13:04:08.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-18T13:04:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:09.427 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:09 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/268795863' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:04:09.465 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:09 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/268795863' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:04:10.440 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:10 smithi081 ceph-mon[92545]: pgmap v366: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:10.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:10 smithi136 ceph-mon[80179]: pgmap v366: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:11.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1832363268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 msgr2=0x7fa5a4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1832363268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a4100180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa598009910 tx=0x7fa598009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1832363268 shutdown_connections 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1832363268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1832363268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a4100180 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1832363268 >> 172.21.15.81:0/1832363268 conn(0x7fa5a40fb650 msgr2=0x7fa5a40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1832363268 shutdown_connections 2024-09-18T13:04:11.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.037+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1832363268 wait complete. 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 Processor -- start 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 -- start start 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a419d1a0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5aaf46700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41966b0 con 0x7fa5a4100750 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54370/0 (socket says 172.21.15.81:54370) 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 -- 172.21.15.81:0/1969262930 learned_addr learned my addr 172.21.15.81:0/1969262930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a3fff700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:11.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 -- 172.21.15.81:0/1969262930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 msgr2=0x7fa5a419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a419cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a8ce2700 1 -- 172.21.15.81:0/1969262930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980095f0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.038+0000 7fa5a3fff700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5a8ce2700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa598006010 tx=0x7fa59800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59801d070 con 0x7fa5a40ffda0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4196930 con 0x7fa5a40ffda0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa598004fb0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa598022ea0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.039+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a4196e20 con 0x7fa5a40ffda0 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.040+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a404f2e0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.041+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa598022470 con 0x7fa5a40ffda0 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.041+0000 7fa5a1ffb700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 0x7fa59407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.041+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa59809f970 con 0x7fa5a40ffda0 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.041+0000 7fa5a3fff700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 0x7fa59407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:11.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.042+0000 7fa5a3fff700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 0x7fa59407d7d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa590005fd0 tx=0x7fa590005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:11.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.046+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa5980629c0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.309+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fa5a41971a0 con 0x7fa5a40ffda0 2024-09-18T13:04:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.310+0000 7fa5a1ffb700 1 -- 172.21.15.81:0/1969262930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v46) v1 ==== 107+0+4203 (secure 0 0 0) 0x7fa598022720 con 0x7fa5a40ffda0 2024-09-18T13:04:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:11.311 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"btime":"2024-09-18T12:59:05:790435+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 msgr2=0x7fa59407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 0x7fa59407d7d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa590005fd0 tx=0x7fa590005e30 comp rx=0 tx=0).stop 2024-09-18T13:04:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 msgr2=0x7fa5a419c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa598006010 tx=0x7fa59800be20 comp rx=0 tx=0).stop 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 shutdown_connections 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa59407b310 0x7fa59407d7d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a40ffda0 0x7fa5a419c610 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 --2- 172.21.15.81:0/1969262930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5a4100750 0x7fa5a419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 >> 172.21.15.81:0/1969262930 conn(0x7fa5a40fb650 msgr2=0x7fa5a40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 shutdown_connections 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:11.313+0000 7fa5aaf46700 1 -- 172.21.15.81:0/1969262930 wait complete. 2024-09-18T13:04:11.315 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2024-09-18T13:04:11.606 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:11 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1969262930' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:04:11.813 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:11 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1969262930' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:04:12.012 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-18T13:04:12.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-18T13:04:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:12.607 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:12 smithi081 ceph-mon[92545]: pgmap v367: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:12.813 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:12 smithi136 ceph-mon[80179]: pgmap v367: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.096+0000 7f0c6e106700 1 -- 172.21.15.81:0/3581910329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 msgr2=0x7f0c68102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.096+0000 7f0c6e106700 1 --2- 172.21.15.81:0/3581910329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c68102220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009910 tx=0x7f0c58009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 -- 172.21.15.81:0/3581910329 shutdown_connections 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 --2- 172.21.15.81:0/3581910329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 0x7f0c6810ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 --2- 172.21.15.81:0/3581910329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c68102220 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 -- 172.21.15.81:0/3581910329 >> 172.21.15.81:0/3581910329 conn(0x7f0c680fb650 msgr2=0x7f0c680fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 -- 172.21.15.81:0/3581910329 shutdown_connections 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 -- 172.21.15.81:0/3581910329 wait complete. 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 Processor -- start 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.097+0000 7f0c6e106700 1 -- start start 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c6e106700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c6e106700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 0x7f0c6819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c6e106700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6819d260 con 0x7f0c68101e40 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c6e106700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68196710 con 0x7f0c68102760 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54390/0 (socket says 172.21.15.81:54390) 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 -- 172.21.15.81:0/4093327012 learned_addr learned my addr 172.21.15.81:0/4093327012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c66ffd700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 0x7f0c6819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 -- 172.21.15.81:0/4093327012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 msgr2=0x7f0c6819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 0x7f0c6819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 -- 172.21.15.81:0/4093327012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580095f0 con 0x7f0c68101e40 2024-09-18T13:04:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c677fe700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c58006010 tx=0x7f0c5800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5801d070 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c58005dc0 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68196990 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.098+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c58017400 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.099+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68196e80 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.099+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c68108350 con 0x7f0c68101e40 2024-09-18T13:04:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.100+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0c58003a60 con 0x7f0c68101e40 2024-09-18T13:04:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.101+0000 7f0c64ff9700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 0x7f0c5007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.101+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0c5809f710 con 0x7f0c68101e40 2024-09-18T13:04:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.101+0000 7f0c66ffd700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 0x7f0c5007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.101+0000 7f0c66ffd700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 0x7f0c5007d7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c68197b80 tx=0x7f0c5c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.105+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0c58062730 con 0x7f0c68101e40 2024-09-18T13:04:14.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:14 smithi081 ceph-mon[92545]: pgmap v368: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:14.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.361+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f0c68197d20 con 0x7f0c68101e40 2024-09-18T13:04:14.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.361+0000 7f0c64ff9700 1 -- 172.21.15.81:0/4093327012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v46) v1 ==== 107+0+5050 (secure 0 0 0) 0x7f0c68197d20 con 0x7f0c68101e40 2024-09-18T13:04:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:14.363 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"btime":"2024-09-18T12:59:11:997622+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24311,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/2568560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2568560818},{"type":"v1","addr":"172.21.15.136:6825","nonce":2568560818}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 msgr2=0x7f0c5007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 0x7f0c5007d7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c68197b80 tx=0x7f0c5c00b410 comp rx=0 tx=0).stop 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 msgr2=0x7f0c6819c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c58006010 tx=0x7f0c5800bd70 comp rx=0 tx=0).stop 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 shutdown_connections 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0c5007b310 0x7f0c5007d7d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c68101e40 0x7f0c6819c690 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 --2- 172.21.15.81:0/4093327012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c68102760 0x7f0c6819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 >> 172.21.15.81:0/4093327012 conn(0x7f0c680fb650 msgr2=0x7f0c68105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 shutdown_connections 2024-09-18T13:04:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:14.364+0000 7f0c6e106700 1 -- 172.21.15.81:0/4093327012 wait complete. 2024-09-18T13:04:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 35 2024-09-18T13:04:14.565 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:14 smithi136 ceph-mon[80179]: pgmap v368: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:15.272 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-18T13:04:15.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-18T13:04:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:15.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:15 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/4093327012' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:04:15.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:15 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/4093327012' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:04:16.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:16 smithi081 ceph-mon[92545]: pgmap v369: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:16.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:16 smithi136 ceph-mon[80179]: pgmap v369: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1205174833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e8105bf0 msgr2=0x7fa9e8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1205174833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e8105bf0 0x7fa9e8105fd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009910 tx=0x7fa9d8009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1205174833 shutdown_connections 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1205174833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e80ffb40 0x7fa9e80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1205174833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e8105bf0 0x7fa9e8105fd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1205174833 >> 172.21.15.81:0/1205174833 conn(0x7fa9e80fb650 msgr2=0x7fa9e80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1205174833 shutdown_connections 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.223+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1205174833 wait complete. 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 Processor -- start 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 -- start start 2024-09-18T13:04:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 0x7fa9e819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e819c1b0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.224+0000 7fa9ee1b6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8195660 con 0x7fa9e8105bf0 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46396/0 (socket says 172.21.15.81:46396) 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 -- 172.21.15.81:0/1670271293 learned_addr learned my addr 172.21.15.81:0/1670271293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e6ffd700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 0x7fa9e819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 -- 172.21.15.81:0/1670271293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 msgr2=0x7fa9e819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 0x7fa9e819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 -- 172.21.15.81:0/1670271293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80095f0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e6ffd700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 0x7fa9e819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e77fe700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8006010 tx=0x7fa9d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d801d070 con 0x7fa9e80ffb40 2024-09-18T13:04:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9d8004fb0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e81958e0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d800f690 con 0x7fa9e80ffb40 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.225+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e8195dd0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.226+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8108020 con 0x7fa9e80ffb40 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.227+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa9d80228a0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.227+0000 7fa9e4ff9700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 0x7fa9d007d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.227+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa9d809fc00 con 0x7fa9e80ffb40 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.227+0000 7fa9e6ffd700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 0x7fa9d007d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.228+0000 7fa9e6ffd700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 0x7fa9d007d7d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80fc8e0 tx=0x7fa9dc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.232+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa9d80a5020 con 0x7fa9e80ffb40 2024-09-18T13:04:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.494+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fa9e804f2e0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.495+0000 7fa9e4ff9700 1 -- 172.21.15.81:0/1670271293 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v46) v1 ==== 107+0+4268 (secure 0 0 0) 0x7fa9d8062ba0 con 0x7fa9e80ffb40 2024-09-18T13:04:17.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:17.496 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-18T12:59:24:013686+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 msgr2=0x7fa9d007d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 0x7fa9d007d7d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80fc8e0 tx=0x7fa9dc008040 comp rx=0 tx=0).stop 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 msgr2=0x7fa9e819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8006010 tx=0x7fa9d800be20 comp rx=0 tx=0).stop 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 shutdown_connections 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa9d007b310 0x7fa9d007d7d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e80ffb40 0x7fa9e819b5e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 --2- 172.21.15.81:0/1670271293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9e8105bf0 0x7fa9e819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 >> 172.21.15.81:0/1670271293 conn(0x7fa9e80fb650 msgr2=0x7fa9e80fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 shutdown_connections 2024-09-18T13:04:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:17.497+0000 7fa9ee1b6700 1 -- 172.21.15.81:0/1670271293 wait complete. 2024-09-18T13:04:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-18T13:04:17.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:17 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1670271293' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-18T13:04:17.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:17 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1670271293' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-18T13:04:18.286 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-18T13:04:18.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-18T13:04:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:18.804 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:18 smithi081 ceph-mon[92545]: pgmap v370: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:18.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:18 smithi136 ceph-mon[80179]: pgmap v370: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:19.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:19 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:19.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:19 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 -- 172.21.15.81:0/744393877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc0ffc20 msgr2=0x7fd3bc100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 --2- 172.21.15.81:0/744393877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc100080 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009910 tx=0x7fd3b0009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 -- 172.21.15.81:0/744393877 shutdown_connections 2024-09-18T13:04:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 --2- 172.21.15.81:0/744393877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc100080 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 --2- 172.21.15.81:0/744393877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.384+0000 7fd3c252e700 1 -- 172.21.15.81:0/744393877 >> 172.21.15.81:0/744393877 conn(0x7fd3bc075670 msgr2=0x7fd3bc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.385+0000 7fd3c252e700 1 -- 172.21.15.81:0/744393877 shutdown_connections 2024-09-18T13:04:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.385+0000 7fd3c252e700 1 -- 172.21.15.81:0/744393877 wait complete. 2024-09-18T13:04:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.385+0000 7fd3c252e700 1 Processor -- start 2024-09-18T13:04:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.385+0000 7fd3c252e700 1 -- start start 2024-09-18T13:04:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.385+0000 7fd3c252e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3c252e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3c252e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc19d170 con 0x7fd3bc105bd0 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3c252e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1966b0 con 0x7fd3bc0ffc20 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46406/0 (socket says 172.21.15.81:46406) 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc19c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:34732/0 (socket says 172.21.15.81:34732) 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 -- 172.21.15.81:0/427823142 learned_addr learned my addr 172.21.15.81:0/427823142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 -- 172.21.15.81:0/427823142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 msgr2=0x7fd3bc19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 -- 172.21.15.81:0/427823142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00095f0 con 0x7fd3bc105bd0 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3bb7fe700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b5c0 tx=0x7fd3b000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3b001d070 con 0x7fd3bc105bd0 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3b000f460 con 0x7fd3bc105bd0 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc196930 con 0x7fd3bc105bd0 2024-09-18T13:04:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.386+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3b0017630 con 0x7fd3bc105bd0 2024-09-18T13:04:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.387+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc196e20 con 0x7fd3bc105bd0 2024-09-18T13:04:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.387+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc04f2e0 con 0x7fd3bc105bd0 2024-09-18T13:04:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.388+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fd3b000f5d0 con 0x7fd3bc105bd0 2024-09-18T13:04:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.389+0000 7fd3b97fa700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 0x7fd3a407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.389+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fd3b009f8c0 con 0x7fd3bc105bd0 2024-09-18T13:04:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.389+0000 7fd3bbfff700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 0x7fd3a407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.389+0000 7fd3bbfff700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 0x7fd3a407d7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ac50 tx=0x7fd3ac00a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.393+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fd3b0062860 con 0x7fd3bc105bd0 2024-09-18T13:04:20.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.645+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fd3bc197bc0 con 0x7fd3bc105bd0 2024-09-18T13:04:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.645+0000 7fd3b97fa700 1 -- 172.21.15.81:0/427823142 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v46) v1 ==== 107+0+5118 (secure 0 0 0) 0x7fd3b0065980 con 0x7fd3bc105bd0 2024-09-18T13:04:20.647 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:20.647 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"btime":"2024-09-18T12:59:27:949259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:58:51.019444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi136.lwvlbo","rank":0,"incarnation":29,"state":"up:active","state_seq":153,"addr":"172.21.15.136:6827/3787656045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3787656045},{"type":"v1","addr":"172.21.15.136:6827","nonce":3787656045}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 msgr2=0x7fd3a407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 0x7fd3a407d7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ac50 tx=0x7fd3ac00a380 comp rx=0 tx=0).stop 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 msgr2=0x7fd3bc19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b5c0 tx=0x7fd3b000bd50 comp rx=0 tx=0).stop 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 shutdown_connections 2024-09-18T13:04:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd3a407b310 0x7fd3a407d7d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3bc0ffc20 0x7fd3bc19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 --2- 172.21.15.81:0/427823142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3bc105bd0 0x7fd3bc19cb70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 >> 172.21.15.81:0/427823142 conn(0x7fd3bc075670 msgr2=0x7fd3bc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 shutdown_connections 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:20.648+0000 7fd3c252e700 1 -- 172.21.15.81:0/427823142 wait complete. 2024-09-18T13:04:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 37 2024-09-18T13:04:20.814 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:20 smithi136 ceph-mon[80179]: pgmap v371: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:20.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:20 smithi081 ceph-mon[92545]: pgmap v371: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:21.322 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-18T13:04:21.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-18T13:04:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:21.813 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:21 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/427823142' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-18T13:04:21.813 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:21 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/427823142' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-18T13:04:22.695 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:22 smithi081 ceph-mon[92545]: pgmap v372: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:23.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:22 smithi136 ceph-mon[80179]: pgmap v372: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 -- 172.21.15.81:0/50148744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 msgr2=0x7f095c1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 --2- 172.21.15.81:0/50148744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c1070b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0950009910 tx=0x7f0950009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 -- 172.21.15.81:0/50148744 shutdown_connections 2024-09-18T13:04:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 --2- 172.21.15.81:0/50148744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c0689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 --2- 172.21.15.81:0/50148744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c1070b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 -- 172.21.15.81:0/50148744 >> 172.21.15.81:0/50148744 conn(0x7f095c075670 msgr2=0x7f095c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 -- 172.21.15.81:0/50148744 shutdown_connections 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.251+0000 7f0962e52700 1 -- 172.21.15.81:0/50148744 wait complete. 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 Processor -- start 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 -- start start 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c197550 con 0x7f095c106cd0 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0962e52700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c19b360 con 0x7f095c068580 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f095bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f095bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46422/0 (socket says 172.21.15.81:46422) 2024-09-18T13:04:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f095bfff700 1 -- 172.21.15.81:0/3725960632 learned_addr learned my addr 172.21.15.81:0/3725960632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f095bfff700 1 -- 172.21.15.81:0/3725960632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 msgr2=0x7f095c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f0960bee700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.252+0000 7f095bfff700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f095bfff700 1 -- 172.21.15.81:0/3725960632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500095f0 con 0x7f095c106cd0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0960bee700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f095bfff700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f094800b4b0 tx=0x7f094800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0948011800 con 0x7f095c106cd0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0948011e20 con 0x7f095c106cd0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094800f2e0 con 0x7f095c106cd0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095c19b640 con 0x7f095c106cd0 2024-09-18T13:04:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.253+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c19bb90 con 0x7f095c106cd0 2024-09-18T13:04:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.254+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095c1091d0 con 0x7f095c106cd0 2024-09-18T13:04:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.254+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0948010380 con 0x7f095c106cd0 2024-09-18T13:04:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.255+0000 7f0959ffb700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 0x7f094c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.255+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f094809dda0 con 0x7f095c106cd0 2024-09-18T13:04:23.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.255+0000 7f0960bee700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 0x7f094c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:23.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.256+0000 7f0960bee700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 0x7f094c07d7d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f095000b5c0 tx=0x7f0950005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:23.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.260+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0948060dc0 con 0x7f095c106cd0 2024-09-18T13:04:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.515+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f095c04f2e0 con 0x7f095c106cd0 2024-09-18T13:04:23.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.515+0000 7f0959ffb700 1 -- 172.21.15.81:0/3725960632 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v46) v1 ==== 107+0+4314 (secure 0 0 0) 0x7f0948063ee0 con 0x7f095c106cd0 2024-09-18T13:04:23.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:23.517 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"btime":"2024-09-18T12:59:37:583527+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi081.irimad","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:37.583525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:04:23.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 msgr2=0x7f094c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:23.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 0x7f094c07d7d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f095000b5c0 tx=0x7f0950005480 comp rx=0 tx=0).stop 2024-09-18T13:04:23.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 msgr2=0x7f095c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:23.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f094800b4b0 tx=0x7f094800b870 comp rx=0 tx=0).stop 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 shutdown_connections 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f094c07b310 0x7f094c07d7d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f095c068580 0x7f095c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 --2- 172.21.15.81:0/3725960632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f095c106cd0 0x7f095c196ec0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 >> 172.21.15.81:0/3725960632 conn(0x7f095c075670 msgr2=0x7f095c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 shutdown_connections 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:23.518+0000 7f0962e52700 1 -- 172.21.15.81:0/3725960632 wait complete. 2024-09-18T13:04:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 38 2024-09-18T13:04:23.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:23 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3725960632' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-18T13:04:24.063 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:23 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3725960632' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-18T13:04:24.207 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-18T13:04:24.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-18T13:04:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:24.791 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:24 smithi081 ceph-mon[92545]: pgmap v373: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:25.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:24 smithi136 ceph-mon[80179]: pgmap v373: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 -- 172.21.15.81:0/3003656379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe380ffb40 msgr2=0x7efe380fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 --2- 172.21.15.81:0/3003656379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe380ffb40 0x7efe380fffc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe20009910 tx=0x7efe20009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 -- 172.21.15.81:0/3003656379 shutdown_connections 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 --2- 172.21.15.81:0/3003656379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe380ffb40 0x7efe380fffc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 --2- 172.21.15.81:0/3003656379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe38105bf0 0x7efe38105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 -- 172.21.15.81:0/3003656379 >> 172.21.15.81:0/3003656379 conn(0x7efe380fb610 msgr2=0x7efe380fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 -- 172.21.15.81:0/3003656379 shutdown_connections 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.199+0000 7efe3cb56700 1 -- 172.21.15.81:0/3003656379 wait complete. 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 Processor -- start 2024-09-18T13:04:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 -- start start 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe380ffb40 0x7efe381017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38102230 con 0x7efe38105bf0 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.200+0000 7efe3cb56700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38102370 con 0x7efe380ffb40 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51122/0 (socket says 172.21.15.81:51122) 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 -- 172.21.15.81:0/1563850386 learned_addr learned my addr 172.21.15.81:0/1563850386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe3659c700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe380ffb40 0x7efe381017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 -- 172.21.15.81:0/1563850386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe380ffb40 msgr2=0x7efe381017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe380ffb40 0x7efe381017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 -- 172.21.15.81:0/1563850386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200095f0 con 0x7efe38105bf0 2024-09-18T13:04:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe35d9b700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efe20006010 tx=0x7efe2000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2001d070 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe2000f460 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe381025f0 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe20017610 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.201+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe381a2e20 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.202+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3804f2e0 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.203+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7efe2000f5d0 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.203+0000 7efe2f7fe700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 0x7efe2407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.204+0000 7efe3659c700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 0x7efe2407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.204+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7efe2009f8d0 con 0x7efe38105bf0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.204+0000 7efe3659c700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 0x7efe2407d7d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe28009a10 tx=0x7efe28009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.208+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7efe20062870 con 0x7efe38105bf0 2024-09-18T13:04:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.465+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7efe381a3180 con 0x7efe38105bf0 2024-09-18T13:04:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.466+0000 7efe2f7fe700 1 -- 172.21.15.81:0/1563850386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v46) v1 ==== 107+0+4393 (secure 0 0 0) 0x7efe20065990 con 0x7efe38105bf0 2024-09-18T13:04:26.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:26.467 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"btime":"2024-09-18T12:59:37:588017+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:37.588007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 msgr2=0x7efe2407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 0x7efe2407d7d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe28009a10 tx=0x7efe28009190 comp rx=0 tx=0).stop 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 msgr2=0x7efe38101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efe20006010 tx=0x7efe2000bd70 comp rx=0 tx=0).stop 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 shutdown_connections 2024-09-18T13:04:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7efe2407b310 0x7efe2407d7d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe380ffb40 0x7efe381017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 --2- 172.21.15.81:0/1563850386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe38105bf0 0x7efe38101cf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 >> 172.21.15.81:0/1563850386 conn(0x7efe380fb610 msgr2=0x7efe38068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 shutdown_connections 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:26.468+0000 7efe3cb56700 1 -- 172.21.15.81:0/1563850386 wait complete. 2024-09-18T13:04:26.470 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 39 2024-09-18T13:04:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:27 smithi081 ceph-mon[92545]: pgmap v374: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:27.107 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:27 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1563850386' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 39, "format": "json"} : dispatch 2024-09-18T13:04:27.192 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-18T13:04:27.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-18T13:04:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:27 smithi136 ceph-mon[80179]: pgmap v374: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:27.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:27 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1563850386' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 39, "format": "json"} : dispatch 2024-09-18T13:04:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 -- 172.21.15.81:0/1809865335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 msgr2=0x7fa4080ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/1809865335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa4080ff980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009910 tx=0x7fa3f0009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 -- 172.21.15.81:0/1809865335 shutdown_connections 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/1809865335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4080fff50 0x7fa408105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/1809865335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa4080ff980 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 -- 172.21.15.81:0/1809865335 >> 172.21.15.81:0/1809865335 conn(0x7fa408074e30 msgr2=0x7fa408075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 -- 172.21.15.81:0/1809865335 shutdown_connections 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.064+0000 7fa40e7ab700 1 -- 172.21.15.81:0/1809865335 wait complete. 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 Processor -- start 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 -- start start 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4080fff50 0x7fa40819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40819d2d0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa40e7ab700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa408196780 con 0x7fa4080fff50 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa407fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa407fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51146/0 (socket says 172.21.15.81:51146) 2024-09-18T13:04:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.065+0000 7fa407fff700 1 -- 172.21.15.81:0/2251990549 learned_addr learned my addr 172.21.15.81:0/2251990549 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa407fff700 1 -- 172.21.15.81:0/2251990549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4080fff50 msgr2=0x7fa40819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa407fff700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4080fff50 0x7fa40819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa407fff700 1 -- 172.21.15.81:0/2251990549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00095f0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa407fff700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0006010 tx=0x7fa3f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f001d070 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa408196a00 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3f0004fb0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f0022ea0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.066+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408196ef0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.067+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa408109270 con 0x7fa4080ff5a0 2024-09-18T13:04:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.068+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa3f0022470 con 0x7fa4080ff5a0 2024-09-18T13:04:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.068+0000 7fa4057fa700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 0x7fa3f407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.068+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa3f009f980 con 0x7fa4080ff5a0 2024-09-18T13:04:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.068+0000 7fa4077fe700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 0x7fa3f407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.069+0000 7fa4077fe700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 0x7fa3f407d7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa408197bf0 tx=0x7fa3f8005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.072+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fa3f00629d0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.106 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:29 smithi081 ceph-mon[92545]: pgmap v375: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.325+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fa40804f2e0 con 0x7fa4080ff5a0 2024-09-18T13:04:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.326+0000 7fa4057fa700 1 -- 172.21.15.81:0/2251990549 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v46) v1 ==== 107+0+4397 (secure 0 0 0) 0x7fa3f0022720 con 0x7fa4080ff5a0 2024-09-18T13:04:29.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:29.327 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-18T12:59:43:351391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:43.301180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:04:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 msgr2=0x7fa3f407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 0x7fa3f407d7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa408197bf0 tx=0x7fa3f8005c80 comp rx=0 tx=0).stop 2024-09-18T13:04:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 msgr2=0x7fa40819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0006010 tx=0x7fa3f000be20 comp rx=0 tx=0).stop 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 shutdown_connections 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fa3f407b310 0x7fa3f407d7d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080ff5a0 0x7fa40819c700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 --2- 172.21.15.81:0/2251990549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4080fff50 0x7fa40819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 >> 172.21.15.81:0/2251990549 conn(0x7fa408074e30 msgr2=0x7fa4080fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 shutdown_connections 2024-09-18T13:04:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:29.328+0000 7fa40e7ab700 1 -- 172.21.15.81:0/2251990549 wait complete. 2024-09-18T13:04:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-18T13:04:29.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:29 smithi136 ceph-mon[80179]: pgmap v375: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:29.982 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-18T13:04:29.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-18T13:04:30.199 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:30.320 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:30 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2251990549' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 40, "format": "json"} : dispatch 2024-09-18T13:04:30.320 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:30 smithi081 ceph-mon[92545]: pgmap v376: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:30.455 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:30 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2251990549' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 40, "format": "json"} : dispatch 2024-09-18T13:04:30.455 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:30 smithi136 ceph-mon[80179]: pgmap v376: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 -- 172.21.15.81:0/3546736474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 msgr2=0x7f643810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 --2- 172.21.15.81:0/3546736474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643810abf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6434009910 tx=0x7f6434009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 -- 172.21.15.81:0/3546736474 shutdown_connections 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 --2- 172.21.15.81:0/3546736474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643810abf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 --2- 172.21.15.81:0/3546736474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f64381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 -- 172.21.15.81:0/3546736474 >> 172.21.15.81:0/3546736474 conn(0x7f64380fb610 msgr2=0x7f64380fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 -- 172.21.15.81:0/3546736474 shutdown_connections 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.014+0000 7f644022a700 1 -- 172.21.15.81:0/3546736474 wait complete. 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 Processor -- start 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 -- start start 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f643819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643819d370 con 0x7f6438102700 2024-09-18T13:04:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f644022a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438196820 con 0x7f6438101de0 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51158/0 (socket says 172.21.15.81:51158) 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 -- 172.21.15.81:0/2432677017 learned_addr learned my addr 172.21.15.81:0/2432677017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643dfc6700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f643819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 -- 172.21.15.81:0/2432677017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 msgr2=0x7f643819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f643819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 -- 172.21.15.81:0/2432677017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340095f0 con 0x7f6438102700 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643dfc6700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f643819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.015+0000 7f643d7c5700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64340092e0 tx=0x7f643400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.016+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643401d070 con 0x7f6438102700 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.016+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f643400f460 con 0x7f6438102700 2024-09-18T13:04:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.016+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6434017610 con 0x7f6438102700 2024-09-18T13:04:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.016+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6438196aa0 con 0x7f6438102700 2024-09-18T13:04:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.016+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6438196f90 con 0x7f6438102700 2024-09-18T13:04:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.017+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64381082f0 con 0x7f6438102700 2024-09-18T13:04:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.018+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f643400f5d0 con 0x7f6438102700 2024-09-18T13:04:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.018+0000 7f642effd700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 0x7f642407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.018+0000 7f643dfc6700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 0x7f642407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.018+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f643409f7a0 con 0x7f6438102700 2024-09-18T13:04:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.019+0000 7f643dfc6700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 0x7f642407d7d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6428007900 tx=0x7f6428008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.022+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f64340627c0 con 0x7f6438102700 2024-09-18T13:04:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.276+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f6438197dd0 con 0x7f6438102700 2024-09-18T13:04:32.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.277+0000 7f642effd700 1 -- 172.21.15.81:0/2432677017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v46) v1 ==== 107+0+4394 (secure 0 0 0) 0x7f64340658e0 con 0x7f6438102700 2024-09-18T13:04:32.278 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:32.278 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"btime":"2024-09-18T12:59:44:353140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:43.355108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:04:32.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 msgr2=0x7f642407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 0x7f642407d7d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6428007900 tx=0x7f6428008040 comp rx=0 tx=0).stop 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 msgr2=0x7f643819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64340092e0 tx=0x7f643400be20 comp rx=0 tx=0).stop 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 shutdown_connections 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f642407b310 0x7f642407d7d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6438101de0 0x7f643819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 --2- 172.21.15.81:0/2432677017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438102700 0x7f643819cce0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 >> 172.21.15.81:0/2432677017 conn(0x7f64380fb610 msgr2=0x7f6438105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 shutdown_connections 2024-09-18T13:04:32.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:32.279+0000 7f644022a700 1 -- 172.21.15.81:0/2432677017 wait complete. 2024-09-18T13:04:32.282 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 41 2024-09-18T13:04:32.965 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-09-18T13:04:32.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-18T13:04:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:33.288 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:33 smithi081 ceph-mon[92545]: pgmap v377: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:33.289 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:33 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/2432677017' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 41, "format": "json"} : dispatch 2024-09-18T13:04:33.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:33 smithi136 ceph-mon[80179]: pgmap v377: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:33.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:33 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/2432677017' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 41, "format": "json"} : dispatch 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 -- 172.21.15.81:0/3306756490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 msgr2=0x7fe7141021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 --2- 172.21.15.81:0/3306756490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7141021e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe710009910 tx=0x7fe710009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 -- 172.21.15.81:0/3306756490 shutdown_connections 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 --2- 172.21.15.81:0/3306756490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 0x7fe71410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 --2- 172.21.15.81:0/3306756490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7141021e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 -- 172.21.15.81:0/3306756490 >> 172.21.15.81:0/3306756490 conn(0x7fe7140fb650 msgr2=0x7fe7140fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 -- 172.21.15.81:0/3306756490 shutdown_connections 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 -- 172.21.15.81:0/3306756490 wait complete. 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.821+0000 7fe71acba700 1 Processor -- start 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe71acba700 1 -- start start 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe71acba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe71acba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 0x7fe7140fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe71acba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141004e0 con 0x7fe714101e00 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe71acba700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe714100620 con 0x7fe714102720 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51182/0 (socket says 172.21.15.81:51182) 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 -- 172.21.15.81:0/1579063251 learned_addr learned my addr 172.21.15.81:0/1579063251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe70bfff700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 0x7fe7140fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 -- 172.21.15.81:0/1579063251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 msgr2=0x7fe7140fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 0x7fe7140fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 -- 172.21.15.81:0/1579063251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100095f0 con 0x7fe714101e00 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.822+0000 7fe718a56700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe710005b40 tx=0x7fe71000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.823+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71001d070 con 0x7fe714101e00 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.823+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7141008a0 con 0x7fe714101e00 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.823+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7100048e0 con 0x7fe714101e00 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.823+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe710003b60 con 0x7fe714101e00 2024-09-18T13:04:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.823+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7141a2e30 con 0x7fe714101e00 2024-09-18T13:04:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.824+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe714108310 con 0x7fe714101e00 2024-09-18T13:04:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.825+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe710004a50 con 0x7fe714101e00 2024-09-18T13:04:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.825+0000 7fe709ffb700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 0x7fe6fc07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.825+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe71009fa10 con 0x7fe714101e00 2024-09-18T13:04:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.825+0000 7fe70bfff700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 0x7fe6fc07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.826+0000 7fe70bfff700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 0x7fe6fc07d7d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe704006fd0 tx=0x7fe704008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:34.829+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fe7100629b0 con 0x7fe714101e00 2024-09-18T13:04:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.084+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fe714107cf0 con 0x7fe714101e00 2024-09-18T13:04:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.085+0000 7fe709ffb700 1 -- 172.21.15.81:0/1579063251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v46) v1 ==== 107+0+4403 (secure 0 0 0) 0x7fe710065ad0 con 0x7fe714101e00 2024-09-18T13:04:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:35.086 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"btime":"2024-09-18T12:59:45:359013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:45.359009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.087+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 msgr2=0x7fe6fc07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.087+0000 7fe71acba700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 0x7fe6fc07d7d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe704006fd0 tx=0x7fe704008040 comp rx=0 tx=0).stop 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.087+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 msgr2=0x7fe7140ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.087+0000 7fe71acba700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe710005b40 tx=0x7fe71000be20 comp rx=0 tx=0).stop 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.087+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 shutdown_connections 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fe6fc07b310 0x7fe6fc07d7d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe714101e00 0x7fe7140ffa60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 --2- 172.21.15.81:0/1579063251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe714102720 0x7fe7140fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 >> 172.21.15.81:0/1579063251 conn(0x7fe7140fb650 msgr2=0x7fe714105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 shutdown_connections 2024-09-18T13:04:35.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:35.088+0000 7fe71acba700 1 -- 172.21.15.81:0/1579063251 wait complete. 2024-09-18T13:04:35.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2024-09-18T13:04:35.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:35 smithi081 ceph-mon[92545]: pgmap v378: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:35.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:35 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:35.531 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:35 smithi136 ceph-mon[80179]: pgmap v378: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:35.532 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:35 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:35.772 DEBUG:tasks.fs:max_mds reduced in epoch 42 2024-09-18T13:04:35.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 43 2024-09-18T13:04:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:36.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:36 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/1579063251' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 42, "format": "json"} : dispatch 2024-09-18T13:04:36.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:36 smithi081 ceph-mon[92545]: pgmap v379: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:36.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:36 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/1579063251' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 42, "format": "json"} : dispatch 2024-09-18T13:04:36.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:36 smithi136 ceph-mon[80179]: pgmap v379: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 -- 172.21.15.81:0/759214578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 msgr2=0x7f68ec101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 --2- 172.21.15.81:0/759214578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec101270 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009910 tx=0x7f68dc009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 -- 172.21.15.81:0/759214578 shutdown_connections 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 --2- 172.21.15.81:0/759214578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 0x7f68ec105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 --2- 172.21.15.81:0/759214578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec101270 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 -- 172.21.15.81:0/759214578 >> 172.21.15.81:0/759214578 conn(0x7f68ec0fc740 msgr2=0x7f68ec0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 -- 172.21.15.81:0/759214578 shutdown_connections 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.786+0000 7f68f2796700 1 -- 172.21.15.81:0/759214578 wait complete. 2024-09-18T13:04:37.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 Processor -- start 2024-09-18T13:04:37.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 -- start start 2024-09-18T13:04:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 0x7f68ec19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec19d230 con 0x7f68ec100e90 2024-09-18T13:04:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68f2796700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec1966e0 con 0x7f68ec101840 2024-09-18T13:04:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51658/0 (socket says 172.21.15.81:51658) 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68ebfff700 1 -- 172.21.15.81:0/857723068 learned_addr learned my addr 172.21.15.81:0/857723068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.787+0000 7f68eb7fe700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 0x7f68ec19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68ebfff700 1 -- 172.21.15.81:0/857723068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 msgr2=0x7f68ec19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68ebfff700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 0x7f68ec19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68ebfff700 1 -- 172.21.15.81:0/857723068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0095f0 con 0x7f68ec100e90 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68ebfff700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0092e0 tx=0x7f68dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc01d070 con 0x7f68ec100e90 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68dc005e00 con 0x7f68ec100e90 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec196960 con 0x7f68ec100e90 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc017400 con 0x7f68ec100e90 2024-09-18T13:04:37.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.788+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec196e50 con 0x7f68ec100e90 2024-09-18T13:04:37.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.789+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec109230 con 0x7f68ec100e90 2024-09-18T13:04:37.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.790+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f68dc00f460 con 0x7f68ec100e90 2024-09-18T13:04:37.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.790+0000 7f68e97fa700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 0x7f68d407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.790+0000 7f68eb7fe700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 0x7f68d407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.790+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f68dc09f8c0 con 0x7f68ec100e90 2024-09-18T13:04:37.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.791+0000 7f68eb7fe700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 0x7f68d407d7d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005950 tx=0x7f68e00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:37.795+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f68dc062860 con 0x7f68ec100e90 2024-09-18T13:04:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.048+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f68ec04f2e0 con 0x7f68ec100e90 2024-09-18T13:04:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.049+0000 7f68e97fa700 1 -- 172.21.15.81:0/857723068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v46) v1 ==== 107+0+5253 (secure 0 0 0) 0x7f68dc065980 con 0x7f68ec100e90 2024-09-18T13:04:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:38.050 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"btime":"2024-09-18T12:59:47:921650+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44325,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6827/1739515569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1739515569},{"type":"v1","addr":"172.21.15.136:6827","nonce":1739515569}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:45.359009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-18T13:04:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 msgr2=0x7f68d407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 0x7f68d407d7d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005950 tx=0x7f68e00058e0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 msgr2=0x7f68ec19c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0092e0 tx=0x7f68dc00be20 comp rx=0 tx=0).stop 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 shutdown_connections 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f68d407b310 0x7f68d407d7d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ec100e90 0x7f68ec19c660 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 --2- 172.21.15.81:0/857723068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec101840 0x7f68ec19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 >> 172.21.15.81:0/857723068 conn(0x7f68ec0fc740 msgr2=0x7f68ec0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.051+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 shutdown_connections 2024-09-18T13:04:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:38.052+0000 7f68f2796700 1 -- 172.21.15.81:0/857723068 wait complete. 2024-09-18T13:04:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 43 2024-09-18T13:04:38.356 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:38 smithi081 ceph-mon[92545]: pgmap v380: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:38.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:38 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/857723068' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 43, "format": "json"} : dispatch 2024-09-18T13:04:38.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:38 smithi136 ceph-mon[80179]: pgmap v380: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:38.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:38 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/857723068' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 43, "format": "json"} : dispatch 2024-09-18T13:04:38.644 DEBUG:tasks.fs:max_mds reduced in epoch 43 2024-09-18T13:04:38.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 44 2024-09-18T13:04:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:40.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 -- 172.21.15.81:0/1356526087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 msgr2=0x7f971c0ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 --2- 172.21.15.81:0/1356526087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c0ff980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9704009910 tx=0x7f9704009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 -- 172.21.15.81:0/1356526087 shutdown_connections 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 --2- 172.21.15.81:0/1356526087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 0x7f971c105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 --2- 172.21.15.81:0/1356526087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c0ff980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 -- 172.21.15.81:0/1356526087 >> 172.21.15.81:0/1356526087 conn(0x7f971c074e30 msgr2=0x7f971c075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 -- 172.21.15.81:0/1356526087 shutdown_connections 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.500+0000 7f9722724700 1 -- 172.21.15.81:0/1356526087 wait complete. 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.501+0000 7f9722724700 1 Processor -- start 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.501+0000 7f9722724700 1 -- start start 2024-09-18T13:04:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 0x7f971c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c19d2d0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c196780 con 0x7f971c0fff50 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51682/0 (socket says 172.21.15.81:51682) 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 -- 172.21.15.81:0/3124863947 learned_addr learned my addr 172.21.15.81:0/3124863947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971b7fe700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 0x7f971c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 -- 172.21.15.81:0/3124863947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 msgr2=0x7f971c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 0x7f971c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 -- 172.21.15.81:0/3124863947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040095f0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f971bfff700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f970400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f970401d070 con 0x7f971c0ff5a0 2024-09-18T13:04:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f970400f460 con 0x7f971c0ff5a0 2024-09-18T13:04:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9704017630 con 0x7f971c0ff5a0 2024-09-18T13:04:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c196a00 con 0x7f971c0ff5a0 2024-09-18T13:04:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.502+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c196ef0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.503+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c109270 con 0x7f971c0ff5a0 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.504+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f970400f5d0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.505+0000 7f97197fa700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 0x7f970807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.505+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f970409f790 con 0x7f971c0ff5a0 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.505+0000 7f971b7fe700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 0x7f970807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.505+0000 7f971b7fe700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 0x7f970807d7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f971c197bf0 tx=0x7f970c0094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.509+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f97040627b0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.766+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 44, "format": "json"} v 0) v1 -- 0x7f971c04f2e0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.767+0000 7f97197fa700 1 -- 172.21.15.81:0/3124863947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 44, "format": "json"}]=0 dumped fsmap epoch 44 v46) v1 ==== 107+0+5253 (secure 0 0 0) 0x7f97040658d0 con 0x7f971c0ff5a0 2024-09-18T13:04:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:40.768 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"btime":"2024-09-18T12:59:55:538827+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44325,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6827/1739515569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1739515569},{"type":"v1","addr":"172.21.15.136:6827","nonce":1739515569}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:54.541981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-18T13:04:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 msgr2=0x7f970807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 0x7f970807d7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f971c197bf0 tx=0x7f970c0094f0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 msgr2=0x7f971c19c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f970400be20 comp rx=0 tx=0).stop 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 shutdown_connections 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f970807b310 0x7f970807d7d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971c0ff5a0 0x7f971c19c700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 --2- 172.21.15.81:0/3124863947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f971c0fff50 0x7f971c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 >> 172.21.15.81:0/3124863947 conn(0x7f971c074e30 msgr2=0x7f971c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 shutdown_connections 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:40.769+0000 7f9722724700 1 -- 172.21.15.81:0/3124863947 wait complete. 2024-09-18T13:04:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-18T13:04:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:41 smithi081 ceph-mon[92545]: pgmap v381: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:41.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:41 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3124863947' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 44, "format": "json"} : dispatch 2024-09-18T13:04:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:41 smithi136 ceph-mon[80179]: pgmap v381: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:41.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:41 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3124863947' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 44, "format": "json"} : dispatch 2024-09-18T13:04:41.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 45 2024-09-18T13:04:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:42.200 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:42 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:04:42.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:42 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:04:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:43 smithi081 ceph-mon[92545]: pgmap v382: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:43 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:04:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:43 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:04:43.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:43 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:04:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:43 smithi136 ceph-mon[80179]: pgmap v382: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:43 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:04:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:43 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:04:43.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:43 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 -- 172.21.15.81:0/550246114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 msgr2=0x7f0fb0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/550246114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb0100180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009910 tx=0x7f0fac009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 -- 172.21.15.81:0/550246114 shutdown_connections 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/550246114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/550246114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb0100180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 -- 172.21.15.81:0/550246114 >> 172.21.15.81:0/550246114 conn(0x7f0fb00fb650 msgr2=0x7f0fb00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 -- 172.21.15.81:0/550246114 shutdown_connections 2024-09-18T13:04:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 -- 172.21.15.81:0/550246114 wait complete. 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.617+0000 7f0fb86cd700 1 Processor -- start 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb86cd700 1 -- start start 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb86cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb86cd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb86cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb019f4f0 con 0x7f0fb00ffda0 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb86cd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb01989a0 con 0x7f0fb0100750 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51688/0 (socket says 172.21.15.81:51688) 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 -- 172.21.15.81:0/3601459947 learned_addr learned my addr 172.21.15.81:0/3601459947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb5c68700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 -- 172.21.15.81:0/3601459947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 msgr2=0x7f0fb019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 -- 172.21.15.81:0/3601459947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0095f0 con 0x7f0fb00ffda0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb5c68700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.618+0000 7f0fb6469700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0092e0 tx=0x7f0fac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.619+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac01d070 con 0x7f0fb00ffda0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.619+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb0198c20 con 0x7f0fb00ffda0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.619+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fac005e00 con 0x7f0fb00ffda0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.619+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac017400 con 0x7f0fb00ffda0 2024-09-18T13:04:43.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.619+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb0199110 con 0x7f0fb00ffda0 2024-09-18T13:04:43.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.620+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb004f2e0 con 0x7f0fb00ffda0 2024-09-18T13:04:43.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.621+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0fac00f460 con 0x7f0fb00ffda0 2024-09-18T13:04:43.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.621+0000 7f0fa77fe700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 0x7f0f9c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:43.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.622+0000 7f0fb5c68700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 0x7f0f9c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:43.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.622+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0fac09f8f0 con 0x7f0fb00ffda0 2024-09-18T13:04:43.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.622+0000 7f0fb5c68700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 0x7f0f9c07d7d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005d90 tx=0x7f0fa0005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.626+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f0fac062890 con 0x7f0fb00ffda0 2024-09-18T13:04:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.874+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 45, "format": "json"} v 0) v1 -- 0x7f0fb0199440 con 0x7f0fb00ffda0 2024-09-18T13:04:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.875+0000 7f0fa77fe700 1 -- 172.21.15.81:0/3601459947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 45, "format": "json"}]=0 dumped fsmap epoch 45 v46) v1 ==== 107+0+5270 (secure 0 0 0) 0x7f0fac0659b0 con 0x7f0fb00ffda0 2024-09-18T13:04:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T13:04:43.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":45,"btime":"2024-09-18T12:59:55:543704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi136.tfcykk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6825/1684210373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1684210373},{"type":"v1","addr":"172.21.15.136:6825","nonce":1684210373}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44325,"name":"cephfs.smithi136.lwvlbo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6827/1739515569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1739515569},{"type":"v1","addr":"172.21.15.136:6827","nonce":1739515569}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:48:39.794953+0000","modified":"2024-09-18T12:59:55.543691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi081.irimad","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6827/380455521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":380455521},{"type":"v1","addr":"172.21.15.81:6827","nonce":380455521}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"cephfs.smithi081.hmnvyn","rank":1,"incarnation":45,"state":"up:starting","state_seq":1,"addr":"172.21.15.81:6829/3322153794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3322153794},{"type":"v1","addr":"172.21.15.81:6829","nonce":3322153794}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-18T13:04:43.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 msgr2=0x7f0f9c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 0x7f0f9c07d7d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005d90 tx=0x7f0fa0005d00 comp rx=0 tx=0).stop 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 msgr2=0x7f0fb019e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0092e0 tx=0x7f0fac00be20 comp rx=0 tx=0).stop 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 shutdown_connections 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f0f9c07b310 0x7f0f9c07d7d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb00ffda0 0x7f0fb019e920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 --2- 172.21.15.81:0/3601459947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb0100750 0x7f0fb019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 >> 172.21.15.81:0/3601459947 conn(0x7f0fb00fb650 msgr2=0x7f0fb0103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 shutdown_connections 2024-09-18T13:04:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:43.877+0000 7f0fb86cd700 1 -- 172.21.15.81:0/3601459947 wait complete. 2024-09-18T13:04:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 45 2024-09-18T13:04:44.241 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:44 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3601459947' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 45, "format": "json"} : dispatch 2024-09-18T13:04:44.241 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:44 smithi081 ceph-mon[92545]: pgmap v383: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:44.519 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-18T13:04:44.530 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-18T13:04:44.530 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T13:04:44.530 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:04:44.549 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T13:04:44.549 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:04:44.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:44 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3601459947' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 45, "format": "json"} : dispatch 2024-09-18T13:04:44.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:44 smithi136 ceph-mon[80179]: pgmap v383: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:44.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:04:44.854 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 -- 172.21.15.81:0/4215396005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c102700 msgr2=0x7fd69c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/4215396005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c102700 0x7fd69c10abf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd684009910 tx=0x7fd684009c20 comp rx=0 tx=0).stop 2024-09-18T13:04:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 -- 172.21.15.81:0/4215396005 shutdown_connections 2024-09-18T13:04:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/4215396005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c102700 0x7fd69c10abf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/4215396005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c101de0 0x7fd69c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 -- 172.21.15.81:0/4215396005 >> 172.21.15.81:0/4215396005 conn(0x7fd69c0fb610 msgr2=0x7fd69c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 -- 172.21.15.81:0/4215396005 shutdown_connections 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.540+0000 7fd6a09e9700 1 -- 172.21.15.81:0/4215396005 wait complete. 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 Processor -- start 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 -- start start 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c102700 0x7fd69c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c19d190 con 0x7fd69c101de0 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd6a09e9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c196720 con 0x7fd69c102700 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd69a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd69a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33220/0 (socket says 172.21.15.81:33220) 2024-09-18T13:04:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.541+0000 7fd69a59c700 1 -- 172.21.15.81:0/962063535 learned_addr learned my addr 172.21.15.81:0/962063535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd699d9b700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c102700 0x7fd69c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd69a59c700 1 -- 172.21.15.81:0/962063535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c102700 msgr2=0x7fd69c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd69a59c700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c102700 0x7fd69c19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd69a59c700 1 -- 172.21.15.81:0/962063535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840095f0 con 0x7fd69c101de0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd69a59c700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd69400cfd0 tx=0x7fd69400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd69400ad70 con 0x7fd69c101de0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c196a00 con 0x7fd69c101de0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6940128e0 con 0x7fd69c101de0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd694011880 con 0x7fd69c101de0 2024-09-18T13:04:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.542+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c196f50 con 0x7fd69c101de0 2024-09-18T13:04:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.543+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c1082f0 con 0x7fd69c101de0 2024-09-18T13:04:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.544+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fd694012420 con 0x7fd69c101de0 2024-09-18T13:04:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.544+0000 7fd6937fe700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 0x7fd68807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.544+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fd69409e650 con 0x7fd69c101de0 2024-09-18T13:04:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.544+0000 7fd699d9b700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 0x7fd68807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.545+0000 7fd699d9b700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 0x7fd68807d7d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd69c197b40 tx=0x7fd68401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.549+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7fd694061670 con 0x7fd69c101de0 2024-09-18T13:04:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.778+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd69c197ce0 con 0x7fd69c101de0 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.779+0000 7fd6937fe700 1 -- 172.21.15.81:0/962063535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v95) v1 ==== 81+0+2164 (secure 0 0 0) 0x7fd69c197ce0 con 0x7fd69c101de0 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6827/3787656045 2024-09-19T12:59:37.583173+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6826/3787656045 2024-09-19T12:59:37.583173+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3422448549 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2051487579 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/98605341 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:46.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/353780439 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1687125345 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/2021963061 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3335789619 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1484526618 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/3205691427 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1872549892 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6829/434262887 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6827/3849514001 2024-09-19T12:58:41.840806+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1329491122 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/875936782 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6825/4063418833 2024-09-19T12:48:53.775295+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/372461948 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3488192554 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/4233780888 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3714357492 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6828/434262887 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/4055419550 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4202672354 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/714768806 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6826/3849514001 2024-09-19T12:58:41.840806+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6824/4063418833 2024-09-19T12:48:53.775295+0000 2024-09-18T13:04:46.783 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/2514806998 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3403991039 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/891805519 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2979835147 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/940042369 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/41128836 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2347927822 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.784 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1484526618 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 msgr2=0x7fd68807d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 0x7fd68807d7d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd69c197b40 tx=0x7fd68401a040 comp rx=0 tx=0).stop 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 msgr2=0x7fd69c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd69400cfd0 tx=0x7fd69400a340 comp rx=0 tx=0).stop 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 shutdown_connections 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7fd68807b310 0x7fd68807d7d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c101de0 0x7fd69c19c650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 --2- 172.21.15.81:0/962063535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd69c102700 0x7fd69c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 >> 172.21.15.81:0/962063535 conn(0x7fd69c0fb610 msgr2=0x7fd69c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 shutdown_connections 2024-09-18T13:04:46.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:46.781+0000 7fd6a09e9700 1 -- 172.21.15.81:0/962063535 wait complete. 2024-09-18T13:04:46.786 INFO:teuthology.orchestra.run.smithi081.stderr:listed 37 entries 2024-09-18T13:04:47.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:47 smithi081 ceph-mon[92545]: pgmap v384: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:47.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:47 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/962063535' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:04:47.500 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-18T13:04:47.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:47.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-18T13:04:47.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T13:04:47.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:47.530 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-18T13:04:47.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:47 smithi136 ceph-mon[80179]: pgmap v384: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:47.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:47 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/962063535' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:04:47.598 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T13:04:47.598 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:04:47.619 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-18T13:04:47.619 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:04:47.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 2a553466-75bb-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:04:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/mon.smithi081/config 2024-09-18T13:04:48.247 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:48 smithi081 ceph-mon[92545]: pgmap v385: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:48.564 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:48 smithi136 ceph-mon[80179]: pgmap v385: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail 2024-09-18T13:04:49.292 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:49 smithi081 ceph-mon[92545]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 -- 172.21.15.81:0/824543274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 msgr2=0x7f05c8102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 --2- 172.21.15.81:0/824543274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c8102240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b0a0 tx=0x7f05b800b3b0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 -- 172.21.15.81:0/824543274 shutdown_connections 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 --2- 172.21.15.81:0/824543274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c810ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 --2- 172.21.15.81:0/824543274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c8102240 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 -- 172.21.15.81:0/824543274 >> 172.21.15.81:0/824543274 conn(0x7f05c80fb650 msgr2=0x7f05c80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 -- 172.21.15.81:0/824543274 shutdown_connections 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.542+0000 7f05cd269700 1 -- 172.21.15.81:0/824543274 wait complete. 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 Processor -- start 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 -- start start 2024-09-18T13:04:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c819f360 con 0x7f05c8101e60 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05cd269700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81988f0 con 0x7f05c8102780 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33230/0 (socket says 172.21.15.81:33230) 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.543+0000 7f05c6ffd700 1 -- 172.21.15.81:0/3561525060 learned_addr learned my addr 172.21.15.81:0/3561525060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c6ffd700 1 -- 172.21.15.81:0/3561525060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 msgr2=0x7f05c819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c6ffd700 1 -- 172.21.15.81:0/3561525060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009d00 con 0x7f05c8101e60 2024-09-18T13:04:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000f80 tx=0x7f05b800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b800e040 con 0x7f05c8101e60 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05b8003e60 con 0x7f05c8101e60 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c8198b70 con 0x7f05c8101e60 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b801d910 con 0x7f05c8101e60 2024-09-18T13:04:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.544+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8199060 con 0x7f05c8101e60 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.545+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c810a710 con 0x7f05c8101e60 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.546+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f05b8004820 con 0x7f05c8101e60 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.546+0000 7f05bffff700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 0x7f05b407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.547+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f05b809fce0 con 0x7f05c8101e60 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.547+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 0x7f05b407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:49.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.547+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 0x7f05b407d7d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b0005fd0 tx=0x7f05b0005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.552+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197088 (secure 0 0 0) 0x7f05b8062c80 con 0x7f05c8101e60 2024-09-18T13:04:49.563 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:49 smithi136 ceph-mon[80179]: from='mgr.34104 172.21.15.81:0/1791821525' entity='mgr.smithi081.pfnvgp' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.776+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05c804f2e0 con 0x7f05c8101e60 2024-09-18T13:04:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.776+0000 7f05bffff700 1 -- 172.21.15.81:0/3561525060 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v95) v1 ==== 81+0+2164 (secure 0 0 0) 0x7f05b8065da0 con 0x7f05c8101e60 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6827/3787656045 2024-09-19T12:59:37.583173+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6826/3787656045 2024-09-19T12:59:37.583173+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3422448549 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2051487579 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/98605341 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/353780439 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1687125345 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/2021963061 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3335789619 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1484526618 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/3205691427 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1872549892 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6829/434262887 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6827/3849514001 2024-09-19T12:58:41.840806+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1329491122 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/875936782 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6825/4063418833 2024-09-19T12:48:53.775295+0000 2024-09-18T13:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/372461948 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3488192554 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/4233780888 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3714357492 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6828/434262887 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/4055419550 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4202672354 2024-09-19T12:41:56.434322+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/714768806 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6826/3849514001 2024-09-19T12:58:41.840806+0000 2024-09-18T13:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:6824/4063418833 2024-09-19T12:48:53.775295+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.136:0/2514806998 2024-09-19T12:52:43.407589+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3403991039 2024-09-19T12:41:23.234470+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/891805519 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2979835147 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/940042369 2024-09-19T12:51:26.974531+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/41128836 2024-09-19T12:43:04.422270+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2347927822 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1484526618 2024-09-19T12:53:33.851742+0000 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 msgr2=0x7f05b407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 0x7f05b407d7d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b0005fd0 tx=0x7f05b0005e20 comp rx=0 tx=0).stop 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 msgr2=0x7f05c819e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000f80 tx=0x7f05b800cdd0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 shutdown_connections 2024-09-18T13:04:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:6800/3835064710,v1:172.21.15.81:6801/3835064710] conn(0x7f05b407b310 0x7f05b407d7d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.778+0000 7f05cd269700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c8101e60 0x7f05c819e820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.779+0000 7f05cd269700 1 --2- 172.21.15.81:0/3561525060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c8102780 0x7f05c819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.779+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 >> 172.21.15.81:0/3561525060 conn(0x7f05c80fb650 msgr2=0x7f05c8107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.779+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 shutdown_connections 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T13:04:49.779+0000 7f05cd269700 1 -- 172.21.15.81:0/3561525060 wait complete. 2024-09-18T13:04:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:listed 37 entries 2024-09-18T13:04:50.413 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:50 smithi081 ceph-mon[92545]: from='client.? 172.21.15.81:0/3561525060' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:04:50.413 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:50 smithi081 ceph-mon[92545]: pgmap v386: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T13:04:50.435 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-18T13:04:50.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-18T13:04:50.466 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:50 smithi136 ceph-mon[80179]: from='client.? 172.21.15.81:0/3561525060' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:04:50.466 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:50 smithi136 ceph-mon[80179]: pgmap v386: 65 pgs: 65 active+clean; 171 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T13:04:50.470 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-09-18T13:04:50.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.470 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-18T13:04:50.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.715 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-18T13:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-18T13:04:50.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T13:04:50.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-18T13:04:50.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.896 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-09-18T13:04:50.913 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-18T13:04:50.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.913 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T13:04:50.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:04:50.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-09-18T13:04:51.075 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-18T13:04:51.088 INFO:tasks.cephadm:Teardown begin 2024-09-18T13:04:51.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:04:51.116 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:04:51.143 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-18T13:04:51.143 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:04:51.172 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:04:51.199 INFO:tasks.cephadm:Stopping all daemons... 2024-09-18T13:04:51.199 INFO:tasks.cephadm.mon.smithi081:Stopping mon.smithi081... 2024-09-18T13:04:51.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081 2024-09-18T13:04:51.535 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:04:51.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[92541]: 2024-09-18T13:04:51.533+0000 7fd3aaaff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:04:51.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081[92541]: 2024-09-18T13:04:51.533+0000 7fd3aaaff640 -1 mon.smithi081@0(leader) e3 *** Got Signal Terminated *** 2024-09-18T13:04:51.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 podman[152739]: 2024-09-18 13:04:51.554677619 +0000 UTC m=+0.149274596 container died e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T13:04:52.228 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 podman[152739]: 2024-09-18 13:04:51.951213748 +0000 UTC m=+0.545810767 container cleanup e507e4a0d8f870b95908309e545efe3310ba56388125428d9c7a4953474805b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T13:04:52.228 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Sep 18 13:04:51 smithi081 bash[152739]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi081 2024-09-18T13:04:52.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi081.service' 2024-09-18T13:04:52.561 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:04:52.561 INFO:tasks.cephadm.mon.smithi081:Stopped mon.smithi081 2024-09-18T13:04:52.562 INFO:tasks.cephadm.mon.smithi136:Stopping mon.smithi136... 2024-09-18T13:04:52.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi136 2024-09-18T13:04:52.874 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:52 smithi136 systemd[1]: Stopping Ceph mon.smithi136 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:04:53.137 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:52 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136[80175]: 2024-09-18T13:04:52.872+0000 7fc52fbc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi136 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:04:53.137 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:52 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136[80175]: 2024-09-18T13:04:52.872+0000 7fc52fbc7640 -1 mon.smithi136@1(peon) e3 *** Got Signal Terminated *** 2024-09-18T13:04:53.433 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:53 smithi136 podman[118392]: 2024-09-18 13:04:53.136787246 +0000 UTC m=+0.379206598 container died 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T13:04:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:53 smithi136 podman[118392]: 2024-09-18 13:04:53.764590834 +0000 UTC m=+1.007010171 container cleanup 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:04:54.064 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:53 smithi136 bash[118392]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136 2024-09-18T13:04:54.065 INFO:journalctl@ceph.mon.smithi136.smithi136.stdout:Sep 18 13:04:54 smithi136 podman[118405]: 2024-09-18 13:04:54.007909694 +0000 UTC m=+0.863989708 container remove 2dbae20169885e85e7db67285a6fdcd16990cd88bad6a26964969309976321d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-mon-smithi136, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-18T13:04:54.244 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@mon.smithi136.service' 2024-09-18T13:04:54.296 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:04:54.297 INFO:tasks.cephadm.mon.smithi136:Stopped mon.smithi136 2024-09-18T13:04:54.297 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-18T13:04:54.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.0 2024-09-18T13:04:54.590 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:04:54 smithi081 systemd[1]: Stopping Ceph osd.0 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:04:54.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:04:54 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T13:04:54.588+0000 7f4af4982640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:04:54.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:04:54 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T13:04:54.588+0000 7f4af4982640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-18T13:04:54.857 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:04:54 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0[100373]: 2024-09-18T13:04:54.588+0000 7f4af4982640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:00.186 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:04:59 smithi081 podman[152873]: 2024-09-18 13:04:59.921305996 +0000 UTC m=+5.430557535 container died abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T13:05:00.607 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:00 smithi081 podman[152873]: 2024-09-18 13:05:00.406496713 +0000 UTC m=+5.915748250 container cleanup abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-18T13:05:00.607 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:00 smithi081 bash[152873]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0 2024-09-18T13:05:00.936 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:00 smithi081 podman[152888]: 2024-09-18 13:05:00.624862422 +0000 UTC m=+0.703320914 container remove abc5ecb73052b7166fe98266f198dd1f78c4f302cb3a0b7c85c09eb1d700b6b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux ) 2024-09-18T13:05:01.189 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:00.967788224 +0000 UTC m=+0.016590040 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:01.189 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:01.092718846 +0000 UTC m=+0.141520646 container create 8d80c009d13faecae64e5e3d72b40f201c91a16e4c8c5672edcd2238e99d86e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-18T13:05:01.506 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:01.320519416 +0000 UTC m=+0.369321230 container init 8d80c009d13faecae64e5e3d72b40f201c91a16e4c8c5672edcd2238e99d86e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-18T13:05:01.506 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:01.323917856 +0000 UTC m=+0.372719662 container start 8d80c009d13faecae64e5e3d72b40f201c91a16e4c8c5672edcd2238e99d86e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:05:01.506 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:01.412064089 +0000 UTC m=+0.460865915 container attach 8d80c009d13faecae64e5e3d72b40f201c91a16e4c8c5672edcd2238e99d86e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-18T13:05:01.841 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 18 13:05:01 smithi081 podman[152985]: 2024-09-18 13:05:01.506512765 +0000 UTC m=+0.555314567 container died 8d80c009d13faecae64e5e3d72b40f201c91a16e4c8c5672edcd2238e99d86e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-18T13:05:02.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.0.service' 2024-09-18T13:05:02.222 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:02.223 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-18T13:05:02.223 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-18T13:05:02.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.1 2024-09-18T13:05:02.570 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:02 smithi081 systemd[1]: Stopping Ceph osd.1 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:05:02.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T13:05:02.569+0000 7f2a5e73f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:05:02.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T13:05:02.569+0000 7f2a5e73f640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-18T13:05:02.857 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:02 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1[105974]: 2024-09-18T13:05:02.569+0000 7f2a5e73f640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:08.163 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:07 smithi081 podman[153089]: 2024-09-18 13:05:07.899312776 +0000 UTC m=+5.444414470 container died 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T13:05:08.529 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:08 smithi081 podman[153089]: 2024-09-18 13:05:08.269645618 +0000 UTC m=+5.814747301 container cleanup 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-18T13:05:08.529 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:08 smithi081 bash[153089]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1 2024-09-18T13:05:08.856 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:08 smithi081 podman[153104]: 2024-09-18 13:05:08.529108234 +0000 UTC m=+0.626942670 container remove 713392197e86eda814d314b81a243dfa0731c36389a16449a63a7ea235299566 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T13:05:09.183 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:08 smithi081 podman[153193]: 2024-09-18 13:05:08.762280855 +0000 UTC m=+0.016082984 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:09.183 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:08 smithi081 podman[153193]: 2024-09-18 13:05:08.880049002 +0000 UTC m=+0.133851124 container create 75f97c11689ece92f24b9c9c60bc4dd6bdd3dd2ddce33f6487d554dae209cb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-18T13:05:09.183 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:09 smithi081 podman[153193]: 2024-09-18 13:05:09.099469473 +0000 UTC m=+0.353271592 container init 75f97c11689ece92f24b9c9c60bc4dd6bdd3dd2ddce33f6487d554dae209cb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T13:05:09.183 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:09 smithi081 podman[153193]: 2024-09-18 13:05:09.102979678 +0000 UTC m=+0.356781801 container start 75f97c11689ece92f24b9c9c60bc4dd6bdd3dd2ddce33f6487d554dae209cb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2) 2024-09-18T13:05:09.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:09 smithi081 podman[153193]: 2024-09-18 13:05:09.182514192 +0000 UTC m=+0.436316327 container attach 75f97c11689ece92f24b9c9c60bc4dd6bdd3dd2ddce33f6487d554dae209cb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T13:05:09.607 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 18 13:05:09 smithi081 podman[153193]: 2024-09-18 13:05:09.288616071 +0000 UTC m=+0.542418189 container died 75f97c11689ece92f24b9c9c60bc4dd6bdd3dd2ddce33f6487d554dae209cb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-18T13:05:10.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.1.service' 2024-09-18T13:05:10.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:10.042 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-18T13:05:10.042 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-18T13:05:10.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.2 2024-09-18T13:05:10.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:10 smithi081 systemd[1]: Stopping Ceph osd.2 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:05:10.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:10 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T13:05:10.393+0000 7f9387e5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:05:10.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:10 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T13:05:10.393+0000 7f9387e5c640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-18T13:05:10.650 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:10 smithi081 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2[111427]: 2024-09-18T13:05:10.393+0000 7f9387e5c640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:15.991 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:15 smithi081 podman[153295]: 2024-09-18 13:05:15.736750815 +0000 UTC m=+5.474151504 container died 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-18T13:05:16.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:16 smithi081 podman[153295]: 2024-09-18 13:05:16.164279637 +0000 UTC m=+5.901680317 container cleanup 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-18T13:05:16.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:16 smithi081 bash[153295]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2 2024-09-18T13:05:16.799 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:16 smithi081 podman[153314]: 2024-09-18 13:05:16.374183694 +0000 UTC m=+0.640040078 container remove 9f36a95559cd304a7f971fd16f31d1a8fc8c1f108e900bdccce47f8c38084f68 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-18T13:05:17.087 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:16 smithi081 podman[153402]: 2024-09-18 13:05:16.701725639 +0000 UTC m=+0.016125028 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:17.087 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:16 smithi081 podman[153402]: 2024-09-18 13:05:16.833674556 +0000 UTC m=+0.148073934 container create e28d6beae17bffa8ae80b5f45eb6517256df65db55bd5840021d32a170784a71 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:05:17.087 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:17 smithi081 podman[153402]: 2024-09-18 13:05:17.08627889 +0000 UTC m=+0.400678276 container init e28d6beae17bffa8ae80b5f45eb6517256df65db55bd5840021d32a170784a71 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True) 2024-09-18T13:05:17.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:17 smithi081 podman[153402]: 2024-09-18 13:05:17.090320207 +0000 UTC m=+0.404719586 container start e28d6beae17bffa8ae80b5f45eb6517256df65db55bd5840021d32a170784a71 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:05:17.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:17 smithi081 podman[153402]: 2024-09-18 13:05:17.186210857 +0000 UTC m=+0.500610244 container attach e28d6beae17bffa8ae80b5f45eb6517256df65db55bd5840021d32a170784a71 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-18T13:05:17.357 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 18 13:05:17 smithi081 podman[153402]: 2024-09-18 13:05:17.28380926 +0000 UTC m=+0.598208639 container died e28d6beae17bffa8ae80b5f45eb6517256df65db55bd5840021d32a170784a71 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T13:05:18.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.2.service' 2024-09-18T13:05:18.098 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:18.099 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-18T13:05:18.099 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-18T13:05:18.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.3 2024-09-18T13:05:18.417 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:18 smithi136 systemd[1]: Stopping Ceph osd.3 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:05:18.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:18 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T13:05:18.416+0000 7f2d7ea89640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:05:18.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:18 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T13:05:18.416+0000 7f2d7ea89640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-18T13:05:18.814 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:18 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3[89192]: 2024-09-18T13:05:18.416+0000 7f2d7ea89640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:23.004 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:22 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:22.602+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:23.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:23 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:23.002+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:23.903 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:23 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:23.585+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:24.235 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:23 smithi136 podman[118528]: 2024-09-18 13:05:23.902619536 +0000 UTC m=+5.592946900 container died 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-18T13:05:24.235 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:24 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:24.029+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:24.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:24 smithi136 podman[118528]: 2024-09-18 13:05:24.424652467 +0000 UTC m=+6.114979820 container cleanup 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:05:24.564 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:24 smithi136 bash[118528]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3 2024-09-18T13:05:25.029 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:24 smithi136 podman[118546]: 2024-09-18 13:05:24.634356542 +0000 UTC m=+0.730925594 container remove 07ef5686c7b9eccfab45ed8851c7b3dd16a66f77a2c0ee0fb018e0dc9543e460 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T13:05:25.029 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:24 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:24.629+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:25.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:25 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:25.028+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:25.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:24.941386379 +0000 UTC m=+0.015802473 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:25.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:25.043471835 +0000 UTC m=+0.117887978 container create 69cc8da0b24f2fdece0a4b7f46a3df52ed7670e4b2fbc1e7f2ca50671c877dee (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-18T13:05:25.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:25.237546339 +0000 UTC m=+0.311962432 container init 69cc8da0b24f2fdece0a4b7f46a3df52ed7670e4b2fbc1e7f2ca50671c877dee (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T13:05:25.314 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:25.240878994 +0000 UTC m=+0.315295091 container start 69cc8da0b24f2fdece0a4b7f46a3df52ed7670e4b2fbc1e7f2ca50671c877dee (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T13:05:25.650 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:25.325098424 +0000 UTC m=+0.399514523 container attach 69cc8da0b24f2fdece0a4b7f46a3df52ed7670e4b2fbc1e7f2ca50671c877dee (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0) 2024-09-18T13:05:25.650 INFO:journalctl@ceph.osd.3.smithi136.stdout:Sep 18 13:05:25 smithi136 podman[118633]: 2024-09-18 13:05:25.432271858 +0000 UTC m=+0.506687955 container died 69cc8da0b24f2fdece0a4b7f46a3df52ed7670e4b2fbc1e7f2ca50671c877dee (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-18T13:05:26.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:25 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:25.649+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:26.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.3.service' 2024-09-18T13:05:26.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:26.141 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-18T13:05:26.141 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-18T13:05:26.142 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.4 2024-09-18T13:05:26.314 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:26 smithi136 systemd[1]: Stopping Ceph osd.4 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:05:26.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:26.042+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:26.689 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:26.494+0000 7f522ba85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:05:26.689 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:26.494+0000 7f522ba85640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-18T13:05:26.689 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:26.494+0000 7f522ba85640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:27.063 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:26 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:26.688+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:27.316 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:27 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:27.064+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:28.033 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:27 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:27.692+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:28.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:28 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:28.032+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:29.022 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:28 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:28.709+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:29.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:29 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:29.021+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:30.016 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:29 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:29.700+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:30.016 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:29 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:29.700+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:05.600244+0000 front 2024-09-18T13:05:05.600258+0000 (oldest deadline 2024-09-18T13:05:29.699990+0000) 2024-09-18T13:05:30.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:30 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:30.014+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:30.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:30 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:30.014+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:31.038 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:30 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:30.715+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:58.599282+0000 front 2024-09-18T13:04:58.599326+0000 (oldest deadline 2024-09-18T13:05:22.099266+0000) 2024-09-18T13:05:31.038 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:30 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4[93876]: 2024-09-18T13:05:30.715+0000 7f522809a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:05.600244+0000 front 2024-09-18T13:05:05.600258+0000 (oldest deadline 2024-09-18T13:05:29.699990+0000) 2024-09-18T13:05:31.297 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:31 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:31.037+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:31.297 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:31 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:31.037+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:32.187 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:31 smithi136 podman[118738]: 2024-09-18 13:05:31.907931251 +0000 UTC m=+5.537435585 container died be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-18T13:05:32.188 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:32 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:32.056+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:32.188 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:32 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:32.056+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:32.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:32 smithi136 podman[118738]: 2024-09-18 13:05:32.385958433 +0000 UTC m=+6.015462808 container cleanup be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T13:05:32.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:32 smithi136 bash[118738]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4 2024-09-18T13:05:32.959 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:32 smithi136 podman[118764]: 2024-09-18 13:05:32.628921244 +0000 UTC m=+0.715806101 container remove be46e31b7ed1a78d325af4314b55064b0eb669a1e7d2d091ab43360accfa3d3b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:05:33.274 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:33 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:33.089+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:33.278 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:33 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:33.089+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:33.278 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:32 smithi136 podman[118856]: 2024-09-18 13:05:32.861822427 +0000 UTC m=+0.015827060 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:33.278 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:32 smithi136 podman[118856]: 2024-09-18 13:05:32.971265271 +0000 UTC m=+0.125269887 container create 0e651b5d7af1d363d17e622f0d78aadc3c10b5bbdbae771e0cff06091854e223 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-18T13:05:33.278 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:33 smithi136 podman[118856]: 2024-09-18 13:05:33.190824867 +0000 UTC m=+0.344829492 container init 0e651b5d7af1d363d17e622f0d78aadc3c10b5bbdbae771e0cff06091854e223 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-18T13:05:33.278 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:33 smithi136 podman[118856]: 2024-09-18 13:05:33.19421198 +0000 UTC m=+0.348216596 container start 0e651b5d7af1d363d17e622f0d78aadc3c10b5bbdbae771e0cff06091854e223 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T13:05:33.279 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:33 smithi136 podman[118856]: 2024-09-18 13:05:33.273907326 +0000 UTC m=+0.427911965 container attach 0e651b5d7af1d363d17e622f0d78aadc3c10b5bbdbae771e0cff06091854e223 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-18T13:05:33.564 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 18 13:05:33 smithi136 podman[118856]: 2024-09-18 13:05:33.380540933 +0000 UTC m=+0.534545554 container died 0e651b5d7af1d363d17e622f0d78aadc3c10b5bbdbae771e0cff06091854e223 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T13:05:33.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.4.service' 2024-09-18T13:05:33.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:33.912 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-18T13:05:33.912 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-18T13:05:33.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.5 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:33 smithi136 systemd[1]: Stopping Ceph osd.5 for 2a553466-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:34 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:34.091+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:34 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:34.091+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:34 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:34.229+0000 7f693d88b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:34 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:34.229+0000 7f693d88b640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-18T13:05:34.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:34 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:34.229+0000 7f693d88b640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:05:35.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:35 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:35.135+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:35.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:35 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:35.135+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:36.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:36 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:36.127+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:36.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:36 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:36.127+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:37.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:37 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:37.158+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:37.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:37 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:37.158+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:37.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:37 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:37.158+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-09-18T13:05:12.122896+0000 front 2024-09-18T13:05:12.122877+0000 (oldest deadline 2024-09-18T13:05:36.222755+0000) 2024-09-18T13:05:38.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:38 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:38.167+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:38.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:38 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:38.167+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:38.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:38 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:38.167+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-09-18T13:05:12.122896+0000 front 2024-09-18T13:05:12.122877+0000 (oldest deadline 2024-09-18T13:05:36.222755+0000) 2024-09-18T13:05:39.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:39.174+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-18T13:04:56.520911+0000 front 2024-09-18T13:04:56.520778+0000 (oldest deadline 2024-09-18T13:05:22.420697+0000) 2024-09-18T13:05:39.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:39.174+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-09-18T13:05:06.322301+0000 front 2024-09-18T13:05:06.322215+0000 (oldest deadline 2024-09-18T13:05:29.822028+0000) 2024-09-18T13:05:39.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:39 smithi136 ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5[98984]: 2024-09-18T13:05:39.174+0000 7f6939ea0640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-09-18T13:05:12.122896+0000 front 2024-09-18T13:05:12.122877+0000 (oldest deadline 2024-09-18T13:05:36.222755+0000) 2024-09-18T13:05:40.014 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:39 smithi136 podman[118961]: 2024-09-18 13:05:39.724169525 +0000 UTC m=+5.593867505 container died 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-18T13:05:40.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[118961]: 2024-09-18 13:05:40.112692766 +0000 UTC m=+5.982390737 container cleanup 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-18T13:05:40.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 bash[118961]: ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5 2024-09-18T13:05:40.679 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[118978]: 2024-09-18 13:05:40.355923294 +0000 UTC m=+0.621775324 container remove 15714fb1bccc48b2a1e8c294e2cd4e55e82866c944ded9104f21d3c4cd8bbb38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-18T13:05:40.967 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[119063]: 2024-09-18 13:05:40.581786276 +0000 UTC m=+0.016094195 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:05:40.967 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[119063]: 2024-09-18 13:05:40.681631735 +0000 UTC m=+0.115939686 container create 00f34cf4baba0b5c403c842031334ef58368bcb44a0a98be9d8c524d7157feda (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:05:40.967 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[119063]: 2024-09-18 13:05:40.884139636 +0000 UTC m=+0.318447543 container init 00f34cf4baba0b5c403c842031334ef58368bcb44a0a98be9d8c524d7157feda (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-18T13:05:40.968 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[119063]: 2024-09-18 13:05:40.88748045 +0000 UTC m=+0.321788358 container start 00f34cf4baba0b5c403c842031334ef58368bcb44a0a98be9d8c524d7157feda (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:05:40.968 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:40 smithi136 podman[119063]: 2024-09-18 13:05:40.96721786 +0000 UTC m=+0.401525769 container attach 00f34cf4baba0b5c403c842031334ef58368bcb44a0a98be9d8c524d7157feda (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:05:41.314 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 18 13:05:41 smithi136 podman[119063]: 2024-09-18 13:05:41.079252507 +0000 UTC m=+0.513560426 container died 00f34cf4baba0b5c403c842031334ef58368bcb44a0a98be9d8c524d7157feda (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-2a553466-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:05:41.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2a553466-75bb-11ef-bceb-c7b262605968@osd.5.service' 2024-09-18T13:05:41.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:05:41.711 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-18T13:05:41.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2a553466-75bb-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:05:41.866 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T13:06:06.162 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2a553466-75bb-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:06:06.318 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T13:06:21.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:06:21.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:06:21.349 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-18T13:06:21.351 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi081/crash 2024-09-18T13:06:21.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:06:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:06:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:06:21.389 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi136/crash 2024-09-18T13:06:21.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:06:21.413 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/2a553466-75bb-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:06:21.413 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:06:21.414 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-18T13:06:21.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-18T13:06:21.473 INFO:tasks.cephadm:Compressing logs... 2024-09-18T13:06:21.474 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:06:21.516 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:06:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi081.pfnvgp.log 2024-09-18T13:06:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:06:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi081.pfnvgp.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.hmnvyn.log 2024-09-18T13:06:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-18T13:06:21.543 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:06:21.543 INFO:teuthology.orchestra.run.smithi136.stderr:: No such file or directory 2024-09-18T13:06:21.543 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-18T13:06:21.544 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:06:21.544 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi136.vdkrdt.log 2024-09-18T13:06:21.544 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi136.log 2024-09-18T13:06:21.544 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.lwvlbo.log 2024-09-18T13:06:21.546 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi136.vdkrdt.log: /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi136.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:06:21.546 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.lwvlbo.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-18T13:06:21.546 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:06:21.546 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log: 85.8% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:06:21.546 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi136.log.gz 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.hmnvyn.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.irimad.log 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log: 91.4% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi081.log 2024-09-18T13:06:21.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.irimad.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi081.log 2024-09-18T13:06:21.550 INFO:teuthology.orchestra.run.smithi136.stderr: 91.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:06:21.550 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi136.log 2024-09-18T13:06:21.550 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-18T13:06:21.550 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi136.log: gzip -5 --verbose -- /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.tfcykk.log 2024-09-18T13:06:21.551 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log: 88.1% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:06:21.552 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:06:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi081.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:06:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi081.log: 91.1% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:06:21.559 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.tfcykk.log: 91.0% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:06:21.562 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:06:21.564 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi081.log.gz 2024-09-18T13:06:21.565 INFO:teuthology.orchestra.run.smithi136.stderr: 92.1% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.tfcykk.log.gz 2024-09-18T13:06:21.585 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi136.vdkrdt.log.gz 2024-09-18T13:06:21.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: 89.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:06:21.823 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi081.pfnvgp.log.gz 2024-09-18T13:06:21.982 INFO:teuthology.orchestra.run.smithi136.stderr: 92.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi136.log.gz 2024-09-18T13:06:22.733 INFO:teuthology.orchestra.run.smithi081.stderr: 90.6% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi081.log.gz 2024-09-18T13:06:25.718 INFO:teuthology.orchestra.run.smithi136.stderr: 93.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-18T13:06:25.904 INFO:teuthology.orchestra.run.smithi136.stderr: 95.2% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi136.lwvlbo.log.gz 2024-09-18T13:06:26.275 INFO:teuthology.orchestra.run.smithi081.stderr: 93.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-18T13:06:26.952 INFO:teuthology.orchestra.run.smithi081.stderr: 93.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-18T13:06:27.433 INFO:teuthology.orchestra.run.smithi136.stderr: 93.3% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-18T13:06:27.452 INFO:teuthology.orchestra.run.smithi136.stderr: 93.5% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-18T13:06:27.454 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-09-18T13:06:27.454 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m5.922s 2024-09-18T13:06:27.454 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m20.029s 2024-09-18T13:06:27.454 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.801s 2024-09-18T13:06:29.483 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-18T13:07:06.811 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.hmnvyn.log.gz 2024-09-18T13:07:13.253 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/2a553466-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi081.irimad.log.gz 2024-09-18T13:07:13.255 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-18T13:07:13.256 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m51.727s 2024-09-18T13:07:13.256 INFO:teuthology.orchestra.run.smithi081.stderr:user 1m52.635s 2024-09-18T13:07:13.256 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m3.736s 2024-09-18T13:07:13.256 INFO:tasks.cephadm:Archiving logs... 2024-09-18T13:07:13.256 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi081/log 2024-09-18T13:07:13.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:07:29.826 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi136/log 2024-09-18T13:07:29.827 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:07:32.697 INFO:tasks.cephadm:Removing cluster... 2024-09-18T13:07:32.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2a553466-75bb-11ef-bceb-c7b262605968 --force 2024-09-18T13:07:32.851 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T13:07:33.245 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2a553466-75bb-11ef-bceb-c7b262605968 --force 2024-09-18T13:07:33.388 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 2a553466-75bb-11ef-bceb-c7b262605968 2024-09-18T13:07:33.738 INFO:tasks.cephadm:Removing cephadm ... 2024-09-18T13:07:33.738 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:07:33.755 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:07:33.771 INFO:tasks.cephadm:Teardown complete 2024-09-18T13:07:33.771 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T13:07:33.782 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T13:07:33.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:07:33.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:07:33.877 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T13:07:33.924 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T13:07:33.924 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:07:33.927 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:07:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:07:33.941 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 7 377 1 +527us[ +536us] +/- 59ms 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 66 -2031us[-2022us] +/- 76ms 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +1736us[+1736us] +/- 67ms 2024-09-18T13:07:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +348us[ +385us] +/- 58ms 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -2189us[-2189us] +/- 77ms 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +1648us[+1648us] +/- 66ms 2024-09-18T13:07:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:07:33.946 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T13:07:33.957 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T13:07:33.957 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T13:07:33.967 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:07:34.067 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:07:34.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:07:34.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:07:34.170 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:07:34.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:07:34.199 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T13:07:34.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T13:07:34.220 INFO:teuthology.task.internal:Duration was 1987.170554 seconds 2024-09-18T13:07:34.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T13:07:34.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T13:07:34.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:07:34.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:07:34.271 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:07:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:07:34.652 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T13:07:34.653 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T13:07:34.653 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:07:34.714 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-09-18T13:07:34.714 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:07:34.739 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T13:07:34.739 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:07:34.757 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:07:34.807 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T13:07:34.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:07:34.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:07:35.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T13:07:35.535 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T13:07:35.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:07:35.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:07:35.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T13:07:35.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:07:35.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:07:35.634 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-18T13:07:35.652 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-09-18T13:07:35.666 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:07:35.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:07:35.701 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:07:35.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:07:35.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T13:07:35.737 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T13:07:35.738 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi081 2024-09-18T13:07:35.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:07:35.793 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911384/remote/smithi136 2024-09-18T13:07:35.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:07:35.833 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T13:07:35.833 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:07:35.836 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:07:35.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T13:07:35.895 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T13:07:35.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T13:07:35.906 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T13:07:35.906 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:07:35.909 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:07:35.921 INFO:teuthology.orchestra.run.smithi081.stdout: 265851 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 13:07 /home/ubuntu/cephtest 2024-09-18T13:07:35.936 INFO:teuthology.orchestra.run.smithi136.stdout: 265980 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 13:07 /home/ubuntu/cephtest 2024-09-18T13:07:35.937 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T13:07:35.949 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T13:07:35.978 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1987.1705536842346 flavor: default owner: scheduled_gabrioux@teuthology success: true 2024-09-18T13:07:35.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T13:07:36.064 INFO:teuthology.run:pass